2012-09-29 10:15:39 -04:00
|
|
|
Hadoop YARN Change Log
|
2012-08-08 01:22:27 -04:00
|
|
|
|
2012-09-07 18:09:48 -04:00
|
|
|
Trunk - Unreleased
|
2012-08-08 01:22:27 -04:00
|
|
|
|
|
|
|
INCOMPATIBLE CHANGES
|
|
|
|
|
|
|
|
NEW FEATURES
|
|
|
|
|
2013-03-06 17:37:42 -05:00
|
|
|
HADOOP-8562. Enhancements to support Hadoop on Windows Server and Windows
|
|
|
|
Azure environments. (See breakdown of tasks below for subtasks and
|
|
|
|
contributors)
|
|
|
|
|
2012-08-08 01:22:27 -04:00
|
|
|
IMPROVEMENTS
|
|
|
|
|
2012-09-04 18:24:04 -04:00
|
|
|
YARN-84. Use Builder to build RPC server. (Brandon Li via suresh)
|
|
|
|
|
2012-09-04 16:56:53 -04:00
|
|
|
OPTIMAZATIONS
|
|
|
|
|
2012-08-08 01:22:27 -04:00
|
|
|
BUG FIXES
|
|
|
|
|
2013-03-21 16:38:43 -04:00
|
|
|
YARN-488. TestContainerManagerSecurity fails on Windows. (Chris Nauroth
|
|
|
|
via hitesh)
|
|
|
|
|
2013-03-21 16:48:18 -04:00
|
|
|
YARN-490. TestDistributedShell fails on Windows. (Chris Nauroth via hitesh)
|
|
|
|
|
2013-03-21 17:04:59 -04:00
|
|
|
YARN-491. TestContainerLogsPage fails on Windows. (Chris Nauroth via hitesh)
|
|
|
|
|
2013-03-06 17:37:42 -05:00
|
|
|
BREAKDOWN OF HADOOP-8562 SUBTASKS
|
|
|
|
|
|
|
|
YARN-158. Yarn creating package-info.java must not depend on sh.
|
|
|
|
(Chris Nauroth via suresh)
|
|
|
|
|
|
|
|
YARN-176. Some YARN tests fail to find winutils. (Chris Nauroth via suresh)
|
|
|
|
|
|
|
|
YARN-207. YARN distribution build fails on Windows. (Chris Nauroth via
|
|
|
|
suresh)
|
|
|
|
|
|
|
|
YARN-199. Yarn cmd line scripts for windows. (Ivan Mitic via suresh)
|
|
|
|
|
|
|
|
YARN-213. YARN build script would be more readable using abspath.
|
|
|
|
(Chris Nauroth via suresh)
|
|
|
|
|
|
|
|
YARN-233. Added support for running containers in MS Windows to YARN. (Chris
|
|
|
|
Nauroth via acmurthy)
|
|
|
|
|
|
|
|
YARN-234. Added support for process tree and resource calculator in MS Windows
|
|
|
|
to YARN. (Chris Nauroth via acmurthy)
|
|
|
|
|
|
|
|
YARN-259. Fix LocalDirsHandlerService to use Path rather than URIs. (Xuan
|
|
|
|
Gong via acmurthy)
|
|
|
|
|
|
|
|
YARN-316. YARN container launch may exceed maximum Windows command line
|
|
|
|
length due to long classpath. (Chris Nauroth via suresh)
|
|
|
|
|
|
|
|
YARN-359. Fixing commands for container signalling in Windows. (Chris Nauroth
|
|
|
|
via vinodkv)
|
2013-04-01 16:57:02 -04:00
|
|
|
|
|
|
|
YARN-524 TestYarnVersionInfo failing if generated properties doesn't
|
|
|
|
include an SVN URL(stevel)
|
2013-03-06 17:37:42 -05:00
|
|
|
|
2013-03-07 09:21:40 -05:00
|
|
|
Release 2.0.5-beta - UNRELEASED
|
2013-02-06 08:31:52 -05:00
|
|
|
|
|
|
|
INCOMPATIBLE CHANGES
|
|
|
|
|
2013-03-20 16:44:35 -04:00
|
|
|
YARN-396. Rationalize AllocateResponse in RM Scheduler API. (Zhijie Shen
|
|
|
|
via hitesh)
|
|
|
|
|
2013-03-25 14:28:50 -04:00
|
|
|
YARN-439. Flatten NodeHeartbeatResponse. (Xuan Gong via sseth)
|
|
|
|
|
2013-03-26 14:20:36 -04:00
|
|
|
YARN-440. Flatten RegisterNodeManagerResponse. (Xuan Gong via sseth)
|
|
|
|
|
2013-02-06 08:31:52 -05:00
|
|
|
NEW FEATURES
|
|
|
|
|
|
|
|
IMPROVEMENTS
|
|
|
|
|
2013-02-25 22:32:10 -05:00
|
|
|
YARN-365. Change NM heartbeat handling to not generate a scheduler event
|
|
|
|
on each heartbeat. (Xuan Gong via sseth)
|
|
|
|
|
2013-03-01 15:39:18 -05:00
|
|
|
YARN-380. Fix yarn node -status output to be better readable. (Omkar Vinit
|
|
|
|
Joshi via vinodkv)
|
|
|
|
|
2013-03-01 20:21:53 -05:00
|
|
|
YARN-410. Fixed RM UI so that the new lines diagnostics for a failed app on
|
|
|
|
the per-application page are translated to html line breaks. (Omkar Vinit
|
|
|
|
Joshi via vinodkv)
|
|
|
|
|
2013-03-13 00:24:35 -04:00
|
|
|
YARN-198. Added a link to RM pages from the NodeManager web app. (Jian He
|
|
|
|
via vinodkv)
|
|
|
|
|
2013-03-14 12:56:10 -04:00
|
|
|
YARN-237. Refreshing the RM page forgets how many rows I had in my
|
|
|
|
Datatables (jian he via bobby)
|
|
|
|
|
2013-03-18 19:48:58 -04:00
|
|
|
YARN-481. Add AM Host and RPC Port to ApplicationCLI Status Output
|
|
|
|
(Chris Riccomini via bikas)
|
|
|
|
|
2013-03-20 17:09:33 -04:00
|
|
|
YARN-297. Improve hashCode implementations for PB records. (Xuan Gong via
|
|
|
|
hitesh)
|
|
|
|
|
2013-03-21 18:26:06 -04:00
|
|
|
YARN-417. Create AMRMClient wrapper that provides asynchronous callbacks.
|
|
|
|
(Sandy Ryza via bikas)
|
|
|
|
|
2013-03-25 14:57:15 -04:00
|
|
|
YARN-497. Yarn unmanaged-am launcher jar does not define a main class in
|
|
|
|
its manifest (Hitesh Shah via bikas)
|
|
|
|
|
2013-03-25 23:25:26 -04:00
|
|
|
YARN-469. Make scheduling mode in FS pluggable. (kkambatl via tucu)
|
|
|
|
|
2013-03-28 15:44:28 -04:00
|
|
|
YARN-450. Define value for * in the scheduling protocol (Zhijie Shen via
|
|
|
|
bikas)
|
|
|
|
|
2013-03-31 15:17:44 -04:00
|
|
|
YARN-475. Remove a unused constant in the public API -
|
|
|
|
ApplicationConstants.AM_APP_ATTEMPT_ID_ENV. (Hitesh Shah via vinodkv)
|
|
|
|
|
2013-02-06 08:31:52 -05:00
|
|
|
OPTIMIZATIONS
|
|
|
|
|
|
|
|
BUG FIXES
|
|
|
|
|
2013-02-07 15:21:38 -05:00
|
|
|
YARN-383. AMRMClientImpl should handle null rmClient in stop()
|
|
|
|
(Hitesh Shah via sseth)
|
|
|
|
|
2013-02-07 15:28:20 -05:00
|
|
|
YARN-385. Add missing fields - location and #containers to
|
|
|
|
ResourceRequestPBImpl's toString(). (Sandy Ryza via sseth)
|
|
|
|
|
2013-02-07 18:53:49 -05:00
|
|
|
YARN-377. Use the new StringUtils methods added by HADOOP-9252 and fix
|
|
|
|
TestContainersMonitor. (Chris Nauroth via szetszwo)
|
|
|
|
|
2013-02-13 14:40:36 -05:00
|
|
|
YARN-391. Formatting fixes for LCEResourceHandler classes.
|
|
|
|
(Steve Loughran via sseth)
|
|
|
|
|
2013-02-25 19:26:24 -05:00
|
|
|
YARN-390. ApplicationCLI and NodeCLI hard-coded platform-specific line
|
|
|
|
separator causes test failures on Windows. (Chris Nauroth via suresh)
|
|
|
|
|
2013-02-28 17:17:39 -05:00
|
|
|
YARN-406. Fix TestRackResolver to function in networks where "host1"
|
|
|
|
resolves to a valid host. (Hitesh Shah via sseth)
|
|
|
|
|
2013-03-01 00:59:54 -05:00
|
|
|
YARN-376. Fixes a bug which would prevent the NM knowing about completed
|
|
|
|
containers and applications. (Jason Lowe via sseth)
|
|
|
|
|
2013-03-15 13:58:58 -04:00
|
|
|
YARN-196. Nodemanager should be more robust in handling connection failure
|
|
|
|
to ResourceManager when a cluster is started (Xuan Gong via hitesh)
|
|
|
|
|
2013-03-18 15:44:01 -04:00
|
|
|
YARN-485. TestProcfsProcessTree#testProcessTree() doesn't wait long enough
|
|
|
|
for the process to die. (kkambatl via tucu)
|
2013-03-22 17:28:31 -04:00
|
|
|
|
|
|
|
YARN-470. Support a way to disable resource monitoring on the NodeManager.
|
|
|
|
(Siddharth Seth via hitesh)
|
2013-03-25 14:23:59 -04:00
|
|
|
|
|
|
|
YARN-71. Fix the NodeManager to clean up local-dirs on restart.
|
|
|
|
(Xuan Gong via sseth)
|
2013-03-18 15:44:01 -04:00
|
|
|
|
2013-03-25 17:11:33 -04:00
|
|
|
YARN-378. Fix RM to make the AM max attempts/retries to be configurable
|
|
|
|
per application by clients. (Zhijie Shen via vinodkv)
|
|
|
|
|
2013-03-25 22:34:27 -04:00
|
|
|
YARN-498. Unmanaged AM launcher does not set various constants in env for
|
|
|
|
an AM, also does not handle failed AMs properly. (Hitesh Shah via bikas)
|
|
|
|
|
2013-03-26 23:44:34 -04:00
|
|
|
YARN-474. Fix CapacityScheduler to trigger application-activation when
|
|
|
|
am-resource-percent configuration is refreshed. (Zhijie Shen via vinodkv)
|
|
|
|
|
2013-03-27 10:42:41 -04:00
|
|
|
YARN-496. Fair scheduler configs are refreshed inconsistently in
|
|
|
|
reinitialize. (Sandy Ryza via tomwhite)
|
|
|
|
|
2013-03-27 14:38:28 -04:00
|
|
|
YARN-209. Fix CapacityScheduler to trigger application-activation when
|
|
|
|
the cluster capacity changes. (Zhijie Shen via vinodkv)
|
|
|
|
|
2013-03-27 19:14:05 -04:00
|
|
|
YARN-24. Nodemanager fails to start if log aggregation enabled and
|
|
|
|
namenode unavailable. (sandyr via tucu)
|
|
|
|
|
2013-03-29 16:20:19 -04:00
|
|
|
YARN-515. Node Manager not getting the master key. (Robert Joseph Evans
|
|
|
|
via jlowe)
|
|
|
|
|
2013-03-07 09:21:40 -05:00
|
|
|
Release 2.0.4-alpha - UNRELEASED
|
|
|
|
|
|
|
|
INCOMPATIBLE CHANGES
|
|
|
|
|
|
|
|
NEW FEATURES
|
|
|
|
|
|
|
|
IMPROVEMENTS
|
|
|
|
|
|
|
|
OPTIMIZATIONS
|
|
|
|
|
|
|
|
BUG FIXES
|
|
|
|
|
2013-03-06 14:26:57 -05:00
|
|
|
YARN-429. capacity-scheduler config missing from yarn-test artifact.
|
|
|
|
(sseth via hitesh)
|
|
|
|
|
2013-02-06 08:31:52 -05:00
|
|
|
Release 2.0.3-alpha - 2013-02-06
|
2012-08-08 01:22:27 -04:00
|
|
|
|
|
|
|
INCOMPATIBLE CHANGES
|
|
|
|
|
|
|
|
NEW FEATURES
|
|
|
|
|
2012-10-26 16:55:57 -04:00
|
|
|
YARN-145. Add a Web UI to the fair share scheduler. (Sandy Ryza via tomwhite)
|
|
|
|
|
2013-02-06 10:19:24 -05:00
|
|
|
YARN-3. Add support for CPU isolation/monitoring of containers.
|
|
|
|
(adferguson via tucu)
|
|
|
|
|
2012-12-18 23:21:18 -05:00
|
|
|
YARN-230. RM Restart phase 1 - includes support for saving/restarting all
|
|
|
|
applications on an RM bounce. (Bikas Saha via acmurthy)
|
|
|
|
|
2013-01-03 14:11:37 -05:00
|
|
|
YARN-103. Add a yarn AM-RM client module. (Bikas Saha via sseth)
|
|
|
|
|
2013-01-04 06:00:55 -05:00
|
|
|
YARN-286. Add a YARN ApplicationClassLoader. (tomwhite)
|
|
|
|
|
2013-01-09 00:08:23 -05:00
|
|
|
YARN-2. Enhanced CapacityScheduler to account for CPU alongwith memory for
|
|
|
|
multi-dimensional resource scheduling. (acmurthy)
|
|
|
|
|
2013-01-14 19:16:57 -05:00
|
|
|
YARN-328. Use token request messages defined in hadoop common. (suresh)
|
|
|
|
|
2013-01-22 19:57:37 -05:00
|
|
|
YARN-231. RM Restart - Add FS-based persistent store implementation for
|
|
|
|
RMStateStore (Bikas Saha via hitesh)
|
|
|
|
|
2012-08-08 01:22:27 -04:00
|
|
|
IMPROVEMENTS
|
|
|
|
|
2012-12-19 19:21:00 -05:00
|
|
|
YARN-223. Update process tree instead of getting new process trees.
|
|
|
|
(Radim Kolar via llu)
|
|
|
|
|
|
|
|
YARN-57. Allow process-tree based resource calculation et al. to be
|
|
|
|
pluggable to support it on multiple platforms. (Radim Kolar via acmurthy)
|
|
|
|
|
2012-09-11 20:49:17 -04:00
|
|
|
YARN-78. Changed UnManagedAM application to use YarnClient. (Bikas Saha via
|
|
|
|
vinodkv)
|
|
|
|
|
2012-09-12 20:46:39 -04:00
|
|
|
YARN-93. Fixed RM to propagate diagnostics from applications that have
|
|
|
|
finished but failed (Jason Lowe via vinodkv).
|
|
|
|
|
2012-09-17 19:30:27 -04:00
|
|
|
YARN-28. Fixed TestCompositeService to not depend on test-order and thus
|
|
|
|
made it pass on JDK7 (Thomas Graves via vinodkv).
|
|
|
|
|
2012-09-21 02:34:06 -04:00
|
|
|
YARN-82. Change the default local and log dirs to be based on
|
|
|
|
hadoop.tmp.dir and yarn.log.dir. (Hemanth Yamijala via sseth)
|
|
|
|
|
2012-09-23 20:51:51 -04:00
|
|
|
YARN-53. Added the missing getGroups API to ResourceManager. (Bo Wang via
|
|
|
|
vinodkv)
|
|
|
|
|
2012-09-29 18:39:03 -04:00
|
|
|
YARN-116. Add the ability to change the RM include/exclude file without
|
|
|
|
a restart. (xieguiming and Harsh J via sseth)
|
|
|
|
|
2012-10-04 19:00:41 -04:00
|
|
|
YARN-23. FairScheduler: FSQueueSchedulable#updateDemand() - potential
|
|
|
|
redundant aggregation. (kkambatl via tucu)
|
|
|
|
|
2012-10-08 18:18:42 -04:00
|
|
|
YARN-127. Move RMAdmin tool to its correct location - the client module.
|
|
|
|
(vinodkv)
|
|
|
|
|
2012-10-08 18:35:50 -04:00
|
|
|
YARN-40. Provided support for missing YARN commands (Devaraj K and Vinod
|
|
|
|
Kumar Vavilapalli via vinodkv)
|
|
|
|
|
2012-10-08 22:26:24 -04:00
|
|
|
YARN-33. Change LocalDirsHandlerService to validate the configured local and
|
|
|
|
log dirs. (Mayank Bansal via sseth)
|
|
|
|
|
2012-10-09 15:40:31 -04:00
|
|
|
YARN-94. Modify DistributedShell to point to main-class by default, clean up
|
|
|
|
the help message, and hard-code the AM class. (Hitesh Shah via vinodkv)
|
|
|
|
|
2012-10-11 06:07:01 -04:00
|
|
|
YARN-146. Add unit tests for computing fair share in the fair scheduler.
|
|
|
|
(Sandy Ryza via tomwhite)
|
|
|
|
|
2012-10-12 00:35:42 -04:00
|
|
|
HADOOP-8911. CRLF characters in source and text files.
|
|
|
|
(Raja Aluri via suresh)
|
|
|
|
|
2012-10-19 16:37:30 -04:00
|
|
|
YARN-136. Make ClientToAMTokenSecretManager part of RMContext (Vinod Kumar
|
|
|
|
Vavilapalli via sseth)
|
2012-10-12 00:35:42 -04:00
|
|
|
|
2012-11-09 07:38:10 -05:00
|
|
|
YARN-183. Clean up fair scheduler code. (Sandy Ryza via tomwhite)
|
|
|
|
|
2012-11-19 10:12:22 -05:00
|
|
|
YARN-129. Simplify classpath construction for mini YARN tests. (tomwhite)
|
|
|
|
|
2012-12-18 22:04:39 -05:00
|
|
|
YARN-254. Update fair scheduler web UI for hierarchical queues.
|
|
|
|
(sandyr via tucu)
|
|
|
|
|
2013-01-07 06:08:21 -05:00
|
|
|
YARN-315. Using the common security token protobuf definition from hadoop
|
|
|
|
common. (Suresh Srinivas via vinodkv)
|
|
|
|
|
2013-01-07 08:43:52 -05:00
|
|
|
YARN-170. Change NodeManager stop to be reentrant. (Sandy Ryza via vinodkv)
|
|
|
|
|
2013-01-17 19:37:23 -05:00
|
|
|
YARN-331. Fill in missing fair scheduler documentation. (sandyr via tucu)
|
|
|
|
|
2013-01-22 15:49:09 -05:00
|
|
|
YARN-277. Use AMRMClient in DistributedShell to exemplify the approach.
|
|
|
|
(Bikas Saha via hitesh)
|
|
|
|
|
2013-02-04 19:26:16 -05:00
|
|
|
YARN-360. Allow apps to concurrently register tokens for renewal.
|
|
|
|
(Daryn Sharp via sseth)
|
|
|
|
|
2012-09-07 18:09:48 -04:00
|
|
|
OPTIMIZATIONS
|
2012-09-04 16:56:53 -04:00
|
|
|
|
2012-08-08 01:22:27 -04:00
|
|
|
BUG FIXES
|
2012-10-02 22:56:20 -04:00
|
|
|
|
|
|
|
YARN-131. Fix incorrect ACL properties in capacity scheduler documentation.
|
|
|
|
(Ahmed Radwan via sseth)
|
2012-08-08 01:22:27 -04:00
|
|
|
|
2012-10-03 17:19:11 -04:00
|
|
|
YARN-102. Move the apache header to the top of the file in MemStore.java.
|
|
|
|
(Devaraj K via sseth)
|
2012-10-08 21:56:05 -04:00
|
|
|
|
|
|
|
YARN-134. ClientToAMSecretManager creates keys without checking for
|
|
|
|
validity of the appID. (Vinod Kumar Vavilapalli via sseth)
|
2012-10-03 17:19:11 -04:00
|
|
|
|
2012-10-09 18:54:11 -04:00
|
|
|
YARN-30. Fixed tests verifying web-services to work on JDK7. (Thomas Graves
|
|
|
|
via vinodkv)
|
|
|
|
|
2012-10-09 20:08:25 -04:00
|
|
|
YARN-150. Fixes AppRejectedTransition does not unregister a rejected
|
|
|
|
app-attempt from the ApplicationMasterService (Bikas Saha via sseth)
|
|
|
|
|
2012-10-23 18:48:49 -04:00
|
|
|
YARN-140. Add capacity-scheduler-default.xml to provide a default set of
|
|
|
|
configurations for the capacity scheduler. (ahmed via tucu)
|
2012-10-19 19:16:07 -04:00
|
|
|
|
2012-10-23 17:06:36 -04:00
|
|
|
YARN-179. Fix some unit test failures. (Vinod Kumar Vavilapalli via sseth)
|
|
|
|
|
2012-10-23 18:48:49 -04:00
|
|
|
YARN-181. Fixed eclipse settings broken by capacity-scheduler.xml move via
|
|
|
|
YARN-140. (Siddharth Seth via vinodkv)
|
|
|
|
|
2012-11-08 05:33:29 -05:00
|
|
|
YARN-169. Update log4j.appender.EventCounter to use
|
|
|
|
org.apache.hadoop.log.metrics.EventCounter (Anthony Rojas via tomwhite)
|
|
|
|
|
2012-11-18 00:00:56 -05:00
|
|
|
YARN-184. Remove unnecessary locking in fair scheduler, and address
|
|
|
|
findbugs excludes. (sandyr via tucu)
|
|
|
|
|
2012-11-28 07:27:30 -05:00
|
|
|
YARN-224. Fair scheduler logs too many nodeUpdate INFO messages.
|
|
|
|
(Sandy Ryza via tomwhite)
|
|
|
|
|
2012-11-28 07:53:29 -05:00
|
|
|
YARN-222. Fair scheduler should create queue for each user by default.
|
|
|
|
(Sandy Ryza via tomwhite)
|
|
|
|
|
2012-11-28 09:40:40 -05:00
|
|
|
MAPREDUCE-4778. Fair scheduler event log is only written if directory
|
|
|
|
exists on HDFS. (Sandy Ryza via tomwhite)
|
|
|
|
|
2012-11-28 20:56:33 -05:00
|
|
|
YARN-229. Remove old unused RM recovery code. (Bikas Saha via acmurthy)
|
|
|
|
|
2012-12-03 07:12:11 -05:00
|
|
|
YARN-187. Add hierarchical queues to the fair scheduler.
|
|
|
|
(Sandy Ryza via tomwhite)
|
|
|
|
|
|
|
|
YARN-72. NM should handle cleaning up containers when it shuts down.
|
|
|
|
(Sandy Ryza via tomwhite)
|
2012-11-30 07:03:25 -05:00
|
|
|
|
2012-12-12 09:35:01 -05:00
|
|
|
YARN-267. Fix fair scheduler web UI. (Sandy Ryza via tomwhite)
|
|
|
|
|
2012-12-13 17:16:29 -05:00
|
|
|
YARN-264. y.s.rm.DelegationTokenRenewer attempts to renew token even
|
|
|
|
after removing an app. (kkambatl via tucu)
|
|
|
|
|
2012-12-21 10:10:24 -05:00
|
|
|
YARN-271. Fair scheduler hits IllegalStateException trying to reserve
|
|
|
|
different apps on same node. (Sandy Ryza via tomwhite)
|
|
|
|
|
2012-12-21 11:01:48 -05:00
|
|
|
YARN-272. Fair scheduler log messages try to print objects without
|
|
|
|
overridden toString methods. (sandyr via tucu)
|
|
|
|
|
2012-12-21 11:07:11 -05:00
|
|
|
YARN-278. Fair scheduler maxRunningApps config causes no apps to make
|
|
|
|
progress. (sandyr via tucu)
|
|
|
|
|
2012-12-21 11:12:20 -05:00
|
|
|
YARN-282. Fair scheduler web UI double counts Apps Submitted.
|
|
|
|
(sandyr via tucu)
|
|
|
|
|
2012-12-21 11:20:12 -05:00
|
|
|
YARN-283. Fair scheduler fails to get queue info without root prefix.
|
|
|
|
(sandyr via tucu)
|
|
|
|
|
2013-01-03 07:29:13 -05:00
|
|
|
YARN-192. Node update causes NPE in the fair scheduler.
|
|
|
|
(Sandy Ryza via tomwhite)
|
|
|
|
|
2013-01-03 09:32:01 -05:00
|
|
|
YARN-288. Fair scheduler queue doesn't accept any jobs when ACLs are
|
|
|
|
configured. (Sandy Ryza via tomwhite)
|
|
|
|
|
2013-01-03 10:07:22 -05:00
|
|
|
YARN-300. After YARN-271, fair scheduler can infinite loop and not
|
|
|
|
schedule any application. (Sandy Ryza via tomwhite)
|
|
|
|
|
2013-01-03 10:26:55 -05:00
|
|
|
YARN-301. Fair scheduler throws ConcurrentModificationException when
|
|
|
|
iterating over app's priorities. (Sandy Ryza via tomwhite)
|
|
|
|
|
2013-01-07 01:36:20 -05:00
|
|
|
YARN-217. Fix RMAdmin protocol description to make it work in secure mode
|
|
|
|
also. (Devaraj K via vinodkv)
|
|
|
|
|
2013-01-08 08:20:07 -05:00
|
|
|
YARN-253. Fixed container-launch to not fail when there are no local
|
|
|
|
resources to localize. (Tom White via vinodkv)
|
|
|
|
|
2013-01-14 16:27:39 -05:00
|
|
|
YARN-330. Fix flakey test: TestNodeManagerShutdown#testKillContainersOnShutdown.
|
|
|
|
(Sandy Ryza via hitesh)
|
2013-01-15 11:12:33 -05:00
|
|
|
|
|
|
|
YARN-335. Fair scheduler doesn't check whether rack needs containers
|
|
|
|
before assigning to node. (Sandy Ryza via tomwhite)
|
2013-01-15 12:09:48 -05:00
|
|
|
|
|
|
|
YARN-336. Fair scheduler FIFO scheduling within a queue only allows 1
|
|
|
|
app at a time. (Sandy Ryza via tomwhite)
|
2013-01-14 16:27:39 -05:00
|
|
|
|
2013-01-15 13:33:38 -05:00
|
|
|
YARN-135. Client tokens should be per app-attempt, and should be
|
|
|
|
unregistered on App-finish. (vinodkv via sseth)
|
|
|
|
|
2013-01-17 19:48:22 -05:00
|
|
|
YARN-302. Fair scheduler assignmultiple should default to false. (sandyr via tucu)
|
2013-01-23 05:53:05 -05:00
|
|
|
|
|
|
|
YARN-319. Submitting a job to a fair scheduler queue for which the user
|
|
|
|
does not have permission causes the client to wait forever.
|
|
|
|
(shenhong via tomwhite)
|
2013-01-17 19:48:22 -05:00
|
|
|
|
2013-02-01 19:43:54 -05:00
|
|
|
YARN-372. Move InlineDispatcher from hadoop-yarn-server-resourcemanager to
|
|
|
|
hadoop-yarn-common (sseth via hitesh)
|
|
|
|
|
2013-02-05 23:24:56 -05:00
|
|
|
YARN-370. Fix SchedulerUtils to correctly round up the resource for
|
|
|
|
containers. (Zhijie Shen via acmurthy)
|
|
|
|
|
2013-02-06 14:03:52 -05:00
|
|
|
YARN-355. Fixes a bug where RM app submission could jam under load.
|
|
|
|
(Daryn Sharp via sseth)
|
|
|
|
|
2012-09-07 18:39:45 -04:00
|
|
|
Release 2.0.2-alpha - 2012-09-07
|
2012-08-08 01:22:27 -04:00
|
|
|
|
|
|
|
INCOMPATIBLE CHANGES
|
|
|
|
|
2012-09-25 19:37:32 -04:00
|
|
|
YARN-9. Rename YARN_HOME to HADOOP_YARN_HOME. (vinodkv via acmurthy)
|
|
|
|
|
2012-08-08 01:22:27 -04:00
|
|
|
NEW FEATURES
|
|
|
|
|
2012-08-08 01:36:50 -04:00
|
|
|
YARN-1. Promote YARN to be a sub-project of Apache Hadoop. (acmurthy)
|
2012-08-08 01:22:27 -04:00
|
|
|
|
|
|
|
IMPROVEMENTS
|
|
|
|
|
2012-08-27 14:27:18 -04:00
|
|
|
YARN-29. Add a yarn-client module. (Vinod Kumar Vavilapalli via sseth)
|
|
|
|
|
2012-09-04 16:56:53 -04:00
|
|
|
YARN-10. Fix DistributedShell module to not have a dependency on
|
|
|
|
hadoop-mapreduce-client-core. (Hitesh Shah via vinodkv)
|
|
|
|
|
2012-09-07 01:10:51 -04:00
|
|
|
YARN-80. Add support for delaying rack-local containers in
|
|
|
|
CapacityScheduler. (acmurthy)
|
|
|
|
|
2012-09-29 20:41:24 -04:00
|
|
|
YARN-137. Change the default YARN scheduler to be the CapacityScheduler.
|
|
|
|
(sseth via acmurthy)
|
|
|
|
|
2012-09-04 16:56:53 -04:00
|
|
|
OPTIMAZATIONS
|
|
|
|
|
2012-08-08 01:22:27 -04:00
|
|
|
BUG FIXES
|
|
|
|
|
2012-08-08 14:53:29 -04:00
|
|
|
YARN-12. Fix findbugs warnings in FairScheduler. (Junping Du via acmurthy)
|
|
|
|
|
2012-08-21 18:27:11 -04:00
|
|
|
YARN-22. Fix ContainerLogs to work if the log-dir is specified as a URI.
|
|
|
|
(Mayank Bansal via sseth)
|
|
|
|
|
2012-08-27 15:35:45 -04:00
|
|
|
YARN-37. Change TestRMAppTransitions to use the DrainDispatcher.
|
|
|
|
(Mayank Bansal via sseth)
|
|
|
|
|
2012-09-04 20:14:35 -04:00
|
|
|
YARN-79. Implement close on all clients to YARN so that RPC clients don't
|
|
|
|
throw exceptions on shut-down. (Vinod Kumar Vavilapalli)
|
|
|
|
|
2012-09-04 22:46:07 -04:00
|
|
|
YARN-42. Modify NM's non-aggregating logs' handler to stop properly so that
|
|
|
|
NMs don't get NPEs on startup errors. (Devaraj K via vinodkv)
|
|
|
|
|
2012-09-06 19:36:27 -04:00
|
|
|
YARN-15. Updated default classpath for YARN applications to reflect split of
|
|
|
|
YARN into a sub-project. (Arun C Murthy via vinodkv)
|
|
|
|
|
2012-09-06 19:46:31 -04:00
|
|
|
YARN-75. Modified ResourceManager's RMContainer to handle a valid RELEASE
|
|
|
|
event at RUNNING state. (Siddharth Seth via vinodkv)
|
|
|
|
|
2012-09-07 18:09:48 -04:00
|
|
|
MAPREDUCE-2374. "Text File Busy" errors launching MR tasks. (Andy Isaacson
|
|
|
|
via atm)
|
|
|
|
|
2012-09-29 23:32:07 -04:00
|
|
|
YARN-138. Ensure default values for minimum/maximum container sizes is
|
|
|
|
sane. (harsh & sseth via acmurthy)
|
|
|
|
|
2013-01-16 11:43:12 -05:00
|
|
|
Release 0.23.7 - UNRELEASED
|
|
|
|
|
|
|
|
INCOMPATIBLE CHANGES
|
|
|
|
|
|
|
|
NEW FEATURES
|
|
|
|
|
|
|
|
IMPROVEMENTS
|
|
|
|
|
2013-01-28 16:51:36 -05:00
|
|
|
YARN-133 Update web services docs for RM clusterMetrics (Ravi Prakash via
|
|
|
|
kihwal)
|
|
|
|
|
2013-02-13 10:40:01 -05:00
|
|
|
YARN-249. Capacity Scheduler web page should show list of active users per
|
|
|
|
queue like it used to (in 1.x) (Ravi Prakash via tgraves)
|
|
|
|
|
2013-02-20 15:57:22 -05:00
|
|
|
YARN-236. RM should point tracking URL to RM web page when app fails to
|
|
|
|
start (Jason Lowe via jeagles)
|
|
|
|
|
2013-02-28 16:02:06 -05:00
|
|
|
YARN-269. Resource Manager not logging the health_check_script result when
|
|
|
|
taking it out (Jason Lowe via kihwal)
|
|
|
|
|
2013-03-05 18:12:17 -05:00
|
|
|
YARN-227. Application expiration difficult to debug for end-users
|
|
|
|
(Jason Lowe via jeagles)
|
2013-03-08 09:46:26 -05:00
|
|
|
|
|
|
|
YARN-443. allow OS scheduling priority of NM to be different than the
|
|
|
|
containers it launches (tgraves)
|
|
|
|
|
2013-03-14 10:52:33 -04:00
|
|
|
YARN-468. coverage fix for org.apache.hadoop.yarn.server.webproxy.amfilter
|
|
|
|
(Aleksey Gorshkov via bobby)
|
2013-03-05 18:12:17 -05:00
|
|
|
|
2013-03-19 15:29:15 -04:00
|
|
|
YARN-200. yarn log does not output all needed information, and is in a
|
|
|
|
binary format (Ravi Prakash via jlowe)
|
|
|
|
|
2013-01-16 11:43:12 -05:00
|
|
|
OPTIMIZATIONS
|
|
|
|
|
2013-02-06 10:26:30 -05:00
|
|
|
YARN-357. App submission should not be synchronized (daryn)
|
|
|
|
|
2013-01-16 11:43:12 -05:00
|
|
|
BUG FIXES
|
|
|
|
|
2013-01-30 10:15:23 -05:00
|
|
|
YARN-343. Capacity Scheduler maximum-capacity value -1 is invalid (Xuan
|
|
|
|
Gong via tgraves)
|
|
|
|
|
2013-01-31 17:46:05 -05:00
|
|
|
YARN-364. AggregatedLogDeletionService can take too long to delete logs
|
|
|
|
(jlowe)
|
|
|
|
|
2013-02-08 10:55:32 -05:00
|
|
|
YARN-362. Unexpected extra results when using webUI table search (Ravi
|
|
|
|
Prakash via jlowe)
|
|
|
|
|
2013-02-20 10:35:06 -05:00
|
|
|
YARN-400. RM can return null application resource usage report leading to
|
|
|
|
NPE in client (Jason Lowe via tgraves)
|
|
|
|
|
2013-02-27 10:30:10 -05:00
|
|
|
YARN-426. Failure to download a public resource prevents further downloads
|
|
|
|
(Jason Lowe via bobby)
|
|
|
|
|
2013-03-04 15:08:21 -05:00
|
|
|
YARN-448. Remove unnecessary hflush from log aggregation (Kihwal Lee via
|
|
|
|
bobby)
|
|
|
|
|
2013-03-04 16:47:39 -05:00
|
|
|
YARN-345. Many InvalidStateTransitonException errors for ApplicationImpl
|
|
|
|
in Node Manager (Robert Parker via jlowe)
|
|
|
|
|
2013-03-25 11:46:25 -04:00
|
|
|
YARN-109. .tmp file is not deleted for localized archives (Mayank Bansal
|
|
|
|
via bobby)
|
|
|
|
|
2013-03-29 10:36:53 -04:00
|
|
|
YARN-460. CS user left in list of active users for the queue even when
|
|
|
|
application finished (tgraves)
|
|
|
|
|
2012-11-15 09:57:23 -05:00
|
|
|
Release 0.23.6 - UNRELEASED
|
|
|
|
|
|
|
|
INCOMPATIBLE CHANGES
|
|
|
|
|
|
|
|
NEW FEATURES
|
|
|
|
|
|
|
|
IMPROVEMENTS
|
|
|
|
|
2012-12-21 20:57:18 -05:00
|
|
|
YARN-285. Added a temporary plugin interface for RM to be able to redirect
|
|
|
|
to JobHistory server for apps that it no longer tracks. (Derek Dagit via
|
|
|
|
vinodkv)
|
|
|
|
|
2012-11-15 09:57:23 -05:00
|
|
|
OPTIMIZATIONS
|
|
|
|
|
|
|
|
BUG FIXES
|
|
|
|
|
2012-11-15 10:15:51 -05:00
|
|
|
YARN-188. Coverage fixing for CapacityScheduler (Aleksey Gorshkov via
|
|
|
|
bobby)
|
|
|
|
|
2012-11-16 13:26:19 -05:00
|
|
|
YARN-214. RMContainerImpl does not handle event EXPIRE at state RUNNING
|
|
|
|
(jeagles via bobby)
|
|
|
|
|
2012-11-16 15:56:08 -05:00
|
|
|
YARN-151. Browser thinks RM main page JS is taking too long
|
|
|
|
(Ravi Prakash via bobby)
|
|
|
|
|
2012-11-27 11:05:16 -05:00
|
|
|
YARN-204. test coverage for org.apache.hadoop.tools (Aleksey Gorshkov via
|
|
|
|
bobby)
|
|
|
|
|
2012-11-30 12:07:40 -05:00
|
|
|
YARN-251. Proxy URI generation fails for blank tracking URIs (Tom White
|
|
|
|
via jlowe)
|
|
|
|
|
2012-12-06 10:39:30 -05:00
|
|
|
YARN-258. RM web page UI shows Invalid Date for start and finish times
|
|
|
|
(Ravi Prakash via jlowe)
|
|
|
|
|
2012-12-11 10:45:10 -05:00
|
|
|
YARN-266. RM and JHS Web UIs are blank because AppsBlock is not escaping
|
|
|
|
string properly (Ravi Prakash via jlowe)
|
|
|
|
|
2012-12-21 13:49:47 -05:00
|
|
|
YARN-280. RM does not reject app submission with invalid tokens
|
|
|
|
(Daryn Sharp via tgraves)
|
|
|
|
|
2012-12-28 09:21:07 -05:00
|
|
|
YARN-225. Proxy Link in RM UI thows NPE in Secure mode
|
|
|
|
(Devaraj K via bobby)
|
|
|
|
|
2013-01-02 17:41:03 -05:00
|
|
|
YARN-293. Node Manager leaks LocalizerRunner object for every Container
|
|
|
|
(Robert Joseph Evans via jlowe)
|
|
|
|
|
2013-01-04 15:15:32 -05:00
|
|
|
YARN-50. Implement renewal / cancellation of Delegation Tokens
|
|
|
|
(Siddharth Seth via tgraves)
|
|
|
|
|
2013-01-09 14:33:06 -05:00
|
|
|
YARN-320. RM should always be able to renew its own tokens.
|
|
|
|
(Daryn Sharp via sseth)
|
|
|
|
|
2013-01-09 16:00:47 -05:00
|
|
|
YARN-325. RM CapacityScheduler can deadlock when getQueueInfo() is
|
|
|
|
called and a container is completing (Arun C Murthy via tgraves)
|
|
|
|
|
2013-01-14 09:34:51 -05:00
|
|
|
YARN-334. Maven RAT plugin is not checking all source files (tgraves)
|
|
|
|
|
2013-01-23 17:05:55 -05:00
|
|
|
YARN-354. WebAppProxyServer exits immediately after startup (Liang Xie via
|
|
|
|
jlowe)
|
|
|
|
|
2013-01-16 11:43:12 -05:00
|
|
|
Release 0.23.5 - 2012-11-28
|
2012-09-29 10:15:39 -04:00
|
|
|
|
|
|
|
INCOMPATIBLE CHANGES
|
|
|
|
|
|
|
|
NEW FEATURES
|
|
|
|
|
|
|
|
IMPROVEMENTS
|
|
|
|
|
2012-10-16 20:31:51 -04:00
|
|
|
YARN-161. Fix multiple compiler warnings for unchecked operations in YARN
|
|
|
|
common. (Chris Nauroth via vinodkv)
|
|
|
|
|
2012-10-16 21:24:50 -04:00
|
|
|
YARN-43. Fix TestResourceTrackerService to not depend on test order and thus
|
|
|
|
pass on JDK7. (Thomas Graves via vinodkv)
|
|
|
|
|
2012-10-18 15:12:13 -04:00
|
|
|
YARN-32. Fix TestApplicationTokens to not depend on test order and thus pass
|
|
|
|
on JDK7. (vinodkv)
|
|
|
|
|
2012-11-08 12:22:52 -05:00
|
|
|
YARN-186. Coverage fixing LinuxContainerExecutor (Aleksey Gorshkov via
|
|
|
|
bobby)
|
|
|
|
|
2012-11-14 14:22:11 -05:00
|
|
|
YARN-216. Remove jquery theming support. (Robert Joseph Evans via jlowe)
|
|
|
|
|
2012-09-29 10:15:39 -04:00
|
|
|
OPTIMIZATIONS
|
|
|
|
|
|
|
|
BUG FIXES
|
|
|
|
|
2012-10-19 13:34:15 -04:00
|
|
|
YARN-163. Retrieving container log via NM webapp can hang with multibyte
|
|
|
|
characters in log (jlowe via bobby)
|
|
|
|
|
2012-10-22 17:25:12 -04:00
|
|
|
YARN-174. Modify NodeManager to pass the user's configuration even when
|
|
|
|
rebooting. (vinodkv)
|
|
|
|
|
2012-10-24 09:21:09 -04:00
|
|
|
YARN-177. CapacityScheduler - adding a queue while the RM is running has
|
|
|
|
wacky results (acmurthy vai tgraves)
|
|
|
|
|
2012-10-24 10:07:16 -04:00
|
|
|
YARN-178. Fix custom ProcessTree instance creation (Radim Kolar via bobby)
|
|
|
|
|
2012-10-24 10:16:49 -04:00
|
|
|
YARN-180. Capacity scheduler - containers that get reserved create
|
|
|
|
container token to early (acmurthy and bobby)
|
|
|
|
|
2012-10-24 11:20:58 -04:00
|
|
|
YARN-139. Interrupted Exception within AsyncDispatcher leads to user
|
|
|
|
confusion. (Vinod Kumar Vavilapalli via jlowe)
|
|
|
|
|
2012-10-31 11:47:11 -04:00
|
|
|
YARN-165. RM should point tracking URL to RM web page for app when AM fails
|
|
|
|
(jlowe via bobby)
|
|
|
|
|
2012-10-31 12:22:34 -04:00
|
|
|
YARN-159. RM web ui applications page should be sorted to display last app
|
|
|
|
first (tgraves via bobby)
|
|
|
|
|
2012-10-31 12:56:23 -04:00
|
|
|
YARN-166. capacity scheduler doesn't allow capacity < 1.0 (tgraves via
|
|
|
|
bobby)
|
|
|
|
|
2012-10-31 20:32:37 -04:00
|
|
|
YARN-189. Fixed a deadlock between RM's ApplicationMasterService and the
|
|
|
|
dispatcher. (Thomas Graves via vinodkv)
|
|
|
|
|
2012-11-06 13:48:49 -05:00
|
|
|
YARN-202. Log Aggregation generates a storm of fsync() for namenode
|
|
|
|
(Kihwal Lee via bobby)
|
|
|
|
|
2012-11-07 16:56:18 -05:00
|
|
|
YARN-201. Fix CapacityScheduler to be less conservative for starved
|
|
|
|
off-switch requests. (jlowe via acmurthy)
|
|
|
|
|
2012-11-09 14:52:28 -05:00
|
|
|
YARN-206. TestApplicationCleanup.testContainerCleanup occasionally fails.
|
|
|
|
(jlowe via jeagles)
|
|
|
|
|
2012-11-13 10:59:13 -05:00
|
|
|
YARN-212. NM state machine ignores an APPLICATION_CONTAINER_FINISHED event
|
|
|
|
when it shouldn't (Nathan Roberts via jlowe)
|
|
|
|
|
2012-11-19 11:41:11 -05:00
|
|
|
YARN-219. NM should aggregate logs when application finishes. (bobby)
|
|
|
|
|
2012-11-15 09:57:23 -05:00
|
|
|
Release 0.23.4
|
2012-09-04 17:45:33 -04:00
|
|
|
|
|
|
|
INCOMPATIBLE CHANGES
|
|
|
|
|
|
|
|
NEW FEATURES
|
|
|
|
|
|
|
|
IMPROVEMENTS
|
|
|
|
|
2012-09-17 17:05:11 -04:00
|
|
|
Change package of YarnClient to org.apache.hadoop. (Bikas Saha via vinodkv)
|
|
|
|
|
|
|
|
YARN-108. FSDownload can create cache directories with the wrong
|
|
|
|
permissions (Jason Lowe via bobby)
|
2012-09-05 13:54:32 -04:00
|
|
|
|
2012-09-04 17:45:33 -04:00
|
|
|
OPTIMIZATIONS
|
|
|
|
|
|
|
|
BUG FIXES
|
|
|
|
|
2012-09-21 13:29:33 -04:00
|
|
|
YARN-88. DefaultContainerExecutor can fail to set proper permissions.
|
|
|
|
(Jason Lowe via sseth)
|
|
|
|
|
2012-09-28 16:50:44 -04:00
|
|
|
YARN-106. Nodemanager needs to set permissions of local directories (jlowe
|
|
|
|
via bobby)
|
|
|
|
|
2012-09-29 10:15:39 -04:00
|
|
|
Release 0.23.3
|
2012-08-09 15:15:56 -04:00
|
|
|
|
|
|
|
INCOMPATIBLE CHANGES
|
|
|
|
|
|
|
|
NEW FEATURES
|
|
|
|
|
|
|
|
IMPROVEMENTS
|
|
|
|
|
2012-09-04 16:56:53 -04:00
|
|
|
OPTIMAZATIONS
|
|
|
|
|
2012-08-09 15:15:56 -04:00
|
|
|
BUG FIXES
|
|
|
|
|
|
|
|
YARN-14. Symlinks to peer distributed cache files no longer work
|
|
|
|
(Jason Lowe via bobby)
|
|
|
|
|
2012-08-17 16:29:38 -04:00
|
|
|
YARN-25. remove old aggregated logs (Robert Evans via tgraves)
|
|
|
|
|
2012-08-20 11:36:51 -04:00
|
|
|
YARN-27. Failed refreshQueues due to misconfiguration prevents further
|
|
|
|
refreshing of queues (Arun Murthy via tgraves)
|
2012-08-20 14:32:13 -04:00
|
|
|
|
2012-08-29 12:51:33 -04:00
|
|
|
YARN-58. NM leaks filesystems (Jason Lowe via jeagles)
|
2012-08-24 22:18:49 -04:00
|
|
|
|
|
|
|
YARN-39. RM-NM secret-keys should be randomly generated and rolled every
|
|
|
|
so often. (vinodkv and sseth via sseth)
|
2012-08-27 23:31:11 -04:00
|
|
|
|
|
|
|
YARN-31. Fix TestDelegationTokenRenewer to not depend on test order so as to
|
|
|
|
pass tests on jdk7. (Thomas Graves via vinodkv)
|
2012-08-31 12:33:21 -04:00
|
|
|
|
|
|
|
YARN-63. RMNodeImpl is missing valid transitions from the UNHEALTHY state
|
|
|
|
(Jason Lowe via bobby)
|
|
|
|
|
2012-08-31 15:11:05 -04:00
|
|
|
YARN-60. Fixed a bug in ResourceManager which causes all NMs to get NPEs and
|
|
|
|
thus causes all containers to be rejected. (vinodkv)
|
2012-08-31 15:57:34 -04:00
|
|
|
|
|
|
|
YARN-66. aggregated logs permissions not set properly (tgraves via bobby)
|
2012-09-05 15:39:53 -04:00
|
|
|
|
|
|
|
YARN-68. NodeManager will refuse to shutdown indefinitely due to container
|
|
|
|
log aggregation (daryn via bobby)
|
2012-09-05 22:08:37 -04:00
|
|
|
|
|
|
|
YARN-87. NM ResourceLocalizationService does not set permissions of local
|
|
|
|
cache directories (Jason Lowe via tgraves)
|