2012-09-29 10:18:27 -04:00
|
|
|
Hadoop YARN Change Log
|
2012-08-08 01:33:56 -04:00
|
|
|
|
2012-09-07 18:34:25 -04:00
|
|
|
Release 2.0.3-alpha - Unreleased
|
|
|
|
|
2012-08-08 01:33:56 -04:00
|
|
|
INCOMPATIBLE CHANGES
|
|
|
|
|
|
|
|
NEW FEATURES
|
|
|
|
|
2012-10-26 17:03:20 -04:00
|
|
|
YARN-145. Add a Web UI to the fair share scheduler. (Sandy Ryza via tomwhite)
|
|
|
|
|
2012-08-08 01:33:56 -04:00
|
|
|
IMPROVEMENTS
|
|
|
|
|
2012-09-11 20:50:25 -04:00
|
|
|
YARN-78. Changed UnManagedAM application to use YarnClient. (Bikas Saha via
|
|
|
|
vinodkv)
|
|
|
|
|
2012-09-12 20:47:54 -04:00
|
|
|
YARN-93. Fixed RM to propagate diagnostics from applications that have
|
|
|
|
finished but failed (Jason Lowe via vinodkv).
|
|
|
|
|
2012-09-17 20:41:44 -04:00
|
|
|
YARN-28. Fixed TestCompositeService to not depend on test-order and thus
|
|
|
|
made it pass on JDK7 (Thomas Graves via vinodkv).
|
|
|
|
|
2012-09-21 02:40:56 -04:00
|
|
|
YARN-82. Change the default local and log dirs to be based on
|
|
|
|
hadoop.tmp.dir and yarn.log.dir. (Hemanth Yamijala via sseth)
|
|
|
|
|
2012-09-23 20:52:55 -04:00
|
|
|
YARN-53. Added the missing getGroups API to ResourceManager. (Bo Wang via
|
|
|
|
vinodkv)
|
|
|
|
|
2012-09-29 18:40:58 -04:00
|
|
|
YARN-116. Add the ability to change the RM include/exclude file without
|
|
|
|
a restart. (xieguiming and Harsh J via sseth)
|
|
|
|
|
2012-10-04 19:02:28 -04:00
|
|
|
YARN-23. FairScheduler: FSQueueSchedulable#updateDemand() - potential
|
|
|
|
redundant aggregation. (kkambatl via tucu)
|
|
|
|
|
2012-10-08 18:19:43 -04:00
|
|
|
YARN-127. Move RMAdmin tool to its correct location - the client module.
|
|
|
|
(vinodkv)
|
|
|
|
|
2012-10-08 18:36:47 -04:00
|
|
|
YARN-40. Provided support for missing YARN commands (Devaraj K and Vinod
|
|
|
|
Kumar Vavilapalli via vinodkv)
|
|
|
|
|
2012-10-08 22:27:18 -04:00
|
|
|
YARN-33. Change LocalDirsHandlerService to validate the configured local and
|
|
|
|
log dirs. (Mayank Bansal via sseth)
|
|
|
|
|
2012-10-09 15:56:32 -04:00
|
|
|
YARN-94. Modify DistributedShell to point to main-class by default, clean up
|
|
|
|
the help message, and hard-code the AM class. (Hitesh Shah via vinodkv)
|
|
|
|
|
2012-10-11 06:30:53 -04:00
|
|
|
YARN-146. Add unit tests for computing fair share in the fair scheduler.
|
|
|
|
(Sandy Ryza via tomwhite)
|
|
|
|
|
2012-10-12 00:48:40 -04:00
|
|
|
HADOOP-8911. CRLF characters in source and text files.
|
|
|
|
(Raja Aluri via suresh)
|
|
|
|
|
2012-10-19 16:39:41 -04:00
|
|
|
YARN-136. Make ClientToAMTokenSecretManager part of RMContext (Vinod Kumar
|
|
|
|
Vavilapalli via sseth)
|
|
|
|
|
2012-09-07 18:34:25 -04:00
|
|
|
OPTIMIZATIONS
|
2012-08-23 14:25:10 -04:00
|
|
|
|
2012-09-07 18:34:25 -04:00
|
|
|
BUG FIXES
|
2012-10-02 22:57:25 -04:00
|
|
|
|
|
|
|
YARN-131. Fix incorrect ACL properties in capacity scheduler documentation.
|
|
|
|
(Ahmed Radwan via sseth)
|
2012-08-08 01:33:56 -04:00
|
|
|
|
2012-10-03 17:20:10 -04:00
|
|
|
YARN-102. Move the apache header to the top of the file in MemStore.java.
|
|
|
|
(Devaraj K via sseth)
|
2012-10-08 21:58:07 -04:00
|
|
|
|
|
|
|
YARN-134. ClientToAMSecretManager creates keys without checking for
|
|
|
|
validity of the appID. (Vinod Kumar Vavilapalli via sseth)
|
2012-10-03 17:20:10 -04:00
|
|
|
|
2012-10-09 18:55:11 -04:00
|
|
|
YARN-30. Fixed tests verifying web-services to work on JDK7. (Thomas Graves
|
|
|
|
via vinodkv)
|
|
|
|
|
2012-10-09 20:09:29 -04:00
|
|
|
YARN-150. Fixes AppRejectedTransition does not unregister a rejected
|
|
|
|
app-attempt from the ApplicationMasterService (Bikas Saha via sseth)
|
|
|
|
|
2012-10-23 18:49:37 -04:00
|
|
|
YARN-140. Add capacity-scheduler-default.xml to provide a default set of
|
|
|
|
configurations for the capacity scheduler. (ahmed via tucu)
|
2012-10-19 19:18:00 -04:00
|
|
|
|
2012-10-23 17:07:42 -04:00
|
|
|
YARN-179. Fix some unit test failures. (Vinod Kumar Vavilapalli via sseth)
|
|
|
|
|
2012-10-23 18:49:37 -04:00
|
|
|
YARN-181. Fixed eclipse settings broken by capacity-scheduler.xml move via
|
|
|
|
YARN-140. (Siddharth Seth via vinodkv)
|
|
|
|
|
2012-09-07 18:37:55 -04:00
|
|
|
Release 2.0.2-alpha - 2012-09-07
|
2012-08-08 01:33:56 -04:00
|
|
|
|
2012-09-25 19:40:14 -04:00
|
|
|
YARN-9. Rename YARN_HOME to HADOOP_YARN_HOME. (vinodkv via acmurthy)
|
|
|
|
|
2012-08-08 01:33:56 -04:00
|
|
|
NEW FEATURES
|
|
|
|
|
|
|
|
YARN-1. Promote YARN to be a sub-project of Apache Hadoop. (acmurthy)
|
|
|
|
|
|
|
|
IMPROVEMENTS
|
|
|
|
|
2012-08-27 14:30:42 -04:00
|
|
|
YARN-29. Add a yarn-client module. (Vinod Kumar Vavilapalli via sseth)
|
|
|
|
|
2012-09-04 17:01:58 -04:00
|
|
|
YARN-10. Fix DistributedShell module to not have a dependency on
|
|
|
|
hadoop-mapreduce-client-core. (Hitesh Shah via vinodkv)
|
|
|
|
|
2012-09-07 01:11:46 -04:00
|
|
|
YARN-80. Add support for delaying rack-local containers in
|
|
|
|
CapacityScheduler. (acmurthy)
|
|
|
|
|
2012-09-29 20:44:15 -04:00
|
|
|
YARN-137. Change the default YARN scheduler to be the CapacityScheduler.
|
|
|
|
(sseth via acmurthy)
|
|
|
|
|
2012-09-07 18:34:25 -04:00
|
|
|
OPTIMIZATIONS
|
2012-09-04 17:01:58 -04:00
|
|
|
|
2012-08-08 01:33:56 -04:00
|
|
|
BUG FIXES
|
|
|
|
|
2012-09-07 18:34:25 -04:00
|
|
|
YARN-13. Fix pom versions for YARN in branch-2 (todd)
|
|
|
|
|
|
|
|
MAPREDUCE-2374. "Text File Busy" errors launching MR tasks. (Andy Isaacson
|
|
|
|
via atm)
|
|
|
|
|
2012-08-08 14:54:26 -04:00
|
|
|
YARN-12. Fix findbugs warnings in FairScheduler. (Junping Du via acmurthy)
|
|
|
|
|
2012-08-21 18:28:58 -04:00
|
|
|
YARN-22. Fix ContainerLogs to work if the log-dir is specified as a URI.
|
|
|
|
(Mayank Bansal via sseth)
|
|
|
|
|
2012-08-27 15:38:24 -04:00
|
|
|
YARN-37. Change TestRMAppTransitions to use the DrainDispatcher.
|
|
|
|
(Mayank Bansal via sseth)
|
|
|
|
|
2012-09-04 20:16:22 -04:00
|
|
|
YARN-79. Implement close on all clients to YARN so that RPC clients don't
|
|
|
|
throw exceptions on shut-down. (Vinod Kumar Vavilapalli)
|
|
|
|
|
2012-09-04 22:47:02 -04:00
|
|
|
YARN-42. Modify NM's non-aggregating logs' handler to stop properly so that
|
|
|
|
NMs don't get NPEs on startup errors. (Devaraj K via vinodkv)
|
|
|
|
|
2012-09-06 19:37:33 -04:00
|
|
|
YARN-15. Updated default classpath for YARN applications to reflect split of
|
|
|
|
YARN into a sub-project. (Arun C Murthy via vinodkv)
|
|
|
|
|
2012-09-06 20:21:36 -04:00
|
|
|
YARN-75. Modified ResourceManager's RMContainer to handle a valid RELEASE
|
|
|
|
event at RUNNING state. (Siddharth Seth via vinodkv)
|
|
|
|
|
2012-09-29 23:46:51 -04:00
|
|
|
YARN-138. Ensure default values for minimum/maximum container sizes is
|
|
|
|
sane. (harsh & sseth via acmurthy)
|
|
|
|
|
2012-09-29 10:18:27 -04:00
|
|
|
Release 0.23.5 - UNRELEASED
|
|
|
|
|
|
|
|
INCOMPATIBLE CHANGES
|
|
|
|
|
|
|
|
NEW FEATURES
|
|
|
|
|
|
|
|
IMPROVEMENTS
|
|
|
|
|
2012-10-16 20:32:37 -04:00
|
|
|
YARN-161. Fix multiple compiler warnings for unchecked operations in YARN
|
|
|
|
common. (Chris Nauroth via vinodkv)
|
|
|
|
|
2012-10-16 21:29:12 -04:00
|
|
|
YARN-43. Fix TestResourceTrackerService to not depend on test order and thus
|
|
|
|
pass on JDK7. (Thomas Graves via vinodkv)
|
|
|
|
|
2012-10-18 15:12:53 -04:00
|
|
|
YARN-32. Fix TestApplicationTokens to not depend on test order and thus pass
|
|
|
|
on JDK7. (vinodkv)
|
|
|
|
|
2012-09-29 10:18:27 -04:00
|
|
|
OPTIMIZATIONS
|
|
|
|
|
|
|
|
BUG FIXES
|
|
|
|
|
2012-10-19 13:36:26 -04:00
|
|
|
YARN-163. Retrieving container log via NM webapp can hang with multibyte
|
|
|
|
characters in log (jlowe via bobby)
|
|
|
|
|
2012-10-22 17:25:56 -04:00
|
|
|
YARN-174. Modify NodeManager to pass the user's configuration even when
|
|
|
|
rebooting. (vinodkv)
|
|
|
|
|
2012-10-24 09:25:19 -04:00
|
|
|
YARN-177. CapacityScheduler - adding a queue while the RM is running has
|
|
|
|
wacky results (acmurthy vai tgraves)
|
|
|
|
|
2012-10-24 10:08:28 -04:00
|
|
|
YARN-178. Fix custom ProcessTree instance creation (Radim Kolar via bobby)
|
|
|
|
|
2012-10-24 10:20:09 -04:00
|
|
|
YARN-180. Capacity scheduler - containers that get reserved create
|
|
|
|
container token to early (acmurthy and bobby)
|
|
|
|
|
2012-10-24 11:25:22 -04:00
|
|
|
YARN-139. Interrupted Exception within AsyncDispatcher leads to user
|
|
|
|
confusion. (Vinod Kumar Vavilapalli via jlowe)
|
|
|
|
|
2012-10-31 11:50:53 -04:00
|
|
|
YARN-165. RM should point tracking URL to RM web page for app when AM fails
|
|
|
|
(jlowe via bobby)
|
|
|
|
|
2012-10-31 12:24:25 -04:00
|
|
|
YARN-159. RM web ui applications page should be sorted to display last app
|
|
|
|
first (tgraves via bobby)
|
|
|
|
|
2012-10-31 13:00:01 -04:00
|
|
|
YARN-166. capacity scheduler doesn't allow capacity < 1.0 (tgraves via
|
|
|
|
bobby)
|
|
|
|
|
2012-10-31 20:33:32 -04:00
|
|
|
YARN-189. Fixed a deadlock between RM's ApplicationMasterService and the
|
|
|
|
dispatcher. (Thomas Graves via vinodkv)
|
|
|
|
|
2012-09-04 17:48:58 -04:00
|
|
|
Release 0.23.4 - UNRELEASED
|
|
|
|
|
|
|
|
INCOMPATIBLE CHANGES
|
|
|
|
|
|
|
|
NEW FEATURES
|
|
|
|
|
|
|
|
IMPROVEMENTS
|
|
|
|
|
2012-09-17 17:11:56 -04:00
|
|
|
Change package of YarnClient to org.apache.hadoop. (Bikas Saha via vinodkv)
|
|
|
|
|
|
|
|
YARN-108. FSDownload can create cache directories with the wrong
|
|
|
|
permissions (Jason Lowe via bobby)
|
2012-09-05 13:55:53 -04:00
|
|
|
|
2012-09-27 12:38:54 -04:00
|
|
|
YARN-57. Allow process-tree based resource calculation et al. to be
|
|
|
|
pluggable to support it on multiple platforms. (Radim Kolar via acmurthy)
|
|
|
|
|
2012-09-04 17:48:58 -04:00
|
|
|
OPTIMIZATIONS
|
|
|
|
|
|
|
|
BUG FIXES
|
|
|
|
|
2012-09-21 13:36:18 -04:00
|
|
|
YARN-88. DefaultContainerExecutor can fail to set proper permissions.
|
|
|
|
(Jason Lowe via sseth)
|
|
|
|
|
2012-09-28 16:53:14 -04:00
|
|
|
YARN-106. Nodemanager needs to set permissions of local directories (jlowe
|
|
|
|
via bobby)
|
|
|
|
|
2012-09-29 10:18:27 -04:00
|
|
|
Release 0.23.3
|
2012-08-09 15:18:37 -04:00
|
|
|
|
|
|
|
INCOMPATIBLE CHANGES
|
|
|
|
|
|
|
|
NEW FEATURES
|
|
|
|
|
|
|
|
IMPROVEMENTS
|
|
|
|
|
2012-09-04 17:01:58 -04:00
|
|
|
OPTIMAZATIONS
|
|
|
|
|
2012-08-09 15:18:37 -04:00
|
|
|
BUG FIXES
|
|
|
|
|
|
|
|
YARN-14. Symlinks to peer distributed cache files no longer work
|
|
|
|
(Jason Lowe via bobby)
|
|
|
|
|
2012-08-17 16:31:09 -04:00
|
|
|
YARN-25. remove old aggregated logs (Robert Evans via tgraves)
|
|
|
|
|
2012-08-20 11:37:43 -04:00
|
|
|
YARN-27. Failed refreshQueues due to misconfiguration prevents further
|
|
|
|
refreshing of queues (Arun Murthy via tgraves)
|
2012-08-20 15:32:11 -04:00
|
|
|
|
|
|
|
MAPREDUCE-4323. NM leaks filesystems (Jason Lowe via jeagles)
|
2012-08-24 22:25:12 -04:00
|
|
|
|
|
|
|
YARN-39. RM-NM secret-keys should be randomly generated and rolled every
|
|
|
|
so often. (vinodkv and sseth via sseth)
|
2012-08-27 23:33:20 -04:00
|
|
|
|
|
|
|
YARN-31. Fix TestDelegationTokenRenewer to not depend on test order so as to
|
|
|
|
pass tests on jdk7. (Thomas Graves via vinodkv)
|
2012-08-31 12:34:33 -04:00
|
|
|
|
|
|
|
YARN-63. RMNodeImpl is missing valid transitions from the UNHEALTHY state
|
|
|
|
(Jason Lowe via bobby)
|
|
|
|
|
2012-08-31 15:12:57 -04:00
|
|
|
YARN-60. Fixed a bug in ResourceManager which causes all NMs to get NPEs and
|
|
|
|
thus causes all containers to be rejected. (vinodkv)
|
2012-08-31 15:58:26 -04:00
|
|
|
|
|
|
|
YARN-66. aggregated logs permissions not set properly (tgraves via bobby)
|
2012-09-05 15:41:21 -04:00
|
|
|
|
|
|
|
YARN-68. NodeManager will refuse to shutdown indefinitely due to container
|
|
|
|
log aggregation (daryn via bobby)
|
2012-09-05 22:11:00 -04:00
|
|
|
|
|
|
|
YARN-87. NM ResourceLocalizationService does not set permissions of local
|
|
|
|
cache directories (Jason Lowe via tgraves)
|