2012-09-29 10:18:27 -04:00
|
|
|
|
Hadoop YARN Change Log
|
2012-08-08 01:33:56 -04:00
|
|
|
|
|
2015-11-04 11:29:56 -05:00
|
|
|
|
Release 2.7.3 - UNRELEASED
|
|
|
|
|
|
|
|
|
|
INCOMPATIBLE CHANGES
|
|
|
|
|
|
|
|
|
|
NEW FEATURES
|
|
|
|
|
|
|
|
|
|
IMPROVEMENTS
|
|
|
|
|
|
2015-11-18 16:58:47 -05:00
|
|
|
|
YARN-4287. Capacity Scheduler: Rack Locality improvement. (Nathan Roberts via wangda)
|
|
|
|
|
|
2016-01-21 10:43:23 -05:00
|
|
|
|
YARN-4492. Add documentation for preemption supported in Capacity
|
|
|
|
|
scheduler (Naganarasimha G R via jlowe)
|
|
|
|
|
|
2016-02-12 13:59:51 -05:00
|
|
|
|
YARN-3404. Display queue name on application page. (Ryu Kobayashi via jianhe)
|
|
|
|
|
|
2016-02-14 04:13:15 -05:00
|
|
|
|
YARN-4653. Document YARN security model from the perspective of
|
|
|
|
|
Application Developers. (Steve Loughran via jianhe)
|
|
|
|
|
|
2016-03-06 22:46:09 -05:00
|
|
|
|
YARN-4761. NMs reconnecting with changed capabilities can lead to wrong cluster
|
|
|
|
|
resource calculations on fair scheduler. (Sangjin Lee via zxu)
|
|
|
|
|
|
2015-11-04 11:29:56 -05:00
|
|
|
|
OPTIMIZATIONS
|
|
|
|
|
|
|
|
|
|
BUG FIXES
|
|
|
|
|
|
2015-11-03 14:18:34 -05:00
|
|
|
|
YARN-4326. Fix TestDistributedShell timeout as AHS in MiniYarnCluster no longer
|
|
|
|
|
binds to default port 8188. (Meng Ding via wangda)
|
|
|
|
|
|
2015-11-12 14:20:38 -05:00
|
|
|
|
YARN-4347. Resource manager fails with Null pointer exception. (Jian He via wangda)
|
|
|
|
|
|
2015-11-20 18:25:27 -05:00
|
|
|
|
YARN-4374. RM capacity scheduler UI rounds user limit factor (Chang Li via
|
|
|
|
|
jlowe)
|
|
|
|
|
|
2015-11-20 14:45:23 -05:00
|
|
|
|
YARN-3849. Too much of preemption activity causing continuos killing of containers
|
|
|
|
|
across queues. (Sunil G via wangda)
|
|
|
|
|
|
2015-11-20 19:36:11 -05:00
|
|
|
|
YARN-3769. Consider user limit when calculating total pending resource for
|
|
|
|
|
preemption policy in Capacity Scheduler. (Eric Payne via wangda)
|
|
|
|
|
|
2015-11-23 15:47:12 -05:00
|
|
|
|
YARN-4344. NMs reconnecting with changed capabilities can lead to wrong
|
|
|
|
|
cluster resource calculations (Varun Vasudev via jlowe)
|
|
|
|
|
|
2015-11-24 18:52:46 -05:00
|
|
|
|
YARN-4365. FileSystemNodeLabelStore should check for root dir existence on
|
|
|
|
|
startup (Kuhu Shukla via jlowe)
|
|
|
|
|
|
2015-11-25 11:10:02 -05:00
|
|
|
|
YARN-4380. TestResourceLocalizationService.testDownloadingResourcesOnContainerKill
|
|
|
|
|
fails intermittently. (Varun Saxena via ozawa)
|
|
|
|
|
|
2015-12-02 14:07:18 -05:00
|
|
|
|
YARN-4398. Remove unnecessary synchronization in RMStateStore. (Ning Ding via jianhe)
|
|
|
|
|
|
2015-12-03 15:42:53 -05:00
|
|
|
|
YARN-3840. Resource Manager web ui issue when sorting application by id
|
|
|
|
|
(with application having id > 9999) (Mohammad Shahid Khan & Varun Saxena
|
|
|
|
|
via jianhe)
|
|
|
|
|
|
2015-12-07 16:04:48 -05:00
|
|
|
|
YARN-4422. Generic AHS sometimes doesn't show started, node, or logs on App page
|
|
|
|
|
(Eric Payne via jeagles)
|
|
|
|
|
|
2015-12-15 13:06:13 -05:00
|
|
|
|
YARN-4439. Clarify NMContainerStatus#toString method. (Jian He via xgong)
|
|
|
|
|
|
2016-01-25 11:32:57 -05:00
|
|
|
|
YARN-4452. NPE when submit Unmanaged application. (Naganarasimha G R via
|
|
|
|
|
junping_du)
|
|
|
|
|
|
2016-01-06 08:49:24 -05:00
|
|
|
|
YARN-4546. ResourceManager crash due to scheduling opportunity overflow.
|
|
|
|
|
(Jason Lowe via junping_du)
|
2015-12-16 13:57:39 -05:00
|
|
|
|
|
2016-01-12 10:04:43 -05:00
|
|
|
|
YARN-3695. ServerProxy (NMProxy, etc.) shouldn't retry forever for non
|
|
|
|
|
network exception. (Raju Bairishetti via jianhe)
|
|
|
|
|
|
2016-01-12 10:59:14 -05:00
|
|
|
|
YARN-4414. Nodemanager connection errors are retried at multiple levels
|
|
|
|
|
(Chang Li via jlowe)
|
|
|
|
|
|
2016-01-15 11:13:04 -05:00
|
|
|
|
YARN-4121. Fix typos in capacity scheduler documentation.
|
|
|
|
|
(Kai Sasaki via vvasudev)
|
|
|
|
|
|
2016-01-15 11:40:56 -05:00
|
|
|
|
YARN-4581. AHS writer thread leak makes RM crash while RM is recovering.
|
|
|
|
|
(sandflee via junping_du)
|
|
|
|
|
|
2016-01-21 13:35:24 -05:00
|
|
|
|
YARN-4610. Reservations continue looking for one app causes other apps to
|
|
|
|
|
starve (jlowe)
|
|
|
|
|
|
2016-01-21 13:52:15 -05:00
|
|
|
|
YARN-4623. TestSystemMetricsPublisher#testPublishAppAttemptMetricsForUnmanagedAM
|
|
|
|
|
fails with NPE on branch-2.7. (Naganarasimha G R via junping_du)
|
|
|
|
|
|
2016-01-22 16:58:12 -05:00
|
|
|
|
YARN-4598. Invalid event: RESOURCE_FAILED at
|
|
|
|
|
CONTAINER_CLEANEDUP_AFTER_KILL (tangshangwen via jlowe)
|
|
|
|
|
|
2016-01-29 17:01:36 -05:00
|
|
|
|
YARN-4428. Redirect RM page to AHS page when AHS turned on and RM page is
|
|
|
|
|
not available (Chang Li via jlowe)
|
|
|
|
|
|
2016-02-01 18:18:44 -05:00
|
|
|
|
YARN-3102. Decommisioned Nodes not listed in Web UI (Kuhu Shukla via
|
|
|
|
|
jlowe)
|
|
|
|
|
|
2016-02-09 11:51:36 -05:00
|
|
|
|
YARN-3602. TestResourceLocalizationService.testPublicResourceInitializesLocalDir
|
|
|
|
|
fails Intermittently due to IOException from cleanup. (zhihai xu via xgong)
|
|
|
|
|
|
2016-02-22 03:17:40 -05:00
|
|
|
|
YARN-4707. Remove the extra char (>) from SecureContainer.md.
|
|
|
|
|
(Brahma Reddy Battula via aajisaka)
|
|
|
|
|
|
2016-02-23 15:53:30 -05:00
|
|
|
|
YARN-2046. Out of band heartbeats are sent only on container kill and
|
|
|
|
|
possibly too early (Ming Ma via jlowe)
|
|
|
|
|
|
2016-02-26 15:28:29 -05:00
|
|
|
|
YARN-4723. NodesListManager$UnknownNodeId ClassCastException (Kuhu Shukla
|
|
|
|
|
via jlowe)
|
|
|
|
|
|
2016-03-07 10:59:45 -05:00
|
|
|
|
YARN-4760. proxy redirect to history server uses wrong URL (Eric Badger
|
|
|
|
|
via jlowe)
|
|
|
|
|
|
2016-03-17 12:44:06 -04:00
|
|
|
|
YARN-4785. inconsistent value type of the "type" field for LeafQueueInfo
|
|
|
|
|
in response of RM REST API. (Varun Vasudev via junping_du)
|
|
|
|
|
|
2016-03-31 13:49:03 -04:00
|
|
|
|
YARN-4183. Clarify the behavior of timeline service config properties
|
|
|
|
|
(Naganarasimha G R via sjlee)
|
|
|
|
|
|
2016-01-25 18:45:12 -05:00
|
|
|
|
Release 2.7.2 - 2016-01-25
|
2015-06-28 19:29:12 -04:00
|
|
|
|
|
|
|
|
|
INCOMPATIBLE CHANGES
|
|
|
|
|
|
|
|
|
|
NEW FEATURES
|
|
|
|
|
|
|
|
|
|
IMPROVEMENTS
|
|
|
|
|
|
2015-10-23 11:34:08 -04:00
|
|
|
|
YARN-4009. CORS support for ResourceManager REST API. ( Varun Vasudev via jeagles)
|
|
|
|
|
|
2015-07-15 02:42:41 -04:00
|
|
|
|
YARN-3170. YARN architecture document needs updating. (Brahma Reddy Battula
|
|
|
|
|
via ozawa)
|
|
|
|
|
|
2015-07-24 13:15:54 -04:00
|
|
|
|
YARN-3967. Fetch the application report from the AHS if the RM does not know about it.
|
|
|
|
|
(Mit Desai via xgong)
|
|
|
|
|
|
2015-09-01 04:54:14 -04:00
|
|
|
|
YARN-2801. Add documentation for node labels feature. (Wangda Tan and Naganarasimha
|
|
|
|
|
G R via ozawa)
|
|
|
|
|
|
2015-10-21 16:38:08 -04:00
|
|
|
|
YARN-2513. Host framework UIs in YARN for use with the ATS (jeagles)
|
|
|
|
|
|
2015-06-28 19:29:12 -04:00
|
|
|
|
OPTIMIZATIONS
|
|
|
|
|
|
|
|
|
|
BUG FIXES
|
|
|
|
|
|
2015-07-01 17:13:32 -04:00
|
|
|
|
YARN-3793. Several NPEs when deleting local files on NM recovery (Varun
|
|
|
|
|
Saxena via jlowe)
|
|
|
|
|
|
2015-07-02 14:08:21 -04:00
|
|
|
|
YARN-3508. Prevent processing preemption events on the main RM dispatcher.
|
|
|
|
|
(Varun Saxena via wangda)
|
|
|
|
|
|
2015-07-08 02:41:33 -04:00
|
|
|
|
YARN-3690. [JDK8] 'mvn site' fails. (Brahma Reddy Battula via aajisaka)
|
|
|
|
|
|
2015-07-17 12:02:11 -04:00
|
|
|
|
YARN-3905. Application History Server UI NPEs when accessing apps run after
|
|
|
|
|
RM restart (Eric Payne via jeagles)
|
|
|
|
|
|
2015-07-17 07:31:34 -04:00
|
|
|
|
YARN-3535. Scheduler must re-request container resources when RMContainer transitions
|
|
|
|
|
from ALLOCATED to KILLED (rohithsharma and peng.zhang via asuresh)
|
|
|
|
|
|
2015-07-21 18:05:41 -04:00
|
|
|
|
YARN-3878. AsyncDispatcher can hang while stopping if it is configured for
|
|
|
|
|
draining events on stop. (Varun Saxena via jianhe)
|
|
|
|
|
|
2015-07-24 16:38:44 -04:00
|
|
|
|
YARN-3969. Allow jobs to be submitted to reservation that is active
|
|
|
|
|
but does not have any allocations. (subru via curino)
|
|
|
|
|
|
2015-07-24 18:27:52 -04:00
|
|
|
|
YARN-3925. ContainerLogsUtils#getContainerLogFile fails to read container
|
|
|
|
|
log files from full disks. (zhihai xu via jlowe)
|
2015-07-24 16:38:44 -04:00
|
|
|
|
|
2015-08-18 13:36:40 -04:00
|
|
|
|
YARN-3857: Memory leak in ResourceManager with SIMPLE mode.
|
|
|
|
|
(mujunchao via zxu)
|
|
|
|
|
|
2015-09-02 05:52:48 -04:00
|
|
|
|
YARN-3893. Both RM in active state when Admin#transitionToActive failure
|
|
|
|
|
from refeshAll() (Bibin A Chundatt via rohithsharmaks)
|
|
|
|
|
|
2015-09-03 14:28:26 -04:00
|
|
|
|
YARN-4103. RM WebServices missing scheme for appattempts logLinks.
|
|
|
|
|
(Jonathan Eagles via vvasudeb)
|
|
|
|
|
|
2015-09-04 12:24:03 -04:00
|
|
|
|
YARN-4105. Capacity Scheduler headroom for DRF is wrong (Chang Li via
|
|
|
|
|
jlowe)
|
|
|
|
|
|
2015-09-08 15:29:54 -04:00
|
|
|
|
YARN-4096. App local logs are leaked if log aggregation fails to initialize
|
|
|
|
|
for the app. (Jason Lowe via zxu)
|
|
|
|
|
|
2015-09-14 05:48:31 -04:00
|
|
|
|
YARN-4153. TestAsyncDispatcher failed at branch-2.7 (Zhihai Xu via jianhe)
|
|
|
|
|
|
2015-09-13 21:07:43 -04:00
|
|
|
|
YARN-3697. FairScheduler: ContinuousSchedulingThread can fail to shutdown.
|
|
|
|
|
(Zhihai Xu via kasha)
|
|
|
|
|
|
2015-09-15 16:21:33 -04:00
|
|
|
|
YARN-4158. Remove duplicate close for LogWriter in
|
|
|
|
|
AppLogAggregatorImpl#uploadLogsForContainers (Zhihai Xu via jlowe)
|
|
|
|
|
|
2015-09-23 12:41:49 -04:00
|
|
|
|
YARN-3975. WebAppProxyServlet should not redirect to RM page if AHS is
|
|
|
|
|
enabled (Mit Desai via jlowe)
|
|
|
|
|
|
2015-09-24 18:01:17 -04:00
|
|
|
|
YARN-3624. ApplicationHistoryServer should not reverse the order of the
|
|
|
|
|
filters it gets. (Mit Desai via xgong)
|
2015-05-29 21:16:48 -04:00
|
|
|
|
|
2015-09-28 18:30:17 -04:00
|
|
|
|
YARN-4180. AMLauncher does not retry on failures when talking to NM.
|
|
|
|
|
(adhoot)
|
|
|
|
|
|
2015-10-02 16:19:14 -04:00
|
|
|
|
YARN-3619. ContainerMetrics unregisters during getMetrics and leads to
|
|
|
|
|
ConcurrentModificationException (Zhihai Xu via jlowe)
|
|
|
|
|
|
2015-10-07 00:05:10 -04:00
|
|
|
|
YARN-4209. RMStateStore FENCED state doesn’t work due to updateFencedState called
|
|
|
|
|
by stateMachine.doTransition. (Zhihai Xu via rohithsharmaks)
|
|
|
|
|
|
2015-10-21 09:43:25 -04:00
|
|
|
|
YARN-4281. 2.7 RM app page is broken (Chang Li via jlowe)
|
|
|
|
|
|
2015-10-21 19:36:37 -04:00
|
|
|
|
YARN-4000. RM crashes with NPE if leaf queue becomes parent queue during restart.
|
|
|
|
|
(Varun Saxena via jianhe)
|
|
|
|
|
|
2015-10-23 16:59:28 -04:00
|
|
|
|
YARN-4041. Slow delegation token renewal can severely prolong RM recovery
|
|
|
|
|
(Sunil G via jlowe)
|
|
|
|
|
|
2015-10-29 12:48:57 -04:00
|
|
|
|
YARN-2902. Killing a container that is localizing can orphan resources in
|
|
|
|
|
the DOWNLOADING state (Varun Saxena via jlowe)
|
|
|
|
|
|
2015-10-29 20:36:36 -04:00
|
|
|
|
YARN-4313. Race condition in MiniMRYarnCluster when getting history server
|
|
|
|
|
address. (Jian He via xgong)
|
|
|
|
|
|
2015-05-06 19:49:16 -04:00
|
|
|
|
YARN-3580. [JDK8] TestClientRMService.testGetLabelsToNodes fails. (Robert Kanter
|
|
|
|
|
via junping_du)
|
|
|
|
|
|
2015-10-30 03:25:44 -04:00
|
|
|
|
YARN-4312. TestSubmitApplicationWithRMHA fails on branch-2.7 and branch-2.6
|
|
|
|
|
as some of the test cases time out. (Varun Saxena via ozawa)
|
|
|
|
|
|
2015-10-30 04:51:39 -04:00
|
|
|
|
YARN-4320. TestJobHistoryEventHandler fails as AHS in MiniYarnCluster no longer
|
|
|
|
|
binds to default port 8188. (Varun Saxena via ozawa)
|
|
|
|
|
|
2015-11-02 14:22:30 -05:00
|
|
|
|
YARN-4321. Incessant retries if NoAuthException is thrown by Zookeeper in non
|
|
|
|
|
HA mode. (Varun Saxena via jianhe)
|
|
|
|
|
|
2015-11-03 15:59:06 -05:00
|
|
|
|
YARN-3136. getTransferredContainers can be a bottleneck during AM registration.
|
|
|
|
|
(Sunil G via jianhe)
|
|
|
|
|
|
2015-11-03 18:33:13 -05:00
|
|
|
|
YARN-4127. RM fail with noAuth error if switched from failover mode to non-failover
|
|
|
|
|
mode. (Varun Saxena via jianhe)
|
|
|
|
|
|
2015-11-16 10:02:56 -05:00
|
|
|
|
YARN-4354. Public resource localization fails with NPE. (Jason Lowe via
|
|
|
|
|
junping_du)
|
|
|
|
|
|
2015-08-18 13:36:40 -04:00
|
|
|
|
Release 2.7.1 - 2015-07-06
|
2015-04-09 16:53:35 -04:00
|
|
|
|
|
|
|
|
|
INCOMPATIBLE CHANGES
|
|
|
|
|
|
|
|
|
|
NEW FEATURES
|
|
|
|
|
|
|
|
|
|
IMPROVEMENTS
|
|
|
|
|
|
2015-03-17 13:22:15 -04:00
|
|
|
|
YARN-3243. CapacityScheduler should pass headroom from parent to children
|
|
|
|
|
to make sure ParentQueue obey its capacity limits. (Wangda Tan via jianhe)
|
|
|
|
|
|
2015-05-13 00:12:18 -04:00
|
|
|
|
YARN-3539. Updated timeline server documentation and marked REST APIs evolving.
|
|
|
|
|
(Steve Loughran via zjshen)
|
|
|
|
|
|
2015-05-28 13:19:36 -04:00
|
|
|
|
YARN-3723. Need to clearly document primaryFilter and otherInfo value type.
|
|
|
|
|
(Zhijie Shen via xgong)
|
|
|
|
|
|
2015-05-28 20:04:20 -04:00
|
|
|
|
YARN-3489. RMServerUtils.validateResourceRequests should only obtain queue
|
|
|
|
|
info once. (Varun Saxena via wangda)
|
|
|
|
|
|
2015-06-15 21:12:38 -04:00
|
|
|
|
YARN-3711. Documentation of ResourceManager HA should explain configurations
|
|
|
|
|
about listen addresses. (Masatake Iwasaki via ozawa)
|
|
|
|
|
|
2015-04-09 16:53:35 -04:00
|
|
|
|
OPTIMIZATIONS
|
|
|
|
|
|
2015-05-01 19:40:44 -04:00
|
|
|
|
YARN-3006. Improve the error message when attempting manual failover with
|
|
|
|
|
auto-failover enabled. (Akira AJISAKA via wangda)
|
|
|
|
|
|
2015-04-10 14:20:34 -04:00
|
|
|
|
YARN-3469. ZKRMStateStore: Avoid setting watches that are not required.
|
2015-04-13 16:52:28 -04:00
|
|
|
|
(Jun Gong via kasha)
|
2015-04-10 14:20:34 -04:00
|
|
|
|
|
2015-04-09 16:53:35 -04:00
|
|
|
|
BUG FIXES
|
2015-03-18 19:30:33 -04:00
|
|
|
|
|
2015-04-15 00:11:43 -04:00
|
|
|
|
YARN-3462. Patches applied for YARN-2424 are inconsistent between
|
|
|
|
|
trunk and branch-2. (Naganarasimha G R via harsh)
|
|
|
|
|
|
2015-04-20 13:38:27 -04:00
|
|
|
|
YARN-3497. ContainerManagementProtocolProxy modifies IPC timeout conf
|
|
|
|
|
without making a copy. (Jason Lowe via jianhe)
|
|
|
|
|
|
2015-04-23 04:22:09 -04:00
|
|
|
|
YARN-2605. [RM HA] Rest api endpoints doing redirect incorrectly.
|
|
|
|
|
(Xuan Gong via stevel)
|
|
|
|
|
|
2015-04-23 14:07:26 -04:00
|
|
|
|
YARN-3522. Fixed DistributedShell to instantiate TimeLineClient as the
|
|
|
|
|
correct user. (Zhijie Shen via jianhe)
|
|
|
|
|
|
2015-03-18 19:30:33 -04:00
|
|
|
|
YARN-3351. AppMaster tracking URL is broken in HA. (Anubhav Dhoot via kasha)
|
|
|
|
|
|
2015-04-13 13:53:34 -04:00
|
|
|
|
YARN-3382. Some of UserMetricsInfo metrics are incorrectly set to root
|
|
|
|
|
queue metrics. (Rohit Agarwal via jianhe)
|
|
|
|
|
|
2015-04-13 17:07:17 -04:00
|
|
|
|
YARN-3472. Fixed possible leak in DelegationTokenRenewer#allTokens.
|
|
|
|
|
(Rohith Sharmaks via jianhe)
|
|
|
|
|
|
2015-04-09 03:07:49 -04:00
|
|
|
|
YARN-3465. Use LinkedHashMap to preserve order of resource requests.
|
|
|
|
|
(Zhihai Xu via kasha)
|
|
|
|
|
|
2015-04-23 19:40:40 -04:00
|
|
|
|
YARN-3516. killing ContainerLocalizer action doesn't take effect when
|
|
|
|
|
private localizer receives FETCH_FAILURE status.(zhihai xu via xgong)
|
|
|
|
|
|
2015-04-29 00:00:35 -04:00
|
|
|
|
YARN-3485. FairScheduler headroom calculation doesn't consider
|
|
|
|
|
maxResources for Fifo and FairShare policies. (kasha)
|
2015-04-23 19:40:40 -04:00
|
|
|
|
|
2015-05-06 16:57:57 -04:00
|
|
|
|
YARN-3301. Fixed the format issue of the new RM attempt web page.
|
|
|
|
|
(Xuan Gong via jianhe)
|
|
|
|
|
|
2015-05-06 20:51:17 -04:00
|
|
|
|
YARN-3385. Fixed a race-condition in ResourceManager's ZooKeeper based
|
|
|
|
|
state-store to avoid crashing on duplicate deletes. (Zhihai Xu via vinodkv)
|
|
|
|
|
|
2015-05-08 02:44:10 -04:00
|
|
|
|
YARN-3358. Audit log not present while refreshing Service ACLs.
|
|
|
|
|
(Varun Saxena via devaraj)
|
|
|
|
|
|
2015-05-08 18:45:52 -04:00
|
|
|
|
YARN-3476. Nodemanager can fail to delete local logs if log aggregation
|
|
|
|
|
fails (Rohith via jlowe)
|
|
|
|
|
|
2015-05-11 18:13:39 -04:00
|
|
|
|
YARN-3434. Interaction between reservations and userlimit can result in
|
|
|
|
|
significant ULF violation. (Thomas Graves via wangda)
|
|
|
|
|
|
2015-05-13 16:10:53 -04:00
|
|
|
|
YARN-3626. On Windows localized resources are not moved to the front
|
|
|
|
|
of the classpath when they should be. (Craig Welch via xgong)
|
|
|
|
|
|
2015-05-13 15:19:02 -04:00
|
|
|
|
YARN-3457. NPE when NodeManager.serviceInit fails and stopRecoveryStore called.
|
|
|
|
|
(Bibin A Chundatt via ozawa)
|
|
|
|
|
|
2015-04-24 18:02:53 -04:00
|
|
|
|
YARN-3537. NPE when NodeManager.serviceInit fails and stopRecoveryStore
|
|
|
|
|
invoked (Brahma Reddy Battula via jlowe)
|
|
|
|
|
|
2015-05-19 12:56:01 -04:00
|
|
|
|
YARN-3601. Fix UT TestRMFailover.testRMWebAppRedirect. (Weiwei Yang via xgong)
|
|
|
|
|
|
2015-05-19 19:53:50 -04:00
|
|
|
|
YARN-3677. Fix findbugs warnings in yarn-server-resourcemanager.
|
|
|
|
|
(Vinod Kumar Vavilapalli via ozawa)
|
|
|
|
|
|
2015-05-20 17:42:59 -04:00
|
|
|
|
YARN-3681. yarn cmd says "could not find main class 'queue'" in windows.
|
|
|
|
|
(Craig Welch and Varun Saxena via xgong)
|
|
|
|
|
|
2015-05-20 20:06:52 -04:00
|
|
|
|
YARN-3609. Load node labels from storage inside RM serviceStart. (Wangda
|
|
|
|
|
Tan via jianhe)
|
|
|
|
|
|
2015-05-21 10:14:44 -04:00
|
|
|
|
YARN-3694. Fix dead link for TimelineServer REST API.
|
|
|
|
|
(Jagadesh Kiran N via aajisaka)
|
|
|
|
|
|
2015-05-21 10:44:44 -04:00
|
|
|
|
YARN-3646. Applications are getting stuck some times in case of retry
|
|
|
|
|
policy forever. (Raju Bairishetti via devaraj)
|
|
|
|
|
|
2015-05-21 16:38:30 -04:00
|
|
|
|
YARN-3675. FairScheduler: RM quits when node removal races with
|
|
|
|
|
continuous-scheduling on the same node. (Anubhav Dhoot via kasha)
|
|
|
|
|
|
2015-05-22 17:34:39 -04:00
|
|
|
|
YARN-3701. Isolating the error of generating a single app report when
|
|
|
|
|
getting all apps from generic history service. (Zhijie Shen via xgong)
|
|
|
|
|
|
2015-05-26 01:39:16 -04:00
|
|
|
|
YARN-2238. filtering on UI sticks even if I move away from the page.
|
|
|
|
|
(Jian He via xgong)
|
|
|
|
|
|
2015-05-26 18:58:47 -04:00
|
|
|
|
YARN-3686. CapacityScheduler should trim default_node_label_expression.
|
|
|
|
|
(Sunil G via wangda)
|
|
|
|
|
|
2015-06-02 13:28:14 -04:00
|
|
|
|
YARN-3753. RM failed to come up with "java.io.IOException: Wait for
|
|
|
|
|
ZKClient creation timed out”. (Jian He via xgong)
|
|
|
|
|
|
2015-06-04 13:52:07 -04:00
|
|
|
|
YARN-3764. CapacityScheduler should forbid moving LeafQueue from one parent
|
|
|
|
|
to another. (Wangda Tan via jianhe)
|
|
|
|
|
|
2015-06-17 19:27:01 -04:00
|
|
|
|
YARN-3804. Both RM are on standBy state when kerberos user not in yarn.admin.acl
|
|
|
|
|
(Varun Saxena via xgong)
|
|
|
|
|
|
2015-06-22 20:45:41 -04:00
|
|
|
|
YARN-3842. NMProxy should retry on NMNotYetReadyException.
|
|
|
|
|
(Robert Kanter via kasha)
|
|
|
|
|
|
2015-06-24 12:23:48 -04:00
|
|
|
|
YARN-3809. Failed to launch new attempts because
|
|
|
|
|
ApplicationMasterLauncher's threads all hang (Jun Gong via jlowe)
|
|
|
|
|
|
2015-04-20 23:16:58 -04:00
|
|
|
|
Release 2.7.0 - 2015-04-20
|
2014-09-30 13:26:42 -04:00
|
|
|
|
|
|
|
|
|
INCOMPATIBLE CHANGES
|
|
|
|
|
|
|
|
|
|
NEW FEATURES
|
2014-09-30 22:01:47 -04:00
|
|
|
|
|
|
|
|
|
YARN-2179. [YARN-1492] Initial cache manager structure and context.
|
|
|
|
|
(Chris Trezzo via kasha)
|
2014-09-30 13:26:42 -04:00
|
|
|
|
|
2014-10-09 20:16:06 -04:00
|
|
|
|
YARN-2180. [YARN-1492] In-memory backing store for cache manager.
|
|
|
|
|
(Chris Trezzo via kasha)
|
|
|
|
|
|
2014-10-25 13:31:06 -04:00
|
|
|
|
YARN-2183. [YARN-1492] Cleaner service for cache manager.
|
|
|
|
|
(Chris Trezzo and Sangjin Lee via kasha)
|
|
|
|
|
|
2014-10-31 16:00:42 -04:00
|
|
|
|
YARN-2186. [YARN-1492] Node Manager uploader service for cache manager.
|
|
|
|
|
(Chris Trezzo and Sangjin Lee via kasha)
|
|
|
|
|
|
2014-11-12 12:31:05 -05:00
|
|
|
|
YARN-2236. [YARN-1492] Shared Cache uploader service on the Node
|
2014-11-25 19:21:29 -05:00
|
|
|
|
Manager. (Chris Trezzo and Sangjin Lee via kasha)
|
|
|
|
|
|
|
|
|
|
YARN-2188. [YARN-1492] Client service for cache manager.
|
|
|
|
|
(Chris Trezzo and Sangjin Lee via kasha)
|
2014-11-12 12:31:05 -05:00
|
|
|
|
|
2014-12-04 20:36:32 -05:00
|
|
|
|
YARN-2189. [YARN-1492] Admin service for cache manager.
|
|
|
|
|
(Chris Trezzo via kasha)
|
|
|
|
|
|
2014-12-01 19:38:25 -05:00
|
|
|
|
YARN-2765. Added leveldb-based implementation for RMStateStore. (Jason Lowe
|
|
|
|
|
via jianhe)
|
2014-11-17 19:45:57 -05:00
|
|
|
|
|
2014-12-17 19:32:21 -05:00
|
|
|
|
YARN-2203. [YARN-1492] Web UI for cache manager. (Chris Trezzo via kasha)
|
|
|
|
|
|
2014-12-19 17:23:43 -05:00
|
|
|
|
YARN-2738. [YARN-2574] Add FairReservationSystem for FairScheduler.
|
|
|
|
|
(Anubhav Dhoot via kasha)
|
|
|
|
|
|
2015-01-05 18:11:45 -05:00
|
|
|
|
YARN-2881. [YARN-2574] Implement PlanFollower for FairScheduler.
|
|
|
|
|
(Anubhav Dhoot via kasha)
|
2014-12-30 22:52:43 -05:00
|
|
|
|
|
2015-01-06 17:32:09 -05:00
|
|
|
|
YARN-2427. Added the API of moving apps between queues in RM web services.
|
|
|
|
|
(Varun Vasudev via zjshen)
|
|
|
|
|
|
2015-01-15 00:43:47 -05:00
|
|
|
|
YARN-2217. [YARN-1492] Shared cache client side changes.
|
|
|
|
|
(Chris Trezzo via kasha)
|
|
|
|
|
|
2015-03-05 10:53:03 -05:00
|
|
|
|
YARN-2616 [YARN-913] Add CLI client to the registry to list, view
|
|
|
|
|
and manipulate entries. (Akshay Radia via stevel)
|
2015-02-11 09:18:46 -05:00
|
|
|
|
|
2015-02-12 23:08:13 -05:00
|
|
|
|
YARN-2994. Document work-preserving RM restart. (Jian He via ozawa)
|
|
|
|
|
|
2015-03-05 13:56:28 -05:00
|
|
|
|
YARN-2786. Created a yarn cluster CLI and seeded with one command for listing
|
|
|
|
|
node-labels collection. (Wangda Tan via vinodkv)
|
|
|
|
|
|
2014-09-30 13:26:42 -04:00
|
|
|
|
IMPROVEMENTS
|
|
|
|
|
|
2015-01-15 07:27:39 -05:00
|
|
|
|
YARN-3005. [JDK7] Use switch statement for String instead of if-else
|
|
|
|
|
statement in RegistrySecurity.java (Kengo Seki via aajisaka)
|
|
|
|
|
|
2014-12-12 20:40:11 -05:00
|
|
|
|
YARN-2950. Change message to mandate, not suggest JS requirement on UI.
|
|
|
|
|
(Dustin Cote via harsh)
|
|
|
|
|
|
2014-12-03 16:46:08 -05:00
|
|
|
|
YARN-2891. Failed Container Executor does not provide a clear error
|
|
|
|
|
message. (Dustin Cote via harsh)
|
|
|
|
|
|
2014-10-02 11:02:59 -04:00
|
|
|
|
YARN-1979. TestDirectoryCollection fails when the umask is unusual.
|
|
|
|
|
(Vinod Kumar Vavilapalli and Tsuyoshi OZAWA via junping_du)
|
|
|
|
|
|
2014-10-13 19:23:04 -04:00
|
|
|
|
YARN-2641. Decommission nodes on -refreshNodes instead of next
|
|
|
|
|
NM-RM heartbeat. (Zhihai Xu via kasha)
|
|
|
|
|
|
2014-10-29 13:24:57 -04:00
|
|
|
|
YARN-2742. FairSchedulerConfiguration should allow extra spaces
|
|
|
|
|
between value and unit. (Wei Yan via kasha)
|
|
|
|
|
|
2014-10-30 03:29:07 -04:00
|
|
|
|
YARN-2712. TestWorkPreservingRMRestart: Augment FS tests with
|
|
|
|
|
queue and headroom checks. (Tsuyoshi Ozawa via kasha)
|
|
|
|
|
|
2014-11-11 13:31:39 -05:00
|
|
|
|
YARN-2735. diskUtilizationPercentageCutoff and diskUtilizationSpaceCutoff
|
|
|
|
|
are initialized twice in DirectoryCollection. (Zhihai Xu via kasha)
|
|
|
|
|
|
2014-11-11 16:22:48 -05:00
|
|
|
|
YARN-570. Time strings are formated in different timezone.
|
|
|
|
|
(Akira Ajisaka and Peng Zhang via kasha)
|
|
|
|
|
|
2014-11-12 12:01:15 -05:00
|
|
|
|
YARN-2780. Log aggregated resource allocation in rm-appsummary.log (Eric
|
|
|
|
|
Payne via jlowe)
|
|
|
|
|
|
2014-11-17 19:45:57 -05:00
|
|
|
|
YARN-2690. [YARN-2574] Make ReservationSystem and its dependent classes
|
|
|
|
|
independent of Scheduler type. (Anubhav Dhoot via kasha)
|
|
|
|
|
|
2014-11-18 19:12:39 -05:00
|
|
|
|
YARN-2157. Added YARN metrics in the documentaion. (Akira AJISAKA via
|
|
|
|
|
jianhe)
|
|
|
|
|
|
2014-11-19 22:49:36 -05:00
|
|
|
|
YARN-2802. ClusterMetrics to include AM launch and register delays.
|
|
|
|
|
(Zhihai Xu via kasha)
|
|
|
|
|
|
2014-11-21 00:40:26 -05:00
|
|
|
|
YARN-2375. Allow enabling/disabling timeline server per framework.
|
|
|
|
|
(Mit Desai via jeagles)
|
|
|
|
|
|
2014-11-21 13:32:28 -05:00
|
|
|
|
YARN-2604. Scheduler should consider max-allocation-* in conjunction
|
|
|
|
|
with the largest node. (Robert Kanter via kasha)
|
|
|
|
|
|
2014-11-21 17:09:48 -05:00
|
|
|
|
YARN-2679. Add metric for container launch duration. (Zhihai Xu via kasha)
|
|
|
|
|
|
2014-11-21 19:04:32 -05:00
|
|
|
|
YARN-2669. FairScheduler: queue names shouldn't allow periods
|
|
|
|
|
(Wei Yan via Sandy Ryza)
|
2014-11-21 17:09:48 -05:00
|
|
|
|
|
2014-11-25 15:48:22 -05:00
|
|
|
|
YARN-2404. Removed ApplicationAttemptState and ApplicationState class in
|
|
|
|
|
RMStateStore. (Tsuyoshi OZAWA via jianhe)
|
|
|
|
|
|
2014-11-26 15:09:34 -05:00
|
|
|
|
YARN-2165. Added the sanity check for the numeric configuration values of
|
|
|
|
|
the timeline service. (Vasanth kumar RJ via zjshen)
|
|
|
|
|
|
2014-12-01 08:38:22 -05:00
|
|
|
|
YARN-2907. SchedulerNode#toString should print all resource detail instead
|
|
|
|
|
of only memory. (Rohith via junping_du)
|
|
|
|
|
|
2014-12-02 13:53:55 -05:00
|
|
|
|
YARN-2136. Changed RMStateStore to ignore store opearations when fenced.
|
|
|
|
|
(Varun Saxena via jianhe)
|
|
|
|
|
|
2014-12-03 07:11:18 -05:00
|
|
|
|
YARN-1156. Enhance NodeManager AllocatedGB and AvailableGB metrics
|
|
|
|
|
for aggregation of decimal values. (Tsuyoshi OZAWA via junping_du)
|
|
|
|
|
|
2014-12-05 16:06:48 -05:00
|
|
|
|
YARN-2056. Disable preemption at Queue level (Eric Payne via jlowe)
|
|
|
|
|
|
2014-12-16 14:00:25 -05:00
|
|
|
|
YARN-2762. Fixed RMAdminCLI to trim and check node-label related arguments
|
|
|
|
|
before sending to RM. (Rohith Sharmaks via jianhe)
|
|
|
|
|
|
2014-12-17 20:40:00 -05:00
|
|
|
|
YARN-2972. DelegationTokenRenewer thread pool never expands. (Jason Lowe
|
|
|
|
|
via junping_du)
|
|
|
|
|
|
2014-12-18 09:25:59 -05:00
|
|
|
|
YARN-2949. Add documentation for CGroups (Varun Vasudev via junping_du)
|
|
|
|
|
|
2014-12-23 21:23:45 -05:00
|
|
|
|
YARN-2970. NodeLabel operations in RMAdmin CLI get missing in help command.
|
|
|
|
|
(Varun Saxena via junping_du)
|
|
|
|
|
|
2014-12-23 21:23:57 -05:00
|
|
|
|
YARN-2837. Support TimeLine server to recover delegation token when
|
|
|
|
|
restarting. (Zhijie Shen via jianhe)
|
|
|
|
|
|
2014-12-26 09:59:25 -05:00
|
|
|
|
YARN-2993. Several fixes (missing acl check, error log msg ...) and some
|
|
|
|
|
refinement in AdminService. (Yi Liu via junping_du)
|
|
|
|
|
|
2014-12-30 18:35:45 -05:00
|
|
|
|
YARN-2943. Added node-labels page on RM web UI. (Wangda Tan via jianhe)
|
|
|
|
|
|
2014-12-30 22:52:43 -05:00
|
|
|
|
YARN-2998. Abstract out scheduler independent PlanFollower components.
|
|
|
|
|
(Anubhav Dhoot via kasha)
|
|
|
|
|
|
2014-08-29 20:15:38 -04:00
|
|
|
|
YARN-2360. Fair Scheduler: Display dynamic fair share for queues on the
|
|
|
|
|
scheduler page. (Ashwin Shankar and Wei Yan via kasha)
|
|
|
|
|
|
2015-01-07 19:20:04 -05:00
|
|
|
|
YARN-2880. Added a test to make sure node labels will be recovered
|
|
|
|
|
if RM restart is enabled. (Rohith Sharmaks via jianhe)
|
2014-12-30 22:52:43 -05:00
|
|
|
|
|
2015-01-08 12:47:02 -05:00
|
|
|
|
YARN-2996. Improved synchronization and I/O operations of FS- and Mem-
|
|
|
|
|
RMStateStore. (Yi Liu via zjshen)
|
|
|
|
|
|
2015-01-09 20:46:36 -05:00
|
|
|
|
YARN-2956. Added missing links in YARN documentation. (Masatake Iwasaki via
|
|
|
|
|
jianhe)
|
|
|
|
|
|
2015-01-12 14:57:57 -05:00
|
|
|
|
YARN-2957. Create unit test to automatically compare YarnConfiguration
|
|
|
|
|
and yarn-default.xml. (rchiang via rkanter)
|
|
|
|
|
|
2015-01-12 20:51:00 -05:00
|
|
|
|
YARN-2643. Don't create a new DominantResourceCalculator on every
|
|
|
|
|
FairScheduler.allocate call. (kasha via rkanter)
|
|
|
|
|
|
2015-01-13 21:20:57 -05:00
|
|
|
|
YARN-3019. Make work-preserving-recovery the default mechanism for RM
|
|
|
|
|
recovery. (Jian He via junping_du)
|
|
|
|
|
|
2015-01-14 14:04:03 -05:00
|
|
|
|
YARN-2807. Option "--forceactive" not works as described in usage of
|
|
|
|
|
"yarn rmadmin -transitionToActive". (Masatake Iwasaki via xgong)
|
|
|
|
|
|
2015-01-16 19:14:04 -05:00
|
|
|
|
YARN-2984. Metrics for container's actual memory usage. (kasha)
|
|
|
|
|
|
2015-01-23 06:37:05 -05:00
|
|
|
|
YARN-2800. Remove MemoryNodeLabelsStore and add a way to enable/disable
|
|
|
|
|
node labels feature. (Wangda Tan via ozawa)
|
|
|
|
|
|
2015-01-27 10:15:34 -05:00
|
|
|
|
YARN-3086. Make NodeManager memory configurable in MiniYARNCluster.
|
|
|
|
|
(Robert Metzger via ozawa)
|
|
|
|
|
|
2015-01-27 17:06:39 -05:00
|
|
|
|
YARN-2897. CrossOriginFilter needs more log statements (Mit Desai via
|
|
|
|
|
jeagles)
|
|
|
|
|
|
2015-01-27 18:23:45 -05:00
|
|
|
|
YARN-3028. Better syntax for replaceLabelsOnNode in RMAdmin CLI
|
|
|
|
|
(Rohith Sharmaks via wangda)
|
|
|
|
|
|
2015-01-27 18:36:09 -05:00
|
|
|
|
YARN-2932. Add entry for "preemptable" status (enabled/disabled) to
|
|
|
|
|
scheduler web UI and queue initialize/refresh logging.
|
|
|
|
|
(Eric Payne via wangda)
|
|
|
|
|
|
2015-01-29 17:51:38 -05:00
|
|
|
|
YARN-3108. ApplicationHistoryServer doesn't process -D arguments (Chang Li
|
|
|
|
|
via jeagles)
|
|
|
|
|
|
2015-02-02 15:03:20 -05:00
|
|
|
|
YARN-2808. Made YARN CLI list attempt’s finished containers of a running
|
|
|
|
|
application. (Naganarasimha G R via zjshen)
|
|
|
|
|
|
2015-02-03 09:56:34 -05:00
|
|
|
|
YARN-3085. Application summary should include the application type (Rohith
|
|
|
|
|
via jlowe)
|
|
|
|
|
|
2015-02-03 13:39:41 -05:00
|
|
|
|
YARN-3022. Expose Container resource information from NodeManager for
|
|
|
|
|
monitoring (adhoot via ranter)
|
|
|
|
|
|
2015-02-03 15:51:21 -05:00
|
|
|
|
YARN-3075. NodeLabelsManager implementation to retrieve label to node
|
|
|
|
|
mapping (Varun Saxena via wangda)
|
|
|
|
|
|
2015-02-03 16:20:41 -05:00
|
|
|
|
YARN-1393. SLS: Add how-to-use instructions. (Wei Yan via kasha)
|
|
|
|
|
|
2015-02-04 15:52:02 -05:00
|
|
|
|
YARN-1723. AMRMClientAsync missing blacklist addition and removal
|
|
|
|
|
functionality. (Bartosz Ługowski via sseth)
|
|
|
|
|
|
2015-02-04 19:02:52 -05:00
|
|
|
|
YARN-3123. Made YARN CLI show a single completed container even if the app
|
|
|
|
|
is running. (Naganarasimha G R via zjshen)
|
|
|
|
|
|
2015-02-05 14:28:49 -05:00
|
|
|
|
YARN-1582. Capacity Scheduler: add a maximum-allocation-mb setting per
|
|
|
|
|
queue (Thomas Graves via jlowe)
|
|
|
|
|
|
2015-02-06 02:48:39 -05:00
|
|
|
|
YARN-1904. Ensure exceptions thrown in ClientRMService &
|
|
|
|
|
ApplicationHistoryClientService are uniform when application-attempt is
|
|
|
|
|
not found. (zjshen via acmurthy)
|
|
|
|
|
|
2015-02-06 15:55:00 -05:00
|
|
|
|
YARN-3144. Configuration for making delegation token failures to timeline
|
|
|
|
|
server not-fatal (Jonathan Eagles via jlowe)
|
|
|
|
|
|
2015-02-09 20:20:25 -05:00
|
|
|
|
YARN-3155. Refactor the exception handling code for TimelineClientImpl's
|
|
|
|
|
retryOn method (Li Lu via wangda)
|
|
|
|
|
|
2015-02-09 23:34:56 -05:00
|
|
|
|
YARN-3100. Made YARN authorization pluggable. (Jian He via zjshen)
|
|
|
|
|
|
2015-02-11 09:26:22 -05:00
|
|
|
|
YARN-2683. [YARN-913] registry config options: document and move to
|
|
|
|
|
core-default. (stevel)
|
|
|
|
|
|
2015-02-12 01:17:38 -05:00
|
|
|
|
YARN-1237. Description for yarn.nodemanager.aux-services in
|
|
|
|
|
yarn-default.xml is misleading. (Brahma Reddy Battula via ozawa)
|
|
|
|
|
|
2015-02-12 09:48:43 -05:00
|
|
|
|
YARN-3157. Refactor the exception handling in ConverterUtils#to*Id.
|
|
|
|
|
(Bibin A Chundatt via ozawa)
|
|
|
|
|
|
2015-02-12 13:57:55 -05:00
|
|
|
|
YARN-3147. Clean up RM web proxy code. (Steve Loughran via xgong)
|
|
|
|
|
|
2015-02-12 14:46:47 -05:00
|
|
|
|
YARN-2079. Recover NonAggregatingLogHandler state upon nodemanager
|
|
|
|
|
restart. (Jason Lowe via junping_du)
|
|
|
|
|
|
2015-02-12 19:42:15 -05:00
|
|
|
|
YARN-3158. Correct log messages in ResourceTrackerService.
|
|
|
|
|
(Varun Saxena via xgong)
|
|
|
|
|
|
2015-02-12 20:31:45 -05:00
|
|
|
|
YARN-3179. Update use of Iterator to Iterable in RMAdminCLI and
|
|
|
|
|
CommonNodeLabelsManager. (Ray Chiang via xgong)
|
|
|
|
|
|
2015-02-13 00:21:21 -05:00
|
|
|
|
YARN-3182. Cleanup switch statement in ApplicationMasterLauncher#handle().
|
|
|
|
|
(Ray Chiang via ozawa)
|
|
|
|
|
|
2015-02-16 09:55:58 -05:00
|
|
|
|
YARN-3203. Correct a log message in AuxServices. (Brahma Reddy Battula
|
|
|
|
|
via ozawa)
|
|
|
|
|
|
2015-02-16 11:48:22 -05:00
|
|
|
|
YARN-1299. Improve a log message in AppSchedulingInfo by adding application
|
|
|
|
|
id. (Ashutosh Jindal and Devaraj K via ozawa)
|
|
|
|
|
|
2015-02-18 19:06:55 -05:00
|
|
|
|
YARN-1514. Utility to benchmark ZKRMStateStore#loadState for RM HA.
|
|
|
|
|
(Tsuyoshi OZAWA via jianhe)
|
|
|
|
|
|
2015-02-19 14:00:57 -05:00
|
|
|
|
YARN-3076. Add API/Implementation to YarnClient to retrieve label-to-node
|
|
|
|
|
mapping. (Varun Saxena via wangda)
|
|
|
|
|
|
2015-02-20 12:43:39 -05:00
|
|
|
|
YARN-2799. Cleanup TestLogAggregationService based on the change in YARN-90.
|
|
|
|
|
(Zhihai Xu via junping_du)
|
|
|
|
|
|
2015-02-20 17:02:40 -05:00
|
|
|
|
YARN-3237. AppLogAggregatorImpl fails to log error cause.
|
|
|
|
|
(Rushabh S Shah via xgong)
|
|
|
|
|
|
2015-02-21 19:18:40 -05:00
|
|
|
|
YARN-3236. Cleanup RMAuthenticationFilter#AUTH_HANDLER_PROPERTY.
|
|
|
|
|
(zhihai xu via xgong)
|
|
|
|
|
|
2015-02-21 22:17:29 -05:00
|
|
|
|
YARN-2797. TestWorkPreservingRMRestart should use ParametrizedSchedulerTestBase
|
|
|
|
|
(Karthik Kambatla via xgong)
|
|
|
|
|
|
2015-02-24 01:34:06 -05:00
|
|
|
|
YARN-2797. Add -help to yarn logs and nodes CLI command.
|
|
|
|
|
(Jagadesh Kiran N via devaraj)
|
|
|
|
|
|
2015-02-26 10:22:46 -05:00
|
|
|
|
YARN-3217. Remove httpclient dependency from hadoop-yarn-server-web-proxy.
|
|
|
|
|
(Brahma Reddy Battula via ozawa).
|
|
|
|
|
|
2015-02-26 20:26:08 -05:00
|
|
|
|
YARN-3255. RM, NM, JobHistoryServer, and WebAppProxyServer's main()
|
|
|
|
|
should support generic options. (shv)
|
|
|
|
|
|
2015-02-27 10:56:44 -05:00
|
|
|
|
YARN-2820. Retry in FileSystemRMStateStore when FS's operations fail
|
|
|
|
|
due to IOException. (Zhihai Xu via ozawa)
|
|
|
|
|
|
2015-02-27 19:13:32 -05:00
|
|
|
|
YARN-3262. Surface application outstanding resource requests table
|
|
|
|
|
in RM web UI. (Jian He via wangda)
|
|
|
|
|
|
2015-03-02 17:39:49 -05:00
|
|
|
|
YARN-3281. Added RMStateStore to StateMachine visualization list.
|
|
|
|
|
(Chengbing Liu via jianhe)
|
|
|
|
|
|
2015-03-03 14:49:01 -05:00
|
|
|
|
YARN-3272. Surface container locality info in RM web UI.
|
|
|
|
|
(Jian He via wangda)
|
|
|
|
|
|
2015-03-03 19:42:06 -05:00
|
|
|
|
YARN-3285. (Backport YARN-3168) Convert branch-2 .apt.vm files of YARN to
|
|
|
|
|
markdown. (Masatake Iwasaki via jianhe)
|
|
|
|
|
|
2015-03-04 20:33:30 -05:00
|
|
|
|
YARN-3122. Metrics for container's actual CPU usage.
|
|
|
|
|
(Anubhav Dhoot via kasha)
|
|
|
|
|
|
2015-03-06 17:17:57 -05:00
|
|
|
|
YARN-2190. Added CPU and memory limit options to the default container
|
|
|
|
|
executor for Windows containers. (Chuan Liu via jianhe)
|
|
|
|
|
|
2015-03-08 17:47:35 -04:00
|
|
|
|
YARN-3296. Mark ResourceCalculatorProcessTree class as Public for configurable
|
|
|
|
|
resource monitoring. (Hitesh Shah via junping_du)
|
|
|
|
|
|
2015-03-10 13:54:08 -04:00
|
|
|
|
YARN-3187. Documentation of Capacity Scheduler Queue mapping based on user
|
|
|
|
|
or group. (Gururaj Shetty via jianhe)
|
|
|
|
|
|
2015-03-16 13:52:32 -04:00
|
|
|
|
YARN-2854. Updated the documentation of the timeline service and the generic
|
|
|
|
|
history service. (Naganarasimha G R via zjshen)
|
|
|
|
|
|
2015-03-18 01:05:23 -04:00
|
|
|
|
Backport part of YARN-3273 to rename
|
|
|
|
|
CapacitySchedulerLeafQueueInfo#aMResourceLimit to AMResourceLimit.
|
|
|
|
|
(Rohith via jianhe)
|
|
|
|
|
|
2015-03-20 13:24:13 -04:00
|
|
|
|
YARN-2777. Mark the end of individual log in aggregated log.
|
|
|
|
|
(Varun Saxena via xgong)
|
|
|
|
|
|
2015-03-18 00:28:58 -04:00
|
|
|
|
YARN-3273. Improve scheduler UI to facilitate scheduling analysis and
|
|
|
|
|
debugging. (Rohith Sharmaks via jianhe)
|
|
|
|
|
|
2014-09-30 13:26:42 -04:00
|
|
|
|
OPTIMIZATIONS
|
|
|
|
|
|
2015-02-09 01:48:10 -05:00
|
|
|
|
YARN-2990. FairScheduler's delay-scheduling always waits for node-local and
|
|
|
|
|
rack-local delays, even for off-rack-only requests. (kasha)
|
|
|
|
|
|
2014-09-30 13:26:42 -04:00
|
|
|
|
BUG FIXES
|
|
|
|
|
|
2015-01-19 07:20:43 -05:00
|
|
|
|
YARN-3071. Remove invalid char from sample conf in doc of FairScheduler.
|
|
|
|
|
(Masatake Iwasaki via aajisaka)
|
|
|
|
|
|
2014-10-01 18:47:40 -04:00
|
|
|
|
YARN-2254. TestRMWebServicesAppsModification should run against both
|
|
|
|
|
CS and FS. (Zhihai Xu via kasha)
|
|
|
|
|
|
2014-10-24 18:00:12 -04:00
|
|
|
|
YARN-2713. "RM Home" link in NM should point to one of the RMs in an
|
|
|
|
|
HA setup. (kasha)
|
|
|
|
|
|
2014-11-14 15:47:26 -05:00
|
|
|
|
YARN-2857. ConcurrentModificationException in ContainerLogAppender
|
|
|
|
|
(Mohammad Kamrul Islam via jlowe)
|
|
|
|
|
|
2014-11-14 20:24:09 -05:00
|
|
|
|
YARN-2432. RMStateStore should process the pending events before close.
|
|
|
|
|
(Varun Saxena via jianhe)
|
|
|
|
|
|
2014-11-15 15:05:25 -05:00
|
|
|
|
YARN-1703. Fixed ResourceManager web-proxy to close connections correctly.
|
|
|
|
|
(Rohith Sharma via vinodkv)
|
|
|
|
|
|
2014-11-18 19:04:31 -05:00
|
|
|
|
YARN-2870. Updated the command to run the timeline server in the document.
|
|
|
|
|
(Masatake Iwasaki via zjshen)
|
|
|
|
|
|
2014-11-19 17:44:25 -05:00
|
|
|
|
YARN-2878. Fix DockerContainerExecutor.apt.vm formatting. (Abin Shahab via
|
|
|
|
|
jianhe)
|
|
|
|
|
|
2014-11-19 23:15:40 -05:00
|
|
|
|
YARN-2315. FairScheduler: Set current capacity in addition to capacity.
|
|
|
|
|
(Zhihai Xu via kasha)
|
|
|
|
|
|
2014-11-24 17:58:59 -05:00
|
|
|
|
YARN-2697. Remove useless RMAuthenticationHandler. (Haosong Huang via zjshen)
|
|
|
|
|
|
2014-12-05 15:07:01 -05:00
|
|
|
|
YARN-2461. Fix PROCFS_USE_SMAPS_BASED_RSS_ENABLED property in
|
|
|
|
|
YarnConfiguration. (rchiang via rkanter)
|
|
|
|
|
|
2014-12-05 20:33:39 -05:00
|
|
|
|
YARN-2869. CapacityScheduler should trim sub queue names when parse
|
|
|
|
|
configuration. (Wangda Tan via jianhe)
|
|
|
|
|
|
2014-12-08 01:28:26 -05:00
|
|
|
|
YARN-2927. [YARN-1492] InMemorySCMStore properties are inconsistent.
|
|
|
|
|
(Ray Chiang via kasha)
|
|
|
|
|
|
2014-12-09 01:18:32 -05:00
|
|
|
|
YARN-2931. PublicLocalizer may fail until directory is initialized by
|
|
|
|
|
LocalizeRunner. (Anubhav Dhoot via kasha)
|
|
|
|
|
|
2014-12-09 19:47:24 -05:00
|
|
|
|
YARN-2930. Fixed TestRMRestart#testRMRestartRecoveringNodeLabelManager
|
|
|
|
|
intermittent failure. (Wangda Tan via jianhe)
|
|
|
|
|
|
2014-12-09 20:56:04 -05:00
|
|
|
|
YARN-2924. Fixed RMAdminCLI to not convert node labels to lower case.
|
|
|
|
|
(Wangda Tan via jianhe)
|
|
|
|
|
|
2014-12-12 02:04:43 -05:00
|
|
|
|
YARN-2243. Order of arguments for Preconditions.checkNotNull() is wrong in
|
|
|
|
|
SchedulerApplicationAttempt ctor. (devaraj)
|
|
|
|
|
|
2014-12-12 12:10:54 -05:00
|
|
|
|
YARN-2912 Jersey Tests failing with port in use. (varun saxena via stevel)
|
|
|
|
|
|
2014-12-15 04:13:21 -05:00
|
|
|
|
YARN-2356. yarn status command for non-existent application/application
|
|
|
|
|
attempt/container is too verbose. (Sunil G via devaraj)
|
|
|
|
|
|
2014-12-15 15:00:12 -05:00
|
|
|
|
YARN-2914. [YARN-1492] Potential race condition in Singleton implementation of
|
|
|
|
|
SharedCacheUploaderMetrics, CleanerMetrics, ClientSCMMetrics. (Varun Saxena via kasha)
|
|
|
|
|
|
2015-08-30 23:01:47 -04:00
|
|
|
|
YARN-2945. FSLeafQueue#assignContainer - document the reason for using both write and
|
2014-12-17 15:03:16 -05:00
|
|
|
|
read locks. (Tsuyoshi Ozawa via kasha)
|
|
|
|
|
|
2014-12-17 19:04:16 -05:00
|
|
|
|
YARN-2944. InMemorySCMStore can not be instantiated with ReflectionUtils#newInstance.
|
|
|
|
|
(Chris Trezzo via kasha)
|
|
|
|
|
|
2014-12-19 19:00:24 -05:00
|
|
|
|
YARN-2675. containersKilled metrics is not updated when the container is killed
|
|
|
|
|
during localization. (Zhihai Xu via kasha)
|
|
|
|
|
|
2014-12-20 15:17:50 -05:00
|
|
|
|
YARN-2975. FSLeafQueue app lists are accessed without required locks. (kasha)
|
|
|
|
|
|
2014-12-20 08:54:48 -05:00
|
|
|
|
YARN-2977. Fixed intermittent TestNMClient failure.
|
|
|
|
|
(Junping Du via ozawa)
|
|
|
|
|
|
2014-12-22 06:06:37 -05:00
|
|
|
|
YARN-2939. Fix new findbugs warnings in hadoop-yarn-common. (Li Lu via junping_du)
|
|
|
|
|
|
2014-12-23 23:04:33 -05:00
|
|
|
|
YARN-2940. Fix new findbugs warnings in rest of the hadoop-yarn components. (Li Lu
|
|
|
|
|
via junping_du)
|
|
|
|
|
|
2014-12-23 23:32:36 -05:00
|
|
|
|
YARN-2937. Fixed new findbugs warnings in hadoop-yarn-nodemanager. (Varun Saxena
|
|
|
|
|
via zjshen)
|
|
|
|
|
|
2014-12-24 01:14:29 -05:00
|
|
|
|
YARN-2946. Fixed potential deadlock in RMStateStore. (Rohith Sharmaks via
|
|
|
|
|
jianhe)
|
|
|
|
|
|
2014-12-24 22:48:24 -05:00
|
|
|
|
YARN-2988. Graph#save() may leak file descriptors. (Ted Yu via ozawa)
|
|
|
|
|
|
2014-12-29 12:59:35 -05:00
|
|
|
|
YARN-2938. Fixed new findbugs warnings in hadoop-yarn-resourcemanager and
|
|
|
|
|
hadoop-yarn-applicationhistoryservice. (Varun Saxena via zjshen)
|
|
|
|
|
|
2014-12-30 20:15:37 -05:00
|
|
|
|
YARN-2987. Fixed ClientRMService#getQueueInfo to check against queue and
|
|
|
|
|
app ACLs. (Varun Saxena via jianhe)
|
|
|
|
|
|
2015-01-02 14:08:47 -05:00
|
|
|
|
YARN-2991. Fixed DrainDispatcher to reuse the draining code path in
|
|
|
|
|
AsyncDispatcher. (Rohith Sharmaks via zjshen)
|
|
|
|
|
|
2015-01-05 16:33:07 -05:00
|
|
|
|
YARN-2958. Made RMStateStore not update the last sequence number when updating the
|
|
|
|
|
delegation token. (Varun Saxena via zjshen)
|
|
|
|
|
|
2015-01-07 13:57:06 -05:00
|
|
|
|
YARN-2230. Fixed few configs description in yarn-default.xml. (Vijay Bhat
|
|
|
|
|
via jianhe)
|
|
|
|
|
|
2015-01-07 17:12:07 -05:00
|
|
|
|
YARN-3010. Fixed findbugs warning in AbstractYarnScheduler. (Yi Liu via
|
|
|
|
|
jianhe)
|
|
|
|
|
|
2015-01-07 19:14:22 -05:00
|
|
|
|
YARN-2936. Changed YARNDelegationTokenIdentifier to set proto fields on
|
|
|
|
|
getProto method. (Varun Saxena via jianhe)
|
|
|
|
|
|
2015-01-09 20:49:53 -05:00
|
|
|
|
YARN-3014. Replaces labels on a host should update all NM's labels on that
|
|
|
|
|
host. (Wangda Tan via jianhe)
|
|
|
|
|
|
2015-01-12 13:47:52 -05:00
|
|
|
|
YARN-3027. Scheduler should use totalAvailable resource from node instead of
|
|
|
|
|
availableResource for maxAllocation. (adhoot via rkanter)
|
|
|
|
|
|
2015-01-15 14:07:43 -05:00
|
|
|
|
YARN-2861. Fixed Timeline DT secret manager to not reuse RM's configs.
|
|
|
|
|
(Zhijie Shen via jianhe)
|
|
|
|
|
|
2015-01-16 03:08:36 -05:00
|
|
|
|
YARN-3064. TestRMRestart/TestContainerResourceUsage/TestNodeManagerResync
|
|
|
|
|
failure with allocation timeout. (Jian He via junping_du)
|
|
|
|
|
|
2015-01-16 19:31:10 -05:00
|
|
|
|
YARN-2815. Excluded transitive dependency of JLine in hadoop-yarn-server-common.
|
|
|
|
|
(Ferdinand Xu via zjshen)
|
|
|
|
|
|
2015-01-19 02:08:06 -05:00
|
|
|
|
YARN-3070. TestRMAdminCLI#testHelp fails for transitionToActive command.
|
|
|
|
|
(Contributed by Junping Du)
|
|
|
|
|
|
2015-01-19 18:54:41 -05:00
|
|
|
|
YARN-3015. yarn classpath command should support same options as hadoop
|
|
|
|
|
classpath. (Contributed by Varun Saxena)
|
|
|
|
|
|
2015-01-19 19:48:50 -05:00
|
|
|
|
YARN-2933. Capacity Scheduler preemption policy should only consider capacity
|
|
|
|
|
without labels temporarily. (Mayank Bansal via wangda)
|
|
|
|
|
|
2015-01-20 17:42:41 -05:00
|
|
|
|
YARN-2731. Fixed RegisterApplicationMasterResponsePBImpl to properly invoke
|
|
|
|
|
maybeInitBuilder. (Carlo Curino via wangda)
|
|
|
|
|
|
2015-01-21 22:25:05 -05:00
|
|
|
|
YARN-3078. LogCLIHelpers lacks of a blank space before string 'does not exist'.
|
|
|
|
|
(Sam Liu via ozawa)
|
|
|
|
|
|
2015-01-23 02:04:18 -05:00
|
|
|
|
YARN-3082. Non thread safe access to systemCredentials in NodeHeartbeatResponse
|
|
|
|
|
processing. (Anubhav Dhoot via ozawa)
|
|
|
|
|
|
2015-01-26 10:40:21 -05:00
|
|
|
|
YARN-3088. LinuxContainerExecutor.deleteAsUser can throw NPE if native
|
|
|
|
|
executor returns an error (Eric Payne via jlowe)
|
|
|
|
|
|
2015-01-29 00:54:27 -05:00
|
|
|
|
YARN-3079. Scheduler should also update maximumAllocation when updateNodeResource.
|
|
|
|
|
(Zhihai Xu via wangda)
|
|
|
|
|
|
2015-01-29 14:42:05 -05:00
|
|
|
|
YARN-3029. FSDownload.unpack() uses local locale for FS case conversion, may not
|
|
|
|
|
work everywhere. (Varun Saxena via ozawa)
|
|
|
|
|
|
2015-01-30 20:34:49 -05:00
|
|
|
|
YARN-3077. Fixed RM to create zk root path recursively. (Chun Chen via jianhe)
|
|
|
|
|
|
2015-02-02 13:58:35 -05:00
|
|
|
|
YARN-3113. Release audit warning for Sorting icons.psd. (stevel via kihwal)
|
|
|
|
|
|
2015-02-03 18:12:54 -05:00
|
|
|
|
YARN-3056. Add verification for containerLaunchDuration
|
|
|
|
|
in TestNodeManagerMetrics. (zhihai xu via xgong)
|
|
|
|
|
|
2015-02-03 20:33:53 -05:00
|
|
|
|
YARN-2543. Made resource usage be published to the timeline server too.
|
|
|
|
|
(Naganarasimha G R via zjshen)
|
|
|
|
|
|
2015-02-03 21:41:14 -05:00
|
|
|
|
YARN-3058. Fix error message of tokens' activation delay configuration.
|
|
|
|
|
(Yi Liu via ozawa)
|
|
|
|
|
|
2015-02-05 12:35:47 -05:00
|
|
|
|
YARN-3101. In Fair Scheduler, fix canceling of reservations for exceeding
|
|
|
|
|
max share (Anubhav Dhoot via Sandy Ryza)
|
|
|
|
|
|
2015-02-05 18:13:57 -05:00
|
|
|
|
YARN-3149. Fix typo in message for invalid application id.
|
|
|
|
|
(Bibin A Chundatt via xgong)
|
|
|
|
|
|
2015-02-05 19:12:53 -05:00
|
|
|
|
YARN-3145. Fixed ConcurrentModificationException on CapacityScheduler
|
|
|
|
|
ParentQueue#getQueueUserAclInfo. (Tsuyoshi OZAWA via jianhe)
|
|
|
|
|
|
2015-02-06 02:58:52 -05:00
|
|
|
|
YARN-1537. Fix race condition in
|
|
|
|
|
TestLocalResourcesTrackerImpl.testLocalResourceCache. (xgong via acmurthy)
|
|
|
|
|
|
2015-02-06 15:39:01 -05:00
|
|
|
|
YARN-3089. LinuxContainerExecutor does not handle file arguments to
|
|
|
|
|
deleteAsUser (Eric Payne via jlowe)
|
|
|
|
|
|
2015-02-06 16:47:32 -05:00
|
|
|
|
YARN-3143. RM Apps REST API can return NPE or entries missing id and other
|
|
|
|
|
fields (jlowe)
|
|
|
|
|
|
2015-02-09 18:56:05 -05:00
|
|
|
|
YARN-2971. RM uses conf instead of token service address to renew timeline
|
|
|
|
|
delegation tokens (jeagles)
|
|
|
|
|
|
2015-02-10 11:54:21 -05:00
|
|
|
|
YARN-3090. DeletionService can silently ignore deletion task failures
|
|
|
|
|
(Varun Saxena via jlowe)
|
|
|
|
|
|
2015-02-10 12:27:21 -05:00
|
|
|
|
YARN-2809. Implement workaround for linux kernel panic when removing
|
|
|
|
|
cgroup (Nathan Roberts via jlowe)
|
|
|
|
|
|
2015-02-11 06:44:31 -05:00
|
|
|
|
YARN-3160. Fix non-atomic operation on nodeUpdateQueue in RMNodeImpl.
|
|
|
|
|
(Chengbing Liu via junping_du)
|
|
|
|
|
|
2015-02-11 11:33:43 -05:00
|
|
|
|
YARN-3074. Nodemanager dies when localizer runner tries to write to a full
|
|
|
|
|
disk (Varun Saxena via jlowe)
|
|
|
|
|
|
2015-02-12 00:19:48 -05:00
|
|
|
|
YARN-3151. On Failover tracking url wrong in application cli for
|
|
|
|
|
KILLED application (Rohith via xgong)
|
|
|
|
|
|
2015-02-12 06:38:54 -05:00
|
|
|
|
YARN-1580. Documentation error regarding "container-allocation.expiry-interval-ms"
|
|
|
|
|
(Brahma Reddy Battula via junping_du)
|
|
|
|
|
|
2015-02-12 19:02:24 -05:00
|
|
|
|
YARN-3104. Fixed RM to not generate new AMRM tokens on every heartbeat
|
|
|
|
|
between rolling and activation. (Jason Lowe via jianhe)
|
|
|
|
|
|
2015-02-12 20:56:59 -05:00
|
|
|
|
YARN-3191. Log object should be initialized with its own class. (Rohith via
|
|
|
|
|
aajisaka)
|
|
|
|
|
|
2015-02-13 00:39:16 -05:00
|
|
|
|
YARN-3164. RMAdmin command usage prints incorrect command name.
|
|
|
|
|
(Bibin A Chundatt via xgong)
|
|
|
|
|
|
2015-02-13 15:20:07 -05:00
|
|
|
|
YARN-2847. Linux native container executor segfaults if default banned
|
|
|
|
|
user detected (Olaf Flebbe via jlowe)
|
|
|
|
|
|
2015-02-14 00:58:50 -05:00
|
|
|
|
YARN-2899. Run TestDockerContainerExecutorWithMocks on Linux only.
|
|
|
|
|
(Ming Ma via cnauroth)
|
|
|
|
|
|
2015-02-15 09:46:32 -05:00
|
|
|
|
YARN-2749. Fix some testcases from TestLogAggregationService fails in trunk.
|
|
|
|
|
(Xuan Gong via junping_du)
|
|
|
|
|
|
2015-02-18 14:51:51 -05:00
|
|
|
|
YARN-3132. RMNodeLabelsManager should remove node from node-to-label mapping
|
|
|
|
|
when node becomes deactivated. (Wangda Tan via jianhe)
|
|
|
|
|
|
2015-02-18 20:24:07 -05:00
|
|
|
|
YARN-1615. Fix typos in description about delay scheduling. (Akira Ajisaka via
|
|
|
|
|
ozawa)
|
|
|
|
|
|
2015-02-19 18:42:39 -05:00
|
|
|
|
YARN-933. Fixed InvalidStateTransitonException at FINAL_SAVING state in
|
|
|
|
|
RMApp. (Rohith Sharmaks via jianhe)
|
|
|
|
|
|
2015-02-24 20:34:28 -05:00
|
|
|
|
YARN-3247. TestQueueMappings should use CapacityScheduler explicitly.
|
|
|
|
|
(Zhihai Xu via ozawa)
|
|
|
|
|
|
2015-02-26 05:15:41 -05:00
|
|
|
|
YARN-3256. TestClientToAMTokens#testClientTokenRace is not running against
|
|
|
|
|
all Schedulers even when using ParameterizedSchedulerTestBase.
|
|
|
|
|
(Anubhav Dhoot via devaraj)
|
|
|
|
|
|
2015-03-02 20:21:19 -05:00
|
|
|
|
YARN-3270. Fix node label expression not getting set in
|
|
|
|
|
ApplicationSubmissionContext (Rohit Agarwal via wangda)
|
|
|
|
|
|
2015-03-02 20:52:47 -05:00
|
|
|
|
YARN-3265. Fixed a deadlock in CapacityScheduler by always passing a queue's
|
|
|
|
|
available resource-limit from the parent queue. (Wangda Tan via vinodkv)
|
|
|
|
|
|
2015-03-04 13:04:22 -05:00
|
|
|
|
YARN-3131. YarnClientImpl should check FAILED and KILLED state in
|
|
|
|
|
submitApplication (Chang Li via jlowe)
|
2015-03-04 21:06:36 -05:00
|
|
|
|
|
2015-03-06 17:36:18 -05:00
|
|
|
|
YARN-3275. CapacityScheduler: Preemption happening on non-preemptable
|
|
|
|
|
queues (Eric Payne via jlowe)
|
|
|
|
|
|
2015-03-09 20:49:08 -04:00
|
|
|
|
YARN-3300. Outstanding_resource_requests table should not be shown in AHS.
|
|
|
|
|
(Xuan Gong via jianhe)
|
|
|
|
|
|
2015-03-11 02:02:24 -04:00
|
|
|
|
YARN-3295. Fix documentation nits found in markdown conversion.
|
|
|
|
|
(Masatake Iwasaki via ozawa)
|
|
|
|
|
|
2015-03-12 13:25:00 -04:00
|
|
|
|
YARN-3338. Exclude jline dependency from YARN. (Zhijie Shen via xgong)
|
|
|
|
|
|
2015-03-12 16:32:29 -04:00
|
|
|
|
YARN-3154. Added additional APIs in LogAggregationContext to avoid aggregating
|
|
|
|
|
running logs of application when rolling is enabled. (Xuan Gong via vinodkv)
|
|
|
|
|
|
2015-03-16 10:19:05 -04:00
|
|
|
|
YARN-1453. [JDK8] Fix Javadoc errors caused by incorrect or illegal tags in
|
|
|
|
|
doc comments. (Akira AJISAKA, Andrew Purtell, and Allen Wittenauer via ozawa)
|
|
|
|
|
|
2015-03-16 19:09:55 -04:00
|
|
|
|
YARN-3349. Treat all exceptions as failure in
|
|
|
|
|
TestFSRMStateStore#testFSRMStateStoreClientRetry. (Zhihai Xu via ozawa)
|
|
|
|
|
|
2015-03-20 01:27:21 -04:00
|
|
|
|
YARN-3379. Fixed missing data in localityTable and ResourceRequests table
|
|
|
|
|
in RM WebUI. (Xuan Gong via jianhe)
|
|
|
|
|
|
2015-03-23 11:25:30 -04:00
|
|
|
|
YARN-3384. TestLogAggregationService.verifyContainerLogs fails after
|
|
|
|
|
YARN-2777. (Naganarasimha G R via ozawa)
|
|
|
|
|
|
2015-03-23 13:45:50 -04:00
|
|
|
|
YARN-3336. FileSystem memory leak in DelegationTokenRenewer.
|
|
|
|
|
(Zhihai Xu via cnauroth)
|
|
|
|
|
|
2015-03-25 07:49:43 -04:00
|
|
|
|
YARN-2213. Change proxy-user cookie log in AmIpFilter to DEBUG.
|
|
|
|
|
(Varun Saxena via xgong)
|
|
|
|
|
|
2015-03-30 13:09:40 -04:00
|
|
|
|
YARN-3304. Cleaning up ResourceCalculatorProcessTree APIs for public use and
|
|
|
|
|
removing inconsistencies in the default values. (Junping Du and Karthik
|
|
|
|
|
Kambatla via vinodkv)
|
|
|
|
|
|
2015-04-01 16:47:54 -04:00
|
|
|
|
YARN-3430. Made headroom data available on app attempt page of RM WebUI.
|
|
|
|
|
(Xuan Gong via zjshen)
|
|
|
|
|
|
2015-04-10 09:52:34 -04:00
|
|
|
|
YARN-3466. Fix RM nodes web page to sort by node HTTP-address, #containers
|
|
|
|
|
and node-label column (Jason Lowe via wangda)
|
|
|
|
|
|
2016-02-02 21:19:08 -05:00
|
|
|
|
Release 2.6.5 - UNRELEASED
|
|
|
|
|
|
|
|
|
|
INCOMPATIBLE CHANGES
|
|
|
|
|
|
|
|
|
|
NEW FEATURES
|
|
|
|
|
|
|
|
|
|
IMPROVEMENTS
|
|
|
|
|
|
|
|
|
|
OPTIMIZATIONS
|
|
|
|
|
|
2016-02-17 23:55:21 -05:00
|
|
|
|
YARN-4690. Skip object allocation in FSAppAttempt#getResourceUsage when
|
|
|
|
|
possible (Ming Ma via sjlee)
|
|
|
|
|
|
2016-02-02 21:19:08 -05:00
|
|
|
|
BUG FIXES
|
|
|
|
|
|
2016-02-23 15:53:30 -05:00
|
|
|
|
YARN-2046. Out of band heartbeats are sent only on container kill and
|
|
|
|
|
possibly too early (Ming Ma via jlowe)
|
|
|
|
|
|
2016-02-24 12:29:41 -05:00
|
|
|
|
YARN-4722. AsyncDispatcher logs redundant event queue sizes (Jason Lowe via
|
|
|
|
|
sjlee)
|
|
|
|
|
|
2016-02-13 04:42:50 -05:00
|
|
|
|
Release 2.6.4 - 2016-02-11
|
2015-12-01 11:16:39 -05:00
|
|
|
|
|
|
|
|
|
INCOMPATIBLE CHANGES
|
|
|
|
|
|
|
|
|
|
NEW FEATURES
|
|
|
|
|
|
|
|
|
|
IMPROVEMENTS
|
|
|
|
|
|
|
|
|
|
OPTIMIZATIONS
|
|
|
|
|
|
|
|
|
|
BUG FIXES
|
|
|
|
|
|
2016-01-25 11:32:57 -05:00
|
|
|
|
YARN-4452. NPE when submit Unmanaged application. (Naganarasimha G R
|
|
|
|
|
via junping_du)
|
|
|
|
|
|
2016-01-12 10:59:14 -05:00
|
|
|
|
YARN-4414. Nodemanager connection errors are retried at multiple levels
|
|
|
|
|
(Chang Li via jlowe)
|
|
|
|
|
|
2016-01-22 16:58:12 -05:00
|
|
|
|
YARN-4598. Invalid event: RESOURCE_FAILED at
|
|
|
|
|
CONTAINER_CLEANEDUP_AFTER_KILL (tangshangwen via jlowe)
|
|
|
|
|
|
2016-01-04 02:12:12 -05:00
|
|
|
|
Release 2.6.3 - 2015-12-17
|
2015-10-30 10:55:33 -04:00
|
|
|
|
|
|
|
|
|
INCOMPATIBLE CHANGES
|
|
|
|
|
|
|
|
|
|
NEW FEATURES
|
|
|
|
|
|
|
|
|
|
IMPROVEMENTS
|
|
|
|
|
|
|
|
|
|
OPTIMIZATIONS
|
|
|
|
|
|
|
|
|
|
BUG FIXES
|
|
|
|
|
|
2015-11-11 02:13:08 -05:00
|
|
|
|
YARN-4241. Fix typo of property name in yarn-default.xml.
|
|
|
|
|
(Anthony Rojas via aajisaka)
|
|
|
|
|
|
2015-11-19 13:14:18 -05:00
|
|
|
|
YARN-2859. ApplicationHistoryServer binds to default port 8188 in MiniYARNCluster.
|
|
|
|
|
(Vinod Kumar Vavilapalli via xgong)
|
|
|
|
|
|
2015-11-23 15:47:12 -05:00
|
|
|
|
YARN-4344. NMs reconnecting with changed capabilities can lead to wrong
|
|
|
|
|
cluster resource calculations (Varun Vasudev via jlowe)
|
|
|
|
|
|
2015-11-23 17:00:27 -05:00
|
|
|
|
YARN-3925. ContainerLogsUtils#getContainerLogFile fails to read container
|
|
|
|
|
log files from full disks. (zhihai xu via jlowe)
|
|
|
|
|
|
2015-11-24 18:52:46 -05:00
|
|
|
|
YARN-4365. FileSystemNodeLabelStore should check for root dir existence on
|
|
|
|
|
startup (Kuhu Shukla via jlowe)
|
|
|
|
|
|
2015-12-07 23:31:23 -05:00
|
|
|
|
YARN-4348. ZKRMStateStore.syncInternal shouldn't wait for sync completion for
|
|
|
|
|
avoiding blocking ZK's event thread. (ozawa)
|
|
|
|
|
|
2015-12-08 17:25:16 -05:00
|
|
|
|
YARN-4424. Fix deadlock in RMAppImpl. (Jian he via wangda)
|
|
|
|
|
|
2015-12-09 02:23:58 -05:00
|
|
|
|
YARN-4434. NodeManager Disk Checker parameter documentation is not correct.
|
|
|
|
|
(Weiwei Yang via aajisaka)
|
|
|
|
|
|
2015-10-30 21:47:16 -04:00
|
|
|
|
Release 2.6.2 - 2015-10-28
|
2015-08-20 20:21:06 -04:00
|
|
|
|
|
|
|
|
|
INCOMPATIBLE CHANGES
|
|
|
|
|
|
|
|
|
|
NEW FEATURES
|
|
|
|
|
|
Moved CHANGES.txt entries to 2.6.2
YARN-2019, YARN-4092, YARN-4101, YARN-4087, YARN-3727, YARN-4005,
YARN-3780, YARN-3802, YARN-3896, YARN-3554, YARN-3194, YARN-3798
(cherry picked from commit 14f0e2787c7c590d8ec1fc52f437866f34b098bd)
Conflicts:
hadoop-yarn-project/CHANGES.txt
2015-10-21 10:15:10 -04:00
|
|
|
|
YARN-2019. Retrospect on decision of making RM crashed if any exception throw
|
|
|
|
|
in ZKRMStateStore. (Jian He via junping_du)
|
|
|
|
|
|
2015-08-20 20:21:06 -04:00
|
|
|
|
IMPROVEMENTS
|
|
|
|
|
|
Moved CHANGES.txt entries to 2.6.2
YARN-2019, YARN-4092, YARN-4101, YARN-4087, YARN-3727, YARN-4005,
YARN-3780, YARN-3802, YARN-3896, YARN-3554, YARN-3194, YARN-3798
(cherry picked from commit 14f0e2787c7c590d8ec1fc52f437866f34b098bd)
Conflicts:
hadoop-yarn-project/CHANGES.txt
2015-10-21 10:15:10 -04:00
|
|
|
|
YARN-4092. Fixed UI redirection to print useful messages when both RMs are
|
|
|
|
|
in standby mode. (Xuan Gong via jianhe)
|
|
|
|
|
|
|
|
|
|
YARN-4101. RM should print alert messages if Zookeeper and Resourcemanager
|
|
|
|
|
gets connection issue. (Xuan Gong via jianhe)
|
|
|
|
|
|
2015-08-20 20:21:06 -04:00
|
|
|
|
OPTIMIZATIONS
|
|
|
|
|
|
|
|
|
|
BUG FIXES
|
|
|
|
|
|
Moved CHANGES.txt entries to 2.6.2
YARN-2019, YARN-4092, YARN-4101, YARN-4087, YARN-3727, YARN-4005,
YARN-3780, YARN-3802, YARN-3896, YARN-3554, YARN-3194, YARN-3798
(cherry picked from commit 14f0e2787c7c590d8ec1fc52f437866f34b098bd)
Conflicts:
hadoop-yarn-project/CHANGES.txt
2015-10-21 10:15:10 -04:00
|
|
|
|
YARN-4087. Followup fixes after YARN-2019 regarding RM behavior when
|
|
|
|
|
state-store error occurs. (Jian He via xgong)
|
|
|
|
|
|
|
|
|
|
YARN-3554. Default value for maximum nodemanager connect wait time is too
|
|
|
|
|
high (Naganarasimha G R via jlowe)
|
|
|
|
|
|
|
|
|
|
YARN-3727. For better error recovery, check if the directory exists before
|
|
|
|
|
using it for localization. (Zhihai Xu via jlowe)
|
|
|
|
|
|
|
|
|
|
YARN-4005. Completed container whose app is finished is possibly not
|
|
|
|
|
removed from NMStateStore. (Jun Gong via jianhe)
|
|
|
|
|
|
|
|
|
|
YARN-3780. Should use equals when compare Resource in RMNodeImpl#ReconnectNodeTransition.
|
|
|
|
|
(zhihai xu via devaraj)
|
|
|
|
|
|
|
|
|
|
YARN-3802. Two RMNodes for the same NodeId are used in RM sometimes
|
|
|
|
|
after NM is reconnected. (zhihai xu via xgong)
|
|
|
|
|
|
|
|
|
|
YARN-3194. RM should handle NMContainerStatuses sent by NM while
|
|
|
|
|
registering if NM is Reconnected node (Rohith via jlowe)
|
|
|
|
|
|
|
|
|
|
YARN-3896. RMNode transitioned from RUNNING to REBOOTED because its response id
|
|
|
|
|
has not been reset synchronously. (Jun Gong via rohithsharmaks)
|
|
|
|
|
|
|
|
|
|
YARN-3798. ZKRMStateStore shouldn't create new session without occurrance of
|
|
|
|
|
SESSIONEXPIED. (ozawa and Varun Saxena)
|
|
|
|
|
|
2015-09-23 18:10:31 -04:00
|
|
|
|
Release 2.6.1 - 2015-09-23
|
2015-08-11 16:25:36 -04:00
|
|
|
|
|
|
|
|
|
INCOMPATIBLE CHANGES
|
|
|
|
|
|
|
|
|
|
NEW FEATURES
|
|
|
|
|
|
2015-09-10 16:45:57 -04:00
|
|
|
|
YARN-3249. Add a 'kill application' button to Resource Manager's Web UI.
|
|
|
|
|
(Ryu Kobayashi via ozawa)
|
|
|
|
|
|
2015-08-11 16:25:36 -04:00
|
|
|
|
IMPROVEMENTS
|
|
|
|
|
|
2015-09-10 16:45:57 -04:00
|
|
|
|
YARN-3230. Clarify application states on the web UI. (Jian He via wangda)
|
|
|
|
|
|
|
|
|
|
YARN-1809. Synchronize RM and TimeLineServer Web-UIs. (Zhijie Shen and
|
|
|
|
|
Xuan Gong via jianhe)
|
|
|
|
|
|
|
|
|
|
YARN-3092. Created a common ResourceUsage class to track labeled resource
|
|
|
|
|
usages in Capacity Scheduler. (Wangda Tan via jianhe)
|
|
|
|
|
|
|
|
|
|
YARN-3098. Created common QueueCapacities class in Capacity Scheduler to
|
|
|
|
|
track capacities-by-labels of queues. (Wangda Tan via jianhe)
|
|
|
|
|
|
|
|
|
|
YARN-2301. Improved yarn container command. (Naganarasimha G R via jianhe)
|
|
|
|
|
|
|
|
|
|
YARN-3978. Configurably turn off the saving of container info in Generic AHS
|
|
|
|
|
(Eric Payne via jeagles)
|
|
|
|
|
|
2015-09-23 18:01:29 -04:00
|
|
|
|
YARN-3248. Display count of nodes blacklisted by apps in the web UI.
|
|
|
|
|
(Varun Vasudev via xgong)
|
|
|
|
|
|
2015-08-11 16:25:36 -04:00
|
|
|
|
OPTIMIZATIONS
|
|
|
|
|
|
|
|
|
|
BUG FIXES
|
|
|
|
|
|
2015-09-10 16:45:57 -04:00
|
|
|
|
YARN-2856. Fixed RMAppImpl to handle ATTEMPT_KILLED event at ACCEPTED state
|
|
|
|
|
on app recovery. (Rohith Sharmaks via jianhe)
|
|
|
|
|
|
|
|
|
|
YARN-2816. NM fail to start with NPE during container recovery (Zhihai Xu
|
|
|
|
|
via jlowe)
|
|
|
|
|
|
|
|
|
|
YARN-2414. RM web UI: app page will crash if app is failed before any
|
|
|
|
|
attempt has been created (Wangda Tan via jlowe)
|
|
|
|
|
|
|
|
|
|
YARN-2865. Fixed RM to always create a new RMContext when transtions from
|
|
|
|
|
StandBy to Active. (Rohith Sharmaks via jianhe)
|
|
|
|
|
|
|
|
|
|
YARN-2906. CapacitySchedulerPage shows HTML tags for a queue's Active Users.
|
|
|
|
|
(Jason Lowe via jianhe)
|
|
|
|
|
|
|
|
|
|
YARN-2905. AggregatedLogsBlock page can infinitely loop if the aggregated
|
|
|
|
|
log file is corrupted (Varun Saxena via jlowe)
|
|
|
|
|
|
|
|
|
|
YARN-2890. MiniYARNCluster should start the timeline server based on the
|
|
|
|
|
configuration. (Mit Desai via zjshen)
|
|
|
|
|
|
|
|
|
|
YARN-2894. Fixed a bug regarding application view acl when RM fails over.
|
|
|
|
|
(Rohith Sharmaks via jianhe)
|
|
|
|
|
|
|
|
|
|
YARN-2874. Dead lock in "DelegationTokenRenewer" which blocks RM to execute
|
|
|
|
|
any further apps. (Naganarasimha G R via kasha)
|
|
|
|
|
|
|
|
|
|
YARN-2910. FSLeafQueue can throw ConcurrentModificationException.
|
|
|
|
|
(Wilfred Spiegelenburg via kasha)
|
|
|
|
|
|
|
|
|
|
YARN-2917. Fixed potential deadlock when system.exit is called in AsyncDispatcher
|
|
|
|
|
(Rohith Sharmaks via jianhe)
|
|
|
|
|
|
|
|
|
|
YARN-2964. RM prematurely cancels tokens for jobs that submit jobs (oozie)
|
|
|
|
|
(Jian He via jlowe)
|
|
|
|
|
|
|
|
|
|
YARN-1984. LeveldbTimelineStore does not handle db exceptions properly
|
|
|
|
|
(Varun Saxena via jlowe)
|
|
|
|
|
|
|
|
|
|
YARN-2952. Fixed incorrect version check in StateStore. (Rohith Sharmaks
|
|
|
|
|
via jianhe)
|
|
|
|
|
|
|
|
|
|
YARN-2340. Fixed NPE when queue is stopped during RM restart.
|
|
|
|
|
(Rohith Sharmaks via jianhe)
|
|
|
|
|
|
|
|
|
|
YARN-2992. ZKRMStateStore crashes due to session expiry. (Karthik Kambatla
|
|
|
|
|
via jianhe)
|
|
|
|
|
|
|
|
|
|
YARN-2922. ConcurrentModificationException in CapacityScheduler's LeafQueue.
|
|
|
|
|
(Rohith Sharmaks via ozawa)
|
|
|
|
|
|
|
|
|
|
YARN-2997. Fixed NodeStatusUpdater to not send alreay-sent completed
|
|
|
|
|
container statuses on heartbeat. (Chengbing Liu via jianhe)
|
|
|
|
|
|
|
|
|
|
YARN-3011. Possible IllegalArgumentException in ResourceLocalizationService
|
|
|
|
|
might lead NM to crash. (Varun Saxena via jianhe)
|
|
|
|
|
|
|
|
|
|
YARN-3103. AMRMClientImpl does not update AMRM token properly. (Jason Lowe
|
|
|
|
|
via jianhe)
|
|
|
|
|
|
|
|
|
|
YARN-3094. Reset timer for liveness monitors after RM recovery. (Jun Gong
|
|
|
|
|
via jianhe)
|
|
|
|
|
|
|
|
|
|
YARN-2246. Made the proxy tracking URL always be
|
|
|
|
|
http(s)://proxy addr:port/proxy/<appId> to avoid duplicate sections. (Devaraj
|
|
|
|
|
K via zjshen)
|
|
|
|
|
|
|
|
|
|
YARN-3207. Secondary filter matches entites which do not have the key being
|
|
|
|
|
filtered for. (Zhijie Shen via xgong)
|
|
|
|
|
|
|
|
|
|
YARN-3238. Connection timeouts to nodemanagers are retried at
|
|
|
|
|
multiple levels (Jason Lowe via xgong)
|
|
|
|
|
|
|
|
|
|
YARN-3239. WebAppProxy does not support a final tracking url which has
|
|
|
|
|
query fragments and params (Jian He via jlowe)
|
|
|
|
|
|
|
|
|
|
YARN-3222. Fixed RMNode to send scheduler events in sequential order when a
|
|
|
|
|
node reconnects. (Rohith Sharma K S via jianhe)
|
|
|
|
|
|
|
|
|
|
YARN-3231. FairScheduler: Changing queueMaxRunningApps interferes with pending
|
|
|
|
|
jobs. (Siqi Li via kasha)
|
|
|
|
|
|
|
|
|
|
YARN-3242. Asynchrony in ZK-close can lead to ZKRMStateStore watcher receiving
|
|
|
|
|
events for old client. (Zhihai Xu via kasha)
|
|
|
|
|
|
|
|
|
|
YARN-3227. Timeline renew delegation token fails when RM user's TGT is expired
|
|
|
|
|
(Zhijie Shen via xgong)
|
|
|
|
|
|
|
|
|
|
YARN-3287. Made TimelineClient put methods do as the correct login context.
|
|
|
|
|
(Daryn Sharp and Jonathan Eagles via zjshen)
|
|
|
|
|
|
|
|
|
|
YARN-3267. Timelineserver applies the ACL rules after applying the limit on
|
|
|
|
|
the number of records (Chang Li via jeagles)
|
|
|
|
|
|
|
|
|
|
YARN-3369. Missing NullPointer check in AppSchedulingInfo causes RM to die.
|
|
|
|
|
(Brahma Reddy Battula via wangda)
|
|
|
|
|
|
|
|
|
|
YARN-3393. Getting application(s) goes wrong when app finishes before
|
|
|
|
|
starting the attempt. (Zhijie Shen via xgong)
|
|
|
|
|
|
|
|
|
|
YARN-3055. Fixed ResourceManager's DelegationTokenRenewer to not stop token
|
|
|
|
|
renewal of applications part of a bigger workflow. (Daryn Sharp via vinodkv)
|
|
|
|
|
|
|
|
|
|
YARN-3493. RM fails to come up with error "Failed to load/recover state"
|
|
|
|
|
when mem settings are changed. (Jian He via wangda)
|
|
|
|
|
|
|
|
|
|
YARN-3487. CapacityScheduler scheduler lock obtained unnecessarily when
|
|
|
|
|
calling getQueue (Jason Lowe via wangda)
|
|
|
|
|
|
|
|
|
|
YARN-3024. LocalizerRunner should give DIE action when all resources are
|
|
|
|
|
localized. (Chengbing Liu via xgong)
|
|
|
|
|
|
|
|
|
|
YARN-3464. Race condition in LocalizerRunner kills localizer before
|
|
|
|
|
localizing all resources. (Zhihai Xu via kasha)
|
|
|
|
|
|
|
|
|
|
YARN-3641. NodeManager: stopRecoveryStore() shouldn't be skipped when
|
|
|
|
|
exceptions happen in stopping NM's sub-services. (Junping Du via jlowe)
|
|
|
|
|
|
|
|
|
|
YARN-3526. ApplicationMaster tracking URL is incorrectly redirected
|
|
|
|
|
on a QJM cluster. (Weiwei Yang via xgong)
|
|
|
|
|
|
|
|
|
|
YARN-2766. Made ApplicationHistoryManager return a sorted list of apps,
|
|
|
|
|
attempts and containers. (Robert Kanter via zjshen)
|
|
|
|
|
|
|
|
|
|
YARN-3700. Made generic history service load a number of latest applications
|
|
|
|
|
according to the parameter or the configuration. (Xuan Gong via zjshen)
|
|
|
|
|
|
|
|
|
|
YARN-2900. Application (Attempt and Container) Not Found in AHS results
|
|
|
|
|
in InternalServer Error (500). (Zhijie Shen and Mit Desai via xgong)
|
|
|
|
|
|
|
|
|
|
YARN-3725. App submission via REST API is broken in secure mode due to
|
|
|
|
|
Timeline DT service address is empty. (Zhijie Shen via wangda)
|
|
|
|
|
|
|
|
|
|
YARN-3585. NodeManager cannot exit on SHUTDOWN event triggered and NM
|
|
|
|
|
recovery is enabled (Rohith Sharmaks via jlowe)
|
|
|
|
|
|
|
|
|
|
YARN-3832. Resource Localization fails on a cluster due to existing cache
|
|
|
|
|
directories (Brahma Reddy Battula via jlowe)
|
|
|
|
|
|
|
|
|
|
YARN-3850. NM fails to read files from full disks which can lead to
|
|
|
|
|
container logs being lost and other issues (Varun Saxena via jlowe)
|
|
|
|
|
|
|
|
|
|
YARN-3990. AsyncDispatcher may overloaded with RMAppNodeUpdateEvent when
|
|
|
|
|
Node is connected/disconnected (Bibin A Chundatt via jlowe)
|
|
|
|
|
|
|
|
|
|
YARN-2637. Fixed max-am-resource-percent calculation in CapacityScheduler
|
|
|
|
|
when activating applications. (Craig Welch via jianhe)
|
|
|
|
|
|
|
|
|
|
YARN-3733. Fix DominantRC#compare() does not work as expected if
|
|
|
|
|
cluster resource is empty. (Rohith Sharmaks via wangda)
|
|
|
|
|
|
|
|
|
|
YARN-2920. Changed CapacityScheduler to kill containers on nodes where
|
|
|
|
|
node labels are changed. (Wangda Tan via jianhe)
|
|
|
|
|
|
|
|
|
|
YARN-2978. Fixed potential NPE while getting queue info. (Varun Saxena via
|
|
|
|
|
jianhe)
|
|
|
|
|
|
|
|
|
|
YARN-3099. Capacity Scheduler LeafQueue/ParentQueue should use ResourceUsage
|
|
|
|
|
to track used-resources-by-label.(Wangda Tan via jianhe)
|
|
|
|
|
|
|
|
|
|
YARN-2694. Ensure only single node label specified in ResourceRequest.
|
|
|
|
|
(Wangda Tan via jianhe)
|
|
|
|
|
|
|
|
|
|
YARN-3124. Fixed CS LeafQueue/ParentQueue to use QueueCapacities to track
|
|
|
|
|
capacities-by-label. (Wangda Tan via jianhe)
|
|
|
|
|
|
|
|
|
|
YARN-2918. RM should not fail on startup if queue's configured labels do
|
|
|
|
|
not exist in cluster-node-labels. (Wangda Tan via jianhe)
|
|
|
|
|
|
|
|
|
|
YARN-3999. RM hangs on draing events. (Jian He via xgong)
|
|
|
|
|
|
|
|
|
|
YARN-4047. ClientRMService getApplications has high scheduler lock contention.
|
|
|
|
|
(Jason Lowe via jianhe)
|
2015-04-08 17:13:10 -04:00
|
|
|
|
|
2015-09-23 16:40:37 -04:00
|
|
|
|
YARN-1884. Added nodeHttpAddress into ContainerReport and fixed the link to NM
|
|
|
|
|
web page. (Xuan Gong via zjshen)
|
|
|
|
|
|
|
|
|
|
YARN-3171. Sort by Application id, AppAttempt and ContainerID doesn't work
|
|
|
|
|
in ATS / RM web ui. (Naganarasimha G R via xgong)
|
|
|
|
|
|
|
|
|
|
YARN-3740. Fixed the typo in the configuration name:
|
|
|
|
|
APPLICATION_HISTORY_PREFIX_MAX_APPS. (Xuan Gong via zjshen)
|
|
|
|
|
|
|
|
|
|
YARN-3544. Got back AM logs link on the RM web UI for a completed app.
|
|
|
|
|
(Xuan Gong via zjshen)
|
|
|
|
|
|
2014-11-13 16:02:55 -05:00
|
|
|
|
Release 2.6.0 - 2014-11-18
|
2014-07-03 01:56:01 -04:00
|
|
|
|
|
|
|
|
|
INCOMPATIBLE CHANGES
|
|
|
|
|
|
|
|
|
|
NEW FEATURES
|
|
|
|
|
|
2014-11-12 00:28:11 -05:00
|
|
|
|
YARN-1964. Create Docker analog of the LinuxContainerExecutor in YARN. (Abin
|
|
|
|
|
Shahab via raviprak)
|
|
|
|
|
|
2014-07-09 16:03:18 -04:00
|
|
|
|
YARN-2131. Add a way to format the RMStateStore. (Robert Kanter via kasha)
|
|
|
|
|
|
2014-07-10 20:10:05 -04:00
|
|
|
|
YARN-1367. Changed NM to not kill containers on NM resync if RM work-preserving
|
|
|
|
|
restart is enabled. (Anubhav Dhoot via jianhe)
|
|
|
|
|
|
|
|
|
|
YARN-1366. Changed AMRMClient to re-register with RM and send outstanding requests
|
|
|
|
|
back to RM on work-preserving RM restart. (Rohith via jianhe)
|
|
|
|
|
|
|
|
|
|
YARN-2181. Added preemption info to logs and RM web UI. (Wangda Tan via
|
|
|
|
|
jianhe)
|
|
|
|
|
|
2014-08-04 09:35:49 -04:00
|
|
|
|
YARN-1354. Recover applications upon nodemanager restart. (Jason Lowe via
|
|
|
|
|
junping_du)
|
|
|
|
|
|
2014-08-12 07:02:38 -04:00
|
|
|
|
YARN-1337. Recover containers upon nodemanager restart. (Jason Lowe via
|
|
|
|
|
junping_du)
|
|
|
|
|
|
2014-08-13 16:31:18 -04:00
|
|
|
|
YARN-2277. Added cross-origin support for the timeline server web services.
|
|
|
|
|
(Jonathan Eagles via zjshen)
|
|
|
|
|
|
2014-08-15 02:02:16 -04:00
|
|
|
|
YARN-2378. Added support for moving applications across queues in
|
|
|
|
|
CapacityScheduler. (Subramaniam Venkatraman Krishnan via jianhe)
|
|
|
|
|
|
2014-08-18 02:10:14 -04:00
|
|
|
|
YARN-2411. Support simple user and group mappings to queues. (Ram Venkatesh
|
|
|
|
|
via jianhe)
|
|
|
|
|
|
2014-08-20 13:07:12 -04:00
|
|
|
|
YARN-2174. Enable HTTPs for the writer REST API of TimelineServer.
|
|
|
|
|
(Zhijie Shen via jianhe)
|
|
|
|
|
|
2014-08-22 12:00:57 -04:00
|
|
|
|
YARN-2393. FairScheduler: Add the notion of steady fair share.
|
|
|
|
|
(Wei Yan via kasha)
|
|
|
|
|
|
2014-08-30 04:17:13 -04:00
|
|
|
|
YARN-2395. FairScheduler: Preemption timeout should be configurable per
|
|
|
|
|
queue. (Wei Yan via kasha)
|
|
|
|
|
|
2014-09-03 13:27:36 -04:00
|
|
|
|
YARN-2394. FairScheduler: Configure fairSharePreemptionThreshold per queue.
|
|
|
|
|
(Wei Yan via kasha)
|
|
|
|
|
|
2014-09-10 21:19:53 -04:00
|
|
|
|
YARN-415. Capture aggregate memory allocation at the app-level for chargeback.
|
|
|
|
|
(Eric Payne & Andrey Klochkov via jianhe)
|
|
|
|
|
|
2014-09-10 22:22:52 -04:00
|
|
|
|
YARN-2440. Enabled Nodemanagers to limit the aggregate cpu usage across all
|
|
|
|
|
containers to a preconfigured limit. (Varun Vasudev via vinodkv)
|
|
|
|
|
|
2014-09-13 21:04:05 -04:00
|
|
|
|
YARN-2033. Merging generic-history into the Timeline Store
|
2014-09-11 22:04:51 -04:00
|
|
|
|
(Zhijie Shen via junping_du)
|
|
|
|
|
|
2014-09-13 21:04:05 -04:00
|
|
|
|
YARN-611. Added an API to let apps specify an interval beyond which AM
|
|
|
|
|
failures should be ignored towards counting max-attempts. (Xuan Gong via
|
|
|
|
|
vinodkv)
|
|
|
|
|
|
2014-09-16 13:14:46 -04:00
|
|
|
|
YARN-2531. Added a configuration for admins to be able to override app-configs
|
|
|
|
|
and enforce/not-enforce strict control of per-container cpu usage. (Varun
|
|
|
|
|
Vasudev via vinodkv)
|
|
|
|
|
|
2014-09-16 21:25:45 -04:00
|
|
|
|
YARN-1250. Generic history service should support application-acls. (Zhijie Shen
|
|
|
|
|
via junping_du)
|
|
|
|
|
|
2014-09-23 13:36:57 -04:00
|
|
|
|
YARN-2569. Added the log handling APIs for the long running services. (Xuan
|
|
|
|
|
Gong via zjshen)
|
|
|
|
|
|
2014-09-24 14:27:53 -04:00
|
|
|
|
YARN-2102. Added the concept of a Timeline Domain to handle read/write ACLs
|
|
|
|
|
on Timeline service event data. (Zhijie Shen via vinodkv)
|
|
|
|
|
|
2014-09-24 20:50:26 -04:00
|
|
|
|
YARN-2581. Passed LogAggregationContext to NM via ContainerTokenIdentifier.
|
|
|
|
|
(Xuan Gong via zjshen)
|
|
|
|
|
|
2014-10-01 12:53:44 -04:00
|
|
|
|
YARN-1063. Augmented Hadoop common winutils to have the ability to create
|
|
|
|
|
containers as domain users. (Remus Rusanu via vinodkv)
|
|
|
|
|
|
2014-10-01 19:47:47 -04:00
|
|
|
|
YARN-2613. Support retry in NMClient for rolling-upgrades. (Jian He via
|
|
|
|
|
junping_du)
|
|
|
|
|
|
2014-10-01 20:04:08 -04:00
|
|
|
|
YARN-1972. Added a secure container-executor for Windows. (Remus Rusanu via
|
|
|
|
|
vinodkv)
|
|
|
|
|
|
2014-10-01 20:51:16 -04:00
|
|
|
|
YARN-2446. Augmented Timeline service APIs to start taking in domains as a
|
|
|
|
|
parameter while posting entities and events. (Zhijie Shen via vinodkv)
|
|
|
|
|
|
2014-10-03 15:15:40 -04:00
|
|
|
|
YARN-2468. Enhanced NodeManager to support log handling APIs (YARN-2569) for
|
|
|
|
|
use by long running services. (Xuan Gong via vinodkv)
|
|
|
|
|
|
2014-10-03 20:05:57 -04:00
|
|
|
|
YARN-1051. Add a system for creating reservations of cluster capacity.
|
|
|
|
|
(see breakdown below)
|
|
|
|
|
|
2014-10-08 15:54:37 -04:00
|
|
|
|
YARN-913. Add a way to register long-lived services in a YARN cluster.
|
|
|
|
|
(stevel)
|
|
|
|
|
|
2014-10-09 14:26:26 -04:00
|
|
|
|
YARN-2493. Added user-APIs for using node-labels. (Wangda Tan via vinodkv)
|
|
|
|
|
|
2014-10-09 18:46:24 -04:00
|
|
|
|
YARN-2544. Added admin-API objects for using node-labels. (Wangda Tan via
|
|
|
|
|
vinodkv)
|
|
|
|
|
|
2014-10-10 14:44:21 -04:00
|
|
|
|
YARN-2494. Added NodeLabels Manager internal API and implementation. (Wangda
|
|
|
|
|
Tan via vinodkv)
|
|
|
|
|
|
2014-10-10 22:57:39 -04:00
|
|
|
|
YARN-2501. Enhanced AMRMClient library to support requests against node
|
|
|
|
|
labels. (Wangda Tan via vinodkv)
|
|
|
|
|
|
2014-10-15 00:50:46 -04:00
|
|
|
|
YARN-2656. Made RM web services authentication filter support proxy user.
|
|
|
|
|
(Varun Vasudev and Zhijie Shen via zjshen)
|
|
|
|
|
|
2014-10-15 21:33:06 -04:00
|
|
|
|
YARN-2496. Enhanced Capacity Scheduler to have basic support for allocating
|
|
|
|
|
resources based on node-labels. (Wangda Tan via vinodkv)
|
|
|
|
|
|
2014-10-18 15:07:40 -04:00
|
|
|
|
YARN-2500. Enhaced ResourceManager to support schedulers allocating resources
|
2014-10-15 21:33:06 -04:00
|
|
|
|
based on node-labels. (Wangda Tan via vinodkv)
|
|
|
|
|
|
2014-10-18 15:07:40 -04:00
|
|
|
|
YARN-2504. Enhanced RM Admin CLI to support management of node-labels.
|
|
|
|
|
(Wangda Tan via vinodkv)
|
|
|
|
|
|
2014-10-22 18:57:46 -04:00
|
|
|
|
YARN-2198. Remove the need to run NodeManager as privileged account for
|
|
|
|
|
Windows Secure Container Executor. (Remus Rusanu via jianhe)
|
|
|
|
|
|
2014-11-06 23:48:31 -05:00
|
|
|
|
YARN-2647. Added a queue CLI for getting queue information. (Sunil Govind via
|
|
|
|
|
vinodkv)
|
|
|
|
|
|
2014-11-07 18:40:22 -05:00
|
|
|
|
YARN-2632. Document NM Restart feature. (Junping Du and Vinod Kumar
|
|
|
|
|
Vavilapalli via jlowe)
|
|
|
|
|
|
2014-11-07 23:35:46 -05:00
|
|
|
|
YARN-2505. Supported get/add/remove/change labels in RM REST API. (Craig Welch
|
|
|
|
|
via zjshen)
|
|
|
|
|
|
2014-11-14 18:18:56 -05:00
|
|
|
|
YARN-2811. In Fair Scheduler, reservation fulfillments shouldn't ignore max
|
|
|
|
|
share (Siqi Li via Sandy Ryza)
|
|
|
|
|
|
2014-07-03 01:56:01 -04:00
|
|
|
|
IMPROVEMENTS
|
|
|
|
|
|
2014-07-03 10:19:18 -04:00
|
|
|
|
YARN-2242. Improve exception information on AM launch crashes. (Li Lu
|
|
|
|
|
via junping_du)
|
|
|
|
|
|
2014-07-14 17:37:36 -04:00
|
|
|
|
YARN-2274. FairScheduler: Add debug information about cluster capacity,
|
|
|
|
|
availability and reservations. (kasha)
|
|
|
|
|
|
2014-07-15 00:34:16 -04:00
|
|
|
|
YARN-2228. Augmented TimelineServer to load pseudo authentication filter when
|
|
|
|
|
authentication = simple. (Zhijie Shen via vinodkv)
|
|
|
|
|
|
2014-07-17 19:38:36 -04:00
|
|
|
|
YARN-1341. Recover NMTokens upon nodemanager restart. (Jason Lowe via
|
|
|
|
|
junping_du)
|
|
|
|
|
|
2014-07-18 17:44:40 -04:00
|
|
|
|
YARN-2208. AMRMTokenManager need to have a way to roll over AMRMToken. (xgong)
|
|
|
|
|
|
2014-07-21 01:00:56 -04:00
|
|
|
|
YARN-2323. FairShareComparator creates too many Resource objects (Hong Zhiguo
|
|
|
|
|
via Sandy Ryza)
|
|
|
|
|
|
2014-07-21 10:49:38 -04:00
|
|
|
|
YARN-2045. Data persisted in NM should be versioned (Junping Du via jlowe)
|
|
|
|
|
|
2014-07-21 23:04:22 -04:00
|
|
|
|
YARN-2013. The diagnostics is always the ExitCodeException stack when the container
|
|
|
|
|
crashes. (Tsuyoshi OZAWA via junping_du)
|
|
|
|
|
|
2014-07-22 13:50:44 -04:00
|
|
|
|
YARN-2295. Refactored DistributedShell to use public APIs of protocol records.
|
|
|
|
|
(Li Lu via jianhe)
|
|
|
|
|
|
2014-07-24 01:02:46 -04:00
|
|
|
|
YARN-1342. Recover container tokens upon nodemanager restart. (Jason Lowe via
|
|
|
|
|
devaraj)
|
|
|
|
|
|
2014-07-25 12:33:55 -04:00
|
|
|
|
YARN-2214. FairScheduler: preemptContainerPreCheck() in FSParentQueue delays
|
|
|
|
|
convergence towards fairness. (Ashwin Shankar via kasha)
|
|
|
|
|
|
2014-07-25 16:44:30 -04:00
|
|
|
|
YARN-2211. Persist AMRMToken master key in RMStateStore for RM recovery.
|
|
|
|
|
(Xuan Gong via jianhe)
|
|
|
|
|
|
2014-07-29 13:46:58 -04:00
|
|
|
|
YARN-2328. FairScheduler: Verify update and continuous scheduling threads are
|
|
|
|
|
stopped when the scheduler is stopped. (kasha)
|
|
|
|
|
|
2014-07-31 05:31:22 -04:00
|
|
|
|
YARN-2347. Consolidated RMStateVersion and NMDBSchemaVersion into Version in
|
|
|
|
|
yarn-server-common. (Junping Du via zjshen)
|
|
|
|
|
|
2014-07-31 17:29:01 -04:00
|
|
|
|
YARN-1994. Expose YARN/MR endpoints on multiple interfaces. (Craig Welch,
|
|
|
|
|
Milan Potocnik, Arpit Agarwal via xgong)
|
|
|
|
|
|
2014-08-01 19:46:26 -04:00
|
|
|
|
YARN-2343. Improve NMToken expire exception message. (Li Lu via jianhe)
|
|
|
|
|
|
2014-08-03 21:19:29 -04:00
|
|
|
|
YARN-2370. Fix comment in o.a.h.y.server.resourcemanager.schedulerAppSchedulingInfo
|
|
|
|
|
(Wenwu Peng via junping_du)
|
|
|
|
|
|
2014-08-06 01:56:34 -04:00
|
|
|
|
YARN-2298. Move TimelineClient to yarn-common project (Zhijie Shen via
|
|
|
|
|
junping_du)
|
|
|
|
|
|
2014-08-07 13:03:58 -04:00
|
|
|
|
YARN-2288. Made persisted data in LevelDB timeline store be versioned. (Junping Du
|
|
|
|
|
via zjshen)
|
|
|
|
|
|
2014-08-08 10:40:46 -04:00
|
|
|
|
YARN-2352. FairScheduler: Collect metrics on duration of critical methods that
|
|
|
|
|
affect performance. (kasha)
|
|
|
|
|
|
2014-08-08 17:37:35 -04:00
|
|
|
|
YARN-2212. ApplicationMaster needs to find a way to update the AMRMToken
|
|
|
|
|
periodically. (xgong)
|
|
|
|
|
|
2014-08-08 22:12:52 -04:00
|
|
|
|
YARN-2026. Fair scheduler: Consider only active queues for computing fairshare.
|
|
|
|
|
(Ashwin Shankar via kasha)
|
|
|
|
|
|
2014-08-09 14:48:15 -04:00
|
|
|
|
YARN-1954. Added waitFor to AMRMClient(Async). (Tsuyoshi Ozawa via zjshen)
|
|
|
|
|
|
2014-08-10 03:25:49 -04:00
|
|
|
|
YARN-2302. Refactor TimelineWebServices. (Zhijie Shen via junping_du)
|
|
|
|
|
|
2014-08-10 20:16:15 -04:00
|
|
|
|
YARN-2337. ResourceManager sets ClientRMService in RMContext multiple times.
|
|
|
|
|
(Zhihai Xu via kasha)
|
|
|
|
|
|
2014-08-11 14:25:51 -04:00
|
|
|
|
YARN-2138. Cleaned up notifyDone* APIs in RMStateStore. (Varun Saxena via
|
|
|
|
|
jianhe)
|
|
|
|
|
|
2014-08-12 14:30:57 -04:00
|
|
|
|
YARN-2373. Changed WebAppUtils to use Configuration#getPassword for
|
|
|
|
|
accessing SSL passwords. (Larry McCay via jianhe)
|
|
|
|
|
|
2014-08-12 17:39:17 -04:00
|
|
|
|
YARN-2317. Updated the document about how to write YARN applications. (Li Lu via
|
|
|
|
|
zjshen)
|
|
|
|
|
|
2014-08-12 19:04:06 -04:00
|
|
|
|
YARN-2399. FairScheduler: Merge AppSchedulable and FSSchedulerApp into
|
|
|
|
|
FSAppAttempt. (kasha)
|
|
|
|
|
|
2014-08-12 21:45:07 -04:00
|
|
|
|
YARN-1370. Fair scheduler to re-populate container allocation state.
|
|
|
|
|
(Anubhav Dhoot via kasha)
|
|
|
|
|
|
2014-08-14 17:48:27 -04:00
|
|
|
|
YARN-2197. Add a link to YARN CHANGES.txt in the left side of doc
|
|
|
|
|
(Akira AJISAKA via aw)
|
|
|
|
|
|
2014-08-14 17:54:02 -04:00
|
|
|
|
YARN-1918. Typo in description and error message for
|
|
|
|
|
'yarn.resourcemanager.cluster-id' (Anandha L Ranganathan via aw)
|
|
|
|
|
|
2014-08-15 20:02:17 -04:00
|
|
|
|
YARN-2389. Added functionality for schedulers to kill all applications in a
|
|
|
|
|
queue. (Subramaniam Venkatraman Krishnan via jianhe)
|
|
|
|
|
|
2014-08-27 04:43:58 -04:00
|
|
|
|
YARN-1326. RM should log using RMStore at startup time.
|
|
|
|
|
(Tsuyoshi Ozawa via kasha)
|
|
|
|
|
|
2014-08-27 13:02:45 -04:00
|
|
|
|
YARN-2182. Updated ContainerId#toString() to append RM Epoch number.
|
|
|
|
|
(Tsuyoshi OZAWA via jianhe)
|
|
|
|
|
|
2014-08-29 00:58:37 -04:00
|
|
|
|
YARN-2406. Move RM recovery related proto to
|
|
|
|
|
yarn_server_resourcemanager_recovery.proto. (Tsuyoshi Ozawa via jianhe)
|
|
|
|
|
|
2014-08-30 02:05:51 -04:00
|
|
|
|
YARN-1506. Changed RMNode/SchedulerNode to update resource with event
|
|
|
|
|
notification. (Junping Du via jianhe)
|
|
|
|
|
|
2014-09-04 12:53:52 -04:00
|
|
|
|
YARN-2509. Enable Cross Origin Filter for timeline server only and not all
|
|
|
|
|
Yarn servers (Mit Desai via jeagles)
|
|
|
|
|
|
2014-09-04 18:01:01 -04:00
|
|
|
|
YARN-2511. Allowed all origins by default when CrossOriginFilter is
|
|
|
|
|
enabled. (Jonathan Eagles via zjshen)
|
|
|
|
|
|
2014-09-05 20:42:40 -04:00
|
|
|
|
YARN-2508. Cross Origin configuration parameters prefix are not honored
|
|
|
|
|
(Mit Desai via jeagles)
|
|
|
|
|
|
2014-09-07 20:49:06 -04:00
|
|
|
|
YARN-2512. Allowed pattern matching for origins in CrossOriginFilter.
|
|
|
|
|
(Jonathan Eagles via zjshen)
|
|
|
|
|
|
2014-09-07 21:22:40 -04:00
|
|
|
|
YARN-2507. Documented CrossOriginFilter configurations for the timeline
|
|
|
|
|
server. (Jonathan Eagles via zjshen)
|
|
|
|
|
|
2014-09-07 21:25:44 -04:00
|
|
|
|
YARN-2515. Updated ConverterUtils#toContainerId to parse epoch.
|
|
|
|
|
(Tsuyoshi OZAWA via jianhe)
|
|
|
|
|
|
2014-09-08 17:48:21 -04:00
|
|
|
|
YARN-2448. Changed ApplicationMasterProtocol to expose RM-recognized resource
|
|
|
|
|
types to the AMs. (Varun Vasudev via vinodkv)
|
|
|
|
|
|
2014-09-12 01:19:00 -04:00
|
|
|
|
YARN-2538. Added logs when RM sends roll-overed AMRMToken to AM. (Xuan Gong
|
|
|
|
|
via zjshen)
|
|
|
|
|
|
2014-09-12 13:33:33 -04:00
|
|
|
|
YARN-2229. Changed the integer field of ContainerId to be long type.
|
|
|
|
|
(Tsuyoshi OZAWA via jianhe)
|
|
|
|
|
|
2014-09-12 16:41:31 -04:00
|
|
|
|
YARN-2547. Cross Origin Filter throws UnsupportedOperationException upon
|
|
|
|
|
destroy (Mit Desai via jeagles)
|
|
|
|
|
|
2014-09-17 18:12:17 -04:00
|
|
|
|
YARN-2557. Add a parameter "attempt_Failures_Validity_Interval" into
|
|
|
|
|
DistributedShell. (xgong)
|
|
|
|
|
|
2014-09-18 14:03:12 -04:00
|
|
|
|
YARN-2001. Added a time threshold for RM to wait before starting container
|
|
|
|
|
allocations after restart/failover. (Jian He via vinodkv)
|
|
|
|
|
|
2014-09-22 13:30:53 -04:00
|
|
|
|
YARN-1372. Ensure all completed containers are reported to the AMs across
|
|
|
|
|
RM restart. (Anubhav Dhoot via jianhe)
|
|
|
|
|
|
2014-09-22 19:09:52 -04:00
|
|
|
|
YARN-2539. FairScheduler: Set the default value for maxAMShare to 0.5.
|
|
|
|
|
(Wei Yan via kasha)
|
|
|
|
|
|
2014-09-23 02:49:39 -04:00
|
|
|
|
YARN-1959. Fix headroom calculation in FairScheduler.
|
|
|
|
|
(Anubhav Dhoot via kasha)
|
|
|
|
|
|
2014-09-26 14:06:04 -04:00
|
|
|
|
YARN-2577. Clarify ACL delimiter and how to configure ACL groups only
|
|
|
|
|
(Miklos Christine via aw)
|
|
|
|
|
|
2014-09-26 15:47:26 -04:00
|
|
|
|
YARN-2372. There are Chinese Characters in the FairScheduler's document
|
|
|
|
|
(Fengdong Yu via aw)
|
|
|
|
|
|
2014-09-26 20:47:16 -04:00
|
|
|
|
YARN-668. Changed NMTokenIdentifier/AMRMTokenIdentifier/ContainerTokenIdentifier
|
|
|
|
|
to use protobuf object as the payload. (Junping Du via jianhe)
|
|
|
|
|
|
2014-09-29 10:12:18 -04:00
|
|
|
|
YARN-1769. CapacityScheduler: Improve reservations (Thomas Graves via
|
|
|
|
|
jlowe)
|
|
|
|
|
|
2014-09-30 15:57:45 -04:00
|
|
|
|
YARN-2627. Added the info logs of attemptFailuresValidityInterval and number
|
|
|
|
|
of previous failed attempts. (Xuan Gong via zjshen)
|
|
|
|
|
|
2014-10-03 14:04:02 -04:00
|
|
|
|
YARN-2562. Changed ContainerId#toString() to be more readable. (Tsuyoshi
|
|
|
|
|
OZAWA via jianhe)
|
|
|
|
|
|
2014-10-06 13:46:37 -04:00
|
|
|
|
YARN-2615. Changed ClientToAMTokenIdentifier/RM(Timeline)DelegationTokenIdentifier
|
|
|
|
|
to use protobuf as payload. (Junping Du via jianhe)
|
|
|
|
|
|
2014-10-09 15:59:47 -04:00
|
|
|
|
YARN-2629. Made the distributed shell use the domain-based timeline ACLs.
|
|
|
|
|
(zjshen)
|
|
|
|
|
|
2014-10-10 03:10:39 -04:00
|
|
|
|
YARN-2583. Modified AggregatedLogDeletionService to be able to delete rolling
|
|
|
|
|
aggregated logs. (Xuan Gong via zjshen)
|
|
|
|
|
|
2014-10-15 18:27:47 -04:00
|
|
|
|
YARN-2312. Deprecated old ContainerId#getId API and updated MapReduce to
|
|
|
|
|
use ContainerId#getContainerId instead. (Tsuyoshi OZAWA via jianhe)
|
|
|
|
|
|
2014-10-16 19:37:21 -04:00
|
|
|
|
YARN-2621. Simplify the output when the user doesn't have the access for
|
|
|
|
|
getDomain(s). (Zhijie Shen via jianhe)
|
|
|
|
|
|
2014-10-17 19:35:13 -04:00
|
|
|
|
YARN-1879. Marked Idempotent/AtMostOnce annotations to ApplicationMasterProtocol
|
|
|
|
|
for RM fail over. (Tsuyoshi OZAWA via jianhe)
|
|
|
|
|
|
2014-10-18 01:02:50 -04:00
|
|
|
|
YARN-2676. Enhanced Timeline auth-filter to support proxy users. (Zhijie Shen
|
|
|
|
|
via vinodkv)
|
|
|
|
|
|
2014-10-20 15:20:39 -04:00
|
|
|
|
YARN-2673. Made timeline client put APIs retry if ConnectException happens.
|
|
|
|
|
(Li Lu via zjshen)
|
|
|
|
|
|
2014-10-20 16:38:59 -04:00
|
|
|
|
YARN-2582. Fixed Log CLI and Web UI for showing aggregated logs of LRS. (Xuan
|
|
|
|
|
Gong via zjshen)
|
|
|
|
|
|
2014-10-21 13:29:22 -04:00
|
|
|
|
YARN-90. NodeManager should identify failed disks becoming good again
|
|
|
|
|
(Varun Vasudev via jlowe)
|
|
|
|
|
|
2014-10-21 19:06:39 -04:00
|
|
|
|
YARN-2709. Made timeline client getDelegationToken API retry if ConnectException
|
|
|
|
|
happens. (Li Lu via zjshen)
|
|
|
|
|
|
2014-10-24 01:27:25 -04:00
|
|
|
|
YARN-2682. Updated WindowsSecureContainerExecutor to not use
|
|
|
|
|
DefaultContainerExecutor#getFirstApplicationDir and use getWorkingDir()
|
|
|
|
|
instead. (Zhihai Xu via jianhe)
|
|
|
|
|
|
2014-10-24 00:56:03 -04:00
|
|
|
|
YARN-2209. Replaced AM resync/shutdown command with corresponding exceptions and
|
|
|
|
|
made related MR changes. (Jian He via zjshen)
|
|
|
|
|
|
2014-10-24 17:10:46 -04:00
|
|
|
|
YARN-2703. Added logUploadedTime into LogValue for better display. (Xuan Gong
|
|
|
|
|
via zjshen)
|
|
|
|
|
|
2014-10-27 18:49:47 -04:00
|
|
|
|
YARN-2704. Changed ResourceManager to optionally obtain tokens itself for the
|
|
|
|
|
sake of localization and log-aggregation for long-running services. (Jian He
|
|
|
|
|
via vinodkv)
|
|
|
|
|
|
2014-10-27 23:13:00 -04:00
|
|
|
|
YARN-2502. Changed DistributedShell to support node labels. (Wangda Tan via
|
|
|
|
|
jianhe)
|
|
|
|
|
|
2014-10-28 11:49:14 -04:00
|
|
|
|
YARN-2760. Remove 'experimental' from FairScheduler docs. (Harsh J via kasha)
|
|
|
|
|
|
2014-10-28 20:57:54 -04:00
|
|
|
|
YARN-2503. Added node lablels in web UI. (Wangda Tan via jianhe)
|
|
|
|
|
|
2014-10-31 02:16:19 -04:00
|
|
|
|
YARN-2779. Fixed ResourceManager to not require delegation tokens for
|
|
|
|
|
communicating with Timeline Service. (Zhijie Shen via vinodkv)
|
|
|
|
|
|
2014-10-31 13:11:59 -04:00
|
|
|
|
YARN-2778. Moved node-lables' reports to the yarn nodes CLI from the admin
|
|
|
|
|
CLI. (Wangda Tan via vinodkv)
|
|
|
|
|
|
2014-10-31 16:15:36 -04:00
|
|
|
|
YARN-2770. Added functionality to renew/cancel TimeLineDelegationToken.
|
|
|
|
|
(Zhijie Shen via jianhe)
|
|
|
|
|
|
2014-11-06 14:48:40 -05:00
|
|
|
|
YARN-2818. Removed the now unnecessary user entity injection from Timeline
|
|
|
|
|
service given we now have domains. (Zhijie Shen via vinodkv)
|
|
|
|
|
|
2014-11-13 13:27:47 -05:00
|
|
|
|
YARN-2635. TestRM, TestRMRestart, TestClientToAMTokens should run
|
|
|
|
|
with both CS and FS. (Wei Yan and kasha via kasha)
|
|
|
|
|
|
2014-08-29 20:15:38 -04:00
|
|
|
|
|
2014-07-03 01:56:01 -04:00
|
|
|
|
OPTIMIZATIONS
|
|
|
|
|
|
|
|
|
|
BUG FIXES
|
|
|
|
|
|
2014-07-04 07:20:43 -04:00
|
|
|
|
YARN-2251. Avoid negative elapsed time in JHS/MRAM web UI and services.
|
|
|
|
|
(Zhijie Shen via junping_du)
|
|
|
|
|
|
2014-07-10 20:10:05 -04:00
|
|
|
|
YARN-2088. Fixed a bug in GetApplicationsRequestPBImpl#mergeLocalToBuilder.
|
|
|
|
|
(Binglin Chang via jianhe)
|
|
|
|
|
|
2014-07-14 19:32:36 -04:00
|
|
|
|
YARN-2260. Fixed ResourceManager's RMNode to correctly remember containers
|
|
|
|
|
when nodes resync during work-preserving RM restart. (Jian He via vinodkv)
|
|
|
|
|
|
2014-07-16 14:27:09 -04:00
|
|
|
|
YARN-2264. Fixed a race condition in DrainDispatcher which may cause random
|
|
|
|
|
test failures. (Li Lu via jianhe)
|
|
|
|
|
|
2014-07-16 20:15:28 -04:00
|
|
|
|
YARN-2219. Changed ResourceManager to avoid AMs and NMs getting exceptions
|
|
|
|
|
after RM recovery but before scheduler learns about apps and app-attempts.
|
|
|
|
|
(Jian He via vinodkv)
|
|
|
|
|
|
2014-07-18 20:20:16 -04:00
|
|
|
|
YARN-2244. FairScheduler missing handling of containers for unknown
|
|
|
|
|
application attempts. (Anubhav Dhoot via kasha)
|
|
|
|
|
|
2014-07-21 18:08:12 -04:00
|
|
|
|
YARN-2321. NodeManager web UI can incorrectly report Pmem enforcement
|
|
|
|
|
(Leitao Guo via jlowe)
|
|
|
|
|
|
2014-07-22 18:45:05 -04:00
|
|
|
|
YARN-2273. NPE in ContinuousScheduling thread when we lose a node.
|
|
|
|
|
(Wei Yan via kasha)
|
|
|
|
|
|
2014-07-23 01:01:35 -04:00
|
|
|
|
YARN-2313. Livelock can occur in FairScheduler when there are lots of
|
|
|
|
|
running apps (Tsuyoshi Ozawa via Sandy Ryza)
|
|
|
|
|
|
2014-07-23 17:46:46 -04:00
|
|
|
|
YARN-2147. client lacks delegation token exception details when
|
|
|
|
|
application submit fails (Chen He via jlowe)
|
|
|
|
|
|
2014-07-25 21:52:25 -04:00
|
|
|
|
YARN-1796. container-executor shouldn't require o-r permissions (atm)
|
|
|
|
|
|
2014-07-30 00:00:54 -04:00
|
|
|
|
YARN-2354. DistributedShell may allocate more containers than client
|
|
|
|
|
specified after AM restarts. (Li Lu via jianhe)
|
|
|
|
|
|
2014-08-01 00:25:49 -04:00
|
|
|
|
YARN-2051. Fix bug in PBimpls and add more unit tests with reflection.
|
|
|
|
|
(Binglin Chang via junping_du)
|
|
|
|
|
|
2014-08-06 15:00:26 -04:00
|
|
|
|
YARN-2374. Fixed TestDistributedShell#testDSShell failure due to hostname
|
|
|
|
|
dismatch. (Varun Vasudev via jianhe)
|
|
|
|
|
|
2014-08-06 20:08:27 -04:00
|
|
|
|
YARN-2359. Application hangs when it fails to launch AM container.
|
|
|
|
|
(Zhihai Xu via kasha)
|
|
|
|
|
|
2014-08-07 01:38:58 -04:00
|
|
|
|
YARN-2388. Fixed TestTimelineWebServices failure due to HADOOP-10791. (zjshen)
|
|
|
|
|
|
2014-08-07 16:01:14 -04:00
|
|
|
|
YARN-2008. Fixed CapacityScheduler to calculate headroom based on max available
|
|
|
|
|
capacity instead of configured max capacity. (Craig Welch via jianhe)
|
|
|
|
|
|
2014-08-09 19:32:08 -04:00
|
|
|
|
YARN-2400. Fixed TestAMRestart fails intermittently. (Jian He via xgong)
|
|
|
|
|
|
2014-08-10 21:44:53 -04:00
|
|
|
|
YARN-2361. RMAppAttempt state machine entries for KILLED state has duplicate
|
|
|
|
|
event entries. (Zhihai Xu via kasha)
|
|
|
|
|
|
2014-08-13 17:09:07 -04:00
|
|
|
|
YARN-2070. Made DistributedShell publish the short user name to the timeline
|
|
|
|
|
server. (Robert Kanter via zjshen)
|
|
|
|
|
|
2014-08-14 17:19:21 -04:00
|
|
|
|
YARN-2397. Avoided loading two authentication filters for RM and TS web
|
|
|
|
|
interfaces. (Varun Vasudev via zjshen)
|
|
|
|
|
|
2014-08-19 13:50:48 -04:00
|
|
|
|
YARN-2409. RM ActiveToStandBy transition missing stoping previous rmDispatcher.
|
|
|
|
|
(Rohith via jianhe)
|
|
|
|
|
|
2014-08-19 16:40:37 -04:00
|
|
|
|
YARN-2249. Avoided AM release requests being lost on work preserving RM
|
|
|
|
|
restart. (Jian He via zjshen)
|
|
|
|
|
|
2014-08-20 13:40:55 -04:00
|
|
|
|
YARN-2034. Description for yarn.nodemanager.localizer.cache.target-size-mb
|
|
|
|
|
is incorrect (Chen He via jlowe)
|
|
|
|
|
|
2014-08-20 18:14:13 -04:00
|
|
|
|
YARN-1919. Potential NPE in EmbeddedElectorService#stop.
|
|
|
|
|
(Tsuyoshi Ozawa via kasha)
|
|
|
|
|
|
2014-08-21 10:57:53 -04:00
|
|
|
|
YARN-2424. LCE should support non-cgroups, non-secure mode (Chris Douglas
|
|
|
|
|
via aw)
|
|
|
|
|
|
2014-08-21 18:45:35 -04:00
|
|
|
|
YARN-2434. RM should not recover containers from previously failed attempt
|
|
|
|
|
when AM restart is not enabled (Jian He via jlowe)
|
|
|
|
|
|
2014-08-27 05:01:00 -04:00
|
|
|
|
YARN-2035. FileSystemApplicationHistoryStore should not make working dir
|
|
|
|
|
when it already exists. (Jonathan Eagles via zjshen)
|
|
|
|
|
|
2014-08-29 02:21:37 -04:00
|
|
|
|
YARN-2405. NPE in FairSchedulerAppsBlock. (Tsuyoshi Ozawa via kasha)
|
|
|
|
|
|
2014-08-29 12:40:39 -04:00
|
|
|
|
YARN-2449. Fixed the bug that TimelineAuthenticationFilterInitializer
|
|
|
|
|
is not automatically added when hadoop.http.filter.initializers is not
|
|
|
|
|
configured. (Varun Vasudev via zjshen)
|
|
|
|
|
|
2014-08-29 14:16:36 -04:00
|
|
|
|
YARN-2450. Fix typos in log messages. (Ray Chiang via hitesh)
|
|
|
|
|
|
2014-08-29 14:40:47 -04:00
|
|
|
|
YARN-2447. RM web service app submission doesn't pass secrets correctly.
|
|
|
|
|
(Varun Vasudev via jianhe)
|
|
|
|
|
|
2014-08-29 16:07:06 -04:00
|
|
|
|
YARN-2462. TestNodeManagerResync#testBlockNewContainerRequestsOnStartAndResync
|
|
|
|
|
should have a test timeout (Eric Payne via jlowe)
|
|
|
|
|
|
2014-09-04 17:11:27 -04:00
|
|
|
|
YARN-2431. NM restart: cgroup is not removed for reacquired containers
|
|
|
|
|
(jlowe)
|
|
|
|
|
|
2014-09-06 23:05:07 -04:00
|
|
|
|
YARN-2519. Credential Provider related unit tests failed on Windows.
|
|
|
|
|
(Xiaoyu Yao via cnauroth)
|
|
|
|
|
|
2014-09-09 18:13:07 -04:00
|
|
|
|
YARN-2526. SLS can deadlock when all the threads are taken by AMSimulators.
|
|
|
|
|
(Wei Yan via kasha)
|
|
|
|
|
|
2014-09-10 11:26:14 -04:00
|
|
|
|
YARN-1458. FairScheduler: Zero weight can lead to livelock.
|
|
|
|
|
(Zhihai Xu via kasha)
|
|
|
|
|
|
2014-09-10 14:51:57 -04:00
|
|
|
|
YARN-2459. RM crashes if App gets rejected for any reason
|
2014-09-10 18:19:38 -04:00
|
|
|
|
and HA is enabled. (Jian He and Mayank Bansal via xgong)
|
2014-09-10 14:51:57 -04:00
|
|
|
|
|
2014-09-10 15:47:34 -04:00
|
|
|
|
YARN-2158. Fixed TestRMWebServicesAppsModification#testSingleAppKill test
|
|
|
|
|
failure. (Varun Vasudev via jianhe)
|
|
|
|
|
|
2014-09-11 15:06:06 -04:00
|
|
|
|
YARN-2534. FairScheduler: Potential integer overflow calculating totalMaxShare.
|
|
|
|
|
(Zhihai Xu via kasha)
|
|
|
|
|
|
2014-09-12 00:31:09 -04:00
|
|
|
|
YARN-2541. Fixed ResourceManagerRest.apt.vm table syntax error. (jianhe)
|
|
|
|
|
|
2014-09-12 10:09:14 -04:00
|
|
|
|
YARN-2484. FileSystemRMStateStore#readFile/writeFile should close
|
|
|
|
|
FSData(In|Out)putStream in final block (Tsuyoshi OZAWA via jlowe)
|
|
|
|
|
|
2014-09-12 18:24:02 -04:00
|
|
|
|
YARN-2456. Possible livelock in CapacityScheduler when RM is recovering apps.
|
|
|
|
|
(Jian He via xgong)
|
|
|
|
|
|
2014-09-12 18:24:17 -04:00
|
|
|
|
YARN-2542. Fixed NPE when retrieving ApplicationReport from TimeLineServer.
|
|
|
|
|
(Zhijie Shen via jianhe)
|
|
|
|
|
|
2014-09-13 00:33:01 -04:00
|
|
|
|
YARN-2528. Relaxed http response split vulnerability protection for the origins
|
|
|
|
|
header and made it accept multiple origins in CrossOriginFilter. (Jonathan
|
|
|
|
|
Eagles via zjshen)
|
|
|
|
|
|
2014-09-15 14:53:57 -04:00
|
|
|
|
YARN-2549. TestContainerLaunch fails due to classpath problem with hamcrest
|
|
|
|
|
classes. (cnauroth)
|
|
|
|
|
|
2014-09-15 16:13:54 -04:00
|
|
|
|
YARN-2529. Generic history service RPC interface doesn't work when service
|
|
|
|
|
authorization is enabled. (Zhijie Shen via jianhe)
|
|
|
|
|
|
2014-09-17 18:12:17 -04:00
|
|
|
|
YARN-2558. Updated ContainerTokenIdentifier#read/write to use
|
|
|
|
|
ContainerId#getContainerId. (Tsuyoshi OZAWA via jianhe)
|
2014-09-16 14:01:26 -04:00
|
|
|
|
|
2014-09-18 00:44:15 -04:00
|
|
|
|
YARN-2559. Fixed NPE in SystemMetricsPublisher when retrieving
|
|
|
|
|
FinalApplicationStatus. (Zhijie Shen via jianhe)
|
|
|
|
|
|
2014-09-18 13:16:18 -04:00
|
|
|
|
YARN-1779. Fixed AMRMClient to handle AMRMTokens correctly across
|
|
|
|
|
ResourceManager work-preserving-restart or failover. (Jian He via vinodkv)
|
|
|
|
|
|
2014-09-18 16:13:16 -04:00
|
|
|
|
YARN-2363. Submitted applications occasionally lack a tracking URL (jlowe)
|
|
|
|
|
|
2014-09-18 17:34:40 -04:00
|
|
|
|
YARN-2561. MR job client cannot reconnect to AM after NM restart. (Junping
|
|
|
|
|
Du via jlowe)
|
|
|
|
|
|
2014-09-18 17:36:23 -04:00
|
|
|
|
YARN-2563. Fixed YarnClient to call getTimeLineDelegationToken only if the
|
|
|
|
|
Token is not present. (Zhijie Shen via jianhe)
|
|
|
|
|
|
2014-09-19 00:56:56 -04:00
|
|
|
|
YARN-2568. Fixed the potential test failures due to race conditions when RM
|
|
|
|
|
work-preserving recovery is enabled. (Jian He via zjshen)
|
|
|
|
|
|
2014-09-19 14:26:29 -04:00
|
|
|
|
YARN-2565. Fixed RM to not use FileSystemApplicationHistoryStore unless
|
|
|
|
|
explicitly set. (Zhijie Shen via jianhe)
|
|
|
|
|
|
2014-09-19 17:08:04 -04:00
|
|
|
|
YARN-2460. Remove obsolete entries from yarn-default.xml (Ray Chiang via
|
|
|
|
|
aw)
|
|
|
|
|
|
2014-09-21 16:14:01 -04:00
|
|
|
|
YARN-2452. TestRMApplicationHistoryWriter fails with FairScheduler.
|
|
|
|
|
(Zhihai Xu via kasha)
|
|
|
|
|
|
2014-09-22 02:13:45 -04:00
|
|
|
|
YARN-2453. TestProportionalCapacityPreemptionPolicy fails with
|
|
|
|
|
FairScheduler. (Zhihai Xu via kasha)
|
2014-09-22 18:40:47 -04:00
|
|
|
|
|
|
|
|
|
YARN-2540. FairScheduler: Queue filters not working on scheduler page in
|
|
|
|
|
RM UI. (Ashwin Shankar via kasha)
|
2014-09-22 02:13:45 -04:00
|
|
|
|
|
2014-09-23 01:45:06 -04:00
|
|
|
|
YARN-2584. TestContainerManagerSecurity fails on trunk. (Jian He via
|
|
|
|
|
junping_du)
|
|
|
|
|
|
2014-09-23 03:03:16 -04:00
|
|
|
|
YARN-2252. Intermittent failure of
|
|
|
|
|
TestFairScheduler.testContinuousScheduling.
|
|
|
|
|
(Ratandeep Ratti and kasha via kasha)
|
|
|
|
|
|
2014-09-24 11:48:42 -04:00
|
|
|
|
YARN-2161. Fix build on macosx: YARN parts (Binglin Chang via aw)
|
|
|
|
|
|
2014-09-24 18:23:31 -04:00
|
|
|
|
YARN-2596. TestWorkPreservingRMRestart fails with FairScheduler. (kasha)
|
|
|
|
|
|
2014-09-24 20:57:32 -04:00
|
|
|
|
YARN-2546. Made REST API for application creation/submission use numeric and
|
|
|
|
|
boolean types instead of the string of them. (Varun Vasudev via zjshen)
|
|
|
|
|
|
2014-09-25 18:39:57 -04:00
|
|
|
|
YARN-2523. ResourceManager UI showing negative value for "Decommissioned
|
|
|
|
|
Nodes" field (Rohith via jlowe)
|
|
|
|
|
|
2014-09-25 20:42:47 -04:00
|
|
|
|
YARN-2608. FairScheduler: Potential deadlocks in loading alloc files and
|
|
|
|
|
clock access. (Wei Yan via kasha)
|
|
|
|
|
|
2014-09-29 17:40:46 -04:00
|
|
|
|
YARN-2606. Application History Server tries to access hdfs before doing
|
|
|
|
|
secure login (Mit Desai via jeagles)
|
|
|
|
|
|
2014-09-29 14:33:44 -04:00
|
|
|
|
YARN-2610. Hamlet should close table tags. (Ray Chiang via kasha)
|
|
|
|
|
|
2014-09-30 18:37:28 -04:00
|
|
|
|
YARN-2387. Resource Manager crashes with NPE due to lack of
|
|
|
|
|
synchronization (Mit Desai via jlowe)
|
|
|
|
|
|
2014-09-30 19:12:27 -04:00
|
|
|
|
YARN-2594. Potential deadlock in RM when querying
|
|
|
|
|
ApplicationResourceUsageReport. (Wangda Tan via kasha)
|
|
|
|
|
|
2014-09-30 19:39:25 -04:00
|
|
|
|
YARN-2602. Fixed possible NPE in ApplicationHistoryManagerOnTimelineStore.
|
|
|
|
|
(Zhijie Shen via jianhe)
|
|
|
|
|
|
2014-10-01 18:38:11 -04:00
|
|
|
|
YARN-2630. Prevented previous AM container status from being acquired by the
|
|
|
|
|
current restarted AM. (Jian He via zjshen)
|
|
|
|
|
|
2014-10-02 13:03:14 -04:00
|
|
|
|
YARN-2617. Fixed NM to not send duplicate container status whose app is not
|
|
|
|
|
running. (Jun Gong via jianhe)
|
|
|
|
|
|
2014-10-02 13:39:34 -04:00
|
|
|
|
YARN-2624. Resource Localization fails on a cluster due to existing cache
|
|
|
|
|
directories (Anubhav Dhoot via jlowe)
|
|
|
|
|
|
2014-10-02 17:55:37 -04:00
|
|
|
|
YARN-2527. Fixed the potential NPE in ApplicationACLsManager and added test
|
|
|
|
|
cases for it. (Benoy Antony via zjshen)
|
|
|
|
|
|
2014-10-02 18:13:33 -04:00
|
|
|
|
YARN-2628. Capacity scheduler with DominantResourceCalculator carries out
|
|
|
|
|
reservation even though slots are free. (Varun Vasudev via jianhe)
|
|
|
|
|
|
2014-10-15 21:47:26 -04:00
|
|
|
|
YARN-2685. Fixed a bug in CommonNodeLabelsManager that caused wrong resource
|
|
|
|
|
tracking per label when a host runs multiple node-managers. (Wangda Tan via
|
|
|
|
|
vinodkv)
|
|
|
|
|
|
2014-10-17 11:58:08 -04:00
|
|
|
|
YARN-2699. Fixed a bug in CommonNodeLabelsManager that caused tests to fail
|
|
|
|
|
when using ephemeral ports on NodeIDs. (Wangda Tan via vinodkv)
|
|
|
|
|
|
2014-10-17 21:26:12 -04:00
|
|
|
|
YARN-2705. Fixed bugs in ResourceManager node-label manager that were causing
|
|
|
|
|
test-failures: added a dummy in-memory labels-manager. (Wangda Tan via
|
|
|
|
|
vinodkv)
|
|
|
|
|
|
2014-10-21 23:09:40 -04:00
|
|
|
|
YARN-2715. Fixed ResourceManager to respect common configurations for proxy
|
|
|
|
|
users/groups beyond just the YARN level config. (Zhijie Shen via vinodkv)
|
|
|
|
|
|
2014-10-26 14:14:34 -04:00
|
|
|
|
YARN-2743. Fixed a bug in ResourceManager that was causing RMDelegationToken
|
|
|
|
|
identifiers to be tampered and thus causing app submission failures in
|
|
|
|
|
secure mode. (Jian He via vinodkv)
|
|
|
|
|
|
2014-10-03 20:05:57 -04:00
|
|
|
|
BREAKDOWN OF YARN-1051 SUBTASKS AND RELATED JIRAS
|
|
|
|
|
|
|
|
|
|
YARN-1707. Introduce APIs to add/remove/resize queues in the
|
|
|
|
|
CapacityScheduler. (Carlo Curino and Subru Krishnan via curino)
|
|
|
|
|
|
|
|
|
|
YARN-2475. Logic for responding to capacity drops for the
|
|
|
|
|
ReservationSystem. (Carlo Curino and Subru Krishnan via curino)
|
|
|
|
|
|
|
|
|
|
YARN-1708. Public YARN APIs for creating/updating/deleting
|
|
|
|
|
reservations. (Subru Krishnan and Carlo Curino via subru)
|
|
|
|
|
|
|
|
|
|
YARN-1709. In-memory data structures used to track resources over
|
|
|
|
|
time to enable reservations. (Subru Krishnan and Carlo Curino via
|
|
|
|
|
subru)
|
|
|
|
|
|
|
|
|
|
YARN-1710. Logic to find allocations within a Plan that satisfy
|
|
|
|
|
user ReservationRequest(s). (Carlo Curino and Subru Krishnan via
|
|
|
|
|
curino)
|
|
|
|
|
|
|
|
|
|
YARN-1711. Policy to enforce instantaneous and over-time quotas
|
|
|
|
|
on user reservations. (Carlo Curino and Subru Krishnan via curino)
|
|
|
|
|
|
|
|
|
|
YARN-1712. Plan follower that synchronizes the current state of reservation
|
|
|
|
|
subsystem with the scheduler. (Subru Krishnan and Carlo Curino via subru)
|
|
|
|
|
|
|
|
|
|
YARN-2080. Integrating reservation system with ResourceManager and
|
|
|
|
|
client-RM protocol. (Subru Krishnan and Carlo Curino via subru)
|
|
|
|
|
|
|
|
|
|
MAPREDUCE-6103. Adding reservation APIs to MR resource manager
|
|
|
|
|
delegate. (Subru Krishnan and Carlo Curino via subru)
|
|
|
|
|
|
|
|
|
|
YARN-2576. Fixing compilation, javadocs and audit issues to pass
|
|
|
|
|
test patch in branch. (Subru Krishnan and Carlo Curino via subru)
|
|
|
|
|
|
|
|
|
|
YARN-2611. Fixing jenkins findbugs warning and TestRMWebServicesCapacitySched
|
|
|
|
|
for branch YARN-1051. (Subru Krishnan and Carlo Curino via subru)
|
|
|
|
|
|
2014-10-06 18:47:48 -04:00
|
|
|
|
YARN-2644. Fixed CapacityScheduler to return up-to-date headroom when
|
|
|
|
|
AM allocates. (Craig Welch via jianhe)
|
|
|
|
|
|
2014-10-07 16:43:12 -04:00
|
|
|
|
YARN-1857. CapacityScheduler headroom doesn't account for other AM's running.
|
|
|
|
|
(Chen He and Craig Welch via jianhe)
|
|
|
|
|
|
2014-10-08 13:58:51 -04:00
|
|
|
|
YARN-2649. Fixed TestAMRMRPCNodeUpdates test failure. (Ming Ma via jianhe)
|
|
|
|
|
|
2014-10-10 01:44:44 -04:00
|
|
|
|
YARN-2662. TestCgroupsLCEResourcesHandler leaks file descriptors. (cnauroth)
|
|
|
|
|
|
2014-10-08 15:54:37 -04:00
|
|
|
|
BREAKDOWN OF YARN-913 SUBTASKS AND RELATED JIRAS
|
|
|
|
|
|
|
|
|
|
YARN-2652 Add hadoop-yarn-registry package under hadoop-yarn. (stevel)
|
|
|
|
|
|
2014-10-11 21:32:47 -04:00
|
|
|
|
YARN-2668 yarn-registry JAR won't link against ZK 3.4.5. (stevel)
|
2014-10-16 17:21:38 -04:00
|
|
|
|
|
|
|
|
|
YARN-2689 TestSecureRMRegistryOperations failing on windows:
|
|
|
|
|
secure ZK won't start (stevel)
|
|
|
|
|
|
2014-10-22 09:34:57 -04:00
|
|
|
|
YARN-2692 ktutil test hanging on some machines/ktutil versions (stevel)
|
|
|
|
|
|
2014-10-22 16:12:52 -04:00
|
|
|
|
YARN-2700 TestSecureRMRegistryOperations failing on windows: auth problems
|
|
|
|
|
(stevel)
|
|
|
|
|
|
2014-10-30 18:32:08 -04:00
|
|
|
|
YARN-2677 registry punycoding of usernames doesn't fix all usernames to be
|
|
|
|
|
DNS-valid (stevel)
|
|
|
|
|
|
2014-11-06 15:21:25 -05:00
|
|
|
|
YARN-2768 Improved Yarn Registry service record structure (stevel)
|
|
|
|
|
|
2014-10-16 17:21:38 -04:00
|
|
|
|
---
|
2014-10-11 21:32:47 -04:00
|
|
|
|
|
2014-10-09 16:41:38 -04:00
|
|
|
|
YARN-2598 GHS should show N/A instead of null for the inaccessible information
|
|
|
|
|
(Zhijie Shen via mayank)
|
|
|
|
|
|
2014-10-09 23:57:29 -04:00
|
|
|
|
YARN-2671. Fixed ApplicationSubmissionContext to still set resource for
|
2014-10-09 20:57:50 -04:00
|
|
|
|
backward compatibility. (Wangda Tan via zjshen)
|
|
|
|
|
|
2014-10-13 11:37:50 -04:00
|
|
|
|
YARN-2667. Fix the release audit warning caused by hadoop-yarn-registry
|
|
|
|
|
(Yi Liu via jlowe)
|
|
|
|
|
|
2014-10-13 13:53:37 -04:00
|
|
|
|
YARN-2651. Spun off LogRollingInterval from LogAggregationContext. (Xuan Gong
|
|
|
|
|
via zjshen)
|
|
|
|
|
|
2014-10-13 14:31:16 -04:00
|
|
|
|
YARN-2377. Localization exception stack traces are not passed as
|
|
|
|
|
diagnostic info (Gera Shegalov via jlowe)
|
|
|
|
|
|
2014-10-13 17:19:28 -04:00
|
|
|
|
YARN-2308. Changed CapacityScheduler to explicitly throw exception if the
|
|
|
|
|
queue to which the apps were submitted is changed across RM restart.
|
|
|
|
|
(Craig Welch & Chang Li via jianhe)
|
|
|
|
|
|
2014-10-13 19:32:01 -04:00
|
|
|
|
YARN-2566. DefaultContainerExecutor should pick a working directory randomly.
|
|
|
|
|
(Zhihai Xu via kasha)
|
|
|
|
|
|
2014-10-17 13:54:24 -04:00
|
|
|
|
YARN-2588. Standby RM fails to transitionToActive if previous
|
|
|
|
|
transitionToActive failed with ZK exception. (Rohith Sharmaks via jianhe)
|
|
|
|
|
|
2014-10-20 21:42:30 -04:00
|
|
|
|
YARN-2701. Potential race condition in startLocalizer when using
|
|
|
|
|
LinuxContainerExecutor. (Xuan Gong via jianhe)
|
|
|
|
|
|
2014-10-21 01:21:37 -04:00
|
|
|
|
YARN-2717. Avoided duplicate logging when container logs are not found. (Xuan
|
|
|
|
|
Gong via zjshen)
|
|
|
|
|
|
2014-10-21 15:33:21 -04:00
|
|
|
|
YARN-2720. Windows: Wildcard classpath variables not expanded against
|
|
|
|
|
resources contained in archives. (Craig Welch via cnauroth)
|
|
|
|
|
|
2014-10-22 00:49:17 -04:00
|
|
|
|
YARN-2721. Suppress NodeExist exception thrown by ZKRMStateStore when it
|
|
|
|
|
retries creating znode. (Jian He via zjshen)
|
|
|
|
|
|
2014-10-22 21:39:29 -04:00
|
|
|
|
YARN-2732. Fixed syntax error in SecureContainer.apt.vm. (Jian He via zjshen)
|
|
|
|
|
|
2014-10-24 14:13:44 -04:00
|
|
|
|
YARN-2724. Skipped uploading a local log file to HDFS if exception is raised
|
|
|
|
|
when opening it. (Xuan Gong via zjshen)
|
|
|
|
|
|
2014-10-25 01:47:16 -04:00
|
|
|
|
YARN-1915. Fixed a race condition that client could use the ClientToAMToken
|
|
|
|
|
to contact with AM before AM actually receives the ClientToAMTokenMasterKey.
|
|
|
|
|
(Jason Lowe via jianhe)
|
|
|
|
|
|
2014-10-25 02:05:16 -04:00
|
|
|
|
YARN-2314. Disable ContainerManagementProtocolProxy cache by default to
|
|
|
|
|
prevent creating thousands of threads in a large cluster. (Jason Lowe via
|
|
|
|
|
jianhe)
|
|
|
|
|
|
2014-10-25 15:47:09 -04:00
|
|
|
|
YARN-2723. Fix rmadmin -replaceLabelsOnNode does not correctly parse port.
|
|
|
|
|
(Naganarasimha G R via xgong)
|
|
|
|
|
|
2014-10-26 15:57:31 -04:00
|
|
|
|
YARN-2734. Skipped sub-folders in the local log dir when aggregating logs.
|
|
|
|
|
(Xuan Gong via zjshen)
|
|
|
|
|
|
2014-10-27 13:28:45 -04:00
|
|
|
|
YARN-2726. CapacityScheduler should explicitly log when an accessible
|
|
|
|
|
label has no capacity. (Wangda Tan via xgong)
|
|
|
|
|
|
2014-10-27 13:45:53 -04:00
|
|
|
|
YARN-2591. Fixed AHSWebServices to return FORBIDDEN(403) if the request user
|
|
|
|
|
doesn't have access to the history data. (Zhijie Shen via jianhe)
|
|
|
|
|
|
2014-10-28 14:18:35 -04:00
|
|
|
|
YARN-2279. Add UTs to cover timeline server authentication.
|
|
|
|
|
(Zhijie Shen via xgong)
|
|
|
|
|
|
2014-10-28 16:30:55 -04:00
|
|
|
|
YARN-2758. Update TestApplicationHistoryClientService to use the new generic
|
|
|
|
|
history store. (Zhijie Shen via xgong)
|
|
|
|
|
|
2014-10-28 17:10:16 -04:00
|
|
|
|
YARN-2741. Made NM web UI serve logs on the drive other than C: on Windows. (Craig
|
|
|
|
|
Welch via zjshen)
|
|
|
|
|
|
2014-10-29 01:43:40 -04:00
|
|
|
|
YARN-2747. Fixed the test failure of TestAggregatedLogFormat when native I/O is
|
|
|
|
|
enabled. (Xuan Gong via zjshen)
|
|
|
|
|
|
2014-10-29 15:05:14 -04:00
|
|
|
|
YARN-2769. Fixed the problem that timeline domain is not set in distributed shell
|
|
|
|
|
AM when using shell_command on Windows. (Varun Vasudev via zjshen)
|
|
|
|
|
|
2014-10-30 11:10:27 -04:00
|
|
|
|
YARN-2755. NM fails to clean up usercache_DEL_<timestamp> dirs after
|
|
|
|
|
YARN-661 (Siqi Li via jlowe)
|
|
|
|
|
|
2014-10-31 01:59:31 -04:00
|
|
|
|
YARN-2698. Moved some node label APIs to be correctly placed in client
|
|
|
|
|
protocol. (Wangda Tan via vinodkv)
|
|
|
|
|
|
2014-10-31 18:32:21 -04:00
|
|
|
|
YARN-2789. Re-instated the NodeReport.newInstance private unstable API
|
|
|
|
|
modified in YARN-2698 so that tests in YARN frameworks don't break. (Wangda
|
|
|
|
|
Tan via vinodkv)
|
|
|
|
|
|
2014-10-31 18:53:04 -04:00
|
|
|
|
YARN-2707. Potential null dereference in FSDownload (Gera Shegalov via
|
|
|
|
|
jlowe)
|
|
|
|
|
|
2014-10-31 20:43:30 -04:00
|
|
|
|
YARN-2711. Fixed TestDefaultContainerExecutor#testContainerLaunchError failure on
|
|
|
|
|
Windows. (Varun Vasudev via zjshen)
|
|
|
|
|
|
2014-11-01 19:32:35 -04:00
|
|
|
|
YARN-2790. Fixed a NodeManager bug that was causing log-aggregation to fail
|
|
|
|
|
beyond HFDS delegation-token expiry even when RM is a proxy-user (YARN-2704).
|
|
|
|
|
(Jian He via vinodkv)
|
|
|
|
|
|
2014-11-02 18:20:40 -05:00
|
|
|
|
YARN-2785. Fixed intermittent TestContainerResourceUsage failure. (Varun Vasudev
|
|
|
|
|
via zjshen)
|
|
|
|
|
|
2014-11-03 15:37:47 -05:00
|
|
|
|
YARN-2730. DefaultContainerExecutor runs only one localizer at a time
|
|
|
|
|
(Siqi Li via jlowe)
|
|
|
|
|
|
2014-11-03 15:36:44 -05:00
|
|
|
|
YARN-2798. Fixed YarnClient to populate the renewer correctly for Timeline
|
|
|
|
|
delegation tokens. (Zhijie Shen via vinodkv)
|
|
|
|
|
|
2014-11-03 16:16:29 -05:00
|
|
|
|
YARN-2788. Fixed backwards compatiblity issues with log-aggregation feature
|
|
|
|
|
that were caused when adding log-upload-time via YARN-2703. (Xuan Gong via
|
|
|
|
|
vinodkv)
|
|
|
|
|
|
2014-11-03 16:44:06 -05:00
|
|
|
|
YARN-2795. Fixed ResourceManager to not crash loading node-label data from
|
|
|
|
|
HDFS in secure mode. (Wangda Tan via vinodkv)
|
|
|
|
|
|
2014-11-03 19:38:55 -05:00
|
|
|
|
YARN-1922. Fixed NodeManager to kill process-trees correctly in the presence
|
|
|
|
|
of races between the launch and the stop-container call and when root
|
|
|
|
|
processes crash. (Billie Rinaldi via vinodkv)
|
|
|
|
|
|
2014-11-04 18:50:10 -05:00
|
|
|
|
YARN-2752. Made ContainerExecutor append "nice -n" arg only when priority
|
|
|
|
|
adjustment flag is set. (Xuan Gong via zjshen)
|
|
|
|
|
|
2014-11-04 20:44:59 -05:00
|
|
|
|
YARN-2010. Handle app-recovery failures gracefully.
|
|
|
|
|
(Jian He and Karthik Kambatla via kasha)
|
|
|
|
|
|
2014-11-04 20:45:46 -05:00
|
|
|
|
YARN-2804. Fixed Timeline service to not fill the logs with JAXB bindings
|
|
|
|
|
exceptions. (Zhijie Shen via vinodkv)
|
2014-11-04 19:50:40 -05:00
|
|
|
|
|
2014-11-05 13:56:39 -05:00
|
|
|
|
YARN-2767. Added a test case to verify that http static user cannot kill or submit
|
|
|
|
|
apps in the secure mode. (Varun Vasudev via zjshen)
|
|
|
|
|
|
2014-11-05 18:29:55 -05:00
|
|
|
|
YARN-2805. Fixed ResourceManager to load HA configs correctly before kerberos
|
|
|
|
|
login. (Wangda Tan via vinodkv)
|
|
|
|
|
|
2014-11-05 19:59:54 -05:00
|
|
|
|
YARN-2579. Fixed a deadlock issue when EmbeddedElectorService and
|
|
|
|
|
FatalEventDispatcher try to transition RM to StandBy at the same time.
|
|
|
|
|
(Rohith Sharmaks via jianhe)
|
|
|
|
|
|
2014-11-05 21:26:07 -05:00
|
|
|
|
YARN-2813. Fixed NPE from MemoryTimelineStore.getDomains. (Zhijie Shen via xgong)
|
|
|
|
|
|
2014-11-05 23:42:38 -05:00
|
|
|
|
YARN-2812. TestApplicationHistoryServer is likely to fail on less powerful machine.
|
|
|
|
|
(Zhijie Shen via xgong)
|
|
|
|
|
|
2014-11-06 20:28:12 -05:00
|
|
|
|
YARN-2744. Fixed CapacityScheduler to validate node-labels correctly against
|
|
|
|
|
queues. (Wangda Tan via vinodkv)
|
|
|
|
|
|
2014-11-07 12:28:36 -05:00
|
|
|
|
YARN-2823. Fixed ResourceManager app-attempt state machine to inform
|
|
|
|
|
schedulers about previous finished attempts of a running appliation to avoid
|
|
|
|
|
expectation mismatch w.r.t transferred containers. (Jian He via vinodkv)
|
|
|
|
|
|
2014-11-07 12:44:43 -05:00
|
|
|
|
YARN-2810. TestRMProxyUsersConf fails on Windows VMs. (Varun Vasudev via xgong)
|
|
|
|
|
|
2014-11-07 13:39:37 -05:00
|
|
|
|
YARN-2824. Fixed Capacity Scheduler to not crash when some node-labels are
|
|
|
|
|
not mapped to queues by making default capacities per label to be zero.
|
|
|
|
|
(Wangda Tan via vinodkv)
|
|
|
|
|
|
2014-11-07 15:00:49 -05:00
|
|
|
|
YARN-2827. Fixed bugs in "yarn queue" CLI. (Wangda Tan via vinodkv).
|
|
|
|
|
|
2014-11-07 15:29:39 -05:00
|
|
|
|
YARN-2803. MR distributed cache not working correctly on Windows after
|
|
|
|
|
NodeManager privileged account changes. (Craig Welch via cnauroth)
|
|
|
|
|
|
2014-11-07 17:15:53 -05:00
|
|
|
|
YARN-2753. Fixed a bunch of bugs in the NodeLabelsManager classes. (Zhihai xu
|
|
|
|
|
via vinodkv)
|
|
|
|
|
|
2014-11-07 18:16:37 -05:00
|
|
|
|
YARN-2825. Container leak on NM (Jian He via jlowe)
|
|
|
|
|
|
2014-11-07 19:11:30 -05:00
|
|
|
|
YARN-2819. NPE in ATS Timeline Domains when upgrading from 2.4 to 2.6.
|
|
|
|
|
(Zhijie Shen via xgong)
|
|
|
|
|
|
2014-11-07 22:43:55 -05:00
|
|
|
|
YARN-2826. Fixed user-groups mappings' refresh bug caused by YARN-2826.
|
|
|
|
|
(Wangda Tan via vinodkv)
|
|
|
|
|
|
2014-11-08 14:00:57 -05:00
|
|
|
|
YARN-2607. Fixed issues in TestDistributedShell. (Wangda Tan via vinodkv)
|
|
|
|
|
|
2014-11-09 17:57:37 -05:00
|
|
|
|
YARN-2830. Add backwords compatible ContainerId.newInstance constructor.
|
|
|
|
|
(jeagles via acmurthy)
|
|
|
|
|
|
2014-11-09 21:56:06 -05:00
|
|
|
|
YARN-2834. Fixed ResourceManager to ignore token-renewal failures on recovery
|
|
|
|
|
consistent with the (somewhat incorrect) behaviour in the non-recovery case.
|
|
|
|
|
(Jian He via vinodkv)
|
|
|
|
|
|
2014-11-12 13:36:54 -05:00
|
|
|
|
YARN-2841. RMProxy should retry EOFException. (Jian He via xgong)
|
|
|
|
|
|
2014-11-12 13:41:24 -05:00
|
|
|
|
YARN-2843. Fixed NodeLabelsManager to trim inputs for hosts and labels so
|
|
|
|
|
as to make them work correctly. (Wangda Tan via vinodkv)
|
|
|
|
|
|
2014-11-12 14:07:57 -05:00
|
|
|
|
YARN-2794. Fixed log messages about distributing system-credentials. (Jian He via
|
|
|
|
|
zjshen)
|
|
|
|
|
|
2014-11-13 11:11:04 -05:00
|
|
|
|
YARN-2846. Incorrect persist exit code for running containers in
|
|
|
|
|
reacquireContainer() that interrupted by NodeManager restart. (Junping Du
|
|
|
|
|
via jlowe)
|
|
|
|
|
|
2014-11-13 13:04:45 -05:00
|
|
|
|
YARN-2853. Fixed a bug in ResourceManager causing apps to hang when the user
|
|
|
|
|
kill request races with ApplicationMaster finish. (Jian He via vinodkv)
|
|
|
|
|
|
2014-11-21 17:34:23 -05:00
|
|
|
|
Release 2.5.2 - 2014-11-19
|
2014-11-04 19:50:40 -05:00
|
|
|
|
|
|
|
|
|
INCOMPATIBLE CHANGES
|
|
|
|
|
|
|
|
|
|
NEW FEATURES
|
|
|
|
|
|
|
|
|
|
IMPROVEMENTS
|
|
|
|
|
|
|
|
|
|
OPTIMIZATIONS
|
|
|
|
|
|
|
|
|
|
BUG FIXES
|
|
|
|
|
|
|
|
|
|
|
2014-09-11 20:35:35 -04:00
|
|
|
|
Release 2.5.1 - 2014-09-05
|
2014-08-27 03:55:19 -04:00
|
|
|
|
|
|
|
|
|
INCOMPATIBLE CHANGES
|
|
|
|
|
|
|
|
|
|
NEW FEATURES
|
|
|
|
|
|
|
|
|
|
IMPROVEMENTS
|
|
|
|
|
|
|
|
|
|
OPTIMIZATIONS
|
|
|
|
|
|
|
|
|
|
BUG FIXES
|
|
|
|
|
|
2014-08-20 17:33:42 -04:00
|
|
|
|
Release 2.5.0 - 2014-08-11
|
2014-02-17 23:41:01 -05:00
|
|
|
|
|
|
|
|
|
INCOMPATIBLE CHANGES
|
|
|
|
|
|
|
|
|
|
NEW FEATURES
|
|
|
|
|
|
2014-04-08 13:17:59 -04:00
|
|
|
|
YARN-1757. NM Recovery. Auxiliary service support. (Jason Lowe via kasha)
|
|
|
|
|
|
2014-05-08 03:23:19 -04:00
|
|
|
|
YARN-1864. Fair Scheduler Dynamic Hierarchical User Queues (Ashwin Shankar
|
|
|
|
|
via Sandy Ryza)
|
|
|
|
|
|
2014-05-13 20:25:08 -04:00
|
|
|
|
YARN-1362. Distinguish between nodemanager shutdown for decommission vs shutdown
|
|
|
|
|
for restart. (Jason Lowe via junping_du)
|
|
|
|
|
|
2014-05-30 12:09:36 -04:00
|
|
|
|
YARN-1338. Recover localized resource cache state upon nodemanager restart
|
|
|
|
|
(Jason Lowe via junping_du)
|
|
|
|
|
|
2014-06-08 23:10:06 -04:00
|
|
|
|
YARN-1368. Added core functionality of recovering container state into
|
|
|
|
|
schedulers after ResourceManager Restart so as to preserve running work in
|
|
|
|
|
the cluster. (Jian He via vinodkv)
|
|
|
|
|
|
2014-06-12 17:33:03 -04:00
|
|
|
|
YARN-1702. Added kill app functionality to RM web services. (Varun Vasudev
|
|
|
|
|
via vinodkv)
|
|
|
|
|
|
2014-06-16 21:10:49 -04:00
|
|
|
|
YARN-1339. Recover DeletionService state upon nodemanager restart. (Jason Lowe
|
|
|
|
|
via junping_du)
|
|
|
|
|
|
2014-06-25 00:45:50 -04:00
|
|
|
|
YARN-1365. Changed ApplicationMasterService to allow an app to re-register
|
|
|
|
|
after RM restart. (Anubhav Dhoot via jianhe)
|
|
|
|
|
|
2014-06-29 14:26:08 -04:00
|
|
|
|
YARN-2052. Embedded an epoch number in container id to ensure the uniqueness
|
|
|
|
|
of container id after RM restarts. (Tsuyoshi OZAWA via jianhe)
|
|
|
|
|
|
2014-07-01 20:23:49 -04:00
|
|
|
|
YARN-1713. Added get-new-app and submit-app functionality to RM web services.
|
|
|
|
|
(Varun Vasudev via vinodkv)
|
|
|
|
|
|
2014-07-15 19:00:48 -04:00
|
|
|
|
YARN-2233. Implemented ResourceManager web-services to create, renew and
|
|
|
|
|
cancel delegation tokens. (Varun Vasudev via vinodkv)
|
|
|
|
|
|
2014-07-27 13:57:44 -04:00
|
|
|
|
YARN-2247. Made RM web services authenticate users via kerberos and delegation
|
|
|
|
|
token. (Varun Vasudev via zjshen)
|
|
|
|
|
|
2014-02-17 23:41:01 -05:00
|
|
|
|
IMPROVEMENTS
|
2014-03-22 21:09:24 -04:00
|
|
|
|
|
2014-02-19 12:58:04 -05:00
|
|
|
|
YARN-1479. Invalid NaN values in Hadoop REST API JSON response (Chen He via
|
|
|
|
|
jeagles)
|
2014-02-17 23:41:01 -05:00
|
|
|
|
|
2014-02-20 15:13:14 -05:00
|
|
|
|
YARN-1736. FS: AppSchedulable.assignContainer's priority argument is
|
|
|
|
|
redundant. (Naren Koneru via kasha)
|
|
|
|
|
|
2014-02-24 17:36:03 -05:00
|
|
|
|
YARN-1678. Fair scheduler gabs incessantly about reservations (Sandy Ryza)
|
|
|
|
|
|
2014-02-26 00:25:47 -05:00
|
|
|
|
YARN-1561. Fix a generic type warning in FairScheduler. (Chen He via junping_du)
|
|
|
|
|
|
2014-02-26 21:19:13 -05:00
|
|
|
|
YARN-1429. *nix: Allow a way for users to augment classpath of YARN daemons.
|
|
|
|
|
(Jarek Jarcec Cecho via kasha)
|
|
|
|
|
|
2014-03-15 00:11:39 -04:00
|
|
|
|
YARN-1520. update capacity scheduler docs to include necessary parameters
|
|
|
|
|
(Chen He via jeagles)
|
|
|
|
|
|
2014-03-17 12:56:43 -04:00
|
|
|
|
YARN-1845. Elapsed time for failed tasks that never started is wrong
|
|
|
|
|
(Rushabh S Shah via jeagles)
|
|
|
|
|
|
2014-03-17 16:20:22 -04:00
|
|
|
|
YARN-1136. Replace junit.framework.Assert with org.junit.Assert (Chen He
|
|
|
|
|
via jeagles)
|
|
|
|
|
|
2014-03-31 19:53:58 -04:00
|
|
|
|
YARN-1889. In Fair Scheduler, avoid creating objects on each call to
|
|
|
|
|
AppSchedulable comparator (Hong Zhiguo via Sandy Ryza)
|
|
|
|
|
|
2014-04-11 19:23:33 -04:00
|
|
|
|
YARN-1923. Make Fair Scheduler resource ratio calculations terminate faster
|
|
|
|
|
(Anubhav Dhoot via Sandy Ryza)
|
|
|
|
|
|
2014-04-17 14:09:32 -04:00
|
|
|
|
YARN-1870. FileInputStream is not closed in ProcfsBasedProcessTree#constructProcessSMAPInfo.
|
|
|
|
|
(Fengdong Yu via junping_du)
|
|
|
|
|
|
2014-04-21 19:39:16 -04:00
|
|
|
|
YARN-1970. Prepare YARN codebase for JUnit 4.11. (cnauroth)
|
|
|
|
|
|
2014-04-25 17:14:25 -04:00
|
|
|
|
YARN-483. Improve documentation on log aggregation in yarn-default.xml
|
|
|
|
|
(Akira Ajisaka via Sandy Ryza)
|
|
|
|
|
|
2014-05-09 18:19:14 -04:00
|
|
|
|
YARN-2036. Document yarn.resourcemanager.hostname in ClusterSetup (Ray
|
|
|
|
|
Chiang via Sandy Ryza)
|
|
|
|
|
|
2014-05-09 23:47:43 -04:00
|
|
|
|
YARN-766. TestNodeManagerShutdown in branch-2 should use Shell to form the output path and a format
|
|
|
|
|
issue in trunk. (Contributed by Siddharth Seth)
|
|
|
|
|
|
2014-05-10 20:05:31 -04:00
|
|
|
|
YARN-1982. Renamed the daemon name to be TimelineServer instead of History
|
|
|
|
|
Server and deprecated the old usage. (Zhijie Shen via vinodkv)
|
|
|
|
|
|
2014-05-11 02:20:00 -04:00
|
|
|
|
YARN-1987. Wrapper for leveldb DBIterator to aid in handling database exceptions.
|
|
|
|
|
(Jason Lowe via kasha)
|
|
|
|
|
|
2014-05-13 12:44:58 -04:00
|
|
|
|
YARN-1751. Improve MiniYarnCluster for log aggregation testing (Ming Ma
|
|
|
|
|
via jlowe)
|
|
|
|
|
|
2014-05-13 16:08:18 -04:00
|
|
|
|
YARN-1981. Nodemanager version is not updated when a node reconnects (Jason
|
|
|
|
|
Lowe via jeagles)
|
|
|
|
|
|
2014-05-21 19:20:40 -04:00
|
|
|
|
YARN-1938. Added kerberos login for the Timeline Server. (Zhijie Shen via
|
|
|
|
|
vinodkv)
|
|
|
|
|
|
2014-05-22 01:33:00 -04:00
|
|
|
|
YARN-2017. Merged some of the common scheduler code. (Jian He via vinodkv)
|
|
|
|
|
|
2014-05-23 13:10:22 -04:00
|
|
|
|
YARN-2049. Added delegation-token support for the Timeline Server. (Zhijie
|
|
|
|
|
Shen via vinodkv)
|
|
|
|
|
|
2014-05-23 14:49:21 -04:00
|
|
|
|
YARN-1936. Added security support for the Timeline Client. (Zhijie Shen via
|
|
|
|
|
vinodkv)
|
|
|
|
|
|
2014-05-23 17:20:07 -04:00
|
|
|
|
YARN-1937. Added owner-only ACLs support for Timeline Client and server.
|
|
|
|
|
(Zhijie Shen via vinodkv)
|
|
|
|
|
|
2014-05-23 18:39:41 -04:00
|
|
|
|
YARN-2012. Fair Scheduler: allow default queue placement rule to take an
|
|
|
|
|
arbitrary queue (Ashwin Shankar via Sandy Ryza)
|
|
|
|
|
|
2014-05-23 18:41:24 -04:00
|
|
|
|
YARN-2059. Added admin ACLs support to Timeline Server. (Zhijie Shen via
|
|
|
|
|
vinodkv)
|
2014-05-23 18:53:17 -04:00
|
|
|
|
|
|
|
|
|
YARN-2073. Fair Scheduler: Add a utilization threshold to prevent preempting
|
|
|
|
|
resources when cluster is free (Karthik Kambatla via Sandy Ryza)
|
2014-05-23 18:41:24 -04:00
|
|
|
|
|
2014-05-23 21:25:04 -04:00
|
|
|
|
YARN-2071. Modified levelDB store permissions to be readable only by the
|
|
|
|
|
server user. (Zhijie Shen via vinodkv)
|
|
|
|
|
|
2014-05-28 14:11:45 -04:00
|
|
|
|
YARN-2107. Refactored timeline classes into o.a.h.y.s.timeline package. (Vinod
|
|
|
|
|
Kumar Vavilapalli via zjshen)
|
|
|
|
|
|
2014-05-29 00:03:04 -04:00
|
|
|
|
YARN-596. Use scheduling policies throughout the queue hierarchy to decide
|
|
|
|
|
which containers to preempt (Wei Yan via Sandy Ryza)
|
|
|
|
|
|
2014-05-30 11:25:27 -04:00
|
|
|
|
YARN-2054. Better defaults for YARN ZK configs for retries and retry-inteval
|
|
|
|
|
when HA is enabled. (kasha)
|
|
|
|
|
|
2014-06-02 16:28:50 -04:00
|
|
|
|
YARN-1877. Document yarn.resourcemanager.zk-auth and its scope.
|
2014-05-30 11:32:53 -04:00
|
|
|
|
(Robert Kanter via kasha)
|
|
|
|
|
|
2014-05-30 20:21:47 -04:00
|
|
|
|
YARN-2115. Replaced RegisterNodeManagerRequest's ContainerStatus with a new
|
|
|
|
|
NMContainerStatus which has more information that is needed for
|
|
|
|
|
work-preserving RM-restart. (Jian He via vinodkv)
|
|
|
|
|
|
2014-06-01 15:11:23 -04:00
|
|
|
|
YARN-1474. Make sechedulers services. (Tsuyoshi Ozawa via kasha)
|
|
|
|
|
|
2014-06-02 20:58:09 -04:00
|
|
|
|
YARN-1913. With Fair Scheduler, cluster can logjam when all resources are
|
|
|
|
|
consumed by AMs (Wei Yan via Sandy Ryza)
|
|
|
|
|
|
2014-06-04 17:40:37 -04:00
|
|
|
|
YARN-2061. Revisit logging levels in ZKRMStateStore. (Ray Chiang via kasha)
|
|
|
|
|
|
2014-06-05 09:24:22 -04:00
|
|
|
|
YARN-1977. Add tests on getApplicationRequest with filtering start time range. (junping_du)
|
|
|
|
|
|
2014-06-06 20:51:50 -04:00
|
|
|
|
YARN-2122. In AllocationFileLoaderService, the reloadThread should be created
|
|
|
|
|
in init() and started in start(). (Robert Kanter via kasha)
|
|
|
|
|
|
2014-06-07 02:13:22 -04:00
|
|
|
|
YARN-2132. ZKRMStateStore.ZKAction#runWithRetries doesn't log the exception
|
|
|
|
|
it encounters. (Vamsee Yarlagadda via kasha)
|
|
|
|
|
|
2014-06-09 21:02:19 -04:00
|
|
|
|
YARN-2030. Augmented RMStateStore with state machine.(Binglin Chang via jianhe)
|
2014-06-09 15:46:48 -04:00
|
|
|
|
|
2014-06-10 15:06:32 -04:00
|
|
|
|
YARN-1424. RMAppAttemptImpl should return the
|
|
|
|
|
DummyApplicationResourceUsageReport for all invalid accesses.
|
|
|
|
|
(Ray Chiang via kasha)
|
|
|
|
|
|
2014-06-10 16:13:23 -04:00
|
|
|
|
YARN-2091. Add more values to ContainerExitStatus and pass it from NM to
|
|
|
|
|
RM and then to app masters (Tsuyoshi OZAWA via bikas)
|
|
|
|
|
|
2014-06-11 14:32:48 -04:00
|
|
|
|
YARN-2125. Changed ProportionalCapacityPreemptionPolicy to log CSV in debug
|
|
|
|
|
level. (Wangda Tan via jianhe)
|
|
|
|
|
|
2014-06-16 18:18:40 -04:00
|
|
|
|
YARN-2159. Better logging in SchedulerNode#allocateContainer.
|
|
|
|
|
(Ray Chiang via kasha)
|
|
|
|
|
|
2014-06-23 18:54:15 -04:00
|
|
|
|
YARN-2191. Added a new test to ensure NM will clean up completed applications
|
|
|
|
|
in the case of RM restart. (Wangda Tan via jianhe)
|
|
|
|
|
|
2014-06-24 09:58:14 -04:00
|
|
|
|
YARN-2195. Clean a piece of code in ResourceRequest. (Wei Yan via devaraj)
|
|
|
|
|
|
2014-06-24 11:16:36 -04:00
|
|
|
|
YARN-2074. Changed ResourceManager to not count AM preemptions towards app
|
|
|
|
|
failures. (Jian He via vinodkv)
|
|
|
|
|
|
2014-06-24 13:14:22 -04:00
|
|
|
|
YARN-2192. TestRMHA fails when run with a mix of Schedulers.
|
|
|
|
|
(Anubhav Dhoot via kasha)
|
|
|
|
|
|
2014-06-24 13:34:29 -04:00
|
|
|
|
YARN-2109. Fix TestRM to work with both schedulers. (Anubhav Dhoot via kasha)
|
|
|
|
|
|
2014-06-24 15:41:56 -04:00
|
|
|
|
YARN-2072. RM/NM UIs and webservices are missing vcore information.
|
|
|
|
|
(Nathan Roberts via tgraves)
|
|
|
|
|
|
2014-06-24 17:44:00 -04:00
|
|
|
|
YARN-2152. Added missing information into ContainerTokenIdentifier so that
|
|
|
|
|
NodeManagers can report the same to RM when RM restarts. (Jian He via vinodkv)
|
|
|
|
|
|
2014-06-25 17:57:28 -04:00
|
|
|
|
YARN-2171. Improved CapacityScheduling to not lock on nodemanager-count when
|
|
|
|
|
AMs heartbeat in. (Jason Lowe via vinodkv)
|
|
|
|
|
|
2014-06-28 19:41:51 -04:00
|
|
|
|
YARN-614. Changed ResourceManager to not count disk failure, node loss and
|
|
|
|
|
RM restart towards app failures. (Xuan Gong via jianhe)
|
|
|
|
|
|
2014-07-10 18:18:54 -04:00
|
|
|
|
YARN-2224. Explicitly enable vmem check in
|
2014-07-01 22:07:48 -04:00
|
|
|
|
TestContainersMonitor#testContainerKillOnMemoryOverflow.
|
|
|
|
|
(Anubhav Dhoot via kasha)
|
|
|
|
|
|
2014-07-02 17:52:13 -04:00
|
|
|
|
YARN-2022. Preempting an Application Master container can be kept as least priority
|
|
|
|
|
when multiple applications are marked for preemption by
|
|
|
|
|
ProportionalCapacityPreemptionPolicy (Sunil G via mayank)
|
|
|
|
|
|
2014-07-02 16:36:09 -04:00
|
|
|
|
YARN-2241. ZKRMStateStore: On startup, show nicer messages if znodes already
|
|
|
|
|
exist. (Robert Kanter via kasha)
|
|
|
|
|
|
2014-07-15 19:44:48 -04:00
|
|
|
|
YARN-1408 Preemption caused Invalid State Event: ACQUIRED at KILLED and caused
|
|
|
|
|
a task timeout for 30mins. (Sunil G via mayank)
|
|
|
|
|
|
2014-07-23 23:14:37 -04:00
|
|
|
|
YARN-2300. Improved the documentation of the sample requests for RM REST API -
|
|
|
|
|
submitting an app. (Varun Vasudev via zjshen)
|
|
|
|
|
|
2014-02-17 23:41:01 -05:00
|
|
|
|
OPTIMIZATIONS
|
|
|
|
|
|
|
|
|
|
BUG FIXES
|
|
|
|
|
|
2014-02-19 16:37:24 -05:00
|
|
|
|
YARN-1718. Fix a couple isTerminals in Fair Scheduler queue placement rules
|
|
|
|
|
(Sandy Ryza)
|
|
|
|
|
|
2014-03-08 00:13:04 -05:00
|
|
|
|
YARN-1790. Fair Scheduler UI not showing apps table (bc Wong via Sandy Ryza)
|
|
|
|
|
|
2014-04-09 01:55:11 -04:00
|
|
|
|
YARN-1784. TestContainerAllocation assumes CapacityScheduler.
|
|
|
|
|
(Robert Kanter via kasha)
|
|
|
|
|
|
2014-04-18 15:36:18 -04:00
|
|
|
|
YARN-1940. deleteAsUser() terminates early without deleting more files on
|
|
|
|
|
error (Rushabh S Shah via jlowe)
|
|
|
|
|
|
2014-04-19 15:00:42 -04:00
|
|
|
|
YARN-1865. ShellScriptBuilder does not check for some error conditions.
|
|
|
|
|
(Remus Rusanu via ivanmi)
|
|
|
|
|
|
2014-04-29 13:49:09 -04:00
|
|
|
|
YARN-738. TestClientRMTokens is failing irregularly while running all yarn
|
|
|
|
|
tests (Ming Ma via jlowe)
|
|
|
|
|
|
2014-05-06 11:47:01 -04:00
|
|
|
|
YARN-2018. TestClientRMService.testTokenRenewalWrongUser fails after
|
|
|
|
|
HADOOP-10562 (Ming Ma via Arpit Agarwal)
|
|
|
|
|
|
2014-05-11 11:16:32 -04:00
|
|
|
|
YARN-2011. Fix typo and warning in TestLeafQueue (Chen He via junping_du)
|
|
|
|
|
|
2014-06-06 20:51:50 -04:00
|
|
|
|
|
2014-05-14 02:56:00 -04:00
|
|
|
|
YARN-2042. String shouldn't be compared using == in
|
|
|
|
|
QueuePlacementRule#NestedUserQueue#getQueueForApp (Chen He via Sandy Ryza)
|
|
|
|
|
|
2014-05-20 12:21:30 -04:00
|
|
|
|
YARN-2050. Fix LogCLIHelpers to create the correct FileContext (Ming Ma
|
|
|
|
|
via jlowe)
|
|
|
|
|
|
2014-05-22 02:14:00 -04:00
|
|
|
|
YARN-2089. FairScheduler: QueuePlacementPolicy and QueuePlacementRule
|
|
|
|
|
are missing audience annotations. (Zhihai Xu via kasha)
|
|
|
|
|
|
2014-05-23 19:51:52 -04:00
|
|
|
|
YARN-2096. Race in TestRMRestart#testQueueMetricsOnRMRestart.
|
|
|
|
|
(Anubhav Dhoot via kasha)
|
|
|
|
|
|
2014-05-27 19:46:45 -04:00
|
|
|
|
YARN-2105. Fix TestFairScheduler after YARN-2012. (Ashwin Shankar via
|
|
|
|
|
Sandy Ryza)
|
|
|
|
|
|
2014-05-29 15:07:16 -04:00
|
|
|
|
YARN-2112. Fixed yarn-common's pom.xml to include jackson dependencies so
|
|
|
|
|
that both Timeline Server and client can access them. (Zhijie Shen via
|
|
|
|
|
vinodkv)
|
|
|
|
|
|
2014-05-30 14:18:18 -04:00
|
|
|
|
YARN-1868. YARN status web ui does not show correctly in IE 11.
|
|
|
|
|
(Chuan Liu via cnauroth)
|
|
|
|
|
|
2014-06-02 04:27:08 -04:00
|
|
|
|
YARN-2103. Inconsistency between viaProto flag and initial value of
|
|
|
|
|
SerializedExceptionProto.Builder (Binglin Chang via junping_du)
|
|
|
|
|
|
2014-06-02 16:24:58 -04:00
|
|
|
|
YARN-1550. NPE in FairSchedulerAppsBlock#render. (Anubhav Dhoot via kasha)
|
|
|
|
|
|
2014-06-04 16:18:49 -04:00
|
|
|
|
YARN-2119. DEFAULT_PROXY_ADDRESS should use DEFAULT_PROXY_PORT.
|
|
|
|
|
(Anubhav Dhoot via kasha)
|
|
|
|
|
|
2014-06-06 13:49:48 -04:00
|
|
|
|
YARN-2118. Fixed the type mismatch in Map#containsKey check of
|
|
|
|
|
TimelineWebServices#injectOwnerInfo. (Ted Yu via zjshen)
|
|
|
|
|
|
2014-06-06 16:10:14 -04:00
|
|
|
|
YARN-2117. Fixed the issue that secret file reader is potentially not
|
|
|
|
|
closed in TimelineAuthenticationFilterInitializer. (Chen He via zjshen)
|
|
|
|
|
|
2014-06-06 16:33:10 -04:00
|
|
|
|
YARN-2121. Fixed NPE handling in Timeline Server's TimelineAuthenticator.
|
|
|
|
|
(Zhijie Shen via vinodkv)
|
|
|
|
|
|
2014-06-06 21:23:23 -04:00
|
|
|
|
YARN-2128. FairScheduler: Incorrect calculation of amResource usage.
|
|
|
|
|
(Wei Yan via kasha)
|
|
|
|
|
|
2014-06-11 13:31:35 -04:00
|
|
|
|
YARN-2124. Fixed NPE in ProportionalCapacityPreemptionPolicy. (Wangda Tan
|
|
|
|
|
via jianhe)
|
|
|
|
|
|
2014-06-11 18:49:19 -04:00
|
|
|
|
YARN-2148. TestNMClient failed due more exit code values added and passed
|
|
|
|
|
to AM (Wangda Tan via bikas)
|
|
|
|
|
|
2014-06-12 02:48:49 -04:00
|
|
|
|
YARN-2075. Fixed the test failure of TestRMAdminCLI. (Kenji Kikushima via
|
|
|
|
|
zjshen)
|
|
|
|
|
|
2014-06-12 17:26:39 -04:00
|
|
|
|
YARN-2155. FairScheduler: Incorrect threshold check for preemption.
|
|
|
|
|
(Wei Yan via kasha)
|
|
|
|
|
|
2014-06-16 20:02:57 -04:00
|
|
|
|
YARN-1885. Fixed a bug that RM may not send application-clean-up signal
|
|
|
|
|
to NMs where the completed applications previously ran in case of RM restart.
|
|
|
|
|
(Wangda Tan via jianhe)
|
|
|
|
|
|
2014-06-16 22:14:29 -04:00
|
|
|
|
YARN-2167. LeveldbIterator should get closed in
|
|
|
|
|
NMLeveldbStateStoreService#loadLocalizationState() within finally block
|
|
|
|
|
(Junping Du via jlowe)
|
|
|
|
|
|
2014-06-21 03:33:04 -04:00
|
|
|
|
YARN-2187. FairScheduler: Disable max-AM-share check by default.
|
|
|
|
|
(Robert Kanter via kasha)
|
|
|
|
|
|
2014-06-24 11:48:51 -04:00
|
|
|
|
YARN-2111. In FairScheduler.attemptScheduling, we don't count containers
|
|
|
|
|
as assigned if they have 0 memory but non-zero cores (Sandy Ryza)
|
|
|
|
|
|
2014-06-25 14:54:15 -04:00
|
|
|
|
YARN-2204. TestAMRestart#testAMRestartWithExistingContainers assumes
|
|
|
|
|
CapacityScheduler. (Robert Kanter via kasha)
|
|
|
|
|
|
2014-06-27 02:45:57 -04:00
|
|
|
|
YARN-2163. WebUI: Order of AppId in apps table should be consistent with
|
|
|
|
|
ApplicationId.compareTo(). (Wangda Tan via raviprak)
|
|
|
|
|
|
2014-06-27 19:13:14 -04:00
|
|
|
|
YARN-2104. Scheduler queue filter failed to work because index of queue
|
|
|
|
|
column changed. (Wangda Tan via jlowe)
|
|
|
|
|
|
2014-06-27 23:33:46 -04:00
|
|
|
|
YARN-2201. Made TestRMWebServicesAppsModification be independent of the
|
|
|
|
|
changes on yarn-default.xml. (Varun Vasudev via zjshen)
|
|
|
|
|
|
2014-06-30 12:51:04 -04:00
|
|
|
|
YARN-2216 TestRMApplicationHistoryWriter sometimes fails in trunk.
|
|
|
|
|
(Zhijie Shen via xgong)
|
|
|
|
|
|
2014-07-02 14:34:09 -04:00
|
|
|
|
YARN-2216 YARN-2065 AM cannot create new containers after restart
|
|
|
|
|
(Jian He via stevel)
|
|
|
|
|
|
2014-07-02 17:37:20 -04:00
|
|
|
|
YARN-2232. Fixed ResourceManager to allow DelegationToken owners to be able
|
|
|
|
|
to cancel their own tokens in secure mode. (Varun Vasudev via vinodkv)
|
|
|
|
|
|
2014-07-04 11:17:14 -04:00
|
|
|
|
YARN-2250. FairScheduler.findLowestCommonAncestorQueue returns null when
|
|
|
|
|
queues not identical (Krisztian Horvath via Sandy Ryza)
|
|
|
|
|
|
2014-07-08 02:09:09 -04:00
|
|
|
|
YARN-2158. Improved assertion messages of TestRMWebServicesAppsModification.
|
|
|
|
|
(Varun Vasudev via zjshen)
|
|
|
|
|
|
2014-07-10 19:32:36 -04:00
|
|
|
|
YARN-2269. Remove External links from YARN UI. (Craig Welch via xgong)
|
|
|
|
|
|
2014-07-22 01:02:26 -04:00
|
|
|
|
YARN-2270. Made TestFSDownload#testDownloadPublicWithStatCache be skipped
|
|
|
|
|
when there’s no ancestor permissions. (Akira Ajisaka via zjshen)
|
|
|
|
|
|
2014-07-22 11:17:13 -04:00
|
|
|
|
YARN-2319. Made the MiniKdc instance start/close before/after the class of
|
|
|
|
|
TestRMWebServicesDelegationTokens. (Wenwu Peng via zjshen)
|
|
|
|
|
|
2014-07-25 13:33:42 -04:00
|
|
|
|
YARN-2335. Annotate all hadoop-sls APIs as @Private. (Wei Yan via kasha)
|
|
|
|
|
|
2014-07-25 21:55:03 -04:00
|
|
|
|
YARN-1726. ResourceSchedulerWrapper broken due to AbstractYarnScheduler.
|
|
|
|
|
(Wei Yan via kasha)
|
|
|
|
|
|
2015-02-02 15:11:36 -05:00
|
|
|
|
YARN-2216. TestRMApplicationHistoryWriter sometimes fails in trunk.
|
|
|
|
|
(Zhijie Shen via xgong)
|
|
|
|
|
|
2014-06-16 11:11:14 -04:00
|
|
|
|
Release 2.4.1 - 2014-06-23
|
2014-03-31 03:39:04 -04:00
|
|
|
|
|
|
|
|
|
INCOMPATIBLE CHANGES
|
|
|
|
|
|
|
|
|
|
NEW FEATURES
|
|
|
|
|
|
|
|
|
|
IMPROVEMENTS
|
|
|
|
|
|
2014-04-15 16:40:53 -04:00
|
|
|
|
YARN-1892. Improved some logs in the scheduler. (Jian He via zjshen)
|
|
|
|
|
|
2014-04-30 14:01:05 -04:00
|
|
|
|
YARN-1696. Added documentation for ResourceManager fail-over. (Karthik
|
|
|
|
|
Kambatla, Masatake Iwasaki, Tsuyoshi OZAWA via vinodkv)
|
|
|
|
|
|
2014-05-09 00:26:36 -04:00
|
|
|
|
YARN-1701. Improved default paths of the timeline store and the generic
|
|
|
|
|
history store. (Tsuyoshi Ozawa via zjshen)
|
|
|
|
|
|
2014-05-10 20:15:48 -04:00
|
|
|
|
YARN-1962. Changed Timeline Service client configuration to be off by default
|
|
|
|
|
given the non-readiness of the feature yet. (Mohammad Kamrul Islam via
|
|
|
|
|
vinodkv)
|
|
|
|
|
|
2014-03-31 03:39:04 -04:00
|
|
|
|
OPTIMIZATIONS
|
|
|
|
|
|
2014-04-01 20:05:15 -04:00
|
|
|
|
BUG FIXES
|
|
|
|
|
|
|
|
|
|
YARN-1898. Made Standby RM links conf, stacks, logLevel, metrics, jmx, logs
|
|
|
|
|
and static not be redirected to Active RM. (Xuan Gong via zjshen)
|
2014-03-31 03:39:04 -04:00
|
|
|
|
|
2014-04-04 14:43:59 -04:00
|
|
|
|
YARN-1837. Fixed TestMoveApplication#testMoveRejectedByScheduler failure.
|
|
|
|
|
(Hong Zhiguo via jianhe)
|
|
|
|
|
|
2014-04-06 23:08:54 -04:00
|
|
|
|
YARN-1905. TestProcfsBasedProcessTree must only run on Linux. (cnauroth)
|
|
|
|
|
|
2014-04-11 16:16:10 -04:00
|
|
|
|
YARN-1883. TestRMAdminService fails due to inconsistent entries in
|
|
|
|
|
UserGroups (Mit Desai via jeagles)
|
|
|
|
|
|
2014-04-08 18:12:17 -04:00
|
|
|
|
YARN-1908. Fixed DistributedShell to not fail in secure clusters. (Vinod
|
|
|
|
|
Kumar Vavilapalli and Jian He via vinodkv)
|
|
|
|
|
|
2014-04-09 21:37:22 -04:00
|
|
|
|
YARN-1910. Fixed a race condition in TestAMRMTokens that causes the test to
|
|
|
|
|
fail more often on Windows. (Xuan Gong via vinodkv)
|
|
|
|
|
|
2014-04-10 14:59:44 -04:00
|
|
|
|
YARN-1920. Fixed TestFileSystemApplicationHistoryStore failure on windows.
|
|
|
|
|
(Vinod Kumar Vavilapalli via zjshen)
|
|
|
|
|
|
2014-04-10 15:28:56 -04:00
|
|
|
|
YARN-1914. Fixed resource-download on NodeManagers to skip permission
|
|
|
|
|
verification of public cache files in Windows+local file-system environment.
|
|
|
|
|
(Varun Vasudev via vinodkv)
|
|
|
|
|
|
2014-04-10 21:28:22 -04:00
|
|
|
|
YARN-1903. Set exit code and diagnostics when container is killed at
|
|
|
|
|
NEW/LOCALIZING state. (Zhijie Shen via jianhe)
|
|
|
|
|
|
2014-04-10 23:38:27 -04:00
|
|
|
|
YARN-1924. Made ZKRMStateStore updateApplication(Attempt)StateInternal work
|
|
|
|
|
when Application(Attempt) state hasn't been stored before. (Jian He via
|
|
|
|
|
zjshen)
|
|
|
|
|
|
2014-04-11 00:07:11 -04:00
|
|
|
|
YARN-1926. Changed DistributedShell to use appIDs as unique identifiers for
|
|
|
|
|
HDFS paths and thus avoid test failures on Windows. (Varun Vasudev via
|
|
|
|
|
vinodkv)
|
|
|
|
|
|
2014-04-11 16:28:27 -04:00
|
|
|
|
YARN-1833. TestRMAdminService Fails in trunk and branch-2 (Mit Desai via
|
|
|
|
|
jeagles)
|
|
|
|
|
|
2014-04-11 16:23:09 -04:00
|
|
|
|
YARN-1907. TestRMApplicationHistoryWriter#testRMWritingMassiveHistory
|
|
|
|
|
intermittently fails. (Mit Desai via kihwal)
|
|
|
|
|
|
2014-04-13 17:52:09 -04:00
|
|
|
|
YARN-1933. Fixed test issues with TestAMRestart and TestNodeHealthService.
|
|
|
|
|
(Jian He via vinodkv)
|
|
|
|
|
|
2014-04-13 18:40:43 -04:00
|
|
|
|
YARN-1928. Fixed a race condition in TestAMRMRPCNodeUpdates which caused it
|
|
|
|
|
to fail occassionally. (Zhijie Shen via vinodkv)
|
|
|
|
|
|
2014-04-15 22:03:54 -04:00
|
|
|
|
YARN-1934. Fixed a potential NPE in ZKRMStateStore caused by handling
|
|
|
|
|
Disconnected event from ZK. (Karthik Kambatla via jianhe)
|
|
|
|
|
|
2014-04-17 11:25:27 -04:00
|
|
|
|
YARN-1931. Private API change in YARN-1824 in 2.4 broke compatibility
|
|
|
|
|
with previous releases (Sandy Ryza via tgraves)
|
2014-04-17 15:13:17 -04:00
|
|
|
|
|
|
|
|
|
YARN-1750. TestNodeStatusUpdater#testNMRegistration is incorrect in test
|
|
|
|
|
case. (Wangda Tan via junping_du)
|
2014-04-17 11:25:27 -04:00
|
|
|
|
|
2014-04-17 16:30:30 -04:00
|
|
|
|
YARN-1947. TestRMDelegationTokens#testRMDTMasterKeyStateOnRollingMasterKey
|
|
|
|
|
is failing intermittently. (Jian He via junping_du)
|
|
|
|
|
|
2014-04-17 16:58:23 -04:00
|
|
|
|
YARN-1281. Fixed TestZKRMStateStoreZKClientConnections to not fail
|
|
|
|
|
intermittently due to ZK-client timeouts. (Tsuyoshi Ozawa via vinodkv)
|
|
|
|
|
|
2014-04-18 17:46:14 -04:00
|
|
|
|
YARN-1932. Javascript injection on the job status page (Mit Desai via
|
|
|
|
|
jlowe)
|
|
|
|
|
|
2014-04-24 16:06:44 -04:00
|
|
|
|
YARN-1975. Used resources shows escaped html in CapacityScheduler and
|
|
|
|
|
FairScheduler page (Mit Desai via jlowe)
|
|
|
|
|
|
2014-04-29 15:50:17 -04:00
|
|
|
|
YARN-1929. Fixed a deadlock in ResourceManager that occurs when failover
|
|
|
|
|
happens right at the time of shutdown. (Karthik Kambatla via vinodkv)
|
|
|
|
|
|
2014-05-03 09:06:32 -04:00
|
|
|
|
YARN-1201. TestAMAuthorization fails with local hostname cannot be resolved.
|
|
|
|
|
(Wangda Tan via junping_du)
|
|
|
|
|
|
2014-05-13 16:03:52 -04:00
|
|
|
|
YARN-1861. Fixed a bug in RM to reset leader-election on fencing that was
|
|
|
|
|
causing both RMs to be stuck in standby mode when automatic failover is
|
|
|
|
|
enabled. (Karthik Kambatla and Xuan Gong via vinodkv)
|
|
|
|
|
|
2014-05-13 19:15:41 -04:00
|
|
|
|
YARN-1957. Consider the max capacity of the queue when computing the ideal
|
|
|
|
|
capacity for preemption. (Carlo Curino via cdouglas)
|
|
|
|
|
|
2014-05-14 02:44:52 -04:00
|
|
|
|
YARN-1986. In Fifo Scheduler, node heartbeat in between creating app and
|
|
|
|
|
attempt causes NPE (Hong Zhiguo via Sandy Ryza)
|
|
|
|
|
|
2014-05-16 03:12:09 -04:00
|
|
|
|
YARN-1976. Fix yarn application CLI to print the scheme of the tracking url
|
|
|
|
|
of failed/killed applications. (Junping Du via jianhe)
|
|
|
|
|
|
|
|
|
|
YARN-2016. Fix a bug in GetApplicationsRequestPBImpl to add the missed fields
|
|
|
|
|
to proto. (Junping Du via jianhe)
|
|
|
|
|
|
|
|
|
|
YARN-2053. Fixed a bug in AMS to not add null NMToken into NMTokens list from
|
|
|
|
|
previous attempts for work-preserving AM restart. (Wangda Tan via jianhe)
|
|
|
|
|
|
2014-05-16 21:50:15 -04:00
|
|
|
|
YARN-2066. Wrong field is referenced in GetApplicationsRequestPBImpl#mergeLocalToBuilder()
|
|
|
|
|
(Hong Zhiguo via junping_du)
|
|
|
|
|
|
2014-05-21 21:19:00 -04:00
|
|
|
|
YARN-2081. Fixed TestDistributedShell failure after YARN-1962. (Zhiguo Hong
|
|
|
|
|
via zjshen)
|
|
|
|
|
|
2014-03-31 03:39:04 -04:00
|
|
|
|
Release 2.4.0 - 2014-04-07
|
2013-06-04 11:34:52 -04:00
|
|
|
|
|
|
|
|
|
INCOMPATIBLE CHANGES
|
|
|
|
|
|
2014-01-30 14:57:22 -05:00
|
|
|
|
NEW FEATURES
|
|
|
|
|
|
2014-01-30 15:40:25 -05:00
|
|
|
|
YARN-930. Bootstrapping ApplicationHistoryService module. (vinodkv)
|
|
|
|
|
|
|
|
|
|
YARN-947. Implementing the data objects to be used by the History reader
|
|
|
|
|
and writer interfaces. (Zhijie Shen via vinodkv)
|
|
|
|
|
|
|
|
|
|
YARN-934. Defined a Writer Interface for HistoryStorage. (Zhijie Shen via
|
|
|
|
|
vinodkv)
|
|
|
|
|
|
|
|
|
|
YARN-925. Defined a Reader Interface for HistoryStorage. (Mayank Bansal via
|
|
|
|
|
vinodkv)
|
|
|
|
|
|
|
|
|
|
YARN-978. Created ApplicationAttemptReport. (Mayank Bansal via vinodkv)
|
|
|
|
|
|
|
|
|
|
YARN-956. Added a testable in-memory HistoryStorage. (Mayank Bansal via
|
|
|
|
|
vinodkv)
|
|
|
|
|
|
|
|
|
|
YARN-975. Added a file-system implementation for HistoryStorage. (Zhijie Shen
|
|
|
|
|
via vinodkv)
|
|
|
|
|
|
|
|
|
|
YARN-1123. Added a new ContainerReport and its Protobuf implementation. (Mayank
|
|
|
|
|
Bansal via vinodkv)
|
|
|
|
|
|
|
|
|
|
YARN-979. Added more APIs for getting information about ApplicationAttempts
|
|
|
|
|
and Containers from ApplicationHistoryProtocol. (Mayank Bansal and Zhijie Shen
|
|
|
|
|
via vinodkv)
|
|
|
|
|
|
|
|
|
|
YARN-953. Changed ResourceManager to start writing history data. (Zhijie Shen
|
|
|
|
|
via vinodkv)
|
|
|
|
|
|
|
|
|
|
YARN-1266. Implemented PB service and client wrappers for
|
|
|
|
|
ApplicationHistoryProtocol. (Mayank Bansal via vinodkv)
|
|
|
|
|
|
|
|
|
|
YARN-955. Implemented ApplicationHistoryProtocol handler. (Mayank Bansal via
|
|
|
|
|
vinodkv)
|
|
|
|
|
|
|
|
|
|
YARN-1242. Changed yarn scripts to be able to start ApplicationHistoryServer
|
|
|
|
|
as an individual process. (Mayank Bansal via vinodkv)
|
|
|
|
|
|
|
|
|
|
YARN-954. Implemented web UI for the ApplicationHistoryServer and wired it into
|
|
|
|
|
the HistoryStorage. (Zhijie Shen via vinodkv)
|
|
|
|
|
|
|
|
|
|
YARN-967. Added the client and CLI interfaces for obtaining ApplicationHistory
|
|
|
|
|
data. (Mayank Bansal via vinodkv)
|
|
|
|
|
|
|
|
|
|
YARN-1023. Added Webservices REST APIs support for Application History. (Zhijie
|
|
|
|
|
Shen via vinodkv)
|
|
|
|
|
|
|
|
|
|
YARN-1413. Implemented serving of aggregated-logs in the ApplicationHistory
|
|
|
|
|
server. (Mayank Bansal via vinodkv)
|
|
|
|
|
|
2014-01-31 19:10:26 -05:00
|
|
|
|
YARN-1633. Defined user-facing entity, entity-info and event objects related
|
|
|
|
|
to Application Timeline feature. (Zhijie Shen via vinodkv)
|
|
|
|
|
|
2014-02-03 14:08:26 -05:00
|
|
|
|
YARN-1611. Introduced the concept of a configuration provider which can be
|
|
|
|
|
used by ResourceManager to read configuration locally or from remote systems
|
|
|
|
|
so as to help RM failover. (Xuan Gong via vinodkv)
|
|
|
|
|
|
2014-02-03 15:07:55 -05:00
|
|
|
|
YARN-1659. Defined the ApplicationTimelineStore store as an abstraction for
|
|
|
|
|
implementing different storage impls for storing timeline information.
|
|
|
|
|
(Billie Rinaldi via vinodkv)
|
|
|
|
|
|
2014-02-04 19:32:40 -05:00
|
|
|
|
YARN-1634. Added a testable in-memory implementation of
|
|
|
|
|
ApplicationTimelineStore. (Zhijie Shen via vinodkv)
|
|
|
|
|
|
2014-02-04 23:58:50 -05:00
|
|
|
|
YARN-1461. Added tags for YARN applications and changed RM to handle them.
|
|
|
|
|
(Karthik Kambatla via zjshen)
|
|
|
|
|
|
2014-02-05 12:03:01 -05:00
|
|
|
|
YARN-1636. Augmented Application-history server's web-services to also expose
|
|
|
|
|
new APIs for retrieving and storing timeline information. (Zhijie Shen via
|
|
|
|
|
vinodkv)
|
|
|
|
|
|
2014-02-07 15:40:58 -05:00
|
|
|
|
YARN-1490. Introduced the ability to make ResourceManager optionally not kill
|
|
|
|
|
all containers when an ApplicationMaster exits. (Jian He via vinodkv)
|
|
|
|
|
|
|
|
|
|
YARN-1041. Added the ApplicationMasterProtocol API for applications to use the
|
|
|
|
|
ability in ResourceManager to optionally not kill containers when the
|
|
|
|
|
ApplicationMaster exits. (Jian He via vinodkv)
|
|
|
|
|
|
|
|
|
|
YARN-1566. Changed Distributed Shell to retain containers across application
|
|
|
|
|
attempts. (Jian He via vinodkv)
|
|
|
|
|
|
2014-02-07 21:18:06 -05:00
|
|
|
|
YARN-1635. Implemented a Leveldb based ApplicationTimelineStore. (Billie
|
|
|
|
|
Rinaldi via zjshen)
|
|
|
|
|
|
2014-02-10 16:33:41 -05:00
|
|
|
|
YARN-1637. Implemented a client library for Java users to post timeline
|
|
|
|
|
entities and events. (zjshen)
|
|
|
|
|
|
2014-02-11 20:00:08 -05:00
|
|
|
|
YARN-1496. Protocol additions to allow moving apps between queues (Sandy
|
|
|
|
|
Ryza)
|
|
|
|
|
|
2014-02-11 20:05:40 -05:00
|
|
|
|
YARN-1498. Common scheduler changes for moving apps between queues (Sandy
|
|
|
|
|
Ryza)
|
|
|
|
|
|
2014-02-11 20:16:05 -05:00
|
|
|
|
YARN-1504. RM changes for moving apps between queues (Sandy Ryza)
|
|
|
|
|
|
2014-02-11 20:19:42 -05:00
|
|
|
|
YARN-1499. Fair Scheduler changes for moving apps between queues (Sandy
|
|
|
|
|
Ryza)
|
|
|
|
|
|
2014-02-11 20:22:02 -05:00
|
|
|
|
YARN-1497. Command line additions for moving apps between queues (Sandy
|
|
|
|
|
Ryza)
|
|
|
|
|
|
2014-02-26 15:20:39 -05:00
|
|
|
|
YARN-1588. Enhanced RM and the scheduling protocol to also send NMTokens of
|
|
|
|
|
transferred containers from previous app-attempts to new AMs after YARN-1490.
|
|
|
|
|
(Jian He via vinodkv)
|
|
|
|
|
|
2014-03-14 16:37:10 -04:00
|
|
|
|
YARN-1717. Enabled periodically discarding old data in LeveldbTimelineStore.
|
|
|
|
|
(Billie Rinaldi via zjshen)
|
|
|
|
|
|
2014-03-18 23:51:27 -04:00
|
|
|
|
YARN-1690. Made DistributedShell send timeline entities+events. (Mayank Bansal
|
|
|
|
|
via zjshen)
|
|
|
|
|
|
2014-03-21 20:02:26 -04:00
|
|
|
|
YARN-1775. Enhanced ProcfsBasedProcessTree to optionally add the ability to
|
|
|
|
|
use smaps for obtaining used memory information. (Rajesh Balamohan via
|
|
|
|
|
vinodkv)
|
|
|
|
|
|
2014-03-24 14:16:27 -04:00
|
|
|
|
YARN-1838. Enhanced timeline service getEntities API to get entities from a
|
|
|
|
|
given entity ID or insertion timestamp. (Billie Rinaldi via zjshen)
|
|
|
|
|
|
2014-01-30 14:57:22 -05:00
|
|
|
|
IMPROVEMENTS
|
|
|
|
|
|
2014-01-30 15:40:25 -05:00
|
|
|
|
YARN-1007. Enhance History Reader interface for Containers. (Mayank Bansal via
|
|
|
|
|
devaraj)
|
|
|
|
|
|
|
|
|
|
YARN-974. Added more information to RMContainer to be collected and recorded in
|
|
|
|
|
Application-History. (Zhijie Shen via vinodkv)
|
|
|
|
|
|
|
|
|
|
YARN-987. Added ApplicationHistoryManager responsible for exposing reports to
|
|
|
|
|
all clients. (Mayank Bansal via vinodkv)
|
|
|
|
|
|
2014-01-30 14:57:22 -05:00
|
|
|
|
YARN-1630. Introduce timeout for async polling operations in YarnClientImpl
|
|
|
|
|
(Aditya Acharya via Sandy Ryza)
|
|
|
|
|
|
2014-01-30 17:41:16 -05:00
|
|
|
|
YARN-1617. Remove ancient comment and surround LOG.debug in
|
|
|
|
|
AppSchedulingInfo.allocate (Sandy Ryza)
|
|
|
|
|
|
2014-02-03 14:55:58 -05:00
|
|
|
|
YARN-1639. Modified RM HA configuration handling to have a way of not
|
|
|
|
|
requiring separate configuration files for each RM. (Xuan Gong via vinodkv)
|
|
|
|
|
|
2014-02-03 15:16:56 -05:00
|
|
|
|
YARN-1668. Modified RM HA handling of admin-acls to be available across RM
|
|
|
|
|
failover by making using of a remote configuration-provider. (Xuan Gong via
|
|
|
|
|
vinodkv)
|
|
|
|
|
|
2014-02-03 17:11:22 -05:00
|
|
|
|
YARN-1667. Modified RM HA handling of super users (with proxying ability) to
|
|
|
|
|
be available across RM failover by making using of a remote
|
|
|
|
|
configuration-provider. (Xuan Gong via vinodkv)
|
|
|
|
|
|
2014-02-03 23:23:35 -05:00
|
|
|
|
YARN-1285. Changed the default value of yarn.acl.enable in yarn-default.xml
|
|
|
|
|
to be consistent with what exists (false) in the code and documentation.
|
|
|
|
|
(Kenji Kikushima via vinodkv)
|
|
|
|
|
|
2014-02-04 17:57:37 -05:00
|
|
|
|
YARN-1669. Modified RM HA handling of protocol level service-ACLS to
|
|
|
|
|
be available across RM failover by making using of a remote
|
|
|
|
|
configuration-provider. (Xuan Gong via vinodkv)
|
|
|
|
|
|
2014-02-06 21:40:02 -05:00
|
|
|
|
YARN-1665. Simplify the configuration of RM HA by having better default
|
|
|
|
|
values. (Xuan Gong via vinodkv)
|
|
|
|
|
|
2014-02-06 22:19:04 -05:00
|
|
|
|
YARN-1660. Simplified the RM HA configuration to accept and be able to simply
|
|
|
|
|
depend just on configuration properties of the form
|
|
|
|
|
yarn.resourcemanager.hostname.RMID and use the default ports for all service
|
|
|
|
|
addresses. (Xuan Gong via vinodkv)
|
|
|
|
|
|
2014-02-07 15:40:58 -05:00
|
|
|
|
YARN-1493. Changed ResourceManager and Scheduler interfacing to recognize
|
|
|
|
|
app-attempts separately from apps. (Jian He via vinodkv)
|
|
|
|
|
|
2014-02-10 17:51:30 -05:00
|
|
|
|
YARN-1459. Changed ResourceManager to depend its service initialization
|
|
|
|
|
on the configuration-provider mechanism during startup too. (Xuan Gong via
|
|
|
|
|
vinodkv)
|
|
|
|
|
|
2014-02-10 23:41:45 -05:00
|
|
|
|
YARN-1706. Created an utility method to dump timeline records to JSON
|
|
|
|
|
strings. (zjshen)
|
|
|
|
|
|
2014-02-12 09:11:37 -05:00
|
|
|
|
YARN-1641. ZK store should attempt a write periodically to ensure it is
|
|
|
|
|
still Active. (kasha)
|
|
|
|
|
|
2014-02-12 17:31:54 -05:00
|
|
|
|
YARN-1531. True up yarn command documentation (Akira Ajisaka via kasha)
|
|
|
|
|
|
2014-02-12 20:01:40 -05:00
|
|
|
|
YARN-1345. Remove FINAL_SAVING state from YarnApplicationAttemptState
|
|
|
|
|
(Zhijie Shen via jianhe)
|
|
|
|
|
|
2014-02-13 16:25:34 -05:00
|
|
|
|
YARN-1676. Modified RM HA handling of user-to-group mappings to
|
|
|
|
|
be available across RM failover by making using of a remote
|
|
|
|
|
configuration-provider. (Xuan Gong via vinodkv)
|
|
|
|
|
|
2014-02-19 12:53:45 -05:00
|
|
|
|
YARN-1666. Modified RM HA handling of include/exclude node-lists to be
|
|
|
|
|
available across RM failover by making using of a remote
|
|
|
|
|
configuration-provider. (Xuan Gong via vinodkv)
|
|
|
|
|
|
2014-02-19 16:30:30 -05:00
|
|
|
|
YARN-1171. Add default queue properties to Fair Scheduler documentation
|
|
|
|
|
(Naren Koneru via Sandy Ryza)
|
|
|
|
|
|
2014-02-21 16:21:48 -05:00
|
|
|
|
YARN-1470. Add audience annotations to MiniYARNCluster. (Anubhav Dhoot
|
|
|
|
|
via kasha)
|
|
|
|
|
|
2014-02-22 15:47:24 -05:00
|
|
|
|
YARN-1732. Changed types of related-entities and primary-filters in the
|
|
|
|
|
timeline-service to be sets instead of maps. (Billie Rinaldi via vinodkv)
|
|
|
|
|
|
2014-02-22 15:55:42 -05:00
|
|
|
|
YARN-1687. Renamed user-facing records for the timeline-service to be simply
|
|
|
|
|
named after 'timeline' instead of 'apptimeline'. (Zhijie Shen via vinodkv)
|
|
|
|
|
|
2014-02-22 21:05:28 -05:00
|
|
|
|
YARN-1749. Updated application-history related configs to reflect the latest
|
|
|
|
|
reality and to be consistently named. (Zhijie Shen via vinodkv)
|
|
|
|
|
|
2014-02-26 21:10:43 -05:00
|
|
|
|
YARN-1301. Added the INFO level log of the non-empty blacklist additions
|
|
|
|
|
and removals inside ApplicationMasterService. (Tsuyoshi Ozawa via zjshen)
|
|
|
|
|
|
2014-02-28 12:36:04 -05:00
|
|
|
|
YARN-1528. Allow setting auth for ZK connections. (kasha)
|
|
|
|
|
|
2014-03-03 14:53:53 -05:00
|
|
|
|
YARN-1704. Modified LICENSE and NOTICE files to reflect newly used levelDB
|
|
|
|
|
related libraries. (Billie Rinaldi via vinodkv)
|
|
|
|
|
|
2014-03-03 15:39:34 -05:00
|
|
|
|
YARN-1765. Added test cases to verify that killApplication API works across
|
|
|
|
|
ResourceManager failover. (Xuan Gong via vinodkv)
|
|
|
|
|
|
2014-03-04 12:34:01 -05:00
|
|
|
|
YARN-1730. Implemented simple write-locking in the LevelDB based timeline-
|
|
|
|
|
store. (Billie Rinaldi via vinodkv)
|
|
|
|
|
|
2014-03-04 15:39:33 -05:00
|
|
|
|
YARN-986. Changed client side to be able to figure out the right RM Delegation
|
|
|
|
|
token for the right ResourceManager when HA is enabled. (Karthik Kambatla via
|
|
|
|
|
vinodkv)
|
|
|
|
|
|
2014-03-05 16:08:20 -05:00
|
|
|
|
YARN-1761. Modified RMAdmin CLI to check whether HA is enabled or not before
|
|
|
|
|
it executes any of the HA admin related commands. (Xuan Gong via vinodkv)
|
|
|
|
|
|
2014-03-06 22:53:31 -05:00
|
|
|
|
YARN-1780. Improved logging in the Timeline client and server. (Zhijie Shen
|
|
|
|
|
via vinodkv)
|
|
|
|
|
|
2014-03-06 23:35:01 -05:00
|
|
|
|
YARN-1525. Web UI should redirect to active RM when HA is enabled. (Cindy Li
|
|
|
|
|
via kasha)
|
|
|
|
|
|
2014-03-07 19:52:32 -05:00
|
|
|
|
YARN-1781. Modified NodeManagers to allow admins to specify max disk
|
|
|
|
|
utilization for local disks so as to be able to offline full disks. (Varun
|
|
|
|
|
Vasudev via vinodkv)
|
|
|
|
|
|
2014-03-07 23:44:02 -05:00
|
|
|
|
YARN-1410. Added tests to validate that clients can fail-over to a new RM
|
|
|
|
|
after getting an application-ID but before submission and can still submit to
|
|
|
|
|
the newly active RM with no issues. (Xuan Gong via vinodkv)
|
|
|
|
|
|
2014-03-10 20:52:33 -04:00
|
|
|
|
YARN-1764. Modified YarnClient to correctly handle failover of ResourceManager
|
|
|
|
|
after the submitApplication call goes through. (Xuan Gong via vinodkv)
|
|
|
|
|
|
2014-03-13 03:45:30 -04:00
|
|
|
|
YARN-1389. Made ApplicationClientProtocol and ApplicationHistoryProtocol
|
|
|
|
|
expose analogous getApplication(s)/Attempt(s)/Container(s) APIs. (Mayank
|
|
|
|
|
Bansal via zjshen)
|
|
|
|
|
|
2014-03-13 22:40:28 -04:00
|
|
|
|
YARN-1658. Modified web-app framework to let standby RMs redirect
|
|
|
|
|
web-service calls to the active RM. (Cindy Li via vinodkv)
|
|
|
|
|
|
2014-03-16 15:13:16 -04:00
|
|
|
|
YARN-1824. Improved NodeManager and clients to be able to handle cross
|
|
|
|
|
platform application submissions. (Jian He via vinodkv)
|
|
|
|
|
|
2014-03-17 22:53:50 -04:00
|
|
|
|
YARN-1512. Enhanced CapacityScheduler to be able to decouple scheduling from
|
|
|
|
|
node-heartbeats. (Arun C Murthy via vinodkv)
|
|
|
|
|
|
2014-03-20 18:14:39 -04:00
|
|
|
|
YARN-1570. Fixed formatting of the lines in YarnCommands.apt.vm docs source.
|
|
|
|
|
(Akira Ajisaka via vinodkv)
|
|
|
|
|
|
2014-03-21 22:38:23 -04:00
|
|
|
|
YARN-1536. Cleanup: Get rid of ResourceManager#get*SecretManager() methods
|
|
|
|
|
and use the RMContext methods instead. (Anubhav Dhoot via kasha)
|
|
|
|
|
|
2014-03-24 22:23:08 -04:00
|
|
|
|
YARN-1850. Introduced the ability to optionally disable sending out timeline-
|
|
|
|
|
events in the TimelineClient. (Zhijie Shen via vinodkv)
|
|
|
|
|
|
2014-03-25 22:54:00 -04:00
|
|
|
|
YARN-1452. Added documentation about the configuration and usage of generic
|
|
|
|
|
application history and the timeline data service. (Zhijie Shen via vinodkv)
|
|
|
|
|
|
2014-03-28 17:54:52 -04:00
|
|
|
|
YARN-1891. Added documentation for NodeManager health-monitoring. (Varun
|
|
|
|
|
Vasudev via vinodkv)
|
|
|
|
|
|
2014-03-28 19:41:44 -04:00
|
|
|
|
YARN-1017. Added documentation for ResourceManager Restart.(jianhe)
|
|
|
|
|
|
2014-02-03 17:11:22 -05:00
|
|
|
|
OPTIMIZATIONS
|
|
|
|
|
|
2014-03-22 21:09:24 -04:00
|
|
|
|
YARN-1771. Reduce the number of NameNode operations during localization of
|
|
|
|
|
public resources using a cache. (Sangjin Lee via cdouglas)
|
|
|
|
|
|
2014-02-03 17:11:22 -05:00
|
|
|
|
BUG FIXES
|
|
|
|
|
|
|
|
|
|
YARN-935. Correcting pom.xml to build applicationhistoryserver module
|
|
|
|
|
successfully. (Zhijie Shen via vinodkv)
|
|
|
|
|
|
|
|
|
|
YARN-962. Fixed bug in application-history proto file and renamed it be just
|
|
|
|
|
a client proto file. (Zhijie Shen via vinodkv)
|
|
|
|
|
|
|
|
|
|
YARN-984. Renamed the incorrectly named applicationhistoryservice.records.pb.impl
|
|
|
|
|
package to be applicationhistoryservice.records.impl.pb. (Devaraj K via vinodkv)
|
|
|
|
|
|
|
|
|
|
YARN-1534. Fixed failure of test TestAHSWebApp. (Shinichi Yamashita via vinodkv)
|
|
|
|
|
|
|
|
|
|
YARN-1555. Fixed test failures in applicationhistoryservice.* (Vinod Kumar
|
|
|
|
|
Vavilapalli via mayank)
|
2014-01-30 15:40:25 -05:00
|
|
|
|
|
|
|
|
|
YARN-1594. Updated pom.xml of applicationhistoryservice sub-project according to
|
|
|
|
|
YARN-888. (Vinod Kumar Vavilapalli via zjshen)
|
|
|
|
|
|
|
|
|
|
YARN-1596. Fixed Javadoc warnings on branch YARN-321. (Vinod Kumar Vavilapalli
|
|
|
|
|
via zjshen)
|
|
|
|
|
|
|
|
|
|
YARN-1597. Fixed Findbugs warnings on branch YARN-321. (Vinod Kumar Vavilapalli
|
|
|
|
|
via zjshen)
|
|
|
|
|
|
|
|
|
|
YARN-1595. Made enabling history service configurable and fixed test failures on
|
|
|
|
|
branch YARN-321. (Vinod Kumar Vavilapalli via zjshen)
|
|
|
|
|
|
|
|
|
|
YARN-1605. Fixed formatting issues in the new module on branch YARN-321. (Vinod
|
|
|
|
|
Kumar Vavilapalli via zjshen)
|
|
|
|
|
|
|
|
|
|
YARN-1625. Fixed RAT warnings after YARN-321 merge. (Shinichi Yamashita via
|
|
|
|
|
vinodkv)
|
|
|
|
|
|
|
|
|
|
YARN-1613. Fixed the typo with the configuration name
|
|
|
|
|
YARN_HISTORY_SERVICE_ENABLED. (Akira Ajisaka via vinodkv)
|
|
|
|
|
|
2014-01-30 14:57:22 -05:00
|
|
|
|
YARN-1618. Fix invalid RMApp transition from NEW to FINAL_SAVING (kasha)
|
|
|
|
|
|
|
|
|
|
YARN-1600. RM does not startup when security is enabled without spnego
|
|
|
|
|
configured (Haohui Mai via jlowe)
|
|
|
|
|
|
|
|
|
|
YARN-1642. RMDTRenewer#getRMClient should use ClientRMProxy (kasha)
|
|
|
|
|
|
2014-01-31 11:13:21 -05:00
|
|
|
|
YARN-1632. TestApplicationMasterServices should be under
|
|
|
|
|
org.apache.hadoop.yarn.server.resourcemanager package (Chen He via jeagles)
|
|
|
|
|
|
2014-02-03 23:08:51 -05:00
|
|
|
|
YARN-1673. Fix option parsing in YARN's application CLI after it is broken
|
|
|
|
|
by YARN-967. (Mayank Bansal via vinodkv)
|
|
|
|
|
|
2014-02-03 23:47:23 -05:00
|
|
|
|
YARN-1684. Fixed history server heap size in yarn script. (Billie Rinaldi
|
|
|
|
|
via zjshen)
|
|
|
|
|
|
2014-02-07 15:40:58 -05:00
|
|
|
|
YARN-1166. Fixed app-specific and attempt-specific QueueMetrics to be
|
|
|
|
|
triggered by accordingly app event and attempt event.
|
|
|
|
|
|
|
|
|
|
YARN-1689. Made RMAppAttempt get killed when RMApp is at ACCEPTED. (Vinod
|
|
|
|
|
Kumar Vavilapalli via zjshen)
|
|
|
|
|
|
|
|
|
|
YARN-1661. Fixed DS ApplicationMaster to write the correct exit log. (Vinod
|
|
|
|
|
Kumar Vavilapalli via zjshen)
|
|
|
|
|
|
2014-02-07 20:56:10 -05:00
|
|
|
|
YARN-1672. YarnConfiguration is missing a default for
|
|
|
|
|
yarn.nodemanager.log.retain-seconds (Naren Koneru via kasha)
|
|
|
|
|
|
2014-02-10 20:05:44 -05:00
|
|
|
|
YARN-1698. Fixed default TimelineStore in code to match what is documented
|
|
|
|
|
in yarn-default.xml (Zhijie Shen via vinodkv)
|
|
|
|
|
|
2014-02-12 03:06:42 -05:00
|
|
|
|
YARN-1697. NodeManager reports negative running containers (Sandy Ryza)
|
2014-02-11 15:50:22 -05:00
|
|
|
|
|
2014-02-11 21:17:11 -05:00
|
|
|
|
YARN-1719. Fixed the root path related Jersey warnings produced in
|
|
|
|
|
ATSWebServices. (Billie Rinaldi via zjshen)
|
|
|
|
|
|
2014-02-12 18:13:08 -05:00
|
|
|
|
YARN-1692. ConcurrentModificationException in fair scheduler AppSchedulable
|
|
|
|
|
(Sangjin Lee via Sandy Ryza)
|
|
|
|
|
|
2014-02-12 19:11:04 -05:00
|
|
|
|
YARN-1578. Fixed reading incomplete application attempt and container data
|
|
|
|
|
in FileSystemApplicationHistoryStore. (Shinichi Yamashita via zjshen)
|
|
|
|
|
|
2014-02-13 17:02:38 -05:00
|
|
|
|
YARN-1417. Modified RM to generate container-tokens not at creation time, but
|
|
|
|
|
at allocation time so as to prevent RM from shelling out containers with
|
|
|
|
|
expired tokens. (Omkar Vinit Joshi and Jian He via vinodkv)
|
|
|
|
|
|
2014-02-14 15:01:32 -05:00
|
|
|
|
YARN-1553. Modified YARN and MR to stop using HttpConfig.isSecure() and
|
|
|
|
|
instead rely on the http policy framework. And also fix some bugs related
|
|
|
|
|
to https handling in YARN web-apps. (Haohui Mai via vinodkv)
|
|
|
|
|
|
2014-02-18 12:52:30 -05:00
|
|
|
|
YARN-1721. When moving app between queues in Fair Scheduler, grab lock on
|
|
|
|
|
FSSchedulerApp (Sandy Ryza)
|
|
|
|
|
|
2014-02-18 13:07:59 -05:00
|
|
|
|
YARN-1724. Race condition in Fair Scheduler when continuous scheduling is
|
|
|
|
|
turned on (Sandy Ryza)
|
|
|
|
|
|
2014-02-18 16:51:06 -05:00
|
|
|
|
YARN-1590. Fixed ResourceManager, web-app proxy and MR JobHistoryServer to
|
|
|
|
|
expand _HOST properly in their kerberos principles. (Mohammad Kamrul Islam
|
|
|
|
|
va vinodkv)
|
|
|
|
|
|
2014-02-18 20:47:21 -05:00
|
|
|
|
YARN-1428. Fixed RM to write the final state of RMApp/RMAppAttempt to the
|
|
|
|
|
application history store in the transition to the final state. (Contributed
|
|
|
|
|
by Zhijie Shen)
|
|
|
|
|
|
2014-02-19 18:39:48 -05:00
|
|
|
|
YARN-713. Fixed ResourceManager to not crash while building tokens when DNS
|
|
|
|
|
issues happen transmittently. (Jian He via vinodkv)
|
|
|
|
|
|
2014-02-20 21:21:13 -05:00
|
|
|
|
YARN-1398. Fixed a deadlock in ResourceManager between users requesting
|
|
|
|
|
queue-acls and completing containers. (vinodkv)
|
|
|
|
|
|
2014-02-21 01:49:43 -05:00
|
|
|
|
YARN-1071. Enabled ResourceManager to recover cluster metrics
|
|
|
|
|
numDecommissionedNMs after restarting. (Jian He via zjshen)
|
|
|
|
|
|
2014-02-22 21:33:15 -05:00
|
|
|
|
YARN-1742. Fixed javadoc of configuration parameter
|
|
|
|
|
DEFAULT_NM_MIN_HEALTHY_DISKS_FRACTION. (Akira Ajisaka via vinodkv)
|
|
|
|
|
|
2014-02-24 17:42:00 -05:00
|
|
|
|
YARN-1686. Fixed NodeManager to properly handle any errors during
|
|
|
|
|
re-registration after a RESYNC and thus avoid hanging. (Rohith Sharma via
|
|
|
|
|
vinodkv)
|
|
|
|
|
|
2014-02-24 21:08:36 -05:00
|
|
|
|
YARN-1734. Fixed ResourceManager to update the configurations when it
|
|
|
|
|
transits from standby to active mode so as to assimilate any changes that
|
|
|
|
|
happened while it was in standby mode. (Xuan Gong via vinodkv)
|
|
|
|
|
|
2014-02-25 13:16:04 -05:00
|
|
|
|
YARN-1760. TestRMAdminService assumes CapacityScheduler. (kasha)
|
|
|
|
|
|
2014-03-03 14:42:24 -05:00
|
|
|
|
YARN-1758. Fixed ResourceManager to not mandate the presence of site specific
|
|
|
|
|
configuration files and thus fix failures in downstream tests. (Xuan Gong via
|
|
|
|
|
vinodkv)
|
|
|
|
|
|
2014-03-03 18:09:31 -05:00
|
|
|
|
YARN-1748. Excluded core-site.xml from hadoop-yarn-server-tests package's jar
|
|
|
|
|
and thus avoid breaking downstream tests. (Sravya Tirukkovalur via vinodkv)
|
|
|
|
|
|
2014-03-03 19:23:23 -05:00
|
|
|
|
YARN-1729. Made TimelineWebServices deserialize the string primary- and
|
|
|
|
|
secondary-filters param into the JSON-compatible object. (Billie Rinaldi via
|
|
|
|
|
zjshen)
|
2014-03-04 18:35:51 -05:00
|
|
|
|
|
|
|
|
|
YARN-1766. Fixed a bug in ResourceManager to use configuration loaded from the
|
|
|
|
|
configuration-provider when booting up. (Xuan Gong via vinodkv)
|
2014-03-05 04:45:28 -05:00
|
|
|
|
|
|
|
|
|
YARN-1768. Fixed error message being too verbose when killing a non-existent
|
2014-03-07 17:37:12 -05:00
|
|
|
|
application. (Tsuyoshi OZAWA via raviprak)
|
2014-03-03 19:23:23 -05:00
|
|
|
|
|
2014-03-07 16:34:51 -05:00
|
|
|
|
YARN-1774. FS: Submitting to non-leaf queue throws NPE. (Anubhav Dhoot and
|
|
|
|
|
Karthik Kambatla via kasha)
|
2014-03-03 19:23:23 -05:00
|
|
|
|
|
2014-03-07 17:37:12 -05:00
|
|
|
|
YARN-1783. Fixed a bug in NodeManager's status-updater that was losing
|
|
|
|
|
completed container statuses when NodeManager is forced to resync by the
|
|
|
|
|
ResourceManager. (Jian He via vinodkv)
|
|
|
|
|
|
2014-03-07 23:50:20 -05:00
|
|
|
|
YARN-1787. Fixed help messages for applicationattempt and container
|
|
|
|
|
sub-commands in bin/yarn. (Zhijie Shen via vinodkv)
|
|
|
|
|
|
2014-03-10 14:03:47 -04:00
|
|
|
|
YARN-1793. Fixed ClientRMService#forceKillApplication not killing unmanaged
|
|
|
|
|
application. (Karthik Kambatla via jianhe)
|
|
|
|
|
|
2014-03-10 16:37:09 -04:00
|
|
|
|
YARN-1788. Fixed a bug in ResourceManager to set the apps-completed and
|
|
|
|
|
apps-killed metrics correctly for killed applications. (Varun Vasudev via
|
|
|
|
|
vinodkv)
|
|
|
|
|
|
2014-03-11 18:19:30 -04:00
|
|
|
|
YARN-1821. NPE on registerNodeManager if the request has containers for
|
|
|
|
|
UnmanagedAMs. (kasha)
|
|
|
|
|
|
2014-03-11 19:34:20 -04:00
|
|
|
|
YARN-1800. Fixed NodeManager to gracefully handle RejectedExecutionException
|
|
|
|
|
in the public-localizer thread-pool. (Varun Vasudev via vinodkv)
|
|
|
|
|
|
2014-03-12 10:37:27 -04:00
|
|
|
|
YARN-1444. Fix CapacityScheduler to deal with cases where applications
|
|
|
|
|
specify host/rack requests without off-switch request. (Wangda Tan via
|
|
|
|
|
acmurthy)
|
|
|
|
|
|
2014-03-12 14:26:53 -04:00
|
|
|
|
YARN-1812. Fixed ResourceManager to synchrously renew tokens after recovery
|
|
|
|
|
and thus recover app itself synchronously and avoid races with resyncing
|
|
|
|
|
NodeManagers. (Jian He via vinodkv)
|
|
|
|
|
|
2014-03-12 17:19:22 -04:00
|
|
|
|
YARN-1816. Fixed ResourceManager to get RMApp correctly handle
|
|
|
|
|
ATTEMPT_FINISHED event at ACCEPTED state that can happen after RM restarts.
|
|
|
|
|
(Jian He via vinodkv)
|
|
|
|
|
|
2014-03-12 18:27:01 -04:00
|
|
|
|
YARN-1789. ApplicationSummary does not escape newlines in the app name
|
|
|
|
|
(Tsuyoshi OZAWA via jlowe)
|
|
|
|
|
|
2014-03-17 14:06:17 -04:00
|
|
|
|
YARN-1830. Fixed TestRMRestart#testQueueMetricsOnRMRestart failure due to
|
|
|
|
|
race condition when app is submitted. (Zhijie Shen via jianhe)
|
|
|
|
|
|
2014-03-17 17:36:51 -04:00
|
|
|
|
YARN-1685. Fixed few bugs related to handling of containers' log-URLs on
|
|
|
|
|
ResourceManager and history-service. (Zhijie Shen via vinodkv)
|
|
|
|
|
|
2014-03-17 17:52:41 -04:00
|
|
|
|
YARN-1206. Fixed AM container log to show on NM web page after application
|
|
|
|
|
finishes if log-aggregation is disabled. (Rohith Sharmaks via jianhe)
|
|
|
|
|
|
2014-03-17 18:18:09 -04:00
|
|
|
|
YARN-1591. Fixed AsyncDispatcher to handle interrupts on shutdown in a sane
|
|
|
|
|
manner and thus fix failure of TestResourceTrackerService. (Tsuyoshi Ozawa
|
|
|
|
|
via vinodkv)
|
|
|
|
|
|
2014-03-17 18:22:58 -04:00
|
|
|
|
YARN-1839. Fixed handling of NMTokens in ResourceManager such that containers
|
|
|
|
|
launched by AMs running on the same machine as the AM are correctly
|
|
|
|
|
propagated. (Jian He via vinodkv)
|
|
|
|
|
|
2014-03-19 22:40:54 -04:00
|
|
|
|
YARN-1640. Fixed manual failover of ResourceManagers to work correctly in
|
|
|
|
|
secure clusters. (Xuan Gong via vinodkv)
|
|
|
|
|
|
2014-03-20 20:18:56 -04:00
|
|
|
|
YARN-1855. Made Application-history server to be optional in MiniYARNCluster
|
|
|
|
|
and thus avoid the failure of TestRMFailover#testRMWebAppRedirect. (Zhijie
|
|
|
|
|
Shen via vinodkv)
|
|
|
|
|
|
2014-03-20 22:03:41 -04:00
|
|
|
|
YARN-1859. Fixed WebAppProxyServlet to correctly handle applications absent
|
|
|
|
|
on the ResourceManager. (Zhijie Shen via vinodkv)
|
|
|
|
|
|
2014-03-21 00:21:14 -04:00
|
|
|
|
YARN-1811. Fixed AMFilters in YARN to correctly accept requests from either
|
|
|
|
|
web-app proxy or the RMs when HA is enabled. (Robert Kanter via vinodkv)
|
|
|
|
|
|
2014-03-21 14:36:25 -04:00
|
|
|
|
YARN-1670. Fixed a bug in log-aggregation that can cause the writer to write
|
|
|
|
|
more log-data than the log-length that it records. (Mit Desai via vinodk)
|
|
|
|
|
|
2014-03-21 18:57:09 -04:00
|
|
|
|
YARN-1849. Fixed NPE in ResourceTrackerService#registerNodeManager for UAM
|
|
|
|
|
(Karthik Kambatla via jianhe )
|
|
|
|
|
|
2014-03-21 20:25:51 -04:00
|
|
|
|
YARN-1863. Fixed test failure in TestRMFailover after YARN-1859. (Xuan Gong
|
|
|
|
|
via vinodkv)
|
|
|
|
|
|
2014-03-21 20:30:11 -04:00
|
|
|
|
YARN-1854. Fixed test failure in TestRMHA#testStartAndTransitions. (Rohith
|
|
|
|
|
Sharma KS via vinodkv)
|
|
|
|
|
|
2014-03-22 00:14:42 -04:00
|
|
|
|
YARN-1776. Fixed DelegationToken renewal to survive RM failover. (Zhijie
|
|
|
|
|
Shen via jianhe)
|
|
|
|
|
|
2014-03-22 00:37:46 -04:00
|
|
|
|
YARN-1577. Made UnmanagedAMLauncher do launchAM after the attempt reaches
|
|
|
|
|
the LAUNCHED state. (Jian He via zjshen)
|
|
|
|
|
|
2014-03-22 21:09:24 -04:00
|
|
|
|
YARN-1785. FairScheduler treats app lookup failures as ERRORs.
|
|
|
|
|
(bc Wong via kasha)
|
|
|
|
|
|
|
|
|
|
YARN-1752. Fixed ApplicationMasterService to reject unregister request if
|
|
|
|
|
AM did not register before. (Rohith Sharma via jianhe)
|
|
|
|
|
|
|
|
|
|
YARN-1846. TestRM#testNMTokenSentForNormalContainer assumes CapacityScheduler.
|
|
|
|
|
(Robert Kanter via kasha)
|
|
|
|
|
|
|
|
|
|
YARN-1705. Reset cluster-metrics on transition to standby. (Rohith via kasha)
|
|
|
|
|
|
2014-03-24 15:06:50 -04:00
|
|
|
|
YARN-1852. Fixed RMAppAttempt to not resend AttemptFailed/AttemptKilled
|
|
|
|
|
events to already recovered Failed/Killed RMApps. (Rohith via jianhe)
|
|
|
|
|
|
2014-03-25 14:22:59 -04:00
|
|
|
|
YARN-1866. Fixed an issue with renewal of RM-delegation tokens on restart or
|
|
|
|
|
fail-over. (Jian He via vinodkv)
|
|
|
|
|
|
2014-03-25 23:04:02 -04:00
|
|
|
|
YARN-1867. Fixed a bug in ResourceManager that was causing invalid ACL checks
|
|
|
|
|
in the web-services after fail-over. (Vinod Kumar Vavilapalli)
|
|
|
|
|
|
2014-03-25 23:48:46 -04:00
|
|
|
|
YARN-1521. Mark Idempotent/AtMostOnce annotations to the APIs in
|
|
|
|
|
ApplicationClientProtcol, ResourceManagerAdministrationProtocol and
|
|
|
|
|
ResourceTrackerProtocol so that they work in HA scenario. (Xuan Gong
|
|
|
|
|
via jianhe)
|
|
|
|
|
|
2014-03-26 17:20:23 -04:00
|
|
|
|
YARN-1873. Fixed TestDistributedShell failure when the test cases are out of
|
|
|
|
|
order. (Mit Desai via zjshen)
|
|
|
|
|
|
2014-03-30 17:38:27 -04:00
|
|
|
|
YARN-1893. Mark AtMostOnce annotation to ApplicationMasterProtocol#allocate.
|
|
|
|
|
(Xuan Gong via jianhe)
|
|
|
|
|
|
2014-02-11 08:27:18 -05:00
|
|
|
|
Release 2.3.1 - UNRELEASED
|
|
|
|
|
|
|
|
|
|
INCOMPATIBLE CHANGES
|
|
|
|
|
|
|
|
|
|
NEW FEATURES
|
|
|
|
|
|
|
|
|
|
IMPROVEMENTS
|
|
|
|
|
|
|
|
|
|
OPTIMIZATIONS
|
|
|
|
|
|
2014-02-12 18:06:11 -05:00
|
|
|
|
BUG FIXES
|
|
|
|
|
|
2014-02-11 08:27:18 -05:00
|
|
|
|
Release 2.3.0 - 2014-02-18
|
2014-01-30 14:57:22 -05:00
|
|
|
|
|
|
|
|
|
INCOMPATIBLE CHANGES
|
|
|
|
|
|
2013-06-04 11:34:52 -04:00
|
|
|
|
NEW FEATURES
|
|
|
|
|
|
2013-09-01 20:09:53 -04:00
|
|
|
|
YARN-649. Added a new NM web-service to serve container logs in plain text
|
|
|
|
|
over HTTP. (Sandy Ryza via vinodkv)
|
|
|
|
|
|
2013-09-27 16:32:06 -04:00
|
|
|
|
YARN-1021. Yarn Scheduler Load Simulator. (ywskycn via tucu)
|
|
|
|
|
|
2013-10-01 15:57:40 -04:00
|
|
|
|
YARN-1010. FairScheduler: decouple container scheduling from nodemanager
|
|
|
|
|
heartbeats. (Wei Yan via Sandy Ryza)
|
|
|
|
|
|
2014-01-30 14:57:22 -05:00
|
|
|
|
YARN-1253. Changes to LinuxContainerExecutor to run containers as a single
|
|
|
|
|
dedicated user in non-secure mode. (rvs via tucu)
|
|
|
|
|
|
2013-10-29 17:21:06 -04:00
|
|
|
|
YARN-1027. Implement RMHAProtocolService (Karthik Kambatla via bikas)
|
|
|
|
|
|
|
|
|
|
YARN-1068. Add admin support for HA operations (Karthik Kambatla via
|
|
|
|
|
bikas)
|
|
|
|
|
|
2013-11-05 16:20:05 -05:00
|
|
|
|
YARN-311. RM/scheduler support for dynamic resource configuration.
|
|
|
|
|
(Junping Du via llu)
|
|
|
|
|
|
2013-11-14 17:20:38 -05:00
|
|
|
|
YARN-1392. Allow sophisticated app-to-queue placement policies in the Fair
|
|
|
|
|
Scheduler (Sandy Ryza)
|
|
|
|
|
|
2013-12-05 17:27:53 -05:00
|
|
|
|
YARN-1447. Common PB type definitions for container resizing. (Wangda Tan
|
|
|
|
|
via Sandy Ryza)
|
|
|
|
|
|
2013-12-09 12:48:00 -05:00
|
|
|
|
YARN-1448. AM-RM protocol changes to support container resizing (Wangda Tan
|
|
|
|
|
via Sandy Ryza)
|
|
|
|
|
|
2013-12-16 18:38:25 -05:00
|
|
|
|
YARN-312. Introduced ResourceManagerAdministrationProtocol changes to support
|
|
|
|
|
changing resources on node. (Junping Du via vinodkv)
|
|
|
|
|
|
2013-12-17 17:33:16 -05:00
|
|
|
|
YARN-1028. Added FailoverProxyProvider capability to ResourceManager to help
|
|
|
|
|
with RM failover. (Karthik Kambatla via vinodkv)
|
|
|
|
|
|
2014-01-06 20:56:56 -05:00
|
|
|
|
YARN-1029. Added embedded leader election in the ResourceManager. (Karthik
|
|
|
|
|
Kambatla via vinodkv)
|
|
|
|
|
|
2014-01-10 11:40:45 -05:00
|
|
|
|
YARN-1033. Expose RM active/standby state to Web UI and REST API (kasha)
|
|
|
|
|
|
2013-06-04 11:34:52 -04:00
|
|
|
|
IMPROVEMENTS
|
|
|
|
|
|
2014-01-30 14:57:22 -05:00
|
|
|
|
YARN-305. Fair scheduler logs too many "Node offered to app" messages.
|
|
|
|
|
(Lohit Vijayarenu via Sandy Ryza)
|
|
|
|
|
|
|
|
|
|
YARN-1258. Allow configuring the Fair Scheduler root queue (Sandy Ryza)
|
|
|
|
|
|
|
|
|
|
YARN-1288. Make Fair Scheduler ACLs more user friendly (Sandy Ryza)
|
|
|
|
|
|
|
|
|
|
YARN-1315. TestQueueACLs should also test FairScheduler (Sandy Ryza)
|
|
|
|
|
|
|
|
|
|
YARN-1335. Move duplicate code from FSSchedulerApp and FiCaSchedulerApp
|
|
|
|
|
into SchedulerApplication (Sandy Ryza)
|
|
|
|
|
|
|
|
|
|
YARN-1333. Support blacklisting in the Fair Scheduler (Tsuyoshi Ozawa via
|
|
|
|
|
Sandy Ryza)
|
|
|
|
|
|
|
|
|
|
YARN-1109. Demote NodeManager "Sending out status for container" logs to
|
|
|
|
|
debug (haosdent via Sandy Ryza)
|
|
|
|
|
|
|
|
|
|
YARN-1321. Changed NMTokenCache to support both singleton and an instance
|
|
|
|
|
usage. (Alejandro Abdelnur via vinodkv)
|
|
|
|
|
|
|
|
|
|
YARN-1388. Fair Scheduler page always displays blank fair share (Liyin Liang
|
|
|
|
|
via Sandy Ryza)
|
|
|
|
|
|
2013-10-11 04:17:08 -04:00
|
|
|
|
YARN-7. Support CPU resource for DistributedShell. (Junping Du via llu)
|
|
|
|
|
|
2013-08-23 18:58:30 -04:00
|
|
|
|
YARN-905. Add state filters to nodes CLI (Wei Yan via Sandy Ryza)
|
2013-09-19 16:40:52 -04:00
|
|
|
|
|
2013-09-10 13:49:20 -04:00
|
|
|
|
YARN-1098. Separate out RM services into Always On and Active (Karthik
|
|
|
|
|
Kambatla via bikas)
|
2013-09-19 16:40:52 -04:00
|
|
|
|
|
|
|
|
|
YARN-353. Add Zookeeper-based store implementation for RMStateStore.
|
|
|
|
|
(Bikas Saha, Jian He and Karthik Kambatla via hitesh)
|
|
|
|
|
|
2013-09-26 16:06:47 -04:00
|
|
|
|
YARN-819. ResourceManager and NodeManager should check for a minimum allowed
|
|
|
|
|
version (Robert Parker via jeagles)
|
|
|
|
|
|
2013-10-02 17:57:00 -04:00
|
|
|
|
YARN-425. coverage fix for yarn api (Aleksey Gorshkov via jeagles)
|
|
|
|
|
|
2013-10-03 17:18:18 -04:00
|
|
|
|
YARN-1199. Make NM/RM Versions Available (Mit Desai via jeagles)
|
|
|
|
|
|
2013-10-04 16:37:47 -04:00
|
|
|
|
YARN-1232. Configuration to support multiple RMs (Karthik Kambatla via
|
|
|
|
|
bikas)
|
|
|
|
|
|
2013-10-07 18:26:48 -04:00
|
|
|
|
YARN-465. fix coverage org.apache.hadoop.yarn.server.webproxy (Aleksey
|
|
|
|
|
Gorshkov and Andrey Klochkov via jlowe)
|
|
|
|
|
|
2013-10-09 01:57:08 -04:00
|
|
|
|
YARN-976. Document the meaning of a virtual core. (Sandy Ryza)
|
|
|
|
|
|
2013-10-14 17:49:55 -04:00
|
|
|
|
YARN-1182. MiniYARNCluster creates and inits the RM/NM only on start()
|
|
|
|
|
(Karthik Kambatla via Sandy Ryza)
|
|
|
|
|
|
2013-10-23 00:15:16 -04:00
|
|
|
|
HADOOP-9598. Improve code coverage of RMAdminCLI (Aleksey Gorshkov and
|
|
|
|
|
Andrey Klochkov via jeagles)
|
|
|
|
|
|
2013-10-30 02:57:41 -04:00
|
|
|
|
YARN-1306. Clean up hadoop-sls sample-conf according to YARN-1228 (Wei Yan
|
|
|
|
|
via Sandy Ryza)
|
|
|
|
|
|
2013-10-31 13:25:37 -04:00
|
|
|
|
YARN-891. Modified ResourceManager state-store to remember completed
|
|
|
|
|
applications so that clients can get information about them post RM-restart.
|
|
|
|
|
(Jian He via vinodkv)
|
|
|
|
|
|
2013-10-31 18:07:09 -04:00
|
|
|
|
YARN-1290. Let continuous scheduling achieve more balanced task assignment
|
|
|
|
|
(Wei Yan via Sandy Ryza)
|
|
|
|
|
|
2013-10-31 23:03:24 -04:00
|
|
|
|
YARN-786. Expose application resource usage in RM REST API (Sandy Ryza)
|
|
|
|
|
|
2013-11-04 20:57:07 -05:00
|
|
|
|
YARN-1323. Set HTTPS webapp address along with other RPC addresses in HAUtil
|
|
|
|
|
(Karthik Kambatla via Sandy Ryza)
|
|
|
|
|
|
2013-11-08 19:56:26 -05:00
|
|
|
|
YARN-1121. Changed ResourceManager's state-store to drain all events on
|
|
|
|
|
shut-down. (Jian He via vinodkv)
|
|
|
|
|
|
2013-11-11 16:52:07 -05:00
|
|
|
|
YARN-1387. RMWebServices should use ClientRMService for filtering
|
|
|
|
|
applications (Karthik Kambatla via Sandy Ryza)
|
|
|
|
|
|
2013-11-14 14:09:40 -05:00
|
|
|
|
YARN-1222. Make improvements in ZKRMStateStore for fencing (Karthik
|
|
|
|
|
Kambatla via bikas)
|
|
|
|
|
|
2013-11-18 19:52:04 -05:00
|
|
|
|
YARN-709. Added tests to verify validity of delegation tokens and logging of
|
|
|
|
|
appsummary after RM restart. (Jian He via vinodkv)
|
|
|
|
|
|
2013-11-19 00:17:56 -05:00
|
|
|
|
YARN-1210. Changed RM to start new app-attempts on RM restart only after
|
|
|
|
|
ensuring that previous AM exited or after expiry time. (Omkar Vinit Joshi via
|
|
|
|
|
vinodkv)
|
|
|
|
|
|
2013-11-19 00:21:45 -05:00
|
|
|
|
YARN-674. Fixed ResourceManager to renew DelegationTokens on submission
|
|
|
|
|
asynchronously to work around potential slowness in state-store. (Omkar Vinit
|
|
|
|
|
Joshi via vinodkv)
|
|
|
|
|
|
2013-11-19 04:03:31 -05:00
|
|
|
|
YARN-584. In scheduler web UIs, queues unexpand on refresh. (Harshit
|
|
|
|
|
Daga via Sandy Ryza)
|
|
|
|
|
|
2013-11-20 22:47:27 -05:00
|
|
|
|
YARN-1303. Fixed DistributedShell to not fail with multiple commands separated
|
|
|
|
|
by a semi-colon as shell-command. (Xuan Gong via vinodkv)
|
|
|
|
|
|
2013-11-25 01:17:27 -05:00
|
|
|
|
YARN-1423. Support queue placement by secondary group in the Fair Scheduler
|
|
|
|
|
(Ted Malaska via Sandy Ryza)
|
|
|
|
|
|
2013-11-25 20:10:51 -05:00
|
|
|
|
YARN-1314. Fixed DistributedShell to not fail with multiple arguments for a
|
|
|
|
|
shell command separated by spaces. (Xuan Gong via vinodkv)
|
2013-11-27 18:23:01 -05:00
|
|
|
|
|
|
|
|
|
YARN-1239. Modified ResourceManager state-store implementations to start
|
|
|
|
|
storing version numbers. (Jian He via vinodkv)
|
2013-11-25 20:10:51 -05:00
|
|
|
|
|
2013-11-29 14:14:36 -05:00
|
|
|
|
YARN-1241. In Fair Scheduler, maxRunningApps does not work for non-leaf
|
|
|
|
|
queues. (Sandy Ryza)
|
|
|
|
|
|
2013-12-02 17:19:43 -05:00
|
|
|
|
YARN-1318. Promoted AdminService to an Always-On service and merged it into
|
|
|
|
|
RMHAProtocolService. (Karthik Kambatla via vinodkv)
|
|
|
|
|
|
2013-12-03 18:23:49 -05:00
|
|
|
|
YARN-1332. In TestAMRMClient, replace assertTrue with assertEquals where
|
|
|
|
|
possible (Sebastian Wong via Sandy Ryza)
|
|
|
|
|
|
2013-12-04 22:30:17 -05:00
|
|
|
|
YARN-1403. Separate out configuration loading from QueueManager in the Fair
|
|
|
|
|
Scheduler (Sandy Ryza)
|
|
|
|
|
|
2013-12-05 19:10:03 -05:00
|
|
|
|
YARN-1181. Augment MiniYARNCluster to support HA mode (Karthik Kambatla)
|
|
|
|
|
|
2013-12-05 20:34:42 -05:00
|
|
|
|
YARN-546. Allow disabling the Fair Scheduler event log (Sandy Ryza)
|
|
|
|
|
|
2013-12-07 22:14:43 -05:00
|
|
|
|
YARN-807. When querying apps by queue, iterating over all apps is
|
|
|
|
|
inefficient and limiting (Sandy Ryza)
|
|
|
|
|
|
2013-12-07 23:19:16 -05:00
|
|
|
|
YARN-1378. Implemented a cleaner of old finished applications from the RM
|
|
|
|
|
state-store. (Jian He via vinodkv)
|
|
|
|
|
|
2013-12-11 10:15:35 -05:00
|
|
|
|
YARN-1481. Move internal services logic from AdminService to ResourceManager.
|
|
|
|
|
(vinodkv via kasha)
|
|
|
|
|
|
2013-12-11 13:09:55 -05:00
|
|
|
|
YARN-1491. Upgrade JUnit3 TestCase to JUnit 4 (Chen He via jeagles)
|
|
|
|
|
|
2013-12-11 15:15:47 -05:00
|
|
|
|
YARN-408. Change CapacityScheduler to not disable delay-scheduling by default.
|
|
|
|
|
(Mayank Bansal via vinodkv)
|
|
|
|
|
|
2013-12-12 15:50:43 -05:00
|
|
|
|
YARN-1325. Modified RM HA configuration validation to also ensure that
|
|
|
|
|
multiple RMs are configured. (Xuan Gong via vinodkv)
|
|
|
|
|
|
2013-12-12 21:07:21 -05:00
|
|
|
|
YARN-1311. Fixed app specific scheduler-events' names to be app-attempt
|
|
|
|
|
based. (vinodkv via jianhe)
|
|
|
|
|
|
2013-12-13 18:55:31 -05:00
|
|
|
|
YARN-1485. Modified RM HA configuration validation to also ensure that
|
|
|
|
|
service-address configuration are configured for every RM. (Xuan Gong via
|
|
|
|
|
vinodkv)
|
|
|
|
|
|
2013-12-13 21:05:52 -05:00
|
|
|
|
YARN-1435. Modified Distributed Shell to accept either the command or the
|
|
|
|
|
custom script. (Xuan Gong via zjshen)
|
|
|
|
|
|
2013-12-16 21:16:59 -05:00
|
|
|
|
YARN-1446. Changed client API to retry killing application till RM
|
|
|
|
|
acknowledges so as to account for RM crashes/failover. (Jian He via vinodkv)
|
|
|
|
|
|
2013-12-18 21:33:33 -05:00
|
|
|
|
YARN-1307. Redesign znode structure for Zookeeper based RM state-store for
|
|
|
|
|
better organization and scalability. (Tsuyoshi OZAWA via vinodkv)
|
|
|
|
|
|
2013-12-25 19:25:05 -05:00
|
|
|
|
YARN-1172. Convert SecretManagers in RM to services (Tsuyoshi OZAWA via kasha)
|
|
|
|
|
|
2013-12-26 22:32:05 -05:00
|
|
|
|
YARN-1523. Use StandbyException instead of RMNotYetReadyException (kasha)
|
|
|
|
|
|
2013-12-27 20:10:02 -05:00
|
|
|
|
YARN-1541. Changed ResourceManager to invalidate ApplicationMaster host/port
|
|
|
|
|
information once an AM crashes. (Jian He via vinodkv)
|
|
|
|
|
|
2014-01-07 17:17:00 -05:00
|
|
|
|
YARN-1482. Modified WebApplicationProxy to make it work across ResourceManager
|
|
|
|
|
fail-over. (Xuan Gong via vinodkv)
|
|
|
|
|
|
2014-01-07 22:31:36 -05:00
|
|
|
|
YARN-1568. Rename clusterid to clusterId in ActiveRMInfoProto (kasha)
|
|
|
|
|
|
2014-01-09 19:49:50 -05:00
|
|
|
|
YARN-1579. ActiveRMInfoProto fields should be optional (kasha)
|
|
|
|
|
|
2014-01-13 13:34:39 -05:00
|
|
|
|
YARN-888. Cleaned up POM files so that non-leaf modules don't include any
|
|
|
|
|
dependencies and thus compact the dependency list for leaf modules.
|
|
|
|
|
(Alejandro Abdelnur via vinodkv)
|
|
|
|
|
|
2014-01-14 17:38:23 -05:00
|
|
|
|
YARN-1567. In Fair Scheduler, allow empty queues to change between leaf and
|
|
|
|
|
parent on allocation file reload (Sandy Ryza)
|
|
|
|
|
|
2014-01-20 21:02:24 -05:00
|
|
|
|
YARN-1616. RMFatalEventDispatcher should log the cause of the event (kasha)
|
|
|
|
|
|
2014-01-22 13:52:25 -05:00
|
|
|
|
YARN-1624. QueuePlacementPolicy format is not easily readable via a JAXB
|
|
|
|
|
parser (Aditya Acharya via Sandy Ryza)
|
|
|
|
|
|
2014-01-22 17:45:33 -05:00
|
|
|
|
YARN-1623. Include queue name in RegisterApplicationMasterResponse (Sandy
|
|
|
|
|
Ryza)
|
|
|
|
|
|
2014-01-23 01:26:23 -05:00
|
|
|
|
YARN-1573. ZK store should use a private password for root-node-acls.
|
|
|
|
|
(kasha).
|
|
|
|
|
|
2013-06-04 11:34:52 -04:00
|
|
|
|
OPTIMIZATIONS
|
|
|
|
|
|
|
|
|
|
BUG FIXES
|
|
|
|
|
|
2014-01-30 14:57:22 -05:00
|
|
|
|
YARN-1284. LCE: Race condition leaves dangling cgroups entries for killed
|
|
|
|
|
containers. (Alejandro Abdelnur via Sandy Ryza)
|
|
|
|
|
|
|
|
|
|
YARN-1283. Fixed RM to give a fully-qualified proxy URL for an application
|
|
|
|
|
so that clients don't need to do scheme-mangling. (Omkar Vinit Joshi via
|
|
|
|
|
vinodkv)
|
|
|
|
|
|
|
|
|
|
YARN-879. Fixed tests w.r.t o.a.h.y.server.resourcemanager.Application.
|
|
|
|
|
(Junping Du via devaraj)
|
|
|
|
|
|
|
|
|
|
YARN-1265. Fair Scheduler chokes on unhealthy node reconnect (Sandy Ryza)
|
|
|
|
|
|
|
|
|
|
YARN-1044. used/min/max resources do not display info in the scheduler page
|
|
|
|
|
(Sangjin Lee via Sandy Ryza)
|
|
|
|
|
|
|
|
|
|
YARN-1259. In Fair Scheduler web UI, queue num pending and num active apps
|
|
|
|
|
switched. (Robert Kanter via Sandy Ryza)
|
|
|
|
|
|
|
|
|
|
YARN-1295. In UnixLocalWrapperScriptBuilder, using bash -c can cause Text
|
|
|
|
|
file busy errors (Sandy Ryza)
|
|
|
|
|
|
|
|
|
|
YARN-1185. Fixed FileSystemRMStateStore to not leave partial files that
|
|
|
|
|
prevent subsequent ResourceManager recovery. (Omkar Vinit Joshi via vinodkv)
|
|
|
|
|
|
|
|
|
|
YARN-1331. yarn.cmd exits with NoClassDefFoundError trying to run rmadmin or
|
|
|
|
|
logs. (cnauroth)
|
|
|
|
|
|
|
|
|
|
YARN-1330. Fair Scheduler: defaultQueueSchedulingPolicy does not take effect
|
|
|
|
|
(Sandy Ryza)
|
|
|
|
|
|
|
|
|
|
YARN-1022. Unnecessary INFO logs in AMRMClientAsync (haosdent via bikas)
|
|
|
|
|
|
|
|
|
|
YARN-1349. yarn.cmd does not support passthrough to any arbitrary class.
|
|
|
|
|
(cnauroth)
|
|
|
|
|
|
|
|
|
|
YARN-1357. TestContainerLaunch.testContainerEnvVariables fails on Windows.
|
|
|
|
|
(Chuan Liu via cnauroth)
|
|
|
|
|
|
|
|
|
|
YARN-1358. TestYarnCLI fails on Windows due to line endings. (Chuan Liu via
|
|
|
|
|
cnauroth)
|
|
|
|
|
|
|
|
|
|
YARN-1343. NodeManagers additions/restarts are not reported as node updates
|
|
|
|
|
in AllocateResponse responses to AMs. (tucu)
|
|
|
|
|
|
|
|
|
|
YARN-1381. Same relaxLocality appears twice in exception message of
|
|
|
|
|
AMRMClientImpl#checkLocalityRelaxationConflict() (Ted Yu via Sandy Ryza)
|
|
|
|
|
|
|
|
|
|
YARN-1407. RM Web UI and REST APIs should uniformly use
|
|
|
|
|
YarnApplicationState (Sandy Ryza)
|
|
|
|
|
|
|
|
|
|
YARN-1438. Ensure container diagnostics includes exception from container
|
|
|
|
|
launch. (stevel via acmurthy)
|
|
|
|
|
|
|
|
|
|
YARN-1138. yarn.application.classpath is set to point to $HADOOP_CONF_DIR
|
|
|
|
|
etc., which does not work on Windows. (Chuan Liu via cnauroth)
|
|
|
|
|
|
2013-10-09 02:49:48 -04:00
|
|
|
|
YARN-461. Fair scheduler should not accept apps with empty string queue name.
|
|
|
|
|
(ywskycn via tucu)
|
|
|
|
|
|
2013-08-14 00:40:30 -04:00
|
|
|
|
YARN-1060. Two tests in TestFairScheduler are missing @Test annotation
|
|
|
|
|
(Niranjan Singh via Sandy Ryza)
|
|
|
|
|
|
2013-09-23 03:06:50 -04:00
|
|
|
|
YARN-1188. The context of QueueMetrics becomes default when using
|
2013-09-23 03:11:24 -04:00
|
|
|
|
FairScheduler (Tsuyoshi Ozawa via Sandy Ryza)
|
2014-01-30 14:57:22 -05:00
|
|
|
|
|
2013-10-05 18:12:24 -04:00
|
|
|
|
YARN-1268. TestFairScheduler.testContinuousScheduling is flaky (Sandy Ryza)
|
2013-09-23 03:06:50 -04:00
|
|
|
|
|
2013-10-11 17:28:41 -04:00
|
|
|
|
YARN-1300. SLS tests fail because conf puts YARN properties in
|
|
|
|
|
fair-scheduler.xml (Ted Yu via Sandy Ryza)
|
|
|
|
|
|
2013-10-22 17:37:03 -04:00
|
|
|
|
YARN-1183. MiniYARNCluster shutdown takes several minutes intermittently
|
|
|
|
|
(Andrey Klochkov via jeagles)
|
|
|
|
|
|
2013-10-22 21:16:05 -04:00
|
|
|
|
YARN-1305. RMHAProtocolService#serviceInit should handle HAUtil's
|
|
|
|
|
IllegalArgumentException (Tsuyoshi Ozawa via bikas)
|
|
|
|
|
|
2013-11-05 13:26:07 -05:00
|
|
|
|
YARN-1374. Changed ResourceManager to start the preemption policy monitors
|
|
|
|
|
as active services. (Karthik Kambatla via vinodkv)
|
|
|
|
|
|
2013-11-11 15:52:22 -05:00
|
|
|
|
YARN-1395. Distributed shell application master launched with debug flag can
|
|
|
|
|
hang waiting for external ls process. (cnauroth)
|
|
|
|
|
|
2013-11-11 22:59:33 -05:00
|
|
|
|
YARN-1400. yarn.cmd uses HADOOP_RESOURCEMANAGER_OPTS. Should be
|
|
|
|
|
YARN_RESOURCEMANAGER_OPTS. (Raja Aluri via cnauroth)
|
|
|
|
|
|
2013-11-14 14:59:05 -05:00
|
|
|
|
YARN-1401. With zero sleep-delay-before-sigkill.ms, no signal is ever sent
|
|
|
|
|
(Gera Shegalov via Sandy Ryza)
|
|
|
|
|
|
2013-11-15 14:48:12 -05:00
|
|
|
|
YARN-1411. HA config shouldn't affect NodeManager RPC addresses (Karthik
|
|
|
|
|
Kambatla via bikas)
|
|
|
|
|
|
2013-11-18 14:29:29 -05:00
|
|
|
|
YARN-1419. TestFifoScheduler.testAppAttemptMetrics fails intermittently
|
|
|
|
|
under jdk7 (Jonathan Eagles via jlowe)
|
|
|
|
|
|
2013-11-20 00:22:40 -05:00
|
|
|
|
YARN-744. Race condition in ApplicationMasterService.allocate .. It might
|
|
|
|
|
process same allocate request twice resulting in additional containers
|
|
|
|
|
getting allocated. (Omkar Vinit Joshi via bikas)
|
|
|
|
|
|
2013-11-20 16:22:34 -05:00
|
|
|
|
YARN-1425. TestRMRestart fails because MockRM.waitForState(AttemptId) uses
|
|
|
|
|
current attempt instead of the attempt passed as argument (Omkar Vinit
|
|
|
|
|
Joshi via bikas)
|
|
|
|
|
|
2013-11-20 17:29:16 -05:00
|
|
|
|
YARN-1053. Diagnostic message from ContainerExitEvent is ignored in
|
|
|
|
|
ContainerImpl (Omkar Vinit Joshi via bikas)
|
|
|
|
|
|
2013-11-21 18:17:48 -05:00
|
|
|
|
YARN-1320. Fixed Distributed Shell application to respect custom log4j
|
|
|
|
|
properties file. (Xuan Gong via vinodkv)
|
|
|
|
|
|
2013-11-25 18:11:01 -05:00
|
|
|
|
YARN-1416. Fixed a few invalid transitions in RMApp, RMAppAttempt and in some
|
|
|
|
|
tests. (Jian He via vinodkv)
|
|
|
|
|
|
2013-12-03 14:28:42 -05:00
|
|
|
|
YARN-895. Changed RM state-store to not crash immediately if RM restarts while
|
|
|
|
|
the state-store is down. (Jian He via vinodkv)
|
|
|
|
|
|
2013-12-03 19:22:52 -05:00
|
|
|
|
YARN-1454. Fixed test failure issue with TestRMRestart. (Karthik Kambatla
|
|
|
|
|
via vinodkv)
|
|
|
|
|
|
2013-12-06 12:54:46 -05:00
|
|
|
|
YARN-1450. Fixed test failure in TestUnmanagedAMLauncher by removing its
|
|
|
|
|
dependency on distributed-shell. (Binglin Chang via vinodkv)
|
|
|
|
|
|
2013-12-07 23:30:58 -05:00
|
|
|
|
YARN-1405. Fixed ResourceManager to not hang when init/start fails with an
|
|
|
|
|
exception w.r.t state-store. (Jian He via vinodkv)
|
|
|
|
|
|
2013-12-16 14:10:17 -05:00
|
|
|
|
YARN-1505. Fixed Webapplication proxy server to not hardcode its bind
|
|
|
|
|
address. (Xuan Gong via vinodkv)
|
|
|
|
|
|
2013-12-16 14:28:20 -05:00
|
|
|
|
YARN-1145. Fixed a potential file-handle leak in the web interface for
|
|
|
|
|
displaying aggregated logs. (Rohith Sharma via vinodkv)
|
|
|
|
|
|
2013-12-16 20:48:15 -05:00
|
|
|
|
YARN-1451. TestResourceManager relies on the scheduler assigning multiple
|
|
|
|
|
containers in a single node update. (Sandy Ryza via kasha)
|
|
|
|
|
|
2013-12-26 17:15:41 -05:00
|
|
|
|
YARN-1527. Fix yarn rmadmin command to print the correct usage info.
|
|
|
|
|
(Akira AJISAKA via jianhe)
|
|
|
|
|
|
2013-12-30 17:22:24 -05:00
|
|
|
|
YARN-1522. Fixed a race condition in the test TestApplicationCleanup that was
|
|
|
|
|
causing it to randomly fail. (Liyin Liang via vinodkv)
|
|
|
|
|
|
2014-01-02 14:54:34 -05:00
|
|
|
|
YARN-1549. Fixed a bug in ResourceManager's ApplicationMasterService that
|
|
|
|
|
was causing unamanged AMs to not finish correctly. (haosdent via vinodkv)
|
|
|
|
|
|
2014-01-06 13:43:09 -05:00
|
|
|
|
YARN-1559. Race between ServerRMProxy and ClientRMProxy setting
|
|
|
|
|
RMProxy#INSTANCE. (kasha and vinodkv via kasha)
|
|
|
|
|
|
2014-01-06 14:03:43 -05:00
|
|
|
|
YARN-1560. Fixed TestYarnClient#testAMMRTokens failure with null AMRM token.
|
|
|
|
|
(Ted Yu via jianhe)
|
|
|
|
|
|
2014-01-07 12:23:50 -05:00
|
|
|
|
YARN-1409. NonAggregatingLogHandler can throw RejectedExecutionException
|
|
|
|
|
(Tsuyoshi OZAWA via jlowe)
|
|
|
|
|
|
2014-01-07 14:03:50 -05:00
|
|
|
|
YARN-1293. Fixed TestContainerLaunch#testInvalidEnvSyntaxDiagnostics failure
|
|
|
|
|
caused by non-English system locale. (Tsuyoshi OZAWA via jianhe)
|
|
|
|
|
|
2014-01-10 15:20:01 -05:00
|
|
|
|
YARN-1574. RMDispatcher should be reset on transition to standby. (Xuan Gong
|
|
|
|
|
via kasha)
|
|
|
|
|
|
2014-01-14 20:00:19 -05:00
|
|
|
|
YARN-1598. HA-related rmadmin commands don't work on a secure cluster (kasha)
|
|
|
|
|
|
2014-01-15 06:12:28 -05:00
|
|
|
|
YARN-1603. Remove two *.orig files which were unexpectedly committed.
|
|
|
|
|
(Zhijie Shen via junping_du)
|
|
|
|
|
|
2014-01-15 12:01:03 -05:00
|
|
|
|
YARN-1601. 3rd party JARs are missing from hadoop-dist output. (tucu)
|
|
|
|
|
|
2014-01-15 18:23:01 -05:00
|
|
|
|
YARN-1351. Invalid string format in Fair Scheduler log warn message
|
|
|
|
|
(Konstantin Weitz via Sandy Ryza)
|
|
|
|
|
|
2014-01-16 13:44:35 -05:00
|
|
|
|
YARN-1608. LinuxContainerExecutor has a few DEBUG messages at INFO level
|
|
|
|
|
(kasha)
|
|
|
|
|
|
2014-01-16 13:55:25 -05:00
|
|
|
|
YARN-1606. Fix the default value of yarn.resourcemanager.zk-timeout-ms
|
|
|
|
|
in yarn-default.xml (kasha)
|
|
|
|
|
|
2014-01-22 17:08:37 -05:00
|
|
|
|
YARN-1607. TestRM relies on the scheduler assigning multiple containers in
|
|
|
|
|
a single node update (Sandy Ryza)
|
|
|
|
|
|
2014-01-24 13:59:54 -05:00
|
|
|
|
YARN-1575. Public localizer crashes with "Localized unkown resource"
|
|
|
|
|
(jlowe)
|
|
|
|
|
|
2014-01-28 03:36:19 -05:00
|
|
|
|
YARN-1629. IndexOutOfBoundsException in MaxRunningAppsEnforcer (Sandy Ryza)
|
|
|
|
|
|
2014-02-06 02:23:35 -05:00
|
|
|
|
YARN-1628. Fixed the test failure in TestContainerManagerSecurity. (Vinod
|
|
|
|
|
Kumar Vavilapalli via zjshen)
|
|
|
|
|
|
2013-10-07 01:32:18 -04:00
|
|
|
|
Release 2.2.0 - 2013-10-13
|
2013-09-24 20:37:14 -04:00
|
|
|
|
|
|
|
|
|
INCOMPATIBLE CHANGES
|
|
|
|
|
|
|
|
|
|
YARN-1229. Define constraints on Auxiliary Service names. Change
|
|
|
|
|
ShuffleHandler service name from mapreduce.shuffle to
|
|
|
|
|
mapreduce_shuffle (Xuan Gong via sseth)
|
|
|
|
|
|
|
|
|
|
NEW FEATURES
|
|
|
|
|
|
|
|
|
|
IMPROVEMENTS
|
|
|
|
|
|
2013-09-28 12:30:28 -04:00
|
|
|
|
YARN-1246. Added application finish-status to ApplicationSummary for the sake
|
|
|
|
|
of testing given ApplicationHistoryServer is not yet ready. (Arpit Gupta via
|
|
|
|
|
vinodkv)
|
|
|
|
|
|
2013-09-29 04:22:14 -04:00
|
|
|
|
YARN-899. Added back queue level administrator-acls so that there is no
|
|
|
|
|
regression w.r.t 1.x. (Xuan Gong via vinodkv)
|
|
|
|
|
|
2013-10-01 16:16:30 -04:00
|
|
|
|
YARN-1228. Clean up Fair Scheduler configuration loading. (Sandy Ryza)
|
|
|
|
|
|
2013-10-02 21:21:47 -04:00
|
|
|
|
YARN-1213. Restore config to ban submitting to undeclared pools in the
|
|
|
|
|
Fair Scheduler. (Sandy Ryza)
|
|
|
|
|
|
2013-10-06 14:44:27 -04:00
|
|
|
|
YARN-1277. Added a policy based configuration for http/https in common
|
|
|
|
|
HttpServer and using the same in YARN - related to per project https config
|
|
|
|
|
support via HADOOP-10022. (Suresh Srinivas and Omkar Vinit Joshi via vinodkv)
|
|
|
|
|
|
2013-09-24 20:37:14 -04:00
|
|
|
|
OPTIMIZATIONS
|
|
|
|
|
|
2013-09-17 01:23:39 -04:00
|
|
|
|
BUG FIXES
|
|
|
|
|
|
2013-09-21 21:55:17 -04:00
|
|
|
|
YARN-1128. FifoPolicy.computeShares throws NPE on empty list of Schedulables
|
|
|
|
|
(Karthik Kambatla via Sandy Ryza)
|
|
|
|
|
|
2013-09-24 21:15:24 -04:00
|
|
|
|
YARN-1214. Register ClientToken MasterKey in SecretManager after it is
|
|
|
|
|
saved (Jian He via bikas)
|
|
|
|
|
|
2013-09-25 19:41:05 -04:00
|
|
|
|
YARN-49. Improve distributed shell application to work on a secure cluster.
|
|
|
|
|
(Vinod Kumar Vavilapalli via hitesh)
|
|
|
|
|
|
2013-09-26 00:18:28 -04:00
|
|
|
|
YARN-1157. Fixed ResourceManager UI to behave correctly when apps like
|
|
|
|
|
distributed-shell do not set tracking urls. (Xuan Gong via vinodkv)
|
|
|
|
|
|
2013-09-30 18:03:06 -04:00
|
|
|
|
YARN-1221. With Fair Scheduler, reserved MB reported in RM web UI increases
|
|
|
|
|
indefinitely (Siqi Li via Sandy Ryza)
|
|
|
|
|
|
2013-09-30 20:18:42 -04:00
|
|
|
|
YARN-1247. test-container-executor has gotten out of sync with the changes to
|
|
|
|
|
container-executor. (rvs via tucu)
|
|
|
|
|
|
|
|
|
|
YARN-1070. Fixed race conditions in NodeManager during container-kill.
|
|
|
|
|
(Zhijie Shen via vinodkv)
|
2013-09-30 18:55:51 -04:00
|
|
|
|
|
2013-10-01 18:38:49 -04:00
|
|
|
|
YARN-1215. Yarn URL should include userinfo. (Chuan Liu via cnauroth)
|
|
|
|
|
|
2013-10-01 18:46:41 -04:00
|
|
|
|
YARN-1262. TestApplicationCleanup relies on all containers assigned in a
|
|
|
|
|
single heartbeat (Karthik Kambatla via Sandy Ryza)
|
|
|
|
|
|
2013-10-02 02:31:53 -04:00
|
|
|
|
YARN-1260. Added webapp.http.address to yarn-default.xml so that default
|
|
|
|
|
install with https enabled doesn't have broken link on NM UI. (Omkar Vinit
|
|
|
|
|
Joshi via vinodkv)
|
|
|
|
|
|
2013-10-02 17:50:20 -04:00
|
|
|
|
YARN-1141. Updating resource requests should be decoupled with updating
|
|
|
|
|
blacklist (Zhijie Shen via bikas)
|
|
|
|
|
|
2013-10-02 18:35:37 -04:00
|
|
|
|
YARN-876. Node resource is added twice when node comes back from unhealthy
|
|
|
|
|
to healthy. (Peng Zhang via Sandy Ryza)
|
|
|
|
|
|
2013-10-03 17:55:17 -04:00
|
|
|
|
YARN-890. Ensure CapacityScheduler doesn't round-up metric for available
|
|
|
|
|
resources. (Xuan Gong & Hitesh Shah via acmurthy)
|
|
|
|
|
|
2013-10-03 19:22:08 -04:00
|
|
|
|
YARN-621. Changed YARN web app to not add paths that can cause duplicate
|
|
|
|
|
additions of authenticated filters there by causing kerberos replay errors.
|
|
|
|
|
(Omkar Vinit Joshi via vinodkv)
|
|
|
|
|
|
2013-10-03 19:32:38 -04:00
|
|
|
|
YARN-1236. FairScheduler setting queue name in RMApp is not working.
|
|
|
|
|
(Sandy Ryza)
|
|
|
|
|
|
2013-10-03 21:04:26 -04:00
|
|
|
|
YARN-1256. NM silently ignores non-existent service in
|
|
|
|
|
StartContainerRequest (Xuan Gong via bikas)
|
|
|
|
|
|
2013-10-03 20:46:18 -04:00
|
|
|
|
YARN-1149. NM throws InvalidStateTransitonException: Invalid event:
|
|
|
|
|
APPLICATION_LOG_HANDLING_FINISHED at RUNNING (Xuan Gong via hitesh)
|
|
|
|
|
|
2013-10-03 21:31:26 -04:00
|
|
|
|
YARN-1271. "Text file busy" errors launching containers again
|
|
|
|
|
(Sandy Ryza)
|
|
|
|
|
|
2013-10-03 22:38:17 -04:00
|
|
|
|
YARN-1131. $yarn logs command should return an appropriate error message if
|
|
|
|
|
YARN application is still running. (Siddharth Seth via hitesh)
|
|
|
|
|
|
2013-10-04 02:04:29 -04:00
|
|
|
|
YARN-1219. FSDownload changes file suffix making FileUtil.unTar() throw
|
|
|
|
|
exception. (Shanyu Zhao via cnauroth)
|
|
|
|
|
|
2013-10-04 20:48:56 -04:00
|
|
|
|
YARN-1251. TestDistributedShell#TestDSShell failed with timeout. (Xuan Gong
|
|
|
|
|
via hitesh)
|
|
|
|
|
|
2013-10-04 21:44:46 -04:00
|
|
|
|
YARN-1167. Fixed Distributed Shell to not incorrectly show empty hostname
|
|
|
|
|
on RM UI. (Xuan Gong via vinodkv)
|
|
|
|
|
|
2013-10-05 00:26:37 -04:00
|
|
|
|
YARN-1254. Fixed NodeManager to not pollute container's credentials. (Omkar
|
|
|
|
|
Vinit Joshi via vinodkv)
|
|
|
|
|
|
2013-10-05 02:10:00 -04:00
|
|
|
|
YARN-1273. Fixed Distributed-shell to account for containers that failed
|
|
|
|
|
to start. (Hitesh Shah via vinodkv)
|
|
|
|
|
|
2013-10-05 18:21:22 -04:00
|
|
|
|
YARN-1032. Fixed NPE in RackResolver. (Lohit Vijayarenu via acmurthy)
|
|
|
|
|
|
2013-10-05 18:27:35 -04:00
|
|
|
|
YARN-1090. Fixed CS UI to better reflect applications as non-schedulable
|
|
|
|
|
and not as pending. (Jian He via acmurthy)
|
|
|
|
|
|
2013-10-05 20:15:51 -04:00
|
|
|
|
YARN-1274. Fixed NodeManager's LinuxContainerExecutor to create user, app-dir
|
|
|
|
|
and log-dirs correctly even when there are no resources to localize for the
|
|
|
|
|
container. (Siddharth Seth via vinodkv)
|
|
|
|
|
|
2013-10-06 14:33:37 -04:00
|
|
|
|
YARN-1278. Fixed NodeManager to not delete local resources for apps on resync
|
|
|
|
|
command from RM - a bug caused by YARN-1149. (Hitesh Shah via vinodkv)
|
|
|
|
|
|
2013-12-28 01:58:50 -05:00
|
|
|
|
YARN-1463. Tests should avoid starting http-server where possible or creates
|
|
|
|
|
spnego keytab/principals (vinodkv via kasha)
|
|
|
|
|
|
2013-09-17 01:23:39 -04:00
|
|
|
|
Release 2.1.1-beta - 2013-09-23
|
2013-06-26 02:51:07 -04:00
|
|
|
|
|
|
|
|
|
INCOMPATIBLE CHANGES
|
|
|
|
|
|
2013-08-29 21:13:36 -04:00
|
|
|
|
YARN-707. Added user information also in the YARN ClientToken so that AMs
|
|
|
|
|
can implement authorization based on incoming users. (Jason Lowe via vinodkv)
|
|
|
|
|
|
2013-09-16 10:06:27 -04:00
|
|
|
|
YARN-1170. YARN & MapReduce proto definitions fixed to specify protobuf
|
|
|
|
|
package as hadoop.yarn and hadoop.mapreduce respectively. (Binglin Chang
|
|
|
|
|
via acmurthy)
|
|
|
|
|
|
2013-06-26 02:51:07 -04:00
|
|
|
|
NEW FEATURES
|
|
|
|
|
|
|
|
|
|
IMPROVEMENTS
|
|
|
|
|
|
2013-08-08 20:37:29 -04:00
|
|
|
|
YARN-589. Expose a REST API for monitoring the fair scheduler (Sandy Ryza).
|
2013-08-24 17:17:11 -04:00
|
|
|
|
|
|
|
|
|
YARN-1074. Cleaned up YARN CLI application list to only display running
|
|
|
|
|
applications by default. (Xuan Gong via vinodkv)
|
2013-08-15 03:21:55 -04:00
|
|
|
|
|
2013-08-26 15:59:12 -04:00
|
|
|
|
YARN-1093. Corrections to Fair Scheduler documentation (Wing Yew Poon via
|
|
|
|
|
Sandy Ryza)
|
|
|
|
|
|
2013-08-26 16:48:54 -04:00
|
|
|
|
YARN-942. In Fair Scheduler documentation, inconsistency on which
|
|
|
|
|
properties have prefix (Akira Ajisaka via Sandy Ryza)
|
|
|
|
|
|
2013-08-27 19:54:33 -04:00
|
|
|
|
YARN-1083. Changed ResourceManager to fail when the expiry interval is less
|
|
|
|
|
than the configured node-heartbeat interval. (Zhijie Shen via vinodkv)
|
|
|
|
|
|
2013-08-28 01:46:57 -04:00
|
|
|
|
YARN-1081. Made a trivial change to YARN node CLI header to avoid potential
|
|
|
|
|
confusion. (Akira AJISAKA via vinodkv)
|
|
|
|
|
|
2013-08-28 22:24:43 -04:00
|
|
|
|
YARN-1034. Remove "experimental" in the Fair Scheduler documentation.
|
|
|
|
|
(Karthik Kambatla via Sandy Ryza)
|
|
|
|
|
|
2013-08-29 13:56:18 -04:00
|
|
|
|
YARN-1080. Improved help message for "yarn logs" command. (Xuan Gong via
|
|
|
|
|
vinodkv)
|
|
|
|
|
|
2013-08-30 19:03:44 -04:00
|
|
|
|
YARN-771. AMRMClient support for resource blacklisting (Junping Du via
|
|
|
|
|
bikas)
|
|
|
|
|
|
2013-08-30 19:26:36 -04:00
|
|
|
|
YARN-1117. Improved help messages for "yarn application" and "yarn node"
|
|
|
|
|
commands. (Xuan Gong via vinodkv)
|
|
|
|
|
|
2013-09-01 22:31:55 -04:00
|
|
|
|
YARN-1120. Made ApplicationConstants.Environment.USER definition OS neutral
|
|
|
|
|
as the corresponding value is now set correctly end-to-end. (Chuan Liu via
|
|
|
|
|
vinodkv)
|
|
|
|
|
|
2013-09-03 18:19:17 -04:00
|
|
|
|
YARN-1124. Modified YARN CLI application list to display new and submitted
|
|
|
|
|
applications together with running apps by default, following up YARN-1074.
|
|
|
|
|
(Xuan Gong via vinodkv)
|
|
|
|
|
|
2013-09-04 16:51:35 -04:00
|
|
|
|
YARN-1065. NM should provide AuxillaryService data to the container (Xuan
|
|
|
|
|
Gong via bikas)
|
|
|
|
|
|
2013-09-06 14:30:59 -04:00
|
|
|
|
YARN-758. Augment MockNM to use multiple cores (Karthik Kambatla via
|
|
|
|
|
Sandy Ryza)
|
|
|
|
|
|
2013-09-07 03:33:35 -04:00
|
|
|
|
YARN-696. Changed RMWebservice apps call to take in multiple application
|
|
|
|
|
states. (Trevor Lorimer via vinodkv)
|
|
|
|
|
|
2013-09-10 08:15:28 -04:00
|
|
|
|
YARN-910. Augmented auxiliary services to listen for container starts and
|
|
|
|
|
completions in addition to application events. (Alejandro Abdelnur via
|
|
|
|
|
vinodkv)
|
|
|
|
|
|
2013-09-16 07:02:13 -04:00
|
|
|
|
YARN-1137. Add support whitelist for system users to Yarn
|
|
|
|
|
container-executor.c. (rvs via tucu)
|
|
|
|
|
|
2013-09-16 20:24:51 -04:00
|
|
|
|
YARN-1001. Added a web-service to get statistics about per application-type
|
|
|
|
|
per state for consumption by downstream projects. (Zhijie Shen via vinodkv)
|
|
|
|
|
|
2013-09-19 19:51:14 -04:00
|
|
|
|
YARN-1203. Changed YARN web-app proxy to handle http and https URLs from
|
|
|
|
|
AM registration and finish correctly. (Omkar Vinit Joshi via vinodkv)
|
|
|
|
|
|
2013-09-24 13:20:48 -04:00
|
|
|
|
YARN-1204. Added separate configuration properties for https for RM and NM
|
|
|
|
|
without which servers enabled with https will also start on http ports.
|
|
|
|
|
(Omkar Vinit Joshi via vinodkv)
|
|
|
|
|
|
2013-06-26 02:51:07 -04:00
|
|
|
|
OPTIMIZATIONS
|
|
|
|
|
|
|
|
|
|
BUG FIXES
|
|
|
|
|
|
2013-07-30 16:31:19 -04:00
|
|
|
|
YARN-948. Changed ResourceManager to validate the release container list
|
|
|
|
|
before actually releasing them. (Omkar Vinit Joshi via vinodkv)
|
|
|
|
|
|
2013-07-30 20:00:28 -04:00
|
|
|
|
YARN-966. Fixed ContainerLaunch to not fail quietly when there are no
|
|
|
|
|
localized resources due to some other failure. (Zhijie Shen via vinodkv)
|
|
|
|
|
|
2013-07-31 20:55:37 -04:00
|
|
|
|
YARN-502. Fixed a state machine issue with RMNode inside ResourceManager
|
|
|
|
|
which was crashing scheduler. (Mayank Bansal via vinodkv)
|
|
|
|
|
|
2013-08-01 19:55:30 -04:00
|
|
|
|
YARN-573. Shared data structures in Public Localizer and Private Localizer
|
|
|
|
|
are not Thread safe. (Omkar Vinit Joshi via jlowe)
|
|
|
|
|
|
2013-08-02 02:55:21 -04:00
|
|
|
|
YARN-903. Changed ContainerManager to suppress unnecessary warnings when
|
|
|
|
|
stopping already stopped containers. (Omkar Vinit Joshi via vinodkv)
|
|
|
|
|
|
2013-08-02 20:49:32 -04:00
|
|
|
|
YARN-906. Fixed a bug in NodeManager where cancelling ContainerLaunch at
|
|
|
|
|
KILLING state causes that the container to hang. (Zhijie Shen via vinodkv)
|
|
|
|
|
|
2013-08-03 18:38:58 -04:00
|
|
|
|
YARN-994. HeartBeat thread in AMRMClientAsync does not handle runtime
|
|
|
|
|
exception correctly (Xuan Gong via bikas)
|
|
|
|
|
|
2013-08-14 10:21:37 -04:00
|
|
|
|
YARN-337. RM handles killed application tracking URL poorly (jlowe)
|
|
|
|
|
|
2013-08-16 19:01:38 -04:00
|
|
|
|
YARN-107. Fixed ResourceManager and clients to better handle
|
|
|
|
|
forceKillApplication on non-running and finished applications. (Xuan Gong
|
|
|
|
|
via vinodkv)
|
|
|
|
|
|
2013-08-18 21:54:22 -04:00
|
|
|
|
YARN-643. Fixed ResourceManager to remove all tokens consistently on app
|
|
|
|
|
finish. (Xuan Gong via vinodkv)
|
|
|
|
|
|
2013-08-19 18:04:43 -04:00
|
|
|
|
YARN-1006. Fixed broken rendering in the Nodes list web page on the RM web
|
|
|
|
|
UI. (Xuan Gong via vinodkv)
|
|
|
|
|
|
2013-08-21 19:43:17 -04:00
|
|
|
|
YARN-881. Priority#compareTo method seems to be wrong. (Jian He via bikas)
|
|
|
|
|
|
2013-08-21 19:55:59 -04:00
|
|
|
|
YARN-1082. Create base directories on HDFS after RM login to ensure RM
|
|
|
|
|
recovery doesn't fail in secure mode. (vinodkv via acmurthy)
|
|
|
|
|
|
2013-08-23 22:48:17 -04:00
|
|
|
|
YARN-1085. Modified YARN and MR2 web-apps to do HTTP authentication in
|
|
|
|
|
secure setup with kerberos. (Omkar Vinit Joshi via vinodkv)
|
|
|
|
|
|
2013-08-24 19:33:15 -04:00
|
|
|
|
YARN-1094. Fixed a blocker with RM restart code because of which RM crashes
|
|
|
|
|
when try to recover an existing app. (vinodkv)
|
|
|
|
|
|
2013-08-26 11:42:43 -04:00
|
|
|
|
YARN-1008. MiniYARNCluster with multiple nodemanagers, all nodes have same
|
|
|
|
|
key for allocations. (tucu)
|
|
|
|
|
|
2013-08-27 19:39:16 -04:00
|
|
|
|
YARN-981. Fixed YARN webapp so that /logs servlet works like before. (Jian He
|
|
|
|
|
via vinodkv)
|
|
|
|
|
|
2013-08-28 01:14:15 -04:00
|
|
|
|
YARN-602. Fixed NodeManager to not let users override some mandatory
|
|
|
|
|
environmental variables. (Kenji Kikushima via vinodkv)
|
|
|
|
|
|
2013-08-28 17:12:21 -04:00
|
|
|
|
YARN-1101. Active nodes can be decremented below 0 (Robert Parker
|
|
|
|
|
via tgraves)
|
|
|
|
|
|
2013-09-01 23:11:06 -04:00
|
|
|
|
YARN-1077. Fixed TestContainerLaunch test failure on Windows. (Chuan Liu via
|
|
|
|
|
vinodkv)
|
|
|
|
|
|
2013-09-04 21:21:18 -04:00
|
|
|
|
YARN-957. Fixed a bug in CapacityScheduler because of which requests that
|
|
|
|
|
need more than a node's total capability were incorrectly allocated on that
|
|
|
|
|
node causing apps to hang. (Omkar Vinit Joshi via vinodkv)
|
|
|
|
|
|
2013-09-07 01:50:42 -04:00
|
|
|
|
YARN-1107. Fixed a bug in ResourceManager because of which RM in secure mode
|
|
|
|
|
fails to restart. (Omkar Vinit Joshi via vinodkv)
|
|
|
|
|
|
2013-09-09 07:10:23 -04:00
|
|
|
|
YARN-1049. ContainerExistStatus should define a status for preempted
|
|
|
|
|
containers. (tucu)
|
|
|
|
|
|
2013-09-09 07:16:43 -04:00
|
|
|
|
YARN-1144. Unmanaged AMs registering a tracking URI should not be
|
|
|
|
|
proxy-fied. (tucu)
|
|
|
|
|
|
2013-09-09 17:19:38 -04:00
|
|
|
|
YARN-1152. Fixed a bug in ResourceManager that was causing clients to get
|
|
|
|
|
invalid client token key errors when an appliation is about to finish.
|
|
|
|
|
(Jason Lowe via vinodkv)
|
|
|
|
|
|
2013-09-09 21:25:41 -04:00
|
|
|
|
YARN-292. Fixed FifoScheduler and FairScheduler to make their applications
|
|
|
|
|
data structures thread safe to avoid RM crashing with
|
|
|
|
|
ArrayIndexOutOfBoundsException. (Zhijie Shen via vinodkv)
|
|
|
|
|
|
2013-09-10 18:52:55 -04:00
|
|
|
|
YARN-1025. ResourceManager and NodeManager do not load native libraries on
|
|
|
|
|
Windows. (cnauroth)
|
|
|
|
|
|
2013-09-11 18:04:27 -04:00
|
|
|
|
YARN-1176. RM web services ClusterMetricsInfo total nodes doesn't include
|
|
|
|
|
unhealthy nodes (Jonathan Eagles via tgraves)
|
|
|
|
|
|
2013-09-12 12:04:41 -04:00
|
|
|
|
YARN-1078. TestNodeManagerResync, TestNodeManagerShutdown, and
|
|
|
|
|
TestNodeStatusUpdater fail on Windows. (Chuan Liu via cnauroth)
|
|
|
|
|
|
2013-09-13 11:20:38 -04:00
|
|
|
|
YARN-1194. TestContainerLogsPage fails with native builds (Roman Shaposhnik
|
|
|
|
|
via jlowe)
|
|
|
|
|
|
2013-09-13 19:57:56 -04:00
|
|
|
|
YARN-1116. Populate AMRMTokens back to AMRMTokenSecretManager after RM
|
|
|
|
|
restarts (Jian He via bikas)
|
|
|
|
|
|
2013-09-13 20:23:20 -04:00
|
|
|
|
YARN-1189. NMTokenSecretManagerInNM is not being told when applications
|
|
|
|
|
have finished (Omkar Vinit Joshi via jlowe)
|
|
|
|
|
|
2013-09-14 21:07:11 -04:00
|
|
|
|
YARN-540. Race condition causing RM to potentially relaunch already
|
|
|
|
|
unregistered AMs on RM restart (Jian He via bikas)
|
|
|
|
|
|
2013-09-16 21:31:18 -04:00
|
|
|
|
YARN-1184. ClassCastException during preemption enforcement. (cdouglas)
|
|
|
|
|
|
2013-08-15 16:34:25 -04:00
|
|
|
|
Release 2.1.0-beta - 2013-08-22
|
2013-02-06 08:39:39 -05:00
|
|
|
|
|
|
|
|
|
INCOMPATIBLE CHANGES
|
|
|
|
|
|
2013-03-20 16:46:22 -04:00
|
|
|
|
YARN-396. Rationalize AllocateResponse in RM Scheduler API. (Zhijie Shen
|
|
|
|
|
via hitesh)
|
|
|
|
|
|
2013-03-25 14:30:15 -04:00
|
|
|
|
YARN-439. Flatten NodeHeartbeatResponse. (Xuan Gong via sseth)
|
|
|
|
|
|
2013-03-26 14:21:43 -04:00
|
|
|
|
YARN-440. Flatten RegisterNodeManagerResponse. (Xuan Gong via sseth)
|
|
|
|
|
|
2013-04-03 23:43:04 -04:00
|
|
|
|
YARN-536. Removed the unused objects ContainerStatus and ContainerStatus from
|
|
|
|
|
Container which also don't belong to the container. (Xuan Gong via vinodkv)
|
|
|
|
|
|
2013-04-11 19:04:09 -04:00
|
|
|
|
YARN-486. Changed NM's startContainer API to accept Container record given by
|
|
|
|
|
RM as a direct parameter instead of as part of the ContainerLaunchContext
|
2013-05-25 20:09:12 -04:00
|
|
|
|
record. (Xuan Gong via vinodkv)
|
2013-04-11 19:04:09 -04:00
|
|
|
|
|
2013-04-15 19:55:26 -04:00
|
|
|
|
YARN-444. Moved special container exit codes from YarnConfiguration to API
|
|
|
|
|
where they belong. (Sandy Ryza via vinodkv)
|
|
|
|
|
|
2013-04-18 21:34:04 -04:00
|
|
|
|
YARN-441. Removed unused utility methods for collections from two API
|
|
|
|
|
records. (Xuan Gong via vinodkv)
|
|
|
|
|
|
2013-04-23 20:01:08 -04:00
|
|
|
|
YARN-561. Modified NodeManager to set key information into the environment
|
|
|
|
|
of every container that it launches. (Xuan Gong via vinodkv)
|
|
|
|
|
|
2013-04-24 22:48:18 -04:00
|
|
|
|
YARN-579. Stop setting the Application Token in the AppMaster env, in
|
|
|
|
|
favour of the copy present in the container token field.
|
|
|
|
|
(Vinod Kumar Vavilapalli via sseth)
|
|
|
|
|
|
2013-05-06 15:20:02 -04:00
|
|
|
|
YARN-629. Make YarnRemoteException not be rooted at IOException. (Xuan Gong
|
|
|
|
|
via vinodkv)
|
|
|
|
|
|
2013-05-06 20:38:57 -04:00
|
|
|
|
YARN-633. Changed RMAdminProtocol api to throw IOException and
|
|
|
|
|
YarnRemoteException. (Xuan Gong via vinodkv)
|
|
|
|
|
|
2013-05-06 20:43:32 -04:00
|
|
|
|
YARN-632. Changed ContainerManager api to throw IOException and
|
|
|
|
|
YarnRemoteException. (Xuan Gong via vinodkv)
|
|
|
|
|
|
2013-05-08 18:54:07 -04:00
|
|
|
|
YARN-631. Changed ClientRMProtocol api to throw IOException and
|
|
|
|
|
YarnRemoteException. (Xuan Gong via vinodkv)
|
|
|
|
|
|
2013-05-09 01:32:52 -04:00
|
|
|
|
YARN-630. Changed AMRMProtocol api to throw IOException and
|
|
|
|
|
YarnRemoteException. (Xuan Gong via vinodkv)
|
|
|
|
|
|
2013-05-14 00:13:00 -04:00
|
|
|
|
YARN-615. Rename ContainerLaunchContext.containerTokens to tokens.
|
|
|
|
|
(Vinod Kumar Vavilapalli via sseth)
|
|
|
|
|
|
2013-05-24 19:11:25 -04:00
|
|
|
|
YARN-571. Remove user from ContainerLaunchContext. (Omkar Vinit Joshi via
|
|
|
|
|
vinodkv)
|
|
|
|
|
|
2013-05-30 16:19:53 -04:00
|
|
|
|
YARN-716. Making ApplicationID immutable. (Siddharth Seth via vinodkv)
|
|
|
|
|
|
2013-05-31 00:14:27 -04:00
|
|
|
|
YARN-684. ContainerManager.startContainer should use
|
|
|
|
|
ContainerTokenIdentifier instead of the entire Container.
|
|
|
|
|
(Vinod Kumar Vavilapalli via sseth)
|
|
|
|
|
|
2013-05-31 20:15:53 -04:00
|
|
|
|
YARN-735. Make ApplicationAttemptId, ContaienrId and NodeId immutable.
|
|
|
|
|
(Jian He via sseth)
|
|
|
|
|
|
2013-06-02 18:55:31 -04:00
|
|
|
|
YARN-749. Rename ResourceRequest.(get,set)HostName to
|
|
|
|
|
ResourceRequest.(get,set)ResourceName. (acmurthy)
|
|
|
|
|
|
2013-06-02 22:36:44 -04:00
|
|
|
|
YARN-720. container-log4j.properties should not refer to mapreduce
|
|
|
|
|
property names. (Zhijie Shen via sseth)
|
|
|
|
|
|
2013-06-03 20:56:26 -04:00
|
|
|
|
YARN-748. Moved BuilderUtils from yarn-common to yarn-server-common for
|
|
|
|
|
eventual retirement. (Jian He via vinodkv)
|
|
|
|
|
|
2013-06-04 00:50:16 -04:00
|
|
|
|
YARN-635. Renamed YarnRemoteException to YarnException. (Siddharth Seth via
|
|
|
|
|
vinodkv)
|
|
|
|
|
|
2013-06-04 01:55:22 -04:00
|
|
|
|
YARN-755. Renamed AllocateResponse.reboot to AllocateResponse.resync. (Bikas
|
|
|
|
|
Saha via vinodkv)
|
2013-06-04 01:05:16 -04:00
|
|
|
|
|
2013-06-04 17:54:09 -04:00
|
|
|
|
YARN-753. Added individual factory methods for all api protocol records and
|
|
|
|
|
converted the records to be abstract classes. (Jian He via vinodkv)
|
|
|
|
|
|
2013-06-04 18:47:05 -04:00
|
|
|
|
YARN-724. Moved ProtoBase from api.records to api.records.impl.pb. (Jian He
|
|
|
|
|
via vinodkv)
|
|
|
|
|
|
2013-06-17 12:51:53 -04:00
|
|
|
|
YARN-759. Create Command enum in AllocateResponse (bikas)
|
|
|
|
|
|
2013-06-07 20:40:45 -04:00
|
|
|
|
YARN-777. Removed unreferenced objects from .proto files. (Jian He via
|
|
|
|
|
vinodkv)
|
|
|
|
|
|
2013-06-07 20:55:25 -04:00
|
|
|
|
YARN-642. Removed health parameter from ResourceManager /nodes web-service
|
|
|
|
|
and cleaned the behaviour of the status parameter. (Sandy Ryza vid vinodkv)
|
|
|
|
|
|
2013-06-13 11:56:44 -04:00
|
|
|
|
YARN-530. Defined Service model strictly, implemented AbstractService for
|
|
|
|
|
robust subclassing and migrated yarn-common services. (Steve Loughran via
|
|
|
|
|
vinodkv)
|
|
|
|
|
|
2013-06-13 13:50:09 -04:00
|
|
|
|
YARN-746. Renamed Service.register() and Service.unregister() to
|
|
|
|
|
registerServiceListener() & unregisterServiceListener() respectively.
|
|
|
|
|
(Steve Loughran via vinodkv)
|
|
|
|
|
|
2013-06-13 23:19:34 -04:00
|
|
|
|
YARN-792. Moved NodeHealthStatus from yarn.api.record to
|
|
|
|
|
yarn.server.api.record. (Jian He via vinodkv)
|
|
|
|
|
|
2013-06-14 12:11:36 -04:00
|
|
|
|
YARN-806. Moved ContainerExitStatus from yarn.api to yarn.api.records. (Jian
|
|
|
|
|
He via vinodkv)
|
|
|
|
|
|
2013-06-15 00:58:45 -04:00
|
|
|
|
YARN-821. Renamed setFinishApplicationStatus to setFinalApplicationStatus in
|
2013-06-16 16:34:02 -04:00
|
|
|
|
FinishApplicationMasterRequest for consistency. (Jian He via vinodkv)
|
2013-06-15 00:58:45 -04:00
|
|
|
|
|
2013-06-16 10:00:36 -04:00
|
|
|
|
YARN-787. Removed minimum resource from RegisterApplicationMasterResponse.
|
|
|
|
|
(tucu via acmurthy)
|
|
|
|
|
|
2013-06-16 16:34:02 -04:00
|
|
|
|
YARN-829. Renamed RMTokenSelector to be RMDelegationTokenSelector. (Zhijie
|
|
|
|
|
Shen via vinodkv)
|
|
|
|
|
|
2013-06-16 17:35:20 -04:00
|
|
|
|
YARN-828. Removed the unsed YarnVersionAnnotation. (Zhijie Shen via vinodkv)
|
|
|
|
|
|
2013-06-16 17:43:27 -04:00
|
|
|
|
YARN-823. Moved RMAdmin from yarn.client to yarn.client.cli and renamed it to
|
|
|
|
|
be RMAdminCLI. (Jian He via vinodkv)
|
|
|
|
|
|
2013-06-16 22:29:56 -04:00
|
|
|
|
YARN-387. Renamed YARN protocols for consistency.
|
|
|
|
|
ClientRMProtocol -> ApplicationClientProtocol
|
|
|
|
|
AMRMProtocol -> ApplicationMasterProtocol
|
|
|
|
|
ContainerManager -> ContainerManagementProtocol
|
|
|
|
|
(vinodkv via acmurthy)
|
|
|
|
|
|
2013-06-16 22:34:04 -04:00
|
|
|
|
YARN-831. Removed minimum resource from GetNewApplicationResponse as a
|
|
|
|
|
follow-up to YARN-787. (Jian He via acmurthy)
|
|
|
|
|
|
2013-06-16 23:20:22 -04:00
|
|
|
|
YARN-824. Added static factory methods to hadoop-yarn-client interfaces.
|
|
|
|
|
(Jian He via acmurthy)
|
|
|
|
|
|
2013-06-17 00:50:30 -04:00
|
|
|
|
YARN-826. Moved Clock and SystemClock into yarn.util package. (Zhijie Shen
|
|
|
|
|
via vinodkv)
|
|
|
|
|
|
2013-06-17 04:15:05 -04:00
|
|
|
|
YARN-837. Moved yarn.ClusterInfo into MapReduce project as it doesn't belong
|
|
|
|
|
to YARN. (Zhijie Shen via vinodkv)
|
|
|
|
|
|
2013-06-17 15:12:12 -04:00
|
|
|
|
YARN-822. Renamed ApplicationToken to be AMRMToken, and similarly the
|
|
|
|
|
corresponding TokenSelector and SecretManager. (Omkar Vinit Joshi via vinodkv)
|
|
|
|
|
|
2013-06-17 19:14:15 -04:00
|
|
|
|
YARN-610. ClientToken is no longer set in the environment of the Containers.
|
|
|
|
|
(Omkar Vinit Joshi via vinodkv)
|
|
|
|
|
|
2013-06-18 00:03:43 -04:00
|
|
|
|
YARN-834. Fixed annotations for yarn-client module, reorganized packages and
|
|
|
|
|
clearly differentiated *Async apis. (Arun C Murthy and Zhijie Shen via
|
|
|
|
|
vinodkv)
|
|
|
|
|
|
2013-06-18 01:59:54 -04:00
|
|
|
|
YARN-840. Moved ProtoUtils to yarn.api.records.pb.impl. (Jian He via
|
|
|
|
|
acmurthy)
|
|
|
|
|
|
2013-06-18 02:23:54 -04:00
|
|
|
|
YARN-841. Move Auxiliary service to yarn-api, annotate and document it.
|
|
|
|
|
(vinodkv)
|
|
|
|
|
|
2013-06-18 17:22:48 -04:00
|
|
|
|
YARN-850. Rename getClusterAvailableResources to getAvailableResources in
|
|
|
|
|
AMRMClients (Jian He via bikas)
|
|
|
|
|
|
2013-06-18 19:20:34 -04:00
|
|
|
|
YARN-694. Starting to use NMTokens to authenticate all communication with
|
|
|
|
|
NodeManagers. (Omkar Vinit Joshi via vinodkv)
|
|
|
|
|
|
2013-06-19 03:07:44 -04:00
|
|
|
|
YARN-553. Replaced YarnClient.getNewApplication with
|
|
|
|
|
YarnClient.createApplication which provides a directly usable
|
|
|
|
|
ApplicationSubmissionContext to simplify the api. (Karthik Kambatla via
|
|
|
|
|
acmurthy)
|
|
|
|
|
|
2013-06-20 20:09:45 -04:00
|
|
|
|
YARN-851. Share NMTokens using NMTokenCache (api-based) between AMRMClient
|
|
|
|
|
and NMClient instead of memory based approach which is used currently. (Omkar
|
|
|
|
|
Vinit Joshi via vinodkv)
|
|
|
|
|
|
2013-06-26 02:03:24 -04:00
|
|
|
|
YARN-869. Move ResourceManagerAdministrationProtocol out of main YARN api.
|
|
|
|
|
(vinodkv via acmurthy)
|
|
|
|
|
|
2013-07-08 18:33:43 -04:00
|
|
|
|
YARN-791. Changed RM APIs and web-services related to nodes to ensure that
|
|
|
|
|
both are consistent with each other. (Sandy Ryza via vinodkv)
|
|
|
|
|
|
2013-07-09 19:07:15 -04:00
|
|
|
|
YARN-727. ClientRMProtocol.getAllApplications should accept ApplicationType as
|
|
|
|
|
a parameter. (Xuan Gong via hitesh)
|
|
|
|
|
|
2013-07-18 15:04:37 -04:00
|
|
|
|
YARN-701. Use application tokens irrespective of secure or non-secure
|
|
|
|
|
mode. (vinodkv via acmurthy)
|
|
|
|
|
|
2013-07-18 20:58:33 -04:00
|
|
|
|
YARN-918. Remove ApplicationAttemptId from
|
|
|
|
|
RegisterApplicationMasterRequestProto. (vinodkv via acmurthy)
|
|
|
|
|
|
2013-07-23 23:42:52 -04:00
|
|
|
|
YARN-926. Modified ContainerManagerProtcol APIs to take in requests for
|
|
|
|
|
multiple containers. (Jian He via vinodkv)
|
|
|
|
|
|
2013-02-06 08:39:39 -05:00
|
|
|
|
NEW FEATURES
|
|
|
|
|
|
2013-04-18 14:13:36 -04:00
|
|
|
|
YARN-482. FS: Extend SchedulingMode to intermediate queues.
|
|
|
|
|
(kkambatl via tucu)
|
|
|
|
|
|
2013-05-07 02:18:25 -04:00
|
|
|
|
YARN-45. Add protocol for schedulers to request containers back from
|
|
|
|
|
ApplicationMasters. (Carlo Curino, cdouglas)
|
|
|
|
|
|
2013-05-23 14:02:45 -04:00
|
|
|
|
YARN-563. Add the concept of an application-type for each application.
|
|
|
|
|
(Mayank Bansal via vinodkv)
|
|
|
|
|
|
2013-05-23 17:07:05 -04:00
|
|
|
|
HADOOP-8562. Enhancements to support Hadoop on Windows Server and Windows
|
|
|
|
|
Azure environments. (See breakdown of tasks below for subtasks and
|
|
|
|
|
contributors)
|
|
|
|
|
|
2013-05-28 21:43:01 -04:00
|
|
|
|
YARN-422. Add a NM Client library to help application-writers. (Zhijie Shen
|
|
|
|
|
via vinodkv)
|
|
|
|
|
|
2013-05-31 13:28:10 -04:00
|
|
|
|
YARN-392. Make it possible to specify hard locality constraints in resource
|
|
|
|
|
requests. (sandyr via tucu)
|
|
|
|
|
|
2013-06-03 13:36:20 -04:00
|
|
|
|
YARN-326. Add multi-resource scheduling to the fair scheduler.
|
|
|
|
|
(sandyr via tucu)
|
|
|
|
|
|
2013-06-03 14:15:04 -04:00
|
|
|
|
YARN-398. Make it possible to specify hard locality constraints in resource
|
|
|
|
|
requests for CapacityScheduler. (acmurthy)
|
|
|
|
|
|
2013-06-15 19:11:26 -04:00
|
|
|
|
YARN-781. Exposing LOGDIR in all containers' environment which should be used
|
|
|
|
|
by containers for logging purposes. (Jian He via vinodkv)
|
|
|
|
|
|
2013-02-06 08:39:39 -05:00
|
|
|
|
IMPROVEMENTS
|
|
|
|
|
|
2013-07-29 03:31:40 -04:00
|
|
|
|
YARN-347. Node CLI should show CPU info besides memory in node status.
|
|
|
|
|
(Junping Du via llu)
|
|
|
|
|
|
2013-02-25 22:33:01 -05:00
|
|
|
|
YARN-365. Change NM heartbeat handling to not generate a scheduler event
|
|
|
|
|
on each heartbeat. (Xuan Gong via sseth)
|
|
|
|
|
|
2013-03-01 15:39:59 -05:00
|
|
|
|
YARN-380. Fix yarn node -status output to be better readable. (Omkar Vinit
|
|
|
|
|
Joshi via vinodkv)
|
|
|
|
|
|
2013-03-01 20:22:35 -05:00
|
|
|
|
YARN-410. Fixed RM UI so that the new lines diagnostics for a failed app on
|
|
|
|
|
the per-application page are translated to html line breaks. (Omkar Vinit
|
|
|
|
|
Joshi via vinodkv)
|
|
|
|
|
|
2013-03-13 00:25:26 -04:00
|
|
|
|
YARN-198. Added a link to RM pages from the NodeManager web app. (Jian He
|
|
|
|
|
via vinodkv)
|
|
|
|
|
|
2013-03-14 12:57:10 -04:00
|
|
|
|
YARN-237. Refreshing the RM page forgets how many rows I had in my
|
|
|
|
|
Datatables (jian he via bobby)
|
|
|
|
|
|
2013-03-18 20:00:12 -04:00
|
|
|
|
YARN-481. Add AM Host and RPC Port to ApplicationCLI Status Output
|
|
|
|
|
(Chris Riccomini via bikas)
|
|
|
|
|
|
2013-03-20 17:11:16 -04:00
|
|
|
|
YARN-297. Improve hashCode implementations for PB records. (Xuan Gong via
|
|
|
|
|
hitesh)
|
|
|
|
|
|
2013-03-21 18:30:10 -04:00
|
|
|
|
YARN-417. Create AMRMClient wrapper that provides asynchronous callbacks.
|
|
|
|
|
(Sandy Ryza via bikas)
|
|
|
|
|
|
2013-03-25 14:59:05 -04:00
|
|
|
|
YARN-497. Yarn unmanaged-am launcher jar does not define a main class in
|
|
|
|
|
its manifest (Hitesh Shah via bikas)
|
|
|
|
|
|
2013-03-25 23:27:26 -04:00
|
|
|
|
YARN-469. Make scheduling mode in FS pluggable. (kkambatl via tucu)
|
|
|
|
|
|
2013-03-28 15:48:52 -04:00
|
|
|
|
YARN-450. Define value for * in the scheduling protocol (Zhijie Shen via
|
|
|
|
|
bikas)
|
|
|
|
|
|
2013-03-31 15:18:42 -04:00
|
|
|
|
YARN-475. Remove a unused constant in the public API -
|
|
|
|
|
ApplicationConstants.AM_APP_ATTEMPT_ID_ENV. (Hitesh Shah via vinodkv)
|
|
|
|
|
|
2013-04-01 21:05:19 -04:00
|
|
|
|
YARN-309. Changed NodeManager to obtain heart-beat interval from the
|
|
|
|
|
ResourceManager. (Xuan Gong via vinodkv)
|
|
|
|
|
|
2013-04-02 02:59:51 -04:00
|
|
|
|
YARN-447. Move ApplicationComparator in CapacityScheduler to use comparator
|
|
|
|
|
in ApplicationId. (Nemon Lou via vinodkv)
|
|
|
|
|
|
2013-04-03 14:03:21 -04:00
|
|
|
|
YARN-381. Improve fair scheduler docs. (Sandy Ryza via tomwhite)
|
|
|
|
|
|
2013-04-03 17:04:45 -04:00
|
|
|
|
YARN-458. YARN daemon addresses must be placed in many different configs.
|
|
|
|
|
(sandyr via tucu)
|
|
|
|
|
|
2013-04-05 13:48:35 -04:00
|
|
|
|
YARN-193. Scheduler.normalizeRequest does not account for allocation
|
|
|
|
|
requests that exceed maximumAllocation limits (Zhijie Shen via bikas)
|
|
|
|
|
|
2013-04-08 15:19:33 -04:00
|
|
|
|
YARN-479. NM retry behavior for connection to RM should be similar for
|
|
|
|
|
lost heartbeats (Jian He via bikas)
|
|
|
|
|
|
2013-04-10 22:01:44 -04:00
|
|
|
|
YARN-495. Changed NM reboot behaviour to be a simple resync - kill all
|
|
|
|
|
containers and re-register with RM. (Jian He via vinodkv)
|
|
|
|
|
|
2013-04-17 16:30:48 -04:00
|
|
|
|
YARN-514. Delayed store operations should not result in RM unavailability
|
|
|
|
|
for app submission (Zhijie Shen via bikas)
|
|
|
|
|
|
2013-04-19 18:25:53 -04:00
|
|
|
|
YARN-586. Fixed a typo in ApplicationSubmissionContext#setApplicationId.
|
|
|
|
|
(Zhijie Shen via vinodkv)
|
|
|
|
|
|
2013-04-19 20:36:07 -04:00
|
|
|
|
YARN-542. Changed the default global AM max-attempts value to be not one.
|
|
|
|
|
(Zhijie Shen via vinodkv)
|
|
|
|
|
|
2013-04-23 00:38:45 -04:00
|
|
|
|
YARN-583. Moved application level local resources to be localized under the
|
|
|
|
|
filecache sub-directory under application directory. (Omkar Vinit Joshi via
|
|
|
|
|
vinodkv)
|
|
|
|
|
|
2013-04-23 18:51:19 -04:00
|
|
|
|
YARN-581. Added a test to verify that app delegation tokens are restored
|
|
|
|
|
after RM restart. (Jian He via vinodkv)
|
|
|
|
|
|
2013-04-25 01:45:15 -04:00
|
|
|
|
YARN-577. Add application-progress also to ApplicationReport. (Hitesh Shah
|
|
|
|
|
via vinodkv)
|
|
|
|
|
|
2013-04-25 04:36:22 -04:00
|
|
|
|
YARN-595. Refactor fair scheduler to use common Resources. (Sandy Ryza
|
|
|
|
|
via tomwhite)
|
|
|
|
|
|
2013-04-26 15:08:44 -04:00
|
|
|
|
YARN-562. Modified NM to reject any containers allocated by a previous
|
|
|
|
|
ResourceManager. (Jian He via vinodkv)
|
|
|
|
|
|
2013-04-26 14:04:24 -04:00
|
|
|
|
YARN-591. Moved RM recovery related records out of public API as they do not
|
|
|
|
|
belong there. (vinodkv)
|
|
|
|
|
|
2013-04-30 01:44:45 -04:00
|
|
|
|
YARN-599. Refactoring submitApplication in ClientRMService and RMAppManager
|
|
|
|
|
to separate out various validation checks depending on whether they rely on
|
|
|
|
|
RM configuration or not. (Zhijie Shen via vinodkv)
|
|
|
|
|
|
2013-05-01 19:48:32 -04:00
|
|
|
|
YARN-618. Modified RM_INVALID_IDENTIFIER to be -1 instead of zero. (Jian He
|
|
|
|
|
via vinodkv)
|
|
|
|
|
|
2013-05-02 18:45:30 -04:00
|
|
|
|
YARN-625. Move the utility method unwrapAndThrowException from
|
|
|
|
|
YarnRemoteExceptionPBImpl to RPCUtil. (Siddharth Seth via vinodkv)
|
|
|
|
|
|
2013-05-03 21:13:43 -04:00
|
|
|
|
YARN-645. Moved RMDelegationTokenSecretManager from yarn-server-common to
|
|
|
|
|
yarn-server-resourcemanager where it really belongs. (Jian He via vinodkv)
|
|
|
|
|
|
2013-05-08 00:17:40 -04:00
|
|
|
|
YARN-651. Changed PBClientImpls of ContainerManager and RMAdmin to throw
|
|
|
|
|
IOExceptions also. (Xuan Gong via vinodkv)
|
|
|
|
|
|
2013-05-08 02:21:02 -04:00
|
|
|
|
YARN-582. Changed ResourceManager to recover Application token and client
|
|
|
|
|
tokens for app attempt so that RM can be restarted while preserving current
|
|
|
|
|
applications. (Jian He via vinodkv)
|
|
|
|
|
|
2013-05-09 19:29:38 -04:00
|
|
|
|
YARN-568. Add support for work preserving preemption to the FairScheduler.
|
|
|
|
|
(Carlo Curino and Sandy Ryza via cdouglas)
|
|
|
|
|
|
2013-05-09 18:24:29 -04:00
|
|
|
|
YARN-598. Add virtual cores to queue metrics. (sandyr via tucu)
|
|
|
|
|
|
2013-05-10 17:51:32 -04:00
|
|
|
|
YARN-634. Modified YarnRemoteException to be not backed by PB and introduced
|
|
|
|
|
a separate SerializedException record. (Siddharth Seth via vinodkv)
|
|
|
|
|
|
2013-05-10 17:59:59 -04:00
|
|
|
|
YARN-663. Changed ResourceTracker API and LocalizationProtocol API to throw
|
|
|
|
|
YarnRemoteException and IOException. (Xuan Gong via vinodkv)
|
|
|
|
|
|
2013-05-10 19:38:35 -04:00
|
|
|
|
YARN-590. Added an optional mesage to be returned by ResourceMaanger when RM
|
|
|
|
|
asks an RM to shutdown/resync etc so that NMs can log this message locally
|
|
|
|
|
for better debuggability. (Mayank Bansal via vinodkv)
|
|
|
|
|
|
2013-05-17 02:38:03 -04:00
|
|
|
|
YARN-617. Made ContainerTokens to be used for validation at NodeManager
|
|
|
|
|
also in unsecure mode to prevent AMs from faking resource requirements in
|
|
|
|
|
unsecure mode. (Omkar Vinit Joshi via vinodkv)
|
|
|
|
|
|
2013-05-22 18:51:51 -04:00
|
|
|
|
YARN-708. Moved RecordFactory classes to hadoop-yarn-api, and put some
|
|
|
|
|
miscellaneous fixes to the interfaces. (Siddharth Seth via vinodkv)
|
|
|
|
|
|
2013-05-23 18:48:13 -04:00
|
|
|
|
YARN-711. Copied BuilderUtil methods in individual API records as
|
|
|
|
|
BuilderUtils is going to be dismantled. (Jian He via vinodkv)
|
|
|
|
|
|
2013-05-29 21:57:39 -04:00
|
|
|
|
YARN-714. Added NMTokens to be sent to AMs as part of heart-beat response.
|
|
|
|
|
(Omkar Vinit Joshi via vinodkv)
|
|
|
|
|
|
2013-05-30 00:15:05 -04:00
|
|
|
|
YARN-638. Modified ResourceManager to restore RMDelegationTokens after
|
|
|
|
|
restarting. (Jian He via vinodkv)
|
|
|
|
|
|
2013-06-01 04:31:50 -04:00
|
|
|
|
YARN-660. Improve AMRMClient with matching requests (bikas)
|
|
|
|
|
|
2013-06-01 17:45:24 -04:00
|
|
|
|
YARN-717. Put object creation factories for Token in the class itself and
|
|
|
|
|
remove useless derivations for specific tokens. (Jian He via vinodkv)
|
|
|
|
|
|
2013-06-04 01:55:22 -04:00
|
|
|
|
YARN-756. Move Preemption* records to yarn.api where they really belong.
|
|
|
|
|
(Jian He via vinodkv)
|
|
|
|
|
|
2013-06-06 16:55:02 -04:00
|
|
|
|
YARN-750. Allow for black-listing resources in YARN API and Impl in CS
|
|
|
|
|
(acmurthy via bikas)
|
|
|
|
|
|
2013-06-29 16:22:19 -04:00
|
|
|
|
YARN-877. Support resource blacklisting for FifoScheduler.
|
|
|
|
|
(Junping Du via llu)
|
|
|
|
|
|
2013-06-07 17:01:23 -04:00
|
|
|
|
YARN-686. Flatten NodeReport. (sandyr via tucu)
|
|
|
|
|
|
2013-06-11 14:48:00 -04:00
|
|
|
|
YARN-737. Throw some specific exceptions directly instead of wrapping them
|
|
|
|
|
in YarnException. (Jian He via sseth)
|
|
|
|
|
|
2013-06-11 18:35:22 -04:00
|
|
|
|
YARN-731. RPCUtil.unwrapAndThrowException should unwrap remote
|
|
|
|
|
RuntimeExceptions. (Zhijie Shen via sseth)
|
|
|
|
|
|
2013-06-12 15:00:00 -04:00
|
|
|
|
YARN-600. Hook up cgroups CPU settings to the number of virtual cores
|
|
|
|
|
allocated. (sandyr via tucu)
|
|
|
|
|
|
2013-06-12 15:24:54 -04:00
|
|
|
|
YARN-648. FS: Add documentation for pluggable policy. (kkambatl via tucu)
|
|
|
|
|
|
2013-06-13 19:26:20 -04:00
|
|
|
|
YARN-773. Moved YarnRuntimeException from package api.yarn to
|
|
|
|
|
api.yarn.exceptions. (Jian He via vinodkv)
|
|
|
|
|
|
2013-06-13 20:07:34 -04:00
|
|
|
|
YARN-692. Creating NMToken master key on RM and sharing it with NM as a part
|
|
|
|
|
of RM-NM heartbeat. (Omkar Vinit Joshi via vinodkv)
|
|
|
|
|
|
2013-06-14 09:43:25 -04:00
|
|
|
|
YARN-782. vcores-pcores ratio functions differently from vmem-pmem ratio in
|
|
|
|
|
misleading way. (sandyr via tucu)
|
|
|
|
|
|
2013-06-14 13:09:16 -04:00
|
|
|
|
YARN-803. factor out scheduler config validation from the ResourceManager
|
|
|
|
|
to each scheduler implementation. (tucu)
|
|
|
|
|
|
2013-06-14 15:18:18 -04:00
|
|
|
|
YARN-789. Enable zero capabilities resource requests in fair scheduler.
|
|
|
|
|
(tucu)
|
|
|
|
|
|
2013-06-14 19:19:09 -04:00
|
|
|
|
YARN-639. Modified Distributed Shell application to start using the new
|
|
|
|
|
NMClient library. (Zhijie Shen via vinodkv)
|
|
|
|
|
|
2013-06-15 23:12:04 -04:00
|
|
|
|
YARN-693. Modified RM to send NMTokens on allocate call so that AMs can then
|
|
|
|
|
use them for authentication with NMs. (Omkar Vinit Joshi via vinodkv)
|
|
|
|
|
|
2013-06-16 18:18:30 -04:00
|
|
|
|
YARN-752. In AMRMClient, automatically add corresponding rack requests for
|
|
|
|
|
requested nodes. (sandyr via tucu)
|
|
|
|
|
|
2013-06-16 23:33:59 -04:00
|
|
|
|
YARN-825. Fixed javadoc and annotations for yarn-common module. (vinodkv)
|
|
|
|
|
|
2013-06-17 02:52:39 -04:00
|
|
|
|
YARN-833. Moved Graph and VisualizeStateMachine into yarn.state package.
|
|
|
|
|
(Zhijie Shen via vinodkv)
|
|
|
|
|
|
2013-06-17 23:14:38 -04:00
|
|
|
|
YARN-805. Fix javadoc and annotations on classes in the yarn-api
|
|
|
|
|
package. (Jian He via sseth)
|
|
|
|
|
|
2013-06-18 03:37:28 -04:00
|
|
|
|
YARN-846. Move pb Impl classes from yarn-api to yarn-common. (Jian He via
|
|
|
|
|
vinodkv)
|
|
|
|
|
|
2013-06-21 14:51:17 -04:00
|
|
|
|
YARN-827. Need to make Resource arithmetic methods accessible (Jian He via
|
|
|
|
|
bikas)
|
|
|
|
|
|
2013-07-10 20:21:49 -04:00
|
|
|
|
YARN-866. Add test for class ResourceWeights. (ywskycn via tucu)
|
|
|
|
|
|
|
|
|
|
YARN-736. Add a multi-resource fair sharing metric. (sandyr via tucu)
|
|
|
|
|
|
|
|
|
|
YARN-883. Expose Fair Scheduler-specific queue metrics. (sandyr via tucu)
|
|
|
|
|
|
2013-07-10 21:20:37 -04:00
|
|
|
|
YARN-569. Add support for requesting and enforcing preemption requests via
|
|
|
|
|
a capacity monitor. (Carlo Curino, cdouglas)
|
|
|
|
|
|
2013-07-15 20:28:29 -04:00
|
|
|
|
YARN-521. Augment AM - RM client module to be able to request containers
|
|
|
|
|
only at specific locations (Sandy Ryza via bikas)
|
|
|
|
|
|
2013-07-16 18:54:55 -04:00
|
|
|
|
YARN-513. Create common proxy client for communicating with RM. (Xuan Gong
|
|
|
|
|
& Jian He via bikas)
|
|
|
|
|
|
2013-07-16 21:01:03 -04:00
|
|
|
|
YARN-927. Change ContainerRequest to not have more than 1 container count
|
|
|
|
|
and remove StoreContainerRequest (bikas)
|
|
|
|
|
|
2013-07-17 16:23:55 -04:00
|
|
|
|
YARN-922. Change FileSystemRMStateStore to use directories (Jian He via
|
|
|
|
|
bikas)
|
|
|
|
|
|
2013-07-17 17:43:51 -04:00
|
|
|
|
YARN-865. RM webservices can't query based on application Types. (Xuan Gong
|
|
|
|
|
via hitesh)
|
|
|
|
|
|
2013-07-18 21:04:10 -04:00
|
|
|
|
YARN-912. Move client facing exceptions to yarn-api module. (Mayank Bansal
|
|
|
|
|
via vinodkv)
|
|
|
|
|
|
2013-07-27 02:47:40 -04:00
|
|
|
|
YARN-84. Use Builder to build RPC server. (Brandon Li via szetszwo)
|
|
|
|
|
|
2013-08-09 17:14:05 -04:00
|
|
|
|
YARN-1046. Disable mem monitoring by default in MiniYARNCluster. (Karthik
|
|
|
|
|
Kambatla via Sandy Ryza)
|
|
|
|
|
|
2013-08-15 14:46:03 -04:00
|
|
|
|
YARN-1045. Improve toString implementation for PBImpls. (Jian He via sseth)
|
|
|
|
|
|
2013-02-06 08:39:39 -05:00
|
|
|
|
OPTIMIZATIONS
|
|
|
|
|
|
2013-05-29 10:29:38 -04:00
|
|
|
|
YARN-512. Log aggregation root directory check is more expensive than it
|
|
|
|
|
needs to be. (Maysam Yabandeh via jlowe)
|
|
|
|
|
|
2013-05-30 01:01:40 -04:00
|
|
|
|
YARN-719. Move RMIdentifier from Container to ContainerTokenIdentifier.
|
|
|
|
|
(Vinod Kumar Vavilapalli via sseth)
|
|
|
|
|
|
2013-02-06 08:39:39 -05:00
|
|
|
|
BUG FIXES
|
|
|
|
|
|
2013-02-07 15:22:34 -05:00
|
|
|
|
YARN-383. AMRMClientImpl should handle null rmClient in stop()
|
|
|
|
|
(Hitesh Shah via sseth)
|
|
|
|
|
|
2013-02-07 15:29:15 -05:00
|
|
|
|
YARN-385. Add missing fields - location and #containers to
|
|
|
|
|
ResourceRequestPBImpl's toString(). (Sandy Ryza via sseth)
|
|
|
|
|
|
2013-02-07 18:57:41 -05:00
|
|
|
|
YARN-377. Use the new StringUtils methods added by HADOOP-9252 and fix
|
|
|
|
|
TestContainersMonitor. (Chris Nauroth via szetszwo)
|
|
|
|
|
|
2013-02-13 14:41:22 -05:00
|
|
|
|
YARN-391. Formatting fixes for LCEResourceHandler classes.
|
|
|
|
|
(Steve Loughran via sseth)
|
|
|
|
|
|
2013-02-25 19:57:35 -05:00
|
|
|
|
YARN-390. ApplicationCLI and NodeCLI hard-coded platform-specific line
|
|
|
|
|
separator causes test failures on Windows. (Chris Nauroth via suresh)
|
|
|
|
|
|
2013-02-28 17:18:38 -05:00
|
|
|
|
YARN-406. Fix TestRackResolver to function in networks where "host1"
|
|
|
|
|
resolves to a valid host. (Hitesh Shah via sseth)
|
|
|
|
|
|
2013-03-01 01:01:02 -05:00
|
|
|
|
YARN-376. Fixes a bug which would prevent the NM knowing about completed
|
|
|
|
|
containers and applications. (Jason Lowe via sseth)
|
|
|
|
|
|
2013-03-15 14:07:04 -04:00
|
|
|
|
YARN-196. Nodemanager should be more robust in handling connection failure
|
|
|
|
|
to ResourceManager when a cluster is started (Xuan Gong via hitesh)
|
|
|
|
|
|
2013-03-18 15:44:23 -04:00
|
|
|
|
YARN-485. TestProcfsProcessTree#testProcessTree() doesn't wait long enough
|
|
|
|
|
for the process to die. (kkambatl via tucu)
|
2013-03-22 17:29:45 -04:00
|
|
|
|
|
2013-03-25 14:25:13 -04:00
|
|
|
|
YARN-71. Fix the NodeManager to clean up local-dirs on restart.
|
|
|
|
|
(Xuan Gong via sseth)
|
2013-03-18 15:44:23 -04:00
|
|
|
|
|
2013-03-25 17:14:42 -04:00
|
|
|
|
YARN-378. Fix RM to make the AM max attempts/retries to be configurable
|
|
|
|
|
per application by clients. (Zhijie Shen via vinodkv)
|
|
|
|
|
|
2013-03-25 22:37:17 -04:00
|
|
|
|
YARN-498. Unmanaged AM launcher does not set various constants in env for
|
|
|
|
|
an AM, also does not handle failed AMs properly. (Hitesh Shah via bikas)
|
|
|
|
|
|
2013-03-27 11:51:20 -04:00
|
|
|
|
YARN-496. Fair scheduler configs are refreshed inconsistently in
|
|
|
|
|
reinitialize. (Sandy Ryza via tomwhite)
|
|
|
|
|
|
2013-03-27 13:26:36 -04:00
|
|
|
|
YARN-474. Fix CapacityScheduler to trigger application-activation when
|
|
|
|
|
am-resource-percent configuration is refreshed. (Zhijie Shen via vinodkv)
|
|
|
|
|
|
2013-03-27 14:52:21 -04:00
|
|
|
|
YARN-209. Fix CapacityScheduler to trigger application-activation when
|
|
|
|
|
the cluster capacity changes. (Zhijie Shen via vinodkv)
|
|
|
|
|
|
2013-03-27 19:15:54 -04:00
|
|
|
|
YARN-24. Nodemanager fails to start if log aggregation enabled and
|
|
|
|
|
namenode unavailable. (sandyr via tucu)
|
|
|
|
|
|
2013-03-29 16:27:05 -04:00
|
|
|
|
YARN-515. Node Manager not getting the master key. (Robert Joseph Evans
|
|
|
|
|
via jlowe)
|
|
|
|
|
|
2013-04-02 14:09:40 -04:00
|
|
|
|
YARN-382. SchedulerUtils improve way normalizeRequest sets the resource
|
|
|
|
|
capabilities. (Zhijie Shen via bikas)
|
2013-04-03 01:01:35 -04:00
|
|
|
|
|
|
|
|
|
YARN-467. Modify public distributed cache to localize files such that no
|
|
|
|
|
local directory hits unix file count limits and thus prevent job failures.
|
|
|
|
|
(Omkar Vinit Joshi via vinodkv)
|
|
|
|
|
|
2013-04-03 12:57:40 -04:00
|
|
|
|
YARN-101. Fix NodeManager heartbeat processing to not lose track of completed
|
|
|
|
|
containers in case of dropped heartbeats. (Xuan Gong via vinodkv)
|
|
|
|
|
|
2013-04-03 16:44:12 -04:00
|
|
|
|
YARN-538. RM address DNS lookup can cause unnecessary slowness on every JHS
|
|
|
|
|
page load. (sandyr via tucu)
|
|
|
|
|
|
2013-04-04 19:31:12 -04:00
|
|
|
|
YARN-532. Change RMAdmin and Localization client protocol PB implementations
|
|
|
|
|
to implement closeable so that they can be stopped when needed via
|
|
|
|
|
RPC.stopProxy(). (Siddharth Seth via vinodkv)
|
|
|
|
|
|
2013-04-08 21:35:05 -04:00
|
|
|
|
YARN-99. Modify private distributed cache to localize files such that no
|
|
|
|
|
local directory hits unix file count limits and thus prevent job failures.
|
|
|
|
|
(Omkar Vinit Joshi via vinodkv)
|
|
|
|
|
|
2013-04-09 15:57:10 -04:00
|
|
|
|
YARN-112. Fixed a race condition during localization that fails containers.
|
|
|
|
|
(Omkar Vinit Joshi via vinodkv)
|
|
|
|
|
|
2013-04-09 16:16:56 -04:00
|
|
|
|
YARN-534. Change RM restart recovery to also account for AM max-attempts
|
|
|
|
|
configuration after the restart. (Jian He via vinodkv)
|
|
|
|
|
|
2013-04-10 22:08:49 -04:00
|
|
|
|
YARN-539. Addressed memory leak of LocalResource objects NM when a resource
|
|
|
|
|
localization fails. (Omkar Vinit Joshi via vinodkv)
|
|
|
|
|
|
2013-04-11 18:00:10 -04:00
|
|
|
|
YARN-319. Submitting a job to a fair scheduler queue for which the user
|
|
|
|
|
does not have permission causes the client to wait forever.
|
|
|
|
|
(shenhong via tomwhite)
|
|
|
|
|
|
2013-04-12 17:20:45 -04:00
|
|
|
|
YARN-412. Fixed FifoScheduler to check hostname of a NodeManager rather
|
|
|
|
|
than its host:port during scheduling which caused incorrect locality for
|
|
|
|
|
containers. (Roger Hoover via acmurthy)
|
2013-04-17 00:17:49 -04:00
|
|
|
|
|
|
|
|
|
YARN-500. Fixed YARN webapps to not roll-over ports when explicitly asked
|
|
|
|
|
to use non-ephemeral ports. (Kenji Kikushima via vinodkv)
|
|
|
|
|
|
2013-04-17 19:06:30 -04:00
|
|
|
|
YARN-518. Fair Scheduler's document link could be added to the hadoop 2.x
|
|
|
|
|
main doc page. (sandyr via tucu)
|
|
|
|
|
|
2013-04-17 19:12:37 -04:00
|
|
|
|
YARN-476. ProcfsBasedProcessTree info message confuses users.
|
|
|
|
|
(sandyr via tucu)
|
|
|
|
|
|
2013-04-18 13:49:57 -04:00
|
|
|
|
YARN-585. Fix failure in TestFairScheduler#testNotAllowSubmitApplication
|
|
|
|
|
caused by YARN-514. (Zhijie Shen via vinodkv)
|
|
|
|
|
|
2013-04-19 18:36:52 -04:00
|
|
|
|
YARN-547. Fixed race conditions in public and private resource localization
|
|
|
|
|
which used to cause duplicate downloads. (Omkar Vinit Joshi via vinodkv)
|
|
|
|
|
|
2013-04-20 18:06:41 -04:00
|
|
|
|
YARN-594. Update test and add comments in YARN-534 (Jian He via bikas)
|
|
|
|
|
|
2013-04-22 23:12:54 -04:00
|
|
|
|
YARN-549. YarnClient.submitApplication should wait for application to be
|
|
|
|
|
accepted by the RM (Zhijie Shen via bikas)
|
|
|
|
|
|
2013-04-24 15:43:23 -04:00
|
|
|
|
YARN-605. Fix failing unit test in TestNMWebServices when versionInfo has
|
|
|
|
|
parantheses like when running on a git checkout. (Hitesh Shah via vinodkv)
|
|
|
|
|
|
2013-04-25 05:18:24 -04:00
|
|
|
|
YARN-289. Fair scheduler allows reservations that won't fit on node.
|
|
|
|
|
(Sandy Ryza via tomwhite)
|
|
|
|
|
|
2013-04-28 16:04:47 -04:00
|
|
|
|
YARN-576. Modified ResourceManager to reject NodeManagers that don't satisy
|
|
|
|
|
minimum resource requirements. (Kenji Kikushima via vinodkv)
|
|
|
|
|
|
2013-05-08 13:18:59 -04:00
|
|
|
|
YARN-646. Fix two typos in Fair Scheduler user guide. (Dapeng Sun via atm)
|
|
|
|
|
|
2013-05-09 17:48:53 -04:00
|
|
|
|
YARN-507. Add interface visibility and stability annotations to FS
|
|
|
|
|
interfaces/classes. (kkambatl via tucu)
|
|
|
|
|
|
2013-05-09 17:52:43 -04:00
|
|
|
|
YARN-637. FS: maxAssign is not honored. (kkambatl via tucu)
|
|
|
|
|
|
2013-05-09 18:17:36 -04:00
|
|
|
|
YARN-655. Fair scheduler metrics should subtract allocated memory from
|
|
|
|
|
available memory. (sandyr via tucu)
|
|
|
|
|
|
2013-05-16 02:59:19 -04:00
|
|
|
|
YARN-628. Fix the way YarnRemoteException is being unrolled to extract out
|
|
|
|
|
the underlying exception. (Siddharth Seth via vinodkv)
|
|
|
|
|
|
2013-05-20 17:51:24 -04:00
|
|
|
|
YARN-695. Remove masterContainer and status unused fields from
|
|
|
|
|
ApplicationReportProto and fix bugs in ApplicationReportPBImpl. (Zhijie Shen
|
|
|
|
|
via vinodkv)
|
|
|
|
|
|
2013-05-21 21:51:09 -04:00
|
|
|
|
YARN-706. Fixed race conditions in TestFSDownload. (Zhijie Shen via vinodkv).
|
|
|
|
|
|
2013-05-23 02:01:55 -04:00
|
|
|
|
YARN-715. Fixed unit test failures - TestDistributedShell and
|
2013-05-23 01:49:07 -04:00
|
|
|
|
TestUnmanagedAMLauncher. (Vinod Kumar Vavilapalli via sseth)
|
|
|
|
|
|
2013-05-29 20:01:04 -04:00
|
|
|
|
YARN-578. Fixed NM to use SecureIOUtils for reading and aggregating logs.
|
|
|
|
|
(Omkar Vinit Joshi via vinodkv)
|
|
|
|
|
|
2013-06-01 18:02:44 -04:00
|
|
|
|
YARN-733. Fixed TestNMClient from failing occasionally. (Zhijie Shen via
|
|
|
|
|
vinodkv)
|
|
|
|
|
|
2013-06-03 00:12:45 -04:00
|
|
|
|
YARN-730. Fix NMClientAsync to remove completed containers. (Zhijie Shen
|
|
|
|
|
via acmurthy)
|
|
|
|
|
|
2013-06-03 19:50:54 -04:00
|
|
|
|
YARN-726. Fix queue & finish time fields in web-ui for ResourceManager.
|
|
|
|
|
(Mayank Bansal via acmurthy)
|
|
|
|
|
|
2013-06-03 21:14:50 -04:00
|
|
|
|
YARN-757. Changed TestRMRestart to use the default scheduler to avoid test
|
|
|
|
|
failures. (Bikas Saha via vinodkv)
|
|
|
|
|
|
2013-06-04 16:55:56 -04:00
|
|
|
|
YARN-742. Log aggregation causes a lot of redundant setPermission calls.
|
|
|
|
|
(jlowe via kihwal)
|
|
|
|
|
|
2013-06-06 14:26:31 -04:00
|
|
|
|
YARN-764. blank Used Resources on Capacity Scheduler page (Nemon Lou via
|
|
|
|
|
tgraves)
|
|
|
|
|
|
2013-06-06 16:55:02 -04:00
|
|
|
|
YARN-761. TestNMClientAsync fails sometimes (Zhijie Shen via bikas)
|
|
|
|
|
|
2013-06-07 12:22:55 -04:00
|
|
|
|
YARN-760. NodeManager throws AvroRuntimeException on failed start.
|
|
|
|
|
(Niranjan Singh via jlowe)
|
|
|
|
|
|
2013-06-11 18:16:03 -04:00
|
|
|
|
YARN-767. Initialize application metrics at RM bootup. (Jian He via
|
|
|
|
|
acmurthy)
|
|
|
|
|
|
2013-06-12 15:22:48 -04:00
|
|
|
|
YARN-700. TestInfoBlock fails on Windows because of line ending missmatch.
|
|
|
|
|
(Ivan Mitic via cnauroth)
|
|
|
|
|
|
2013-06-13 11:56:44 -04:00
|
|
|
|
YARN-117. Migrated rest of YARN to the new service model. (Steve Louhran via
|
|
|
|
|
vinodkv)
|
|
|
|
|
|
2013-06-14 02:04:49 -04:00
|
|
|
|
YARN-812. Set default logger for application summary logger to
|
|
|
|
|
hadoop.root.logger. (sseth via acmurthy)
|
|
|
|
|
|
2013-06-18 19:50:32 -04:00
|
|
|
|
YARN-848. Nodemanager does not register with RM using the fully qualified
|
|
|
|
|
hostname. (Hitesh Shah via sseth)
|
|
|
|
|
|
2013-06-19 23:42:13 -04:00
|
|
|
|
YARN-854. Fixing YARN bugs that are failing applications in secure
|
|
|
|
|
environment. (Omkar Vinit Joshi via vinodkv)
|
|
|
|
|
|
2013-06-20 16:22:02 -04:00
|
|
|
|
YARN-861. TestContainerManager is failing. (Vinod Kumar Vavilapalli via
|
|
|
|
|
hitesh)
|
|
|
|
|
|
2013-06-25 20:43:05 -04:00
|
|
|
|
YARN-874. Making common RPC to switch to not switch to simple when other
|
|
|
|
|
mechanisms are enabled and thus fix YARN/MR test failures after HADOOP-9421.
|
|
|
|
|
(Daryn Sharp and Vinod Kumar Vavilapalli via vinodkv)
|
|
|
|
|
|
2013-07-04 19:38:29 -04:00
|
|
|
|
YARN-845. RM crash with NPE on NODE_UPDATE (Mayank Bansal via bikas)
|
|
|
|
|
|
2013-07-09 19:20:08 -04:00
|
|
|
|
YARN-369. Handle ( or throw a proper error when receiving) status updates
|
|
|
|
|
from application masters that have not registered (Mayank Bansal &
|
|
|
|
|
Abhishek Kapoor via bikas)
|
|
|
|
|
|
2013-07-13 18:42:47 -04:00
|
|
|
|
YARN-541. getAllocatedContainers() is not returning all the allocated
|
|
|
|
|
containers (bikas)
|
|
|
|
|
|
2013-07-13 19:38:27 -04:00
|
|
|
|
YARN-763. AMRMClientAsync should stop heartbeating after receiving
|
|
|
|
|
shutdown from RM (Xuan Gong via bikas)
|
|
|
|
|
|
2013-07-15 13:18:47 -04:00
|
|
|
|
YARN-654. AMRMClient: Perform sanity checks for parameters of public
|
|
|
|
|
methods (Xuan Gong via bikas)"
|
|
|
|
|
|
2013-07-19 15:24:13 -04:00
|
|
|
|
YARN-919. Document setting default heap sizes in yarn-env.sh (Mayank
|
|
|
|
|
Bansal via hitesh)
|
|
|
|
|
|
2013-07-22 19:32:51 -04:00
|
|
|
|
YARN-795. Fair scheduler queue metrics should subtract allocated vCores from
|
|
|
|
|
available vCores. (ywskycn via tucu)
|
|
|
|
|
|
|
|
|
|
YARN-799. Fix CgroupsLCEResourcesHandler to use /tasks instead of
|
|
|
|
|
/cgroup.procs. (Chris Riccomini via acmurthy)
|
|
|
|
|
|
|
|
|
|
YARN-333. Schedulers cannot control the queue-name of an
|
|
|
|
|
application. (sandyr via tucu)
|
|
|
|
|
|
|
|
|
|
YARN-368. Fixed a typo in error message in Auxiliary services. (Albert Chu
|
|
|
|
|
via vinodkv)
|
|
|
|
|
|
|
|
|
|
YARN-295. Fixed a race condition in ResourceManager RMAppAttempt state
|
|
|
|
|
machine. (Mayank Bansal via vinodkv)
|
|
|
|
|
|
|
|
|
|
YARN-523. Modified a test-case to validate container diagnostics on
|
|
|
|
|
localization failures. (Jian He via vinodkv)
|
|
|
|
|
|
|
|
|
|
YARN-661. Fixed NM to cleanup users' local directories correctly when
|
|
|
|
|
starting up. (Omkar Vinit Joshi via vinodkv)
|
|
|
|
|
|
|
|
|
|
YARN-820. Fixed an invalid state transition in NodeManager caused by failing
|
|
|
|
|
resource localization. (Mayank Bansal via vinodkv)
|
|
|
|
|
|
|
|
|
|
YARN-62. Modified NodeManagers to avoid AMs from abusing container tokens for
|
|
|
|
|
repetitive container launches. (Omkar Vinit Joshi via vinodkv)
|
|
|
|
|
|
|
|
|
|
YARN-814. Improving diagnostics when containers fail during launch due to
|
|
|
|
|
various reasons like invalid env etc. (Jian He via vinodkv)
|
|
|
|
|
|
|
|
|
|
YARN-897. Ensure child queues are ordered correctly to account for
|
|
|
|
|
completed containers. (Djellel Eddine Difallah via acmurthy)
|
|
|
|
|
|
2013-07-22 19:50:54 -04:00
|
|
|
|
YARN-853. Fixed CapacityScheduler's maximum-am-resource-percent to properly
|
|
|
|
|
work beyond refreshing queues. (Devaraj K via vinodkv)
|
|
|
|
|
|
2013-07-24 17:42:50 -04:00
|
|
|
|
YARN-873. YARNClient.getApplicationReport(unknownAppId) returns a null
|
|
|
|
|
report (Xuan Gong via bikas)
|
|
|
|
|
|
2013-07-24 18:16:37 -04:00
|
|
|
|
YARN-875. Application can hang if AMRMClientAsync callback thread has
|
|
|
|
|
exception (Xuan Gong via bikas)
|
|
|
|
|
|
2013-07-25 00:15:16 -04:00
|
|
|
|
YARN-968. RM admin commands don't work. (vinodkv via kihwal)
|
|
|
|
|
|
|
|
|
|
YARN-688. Fixed NodeManager to properly cleanup containers when it is shut
|
|
|
|
|
down. (Jian He via vinodkv)
|
|
|
|
|
|
2013-07-27 14:51:01 -04:00
|
|
|
|
YARN-960. Fixed ResourceManager to propagate client-submitted credentials
|
|
|
|
|
irrespective of security. (Daryn Sharp via vinodkv)
|
|
|
|
|
|
2013-07-29 14:15:36 -04:00
|
|
|
|
YARN-937. Fix unmanaged AM in non-secure/secure setup post YARN-701. (tucu)
|
|
|
|
|
|
2013-07-29 18:23:58 -04:00
|
|
|
|
YARN-932. TestResourceLocalizationService.testLocalizationInit can fail on
|
|
|
|
|
JDK7. (Karthik Kambatla via Sandy Ryza)
|
|
|
|
|
|
|
|
|
|
YARN-961. Changed ContainerManager to enforce Token auth irrespective of
|
|
|
|
|
security. (Omkar Vinit Joshi via vinodkv)
|
|
|
|
|
|
2013-07-29 19:18:10 -04:00
|
|
|
|
YARN-945. Removed setting of AMRMToken's service from ResourceManager
|
|
|
|
|
and changed client libraries do it all the time and correctly. (vinodkv)
|
|
|
|
|
|
2013-08-09 16:29:26 -04:00
|
|
|
|
YARN-656. In scheduler UI, including reserved memory in Memory Total can
|
|
|
|
|
make it exceed cluster capacity. (Sandy Ryza)
|
|
|
|
|
|
2013-07-22 19:32:51 -04:00
|
|
|
|
BREAKDOWN OF HADOOP-8562/YARN-191 SUBTASKS AND RELATED JIRAS
|
2013-05-23 17:07:05 -04:00
|
|
|
|
|
|
|
|
|
YARN-158. Yarn creating package-info.java must not depend on sh.
|
|
|
|
|
(Chris Nauroth via suresh)
|
|
|
|
|
|
|
|
|
|
YARN-176. Some YARN tests fail to find winutils. (Chris Nauroth via suresh)
|
|
|
|
|
|
|
|
|
|
YARN-207. YARN distribution build fails on Windows. (Chris Nauroth via
|
|
|
|
|
suresh)
|
|
|
|
|
|
|
|
|
|
YARN-199. Yarn cmd line scripts for windows. (Ivan Mitic via suresh)
|
|
|
|
|
|
|
|
|
|
YARN-213. YARN build script would be more readable using abspath.
|
|
|
|
|
(Chris Nauroth via suresh)
|
|
|
|
|
|
|
|
|
|
YARN-233. Added support for running containers in MS Windows to YARN. (Chris
|
|
|
|
|
Nauroth via acmurthy)
|
|
|
|
|
|
|
|
|
|
YARN-234. Added support for process tree and resource calculator in MS Windows
|
|
|
|
|
to YARN. (Chris Nauroth via acmurthy)
|
|
|
|
|
|
|
|
|
|
YARN-259. Fix LocalDirsHandlerService to use Path rather than URIs. (Xuan
|
|
|
|
|
Gong via acmurthy)
|
|
|
|
|
|
|
|
|
|
YARN-316. YARN container launch may exceed maximum Windows command line
|
|
|
|
|
length due to long classpath. (Chris Nauroth via suresh)
|
|
|
|
|
|
|
|
|
|
YARN-359. Fixing commands for container signalling in Windows. (Chris Nauroth
|
|
|
|
|
via vinodkv)
|
|
|
|
|
|
2013-05-25 20:09:12 -04:00
|
|
|
|
YARN-506. Move to common utils FileUtil#setReadable/Writable/Executable and
|
|
|
|
|
FileUtil#canRead/Write/Execute. (Ivan Mitic via suresh)
|
|
|
|
|
|
2013-05-23 20:51:31 -04:00
|
|
|
|
YARN-488. TestContainerManagerSecurity fails on Windows. (Chris Nauroth
|
|
|
|
|
via hitesh)
|
|
|
|
|
|
|
|
|
|
YARN-490. TestDistributedShell fails on Windows. (Chris Nauroth via hitesh)
|
|
|
|
|
|
|
|
|
|
YARN-491. TestContainerLogsPage fails on Windows. (Chris Nauroth via hitesh)
|
2013-05-23 17:07:05 -04:00
|
|
|
|
|
2013-05-24 01:34:41 -04:00
|
|
|
|
YARN-487. Modify path manipulation in LocalDirsHandlerService to let
|
|
|
|
|
TestDiskFailures pass on Windows. (Chris Nauroth via vinodkv)
|
|
|
|
|
|
2013-05-24 12:03:32 -04:00
|
|
|
|
YARN-593. container launch on Windows does not correctly populate
|
|
|
|
|
classpath with new process's environment variables and localized resources
|
|
|
|
|
(Chris Nauroth via bikas)
|
|
|
|
|
|
2013-05-24 17:58:04 -04:00
|
|
|
|
YARN-493. Fixed some shell related flaws in YARN on Windows. (Chris Nauroth
|
|
|
|
|
via vinodkv)
|
|
|
|
|
|
2013-06-17 17:19:57 -04:00
|
|
|
|
YARN-839. TestContainerLaunch.testContainerEnvVariables fails on Windows.
|
|
|
|
|
(Chuan Liu via cnauroth)
|
|
|
|
|
|
2013-06-19 14:03:13 -04:00
|
|
|
|
YARN-597. TestFSDownload fails on Windows due to dependencies on
|
|
|
|
|
tar/gzip/jar tools. (Ivan Mitic via acmurthy)
|
|
|
|
|
|
2013-06-19 14:54:50 -04:00
|
|
|
|
YARN-852. TestAggregatedLogFormat.testContainerLogsFileAccess fails on
|
|
|
|
|
Windows. (Chuan Liu via cnauroth)
|
|
|
|
|
|
2013-07-08 19:44:30 -04:00
|
|
|
|
YARN-894. NodeHealthScriptRunner timeout checking is inaccurate on Windows.
|
|
|
|
|
(Chuan Liu via cnauroth)
|
|
|
|
|
|
2013-07-15 13:36:16 -04:00
|
|
|
|
YARN-909. Disable TestLinuxContainerExecutorWithMocks on Windows. (Chuan Liu
|
|
|
|
|
via cnauroth)
|
|
|
|
|
|
2013-08-08 18:55:33 -04:00
|
|
|
|
YARN-1043. Push all metrics consistently. (Jian He via acmurthy)
|
|
|
|
|
|
2013-08-14 22:36:58 -04:00
|
|
|
|
YARN-1056. Remove dual use of string 'resourcemanager' in
|
|
|
|
|
yarn.resourcemanager.connect.{max.wait.secs|retry_interval.secs}
|
|
|
|
|
(Karthik Kambatla via acmurthy)
|
|
|
|
|
|
2014-01-14 16:52:06 -05:00
|
|
|
|
Release 2.0.6-alpha - 08/22/2013
|
|
|
|
|
|
|
|
|
|
INCOMPATIBLE CHANGES
|
|
|
|
|
|
|
|
|
|
NEW FEATURES
|
|
|
|
|
|
|
|
|
|
IMPROVEMENTS
|
|
|
|
|
|
|
|
|
|
OPTIMIZATIONS
|
|
|
|
|
|
|
|
|
|
BUG FIXES
|
|
|
|
|
|
|
|
|
|
YARN-854. Fixing YARN bugs that are failing applications in secure
|
|
|
|
|
environment. (Omkar Vinit Joshi and shv)
|
|
|
|
|
|
2013-06-09 00:51:28 -04:00
|
|
|
|
Release 2.0.5-alpha - 06/06/2013
|
2013-06-01 16:06:32 -04:00
|
|
|
|
|
|
|
|
|
INCOMPATIBLE CHANGES
|
|
|
|
|
|
|
|
|
|
NEW FEATURES
|
|
|
|
|
|
|
|
|
|
IMPROVEMENTS
|
|
|
|
|
|
|
|
|
|
OPTIMIZATIONS
|
|
|
|
|
|
|
|
|
|
BUG FIXES
|
|
|
|
|
|
2013-05-08 18:02:00 -04:00
|
|
|
|
Release 2.0.4-alpha - 2013-04-25
|
2013-03-07 09:23:26 -05:00
|
|
|
|
|
|
|
|
|
INCOMPATIBLE CHANGES
|
|
|
|
|
|
|
|
|
|
NEW FEATURES
|
|
|
|
|
|
|
|
|
|
IMPROVEMENTS
|
|
|
|
|
|
|
|
|
|
OPTIMIZATIONS
|
|
|
|
|
|
|
|
|
|
BUG FIXES
|
|
|
|
|
|
2013-03-06 14:29:12 -05:00
|
|
|
|
YARN-429. capacity-scheduler config missing from yarn-test artifact.
|
|
|
|
|
(sseth via hitesh)
|
|
|
|
|
|
2013-04-04 17:25:33 -04:00
|
|
|
|
YARN-470. Support a way to disable resource monitoring on the NodeManager.
|
|
|
|
|
(Siddharth Seth via hitesh)
|
|
|
|
|
|
2013-02-06 08:39:39 -05:00
|
|
|
|
Release 2.0.3-alpha - 2013-02-06
|
|
|
|
|
|
2012-08-08 01:33:56 -04:00
|
|
|
|
INCOMPATIBLE CHANGES
|
|
|
|
|
|
|
|
|
|
NEW FEATURES
|
|
|
|
|
|
2012-10-26 17:03:20 -04:00
|
|
|
|
YARN-145. Add a Web UI to the fair share scheduler. (Sandy Ryza via tomwhite)
|
|
|
|
|
|
2013-02-06 10:17:57 -05:00
|
|
|
|
YARN-3. Add support for CPU isolation/monitoring of containers.
|
|
|
|
|
(adferguson via tucu)
|
|
|
|
|
|
2012-12-18 23:34:54 -05:00
|
|
|
|
YARN-230. RM Restart phase 1 - includes support for saving/restarting all
|
|
|
|
|
applications on an RM bounce. (Bikas Saha via acmurthy)
|
|
|
|
|
|
2013-01-03 14:12:30 -05:00
|
|
|
|
YARN-103. Add a yarn AM-RM client module. (Bikas Saha via sseth)
|
|
|
|
|
|
2013-01-04 06:02:51 -05:00
|
|
|
|
YARN-286. Add a YARN ApplicationClassLoader. (tomwhite)
|
|
|
|
|
|
2013-01-09 00:17:31 -05:00
|
|
|
|
YARN-2. Enhanced CapacityScheduler to account for CPU alongwith memory for
|
|
|
|
|
multi-dimensional resource scheduling. (acmurthy)
|
|
|
|
|
|
2013-01-14 19:22:56 -05:00
|
|
|
|
YARN-328. Use token request messages defined in hadoop common. (suresh)
|
|
|
|
|
|
2013-01-22 19:59:57 -05:00
|
|
|
|
YARN-231. RM Restart - Add FS-based persistent store implementation for
|
|
|
|
|
RMStateStore (Bikas Saha via hitesh)
|
|
|
|
|
|
2012-08-08 01:33:56 -04:00
|
|
|
|
IMPROVEMENTS
|
|
|
|
|
|
2012-12-19 19:19:47 -05:00
|
|
|
|
YARN-223. Update process tree instead of getting new process trees.
|
|
|
|
|
(Radim Kolar via llu)
|
|
|
|
|
|
|
|
|
|
YARN-57. Allow process-tree based resource calculation et al. to be
|
|
|
|
|
pluggable to support it on multiple platforms. (Radim Kolar via acmurthy)
|
|
|
|
|
|
2012-09-11 20:50:25 -04:00
|
|
|
|
YARN-78. Changed UnManagedAM application to use YarnClient. (Bikas Saha via
|
|
|
|
|
vinodkv)
|
|
|
|
|
|
2012-09-12 20:47:54 -04:00
|
|
|
|
YARN-93. Fixed RM to propagate diagnostics from applications that have
|
|
|
|
|
finished but failed (Jason Lowe via vinodkv).
|
|
|
|
|
|
2012-09-17 20:41:44 -04:00
|
|
|
|
YARN-28. Fixed TestCompositeService to not depend on test-order and thus
|
|
|
|
|
made it pass on JDK7 (Thomas Graves via vinodkv).
|
|
|
|
|
|
2012-09-21 02:40:56 -04:00
|
|
|
|
YARN-82. Change the default local and log dirs to be based on
|
|
|
|
|
hadoop.tmp.dir and yarn.log.dir. (Hemanth Yamijala via sseth)
|
|
|
|
|
|
2012-09-23 20:52:55 -04:00
|
|
|
|
YARN-53. Added the missing getGroups API to ResourceManager. (Bo Wang via
|
|
|
|
|
vinodkv)
|
|
|
|
|
|
2012-09-29 18:40:58 -04:00
|
|
|
|
YARN-116. Add the ability to change the RM include/exclude file without
|
|
|
|
|
a restart. (xieguiming and Harsh J via sseth)
|
|
|
|
|
|
2012-10-04 19:02:28 -04:00
|
|
|
|
YARN-23. FairScheduler: FSQueueSchedulable#updateDemand() - potential
|
|
|
|
|
redundant aggregation. (kkambatl via tucu)
|
|
|
|
|
|
2012-10-08 18:19:43 -04:00
|
|
|
|
YARN-127. Move RMAdmin tool to its correct location - the client module.
|
|
|
|
|
(vinodkv)
|
|
|
|
|
|
2012-10-08 18:36:47 -04:00
|
|
|
|
YARN-40. Provided support for missing YARN commands (Devaraj K and Vinod
|
|
|
|
|
Kumar Vavilapalli via vinodkv)
|
|
|
|
|
|
2012-10-08 22:27:18 -04:00
|
|
|
|
YARN-33. Change LocalDirsHandlerService to validate the configured local and
|
|
|
|
|
log dirs. (Mayank Bansal via sseth)
|
|
|
|
|
|
2012-10-09 15:56:32 -04:00
|
|
|
|
YARN-94. Modify DistributedShell to point to main-class by default, clean up
|
|
|
|
|
the help message, and hard-code the AM class. (Hitesh Shah via vinodkv)
|
|
|
|
|
|
2012-10-11 06:30:53 -04:00
|
|
|
|
YARN-146. Add unit tests for computing fair share in the fair scheduler.
|
|
|
|
|
(Sandy Ryza via tomwhite)
|
|
|
|
|
|
2012-10-12 00:48:40 -04:00
|
|
|
|
HADOOP-8911. CRLF characters in source and text files.
|
|
|
|
|
(Raja Aluri via suresh)
|
|
|
|
|
|
2012-10-19 16:39:41 -04:00
|
|
|
|
YARN-136. Make ClientToAMTokenSecretManager part of RMContext (Vinod Kumar
|
|
|
|
|
Vavilapalli via sseth)
|
|
|
|
|
|
2012-11-09 07:39:26 -05:00
|
|
|
|
YARN-183. Clean up fair scheduler code. (Sandy Ryza via tomwhite)
|
|
|
|
|
|
2012-11-19 10:16:57 -05:00
|
|
|
|
YARN-129. Simplify classpath construction for mini YARN tests. (tomwhite)
|
|
|
|
|
|
2012-12-18 22:06:49 -05:00
|
|
|
|
YARN-254. Update fair scheduler web UI for hierarchical queues.
|
|
|
|
|
(sandyr via tucu)
|
|
|
|
|
|
2013-01-07 06:10:04 -05:00
|
|
|
|
YARN-315. Using the common security token protobuf definition from hadoop
|
|
|
|
|
common. (Suresh Srinivas via vinodkv)
|
|
|
|
|
|
2013-01-07 08:45:31 -05:00
|
|
|
|
YARN-170. Change NodeManager stop to be reentrant. (Sandy Ryza via vinodkv)
|
|
|
|
|
|
2013-01-17 19:37:46 -05:00
|
|
|
|
YARN-331. Fill in missing fair scheduler documentation. (sandyr via tucu)
|
|
|
|
|
|
2013-01-22 15:53:47 -05:00
|
|
|
|
YARN-277. Use AMRMClient in DistributedShell to exemplify the approach.
|
|
|
|
|
(Bikas Saha via hitesh)
|
|
|
|
|
|
2013-02-04 19:27:36 -05:00
|
|
|
|
YARN-360. Allow apps to concurrently register tokens for renewal.
|
|
|
|
|
(Daryn Sharp via sseth)
|
|
|
|
|
|
2012-09-07 18:34:25 -04:00
|
|
|
|
OPTIMIZATIONS
|
2012-08-23 14:25:10 -04:00
|
|
|
|
|
2012-09-07 18:34:25 -04:00
|
|
|
|
BUG FIXES
|
2012-10-02 22:57:25 -04:00
|
|
|
|
|
|
|
|
|
YARN-131. Fix incorrect ACL properties in capacity scheduler documentation.
|
|
|
|
|
(Ahmed Radwan via sseth)
|
2012-08-08 01:33:56 -04:00
|
|
|
|
|
2012-10-03 17:20:10 -04:00
|
|
|
|
YARN-102. Move the apache header to the top of the file in MemStore.java.
|
|
|
|
|
(Devaraj K via sseth)
|
2012-10-08 21:58:07 -04:00
|
|
|
|
|
|
|
|
|
YARN-134. ClientToAMSecretManager creates keys without checking for
|
|
|
|
|
validity of the appID. (Vinod Kumar Vavilapalli via sseth)
|
2012-10-03 17:20:10 -04:00
|
|
|
|
|
2012-10-09 18:55:11 -04:00
|
|
|
|
YARN-30. Fixed tests verifying web-services to work on JDK7. (Thomas Graves
|
|
|
|
|
via vinodkv)
|
|
|
|
|
|
2012-10-09 20:09:29 -04:00
|
|
|
|
YARN-150. Fixes AppRejectedTransition does not unregister a rejected
|
|
|
|
|
app-attempt from the ApplicationMasterService (Bikas Saha via sseth)
|
|
|
|
|
|
2012-10-23 18:49:37 -04:00
|
|
|
|
YARN-140. Add capacity-scheduler-default.xml to provide a default set of
|
|
|
|
|
configurations for the capacity scheduler. (ahmed via tucu)
|
2012-10-19 19:18:00 -04:00
|
|
|
|
|
2012-10-23 17:07:42 -04:00
|
|
|
|
YARN-179. Fix some unit test failures. (Vinod Kumar Vavilapalli via sseth)
|
|
|
|
|
|
2012-10-23 18:49:37 -04:00
|
|
|
|
YARN-181. Fixed eclipse settings broken by capacity-scheduler.xml move via
|
|
|
|
|
YARN-140. (Siddharth Seth via vinodkv)
|
|
|
|
|
|
2012-11-08 05:34:33 -05:00
|
|
|
|
YARN-169. Update log4j.appender.EventCounter to use
|
|
|
|
|
org.apache.hadoop.log.metrics.EventCounter (Anthony Rojas via tomwhite)
|
|
|
|
|
|
2012-11-18 00:46:29 -05:00
|
|
|
|
YARN-184. Remove unnecessary locking in fair scheduler, and address
|
|
|
|
|
findbugs excludes. (sandyr via tucu)
|
|
|
|
|
|
2012-11-28 07:28:35 -05:00
|
|
|
|
YARN-224. Fair scheduler logs too many nodeUpdate INFO messages.
|
|
|
|
|
(Sandy Ryza via tomwhite)
|
|
|
|
|
|
2012-11-28 09:23:32 -05:00
|
|
|
|
YARN-222. Fair scheduler should create queue for each user by default.
|
|
|
|
|
(Sandy Ryza via tomwhite)
|
|
|
|
|
|
2012-11-28 09:42:22 -05:00
|
|
|
|
MAPREDUCE-4778. Fair scheduler event log is only written if directory
|
|
|
|
|
exists on HDFS. (Sandy Ryza via tomwhite)
|
|
|
|
|
|
2012-11-28 20:59:49 -05:00
|
|
|
|
YARN-229. Remove old unused RM recovery code. (Bikas Saha via acmurthy)
|
|
|
|
|
|
2012-12-03 07:14:04 -05:00
|
|
|
|
YARN-187. Add hierarchical queues to the fair scheduler.
|
|
|
|
|
(Sandy Ryza via tomwhite)
|
|
|
|
|
|
|
|
|
|
YARN-72. NM should handle cleaning up containers when it shuts down.
|
|
|
|
|
(Sandy Ryza via tomwhite)
|
2012-11-30 07:05:13 -05:00
|
|
|
|
|
2012-12-12 09:36:07 -05:00
|
|
|
|
YARN-267. Fix fair scheduler web UI. (Sandy Ryza via tomwhite)
|
|
|
|
|
|
2012-12-13 17:21:16 -05:00
|
|
|
|
YARN-264. y.s.rm.DelegationTokenRenewer attempts to renew token even
|
|
|
|
|
after removing an app. (kkambatl via tucu)
|
|
|
|
|
|
2012-12-21 10:11:43 -05:00
|
|
|
|
YARN-271. Fair scheduler hits IllegalStateException trying to reserve
|
|
|
|
|
different apps on same node. (Sandy Ryza via tomwhite)
|
|
|
|
|
|
2012-12-21 11:03:50 -05:00
|
|
|
|
YARN-272. Fair scheduler log messages try to print objects without
|
|
|
|
|
overridden toString methods. (sandyr via tucu)
|
|
|
|
|
|
2012-12-21 11:09:14 -05:00
|
|
|
|
YARN-278. Fair scheduler maxRunningApps config causes no apps to make
|
|
|
|
|
progress. (sandyr via tucu)
|
|
|
|
|
|
2012-12-21 11:16:29 -05:00
|
|
|
|
YARN-282. Fair scheduler web UI double counts Apps Submitted.
|
|
|
|
|
(sandyr via tucu)
|
|
|
|
|
|
2012-12-21 11:22:41 -05:00
|
|
|
|
YARN-283. Fair scheduler fails to get queue info without root prefix.
|
|
|
|
|
(sandyr via tucu)
|
|
|
|
|
|
2013-01-03 07:30:20 -05:00
|
|
|
|
YARN-192. Node update causes NPE in the fair scheduler.
|
|
|
|
|
(Sandy Ryza via tomwhite)
|
|
|
|
|
|
2013-01-03 10:02:51 -05:00
|
|
|
|
YARN-288. Fair scheduler queue doesn't accept any jobs when ACLs are
|
|
|
|
|
configured. (Sandy Ryza via tomwhite)
|
|
|
|
|
|
2013-01-03 10:10:14 -05:00
|
|
|
|
YARN-300. After YARN-271, fair scheduler can infinite loop and not
|
|
|
|
|
schedule any application. (Sandy Ryza via tomwhite)
|
|
|
|
|
|
2013-01-03 10:29:17 -05:00
|
|
|
|
YARN-301. Fair scheduler throws ConcurrentModificationException when
|
|
|
|
|
iterating over app's priorities. (Sandy Ryza via tomwhite)
|
|
|
|
|
|
2013-01-07 01:37:30 -05:00
|
|
|
|
YARN-217. Fix RMAdmin protocol description to make it work in secure mode
|
|
|
|
|
also. (Devaraj K via vinodkv)
|
|
|
|
|
|
2013-01-08 08:23:04 -05:00
|
|
|
|
YARN-253. Fixed container-launch to not fail when there are no local
|
|
|
|
|
resources to localize. (Tom White via vinodkv)
|
|
|
|
|
|
2013-01-14 16:36:32 -05:00
|
|
|
|
YARN-330. Fix flakey test: TestNodeManagerShutdown#testKillContainersOnShutdown.
|
|
|
|
|
(Sandy Ryza via hitesh)
|
2013-01-15 11:41:04 -05:00
|
|
|
|
|
|
|
|
|
YARN-335. Fair scheduler doesn't check whether rack needs containers
|
|
|
|
|
before assigning to node. (Sandy Ryza via tomwhite)
|
2013-01-15 12:38:31 -05:00
|
|
|
|
|
|
|
|
|
YARN-336. Fair scheduler FIFO scheduling within a queue only allows 1
|
|
|
|
|
app at a time. (Sandy Ryza via tomwhite)
|
2013-01-14 16:36:32 -05:00
|
|
|
|
|
2013-01-15 13:35:10 -05:00
|
|
|
|
YARN-135. Client tokens should be per app-attempt, and should be
|
|
|
|
|
unregistered on App-finish. (vinodkv via sseth)
|
|
|
|
|
|
2013-01-17 19:48:45 -05:00
|
|
|
|
YARN-302. Fair scheduler assignmultiple should default to false. (sandyr via tucu)
|
2013-04-11 18:00:10 -04:00
|
|
|
|
|
2013-02-01 19:45:37 -05:00
|
|
|
|
YARN-372. Move InlineDispatcher from hadoop-yarn-server-resourcemanager to
|
|
|
|
|
hadoop-yarn-common (sseth via hitesh)
|
|
|
|
|
|
2013-02-05 23:27:54 -05:00
|
|
|
|
YARN-370. Fix SchedulerUtils to correctly round up the resource for
|
|
|
|
|
containers. (Zhijie Shen via acmurthy)
|
|
|
|
|
|
2013-02-06 14:06:22 -05:00
|
|
|
|
YARN-355. Fixes a bug where RM app submission could jam under load.
|
|
|
|
|
(Daryn Sharp via sseth)
|
|
|
|
|
|
2012-09-07 18:37:55 -04:00
|
|
|
|
Release 2.0.2-alpha - 2012-09-07
|
2012-08-08 01:33:56 -04:00
|
|
|
|
|
2012-09-25 19:40:14 -04:00
|
|
|
|
YARN-9. Rename YARN_HOME to HADOOP_YARN_HOME. (vinodkv via acmurthy)
|
|
|
|
|
|
2012-08-08 01:33:56 -04:00
|
|
|
|
NEW FEATURES
|
|
|
|
|
|
|
|
|
|
YARN-1. Promote YARN to be a sub-project of Apache Hadoop. (acmurthy)
|
|
|
|
|
|
|
|
|
|
IMPROVEMENTS
|
|
|
|
|
|
2012-08-27 14:30:42 -04:00
|
|
|
|
YARN-29. Add a yarn-client module. (Vinod Kumar Vavilapalli via sseth)
|
|
|
|
|
|
2012-09-04 17:01:58 -04:00
|
|
|
|
YARN-10. Fix DistributedShell module to not have a dependency on
|
|
|
|
|
hadoop-mapreduce-client-core. (Hitesh Shah via vinodkv)
|
|
|
|
|
|
2012-09-07 01:11:46 -04:00
|
|
|
|
YARN-80. Add support for delaying rack-local containers in
|
|
|
|
|
CapacityScheduler. (acmurthy)
|
|
|
|
|
|
2012-09-29 20:44:15 -04:00
|
|
|
|
YARN-137. Change the default YARN scheduler to be the CapacityScheduler.
|
|
|
|
|
(sseth via acmurthy)
|
|
|
|
|
|
2012-09-07 18:34:25 -04:00
|
|
|
|
OPTIMIZATIONS
|
2012-09-04 17:01:58 -04:00
|
|
|
|
|
2012-08-08 01:33:56 -04:00
|
|
|
|
BUG FIXES
|
|
|
|
|
|
2012-09-07 18:34:25 -04:00
|
|
|
|
YARN-13. Fix pom versions for YARN in branch-2 (todd)
|
|
|
|
|
|
|
|
|
|
MAPREDUCE-2374. "Text File Busy" errors launching MR tasks. (Andy Isaacson
|
|
|
|
|
via atm)
|
|
|
|
|
|
2012-08-08 14:54:26 -04:00
|
|
|
|
YARN-12. Fix findbugs warnings in FairScheduler. (Junping Du via acmurthy)
|
|
|
|
|
|
2012-08-21 18:28:58 -04:00
|
|
|
|
YARN-22. Fix ContainerLogs to work if the log-dir is specified as a URI.
|
|
|
|
|
(Mayank Bansal via sseth)
|
|
|
|
|
|
2012-08-27 15:38:24 -04:00
|
|
|
|
YARN-37. Change TestRMAppTransitions to use the DrainDispatcher.
|
|
|
|
|
(Mayank Bansal via sseth)
|
|
|
|
|
|
2012-09-04 20:16:22 -04:00
|
|
|
|
YARN-79. Implement close on all clients to YARN so that RPC clients don't
|
|
|
|
|
throw exceptions on shut-down. (Vinod Kumar Vavilapalli)
|
|
|
|
|
|
2012-09-04 22:47:02 -04:00
|
|
|
|
YARN-42. Modify NM's non-aggregating logs' handler to stop properly so that
|
|
|
|
|
NMs don't get NPEs on startup errors. (Devaraj K via vinodkv)
|
|
|
|
|
|
2012-09-06 19:37:33 -04:00
|
|
|
|
YARN-15. Updated default classpath for YARN applications to reflect split of
|
|
|
|
|
YARN into a sub-project. (Arun C Murthy via vinodkv)
|
|
|
|
|
|
2012-09-06 20:21:36 -04:00
|
|
|
|
YARN-75. Modified ResourceManager's RMContainer to handle a valid RELEASE
|
|
|
|
|
event at RUNNING state. (Siddharth Seth via vinodkv)
|
|
|
|
|
|
2012-09-29 23:46:51 -04:00
|
|
|
|
YARN-138. Ensure default values for minimum/maximum container sizes is
|
|
|
|
|
sane. (harsh & sseth via acmurthy)
|
|
|
|
|
|
2013-12-20 14:24:43 -05:00
|
|
|
|
Release 0.23.11 - UNRELEASED
|
|
|
|
|
|
|
|
|
|
INCOMPATIBLE CHANGES
|
|
|
|
|
|
|
|
|
|
NEW FEATURES
|
|
|
|
|
|
|
|
|
|
IMPROVEMENTS
|
|
|
|
|
|
|
|
|
|
OPTIMIZATIONS
|
|
|
|
|
|
|
|
|
|
BUG FIXES
|
|
|
|
|
|
|
|
|
|
YARN-1180. Update capacity scheduler docs to include types on the configs
|
|
|
|
|
(Chen He via jeagles)
|
|
|
|
|
|
|
|
|
|
Release 0.23.10 - 2013-12-09
|
2013-07-01 10:27:48 -04:00
|
|
|
|
|
|
|
|
|
INCOMPATIBLE CHANGES
|
|
|
|
|
|
|
|
|
|
NEW FEATURES
|
|
|
|
|
|
|
|
|
|
IMPROVEMENTS
|
|
|
|
|
|
2013-08-06 15:55:07 -04:00
|
|
|
|
YARN-985. Nodemanager should log where a resource was localized (Ravi
|
|
|
|
|
Prakash via jeagles)
|
|
|
|
|
|
2013-09-10 16:12:05 -04:00
|
|
|
|
YARN-1119. Add ClusterMetrics checks to tho TestRMNodeTransitions tests
|
|
|
|
|
(Mit Desai via jeagles)
|
|
|
|
|
|
2013-07-01 10:27:48 -04:00
|
|
|
|
OPTIMIZATIONS
|
|
|
|
|
|
|
|
|
|
BUG FIXES
|
|
|
|
|
|
2013-08-14 10:21:37 -04:00
|
|
|
|
YARN-337. RM handles killed application tracking URL poorly (jlowe)
|
|
|
|
|
|
2013-08-28 17:12:21 -04:00
|
|
|
|
YARN-1101. Active nodes can be decremented below 0 (Robert Parker
|
|
|
|
|
via tgraves)
|
|
|
|
|
|
2013-09-11 18:04:27 -04:00
|
|
|
|
YARN-1176. RM web services ClusterMetricsInfo total nodes doesn't include
|
|
|
|
|
unhealthy nodes (Jonathan Eagles via tgraves)
|
|
|
|
|
|
2013-11-12 22:26:20 -05:00
|
|
|
|
YARN-1386. NodeManager mistakenly loses resources and relocalizes them
|
|
|
|
|
(Jason Lowe via jeagles)
|
|
|
|
|
|
2013-07-01 10:27:48 -04:00
|
|
|
|
Release 0.23.9 - 2013-07-08
|
2013-06-05 11:01:24 -04:00
|
|
|
|
|
|
|
|
|
INCOMPATIBLE CHANGES
|
|
|
|
|
|
|
|
|
|
NEW FEATURES
|
|
|
|
|
|
|
|
|
|
IMPROVEMENTS
|
|
|
|
|
|
2013-06-12 13:01:50 -04:00
|
|
|
|
YARN-427. Coverage fix for org.apache.hadoop.yarn.server.api.* (Aleksey
|
|
|
|
|
Gorshkov via jeagles)
|
2013-06-20 15:04:30 -04:00
|
|
|
|
|
|
|
|
|
YARN-478. fix coverage org.apache.hadoop.yarn.webapp.log (Aleksey Gorshkov
|
|
|
|
|
via jeagles)
|
2013-06-12 13:01:50 -04:00
|
|
|
|
|
2013-06-05 11:01:24 -04:00
|
|
|
|
OPTIMIZATIONS
|
|
|
|
|
|
|
|
|
|
BUG FIXES
|
|
|
|
|
|
|
|
|
|
Release 0.23.8 - 2013-06-05
|
2013-04-11 16:09:26 -04:00
|
|
|
|
|
|
|
|
|
INCOMPATIBLE CHANGES
|
|
|
|
|
|
|
|
|
|
NEW FEATURES
|
|
|
|
|
|
|
|
|
|
IMPROVEMENTS
|
|
|
|
|
|
|
|
|
|
OPTIMIZATIONS
|
|
|
|
|
|
2013-05-23 18:27:19 -04:00
|
|
|
|
YARN-548. Add tests for YarnUncaughtExceptionHandler (Vadim Bondarev via
|
|
|
|
|
jeagles)
|
|
|
|
|
|
2013-04-11 16:09:26 -04:00
|
|
|
|
BUG FIXES
|
|
|
|
|
|
2013-04-26 14:31:04 -04:00
|
|
|
|
YARN-363. Add webapps/proxy directory without which YARN proxy-server fails
|
|
|
|
|
when started in stand-alone mode. (Kenji Kikushima via vinodkv)
|
|
|
|
|
|
2013-05-16 17:42:41 -04:00
|
|
|
|
YARN-690. RM exits on token cancel/renew problems (daryn via bobby)
|
|
|
|
|
|
2013-06-05 11:01:24 -04:00
|
|
|
|
Release 0.23.7 - 2013-04-18
|
2013-01-16 11:46:12 -05:00
|
|
|
|
|
|
|
|
|
INCOMPATIBLE CHANGES
|
|
|
|
|
|
|
|
|
|
NEW FEATURES
|
|
|
|
|
|
|
|
|
|
IMPROVEMENTS
|
|
|
|
|
|
2013-01-28 16:55:49 -05:00
|
|
|
|
YARN-133 Update web services docs for RM clusterMetrics (Ravi Prakash via
|
|
|
|
|
kihwal)
|
|
|
|
|
|
2013-02-13 10:52:05 -05:00
|
|
|
|
YARN-249. Capacity Scheduler web page should show list of active users per
|
|
|
|
|
queue like it used to (in 1.x) (Ravi Prakash via tgraves)
|
|
|
|
|
|
2013-02-20 16:00:05 -05:00
|
|
|
|
YARN-236. RM should point tracking URL to RM web page when app fails to
|
|
|
|
|
start (Jason Lowe via jeagles)
|
|
|
|
|
|
2013-02-28 16:04:10 -05:00
|
|
|
|
YARN-269. Resource Manager not logging the health_check_script result when
|
|
|
|
|
taking it out (Jason Lowe via kihwal)
|
|
|
|
|
|
2013-03-05 18:23:18 -05:00
|
|
|
|
YARN-227. Application expiration difficult to debug for end-users
|
|
|
|
|
(Jason Lowe via jeagles)
|
|
|
|
|
|
2013-03-08 09:53:38 -05:00
|
|
|
|
YARN-443. allow OS scheduling priority of NM to be different than the
|
|
|
|
|
containers it launches (tgraves)
|
|
|
|
|
|
2013-03-14 10:55:04 -04:00
|
|
|
|
YARN-468. coverage fix for org.apache.hadoop.yarn.server.webproxy.amfilter
|
|
|
|
|
(Aleksey Gorshkov via bobby)
|
|
|
|
|
|
2013-03-19 15:39:31 -04:00
|
|
|
|
YARN-200. yarn log does not output all needed information, and is in a
|
|
|
|
|
binary format (Ravi Prakash via jlowe)
|
|
|
|
|
|
2013-04-05 11:34:40 -04:00
|
|
|
|
YARN-525. make CS node-locality-delay refreshable (Thomas Graves via jlowe)
|
|
|
|
|
|
2013-01-16 11:46:12 -05:00
|
|
|
|
OPTIMIZATIONS
|
|
|
|
|
|
2013-02-06 10:36:55 -05:00
|
|
|
|
YARN-357. App submission should not be synchronized (daryn)
|
|
|
|
|
|
2013-01-16 11:46:12 -05:00
|
|
|
|
BUG FIXES
|
|
|
|
|
|
2013-01-30 10:18:40 -05:00
|
|
|
|
YARN-343. Capacity Scheduler maximum-capacity value -1 is invalid (Xuan
|
|
|
|
|
Gong via tgraves)
|
|
|
|
|
|
2013-01-31 17:51:49 -05:00
|
|
|
|
YARN-364. AggregatedLogDeletionService can take too long to delete logs
|
|
|
|
|
(jlowe)
|
|
|
|
|
|
2013-02-08 10:56:38 -05:00
|
|
|
|
YARN-362. Unexpected extra results when using webUI table search (Ravi
|
|
|
|
|
Prakash via jlowe)
|
|
|
|
|
|
2013-02-20 10:37:27 -05:00
|
|
|
|
YARN-400. RM can return null application resource usage report leading to
|
|
|
|
|
NPE in client (Jason Lowe via tgraves)
|
|
|
|
|
|
2013-02-27 10:33:22 -05:00
|
|
|
|
YARN-426. Failure to download a public resource prevents further downloads
|
|
|
|
|
(Jason Lowe via bobby)
|
|
|
|
|
|
2013-03-04 15:10:30 -05:00
|
|
|
|
YARN-448. Remove unnecessary hflush from log aggregation (Kihwal Lee via
|
|
|
|
|
bobby)
|
|
|
|
|
|
2013-03-04 16:54:03 -05:00
|
|
|
|
YARN-345. Many InvalidStateTransitonException errors for ApplicationImpl
|
|
|
|
|
in Node Manager (Robert Parker via jlowe)
|
|
|
|
|
|
2013-03-25 11:48:46 -04:00
|
|
|
|
YARN-109. .tmp file is not deleted for localized archives (Mayank Bansal
|
|
|
|
|
via bobby)
|
|
|
|
|
|
2013-03-29 11:32:16 -04:00
|
|
|
|
YARN-460. CS user left in list of active users for the queue even when
|
|
|
|
|
application finished (tgraves)
|
|
|
|
|
|
2013-06-05 11:01:24 -04:00
|
|
|
|
Release 0.23.6 - 2013-02-06
|
2012-11-15 09:59:27 -05:00
|
|
|
|
|
|
|
|
|
INCOMPATIBLE CHANGES
|
|
|
|
|
|
|
|
|
|
NEW FEATURES
|
|
|
|
|
|
|
|
|
|
IMPROVEMENTS
|
|
|
|
|
|
2012-12-21 20:57:49 -05:00
|
|
|
|
YARN-285. Added a temporary plugin interface for RM to be able to redirect
|
|
|
|
|
to JobHistory server for apps that it no longer tracks. (Derek Dagit via
|
|
|
|
|
vinodkv)
|
|
|
|
|
|
2012-11-15 09:59:27 -05:00
|
|
|
|
OPTIMIZATIONS
|
|
|
|
|
|
|
|
|
|
BUG FIXES
|
|
|
|
|
|
2012-11-15 10:19:30 -05:00
|
|
|
|
YARN-188. Coverage fixing for CapacityScheduler (Aleksey Gorshkov via
|
|
|
|
|
bobby)
|
|
|
|
|
|
2012-11-16 13:29:21 -05:00
|
|
|
|
YARN-214. RMContainerImpl does not handle event EXPIRE at state RUNNING
|
|
|
|
|
(jeagles via bobby)
|
|
|
|
|
|
2012-11-16 16:03:41 -05:00
|
|
|
|
YARN-151. Browser thinks RM main page JS is taking too long
|
|
|
|
|
(Ravi Prakash via bobby)
|
|
|
|
|
|
2012-11-27 11:06:57 -05:00
|
|
|
|
YARN-204. test coverage for org.apache.hadoop.tools (Aleksey Gorshkov via
|
|
|
|
|
bobby)
|
|
|
|
|
|
2012-11-30 12:10:39 -05:00
|
|
|
|
YARN-251. Proxy URI generation fails for blank tracking URIs (Tom White
|
|
|
|
|
via jlowe)
|
|
|
|
|
|
2012-12-06 10:41:20 -05:00
|
|
|
|
YARN-258. RM web page UI shows Invalid Date for start and finish times
|
|
|
|
|
(Ravi Prakash via jlowe)
|
|
|
|
|
|
2012-12-11 10:51:12 -05:00
|
|
|
|
YARN-266. RM and JHS Web UIs are blank because AppsBlock is not escaping
|
|
|
|
|
string properly (Ravi Prakash via jlowe)
|
|
|
|
|
|
2012-12-21 13:56:09 -05:00
|
|
|
|
YARN-280. RM does not reject app submission with invalid tokens
|
|
|
|
|
(Daryn Sharp via tgraves)
|
|
|
|
|
|
2012-12-28 09:22:23 -05:00
|
|
|
|
YARN-225. Proxy Link in RM UI thows NPE in Secure mode
|
|
|
|
|
(Devaraj K via bobby)
|
|
|
|
|
|
2013-01-02 17:46:35 -05:00
|
|
|
|
YARN-293. Node Manager leaks LocalizerRunner object for every Container
|
|
|
|
|
(Robert Joseph Evans via jlowe)
|
|
|
|
|
|
2013-01-04 15:31:12 -05:00
|
|
|
|
YARN-50. Implement renewal / cancellation of Delegation Tokens
|
|
|
|
|
(Siddharth Seth via tgraves)
|
|
|
|
|
|
2013-01-09 14:34:01 -05:00
|
|
|
|
YARN-320. RM should always be able to renew its own tokens.
|
|
|
|
|
(Daryn Sharp via sseth)
|
|
|
|
|
|
2013-01-09 16:04:39 -05:00
|
|
|
|
YARN-325. RM CapacityScheduler can deadlock when getQueueInfo() is
|
|
|
|
|
called and a container is completing (Arun C Murthy via tgraves)
|
|
|
|
|
|
2013-01-14 10:01:01 -05:00
|
|
|
|
YARN-334. Maven RAT plugin is not checking all source files (tgraves)
|
|
|
|
|
|
2013-01-23 17:10:50 -05:00
|
|
|
|
YARN-354. WebAppProxyServer exits immediately after startup (Liang Xie via
|
|
|
|
|
jlowe)
|
|
|
|
|
|
2013-01-16 11:46:12 -05:00
|
|
|
|
Release 0.23.5 - 2012-11-28
|
2012-09-29 10:18:27 -04:00
|
|
|
|
|
|
|
|
|
INCOMPATIBLE CHANGES
|
|
|
|
|
|
|
|
|
|
NEW FEATURES
|
|
|
|
|
|
|
|
|
|
IMPROVEMENTS
|
|
|
|
|
|
2012-10-16 20:32:37 -04:00
|
|
|
|
YARN-161. Fix multiple compiler warnings for unchecked operations in YARN
|
|
|
|
|
common. (Chris Nauroth via vinodkv)
|
|
|
|
|
|
2012-10-16 21:29:12 -04:00
|
|
|
|
YARN-43. Fix TestResourceTrackerService to not depend on test order and thus
|
|
|
|
|
pass on JDK7. (Thomas Graves via vinodkv)
|
|
|
|
|
|
2012-10-18 15:12:53 -04:00
|
|
|
|
YARN-32. Fix TestApplicationTokens to not depend on test order and thus pass
|
|
|
|
|
on JDK7. (vinodkv)
|
|
|
|
|
|
2012-11-08 12:28:00 -05:00
|
|
|
|
YARN-186. Coverage fixing LinuxContainerExecutor (Aleksey Gorshkov via
|
|
|
|
|
bobby)
|
|
|
|
|
|
2012-11-14 14:26:54 -05:00
|
|
|
|
YARN-216. Remove jquery theming support. (Robert Joseph Evans via jlowe)
|
|
|
|
|
|
2012-09-29 10:18:27 -04:00
|
|
|
|
OPTIMIZATIONS
|
|
|
|
|
|
|
|
|
|
BUG FIXES
|
|
|
|
|
|
2012-10-19 13:36:26 -04:00
|
|
|
|
YARN-163. Retrieving container log via NM webapp can hang with multibyte
|
|
|
|
|
characters in log (jlowe via bobby)
|
|
|
|
|
|
2012-10-22 17:25:56 -04:00
|
|
|
|
YARN-174. Modify NodeManager to pass the user's configuration even when
|
|
|
|
|
rebooting. (vinodkv)
|
|
|
|
|
|
2012-10-24 09:25:19 -04:00
|
|
|
|
YARN-177. CapacityScheduler - adding a queue while the RM is running has
|
|
|
|
|
wacky results (acmurthy vai tgraves)
|
|
|
|
|
|
2012-10-24 10:08:28 -04:00
|
|
|
|
YARN-178. Fix custom ProcessTree instance creation (Radim Kolar via bobby)
|
|
|
|
|
|
2012-10-24 10:20:09 -04:00
|
|
|
|
YARN-180. Capacity scheduler - containers that get reserved create
|
|
|
|
|
container token to early (acmurthy and bobby)
|
|
|
|
|
|
2012-10-24 11:25:22 -04:00
|
|
|
|
YARN-139. Interrupted Exception within AsyncDispatcher leads to user
|
|
|
|
|
confusion. (Vinod Kumar Vavilapalli via jlowe)
|
|
|
|
|
|
2012-10-31 11:50:53 -04:00
|
|
|
|
YARN-165. RM should point tracking URL to RM web page for app when AM fails
|
|
|
|
|
(jlowe via bobby)
|
|
|
|
|
|
2012-10-31 12:24:25 -04:00
|
|
|
|
YARN-159. RM web ui applications page should be sorted to display last app
|
|
|
|
|
first (tgraves via bobby)
|
|
|
|
|
|
2012-10-31 13:00:01 -04:00
|
|
|
|
YARN-166. capacity scheduler doesn't allow capacity < 1.0 (tgraves via
|
|
|
|
|
bobby)
|
|
|
|
|
|
2012-10-31 20:33:32 -04:00
|
|
|
|
YARN-189. Fixed a deadlock between RM's ApplicationMasterService and the
|
|
|
|
|
dispatcher. (Thomas Graves via vinodkv)
|
|
|
|
|
|
2012-11-06 13:50:13 -05:00
|
|
|
|
YARN-202. Log Aggregation generates a storm of fsync() for namenode
|
|
|
|
|
(Kihwal Lee via bobby)
|
|
|
|
|
|
2012-11-07 16:57:01 -05:00
|
|
|
|
YARN-201. Fix CapacityScheduler to be less conservative for starved
|
|
|
|
|
off-switch requests. (jlowe via acmurthy)
|
|
|
|
|
|
2012-11-09 14:55:37 -05:00
|
|
|
|
YARN-206. TestApplicationCleanup.testContainerCleanup occasionally fails.
|
|
|
|
|
(jlowe via jeagles)
|
|
|
|
|
|
2012-11-13 11:04:47 -05:00
|
|
|
|
YARN-212. NM state machine ignores an APPLICATION_CONTAINER_FINISHED event
|
|
|
|
|
when it shouldn't (Nathan Roberts via jlowe)
|
|
|
|
|
|
2012-11-19 11:45:14 -05:00
|
|
|
|
YARN-219. NM should aggregate logs when application finishes. (bobby)
|
|
|
|
|
|
2012-11-15 09:59:27 -05:00
|
|
|
|
Release 0.23.4
|
2012-09-04 17:48:58 -04:00
|
|
|
|
|
|
|
|
|
INCOMPATIBLE CHANGES
|
|
|
|
|
|
|
|
|
|
NEW FEATURES
|
|
|
|
|
|
|
|
|
|
IMPROVEMENTS
|
|
|
|
|
|
2012-09-17 17:11:56 -04:00
|
|
|
|
Change package of YarnClient to org.apache.hadoop. (Bikas Saha via vinodkv)
|
|
|
|
|
|
|
|
|
|
YARN-108. FSDownload can create cache directories with the wrong
|
|
|
|
|
permissions (Jason Lowe via bobby)
|
2012-09-05 13:55:53 -04:00
|
|
|
|
|
2012-09-27 12:38:54 -04:00
|
|
|
|
YARN-57. Allow process-tree based resource calculation et al. to be
|
|
|
|
|
pluggable to support it on multiple platforms. (Radim Kolar via acmurthy)
|
|
|
|
|
|
2012-09-04 17:48:58 -04:00
|
|
|
|
OPTIMIZATIONS
|
|
|
|
|
|
|
|
|
|
BUG FIXES
|
|
|
|
|
|
2012-09-21 13:36:18 -04:00
|
|
|
|
YARN-88. DefaultContainerExecutor can fail to set proper permissions.
|
|
|
|
|
(Jason Lowe via sseth)
|
|
|
|
|
|
2012-09-28 16:53:14 -04:00
|
|
|
|
YARN-106. Nodemanager needs to set permissions of local directories (jlowe
|
|
|
|
|
via bobby)
|
|
|
|
|
|
2012-09-29 10:18:27 -04:00
|
|
|
|
Release 0.23.3
|
2012-08-09 15:18:37 -04:00
|
|
|
|
|
|
|
|
|
INCOMPATIBLE CHANGES
|
|
|
|
|
|
|
|
|
|
NEW FEATURES
|
|
|
|
|
|
|
|
|
|
IMPROVEMENTS
|
|
|
|
|
|
2012-09-04 17:01:58 -04:00
|
|
|
|
OPTIMAZATIONS
|
|
|
|
|
|
2012-08-09 15:18:37 -04:00
|
|
|
|
BUG FIXES
|
|
|
|
|
|
|
|
|
|
YARN-14. Symlinks to peer distributed cache files no longer work
|
|
|
|
|
(Jason Lowe via bobby)
|
|
|
|
|
|
2012-08-17 16:31:09 -04:00
|
|
|
|
YARN-25. remove old aggregated logs (Robert Evans via tgraves)
|
|
|
|
|
|
2012-08-20 11:37:43 -04:00
|
|
|
|
YARN-27. Failed refreshQueues due to misconfiguration prevents further
|
|
|
|
|
refreshing of queues (Arun Murthy via tgraves)
|
2012-08-20 15:32:11 -04:00
|
|
|
|
|
|
|
|
|
MAPREDUCE-4323. NM leaks filesystems (Jason Lowe via jeagles)
|
2012-08-24 22:25:12 -04:00
|
|
|
|
|
|
|
|
|
YARN-39. RM-NM secret-keys should be randomly generated and rolled every
|
|
|
|
|
so often. (vinodkv and sseth via sseth)
|
2012-08-27 23:33:20 -04:00
|
|
|
|
|
|
|
|
|
YARN-31. Fix TestDelegationTokenRenewer to not depend on test order so as to
|
|
|
|
|
pass tests on jdk7. (Thomas Graves via vinodkv)
|
2012-08-31 12:34:33 -04:00
|
|
|
|
|
|
|
|
|
YARN-63. RMNodeImpl is missing valid transitions from the UNHEALTHY state
|
|
|
|
|
(Jason Lowe via bobby)
|
|
|
|
|
|
2012-08-31 15:12:57 -04:00
|
|
|
|
YARN-60. Fixed a bug in ResourceManager which causes all NMs to get NPEs and
|
|
|
|
|
thus causes all containers to be rejected. (vinodkv)
|
2012-08-31 15:58:26 -04:00
|
|
|
|
|
|
|
|
|
YARN-66. aggregated logs permissions not set properly (tgraves via bobby)
|
2012-09-05 15:41:21 -04:00
|
|
|
|
|
|
|
|
|
YARN-68. NodeManager will refuse to shutdown indefinitely due to container
|
|
|
|
|
log aggregation (daryn via bobby)
|
2012-09-05 22:11:00 -04:00
|
|
|
|
|
|
|
|
|
YARN-87. NM ResourceLocalizationService does not set permissions of local
|
|
|
|
|
cache directories (Jason Lowe via tgraves)
|