Arun Suresh
|
81da7d1d30
|
YARN-5938. Refactoring OpportunisticContainerAllocator to use SchedulerRequestKey instead of Priority and other misc fixes (asuresh)
(cherry picked from commit ac1e5d4f77 )
|
2017-01-06 11:25:49 -08:00 |
Arun Suresh
|
2b4d3e8506
|
YARN-5646. Add documentation and update config parameter names for scheduling of OPPORTUNISTIC containers. (Konstantinos Karanasos via asuresh)
(cherry picked from commit 2273a74c1f )
(cherry picked from commit 9e17ffe599e12c59c48f4355de645c31a4735d04)
|
2017-01-06 11:15:10 -08:00 |
Arun Suresh
|
3d3bb30a25
|
YARN-5982. Simplify opportunistic container parameters and metrics. (Konstantinos Karanasos via asuresh)
(cherry picked from commit b0aace21b1 )
(cherry picked from commit 3faa0b0d682687099b253feee9b41340edef7111)
|
2017-01-06 11:15:09 -08:00 |
Arun Suresh
|
44774eb21c
|
YARN-5918. Handle Opportunistic scheduling allocate request failure when NM is lost. (Bibin A Chundatt via asuresh)
(cherry picked from commit 005850b28f )
(cherry picked from commit cbff10b4147f98a89b393519b17e16385294af07)
|
2017-01-06 11:15:09 -08:00 |
Arun Suresh
|
368565f0ce
|
YARN-4597. Introduce ContainerScheduler and a SCHEDULED state to NodeManager container lifecycle. (asuresh)
(cherry picked from commit 3219b7b4ac )
(cherry picked from commit 49921678858a17ca58ca2ae704ced1ff584e0859)
|
2017-01-06 11:15:09 -08:00 |
Arun Suresh
|
047772f15f
|
YARN-5823. Update NMTokens in case of requests with only opportunistic containers. (Konstantinos Karanasos via asuresh)
(cherry picked from commit 283fa33feb )
(cherry picked from commit 1c4cc88a754ac9f557cdc8c859b8aadec19a5067)
|
2017-01-06 11:15:09 -08:00 |
Arun Suresh
|
0e60c7cd33
|
YARN-5377. Fix TestQueuingContainerManager.testKillMultipleOpportunisticContainers. (Konstantinos Karanasos via asuresh)
(cherry picked from commit f38a6d03a1 )
(cherry picked from commit 83ccab8a653a4ef943276651c9604bd434675980)
|
2017-01-06 11:15:09 -08:00 |
Arun Suresh
|
7437252102
|
YARN-2995. Enhance UI to show cluster resource utilization of various container Execution types. (Konstantinos Karanasos via asuresh)
(cherry picked from commit 0aafc122d4 )
(cherry picked from commit 25598b6e7118bacd33a167fb496e9cda5e9f9ad0)
|
2017-01-06 11:15:09 -08:00 |
Arun Suresh
|
28f3bb38bf
|
YARN-5799. Fix Opportunistic Allocation to set the correct value of Node Http Address. (asuresh)
(cherry picked from commit aa3cab1eb2 )
(cherry picked from commit ce10e98826884245e733431297d0275177965f17)
|
2017-01-06 11:15:09 -08:00 |
Arun Suresh
|
f9ea753414
|
YARN-5486. Update OpportunisticContainerAllocatorAMService::allocate method to handle OPPORTUNISTIC container requests. (Konstantinos Karanasos via asuresh)
(cherry picked from commit 10be45986c )
(cherry picked from commit e3baa0988b4dfb592afe426ffeba3c7091b271c5)
|
2017-01-06 11:15:09 -08:00 |
Sunil G
|
65e7ae5dcf
|
YARN-5906. Update AppSchedulingInfo to use SchedulingPlacementSet. Contributed by Wangda Tan.
|
2017-01-06 21:30:52 +05:30 |
Rohith Sharma K S
|
3207762192
|
YARN-5988. RM unable to start in secure setup. Contributed by Ajith S.
(cherry picked from commit e49e0a6e37 )
|
2017-01-04 12:10:05 +05:30 |
Junping Du
|
dc2e44e8f8
|
YARN-5923. Unable to access logs for a running application if YARN_ACL_ENABLE is enabled. Contributed by Xuan Gong.
(cherry picked from commit 8fadd69047 )
|
2017-01-03 15:19:36 -08:00 |
Wangda Tan
|
23f6a33156
|
YARN-6025. Fix synchronization issues of AbstractYarnScheduler#nodeUpdate and its implementations. (Naganarasimha G R via wangda)
(cherry picked from commit e0f2379312 )
(cherry picked from commit 554e6656bc )
|
2017-01-03 14:52:31 -08:00 |
Wangda Tan
|
cb64e8eb19
|
Revert "Fix synchronization issues of AbstractYarnScheduler#nodeUpdate and its implementations. (Naganarasimha G R via wangda)" because forgot to add JIRA Number
This reverts commit 554e6656bc .
|
2017-01-03 14:51:59 -08:00 |
Wangda Tan
|
554e6656bc
|
Fix synchronization issues of AbstractYarnScheduler#nodeUpdate and its implementations. (Naganarasimha G R via wangda)
(cherry picked from commit e0f2379312 )
|
2017-01-03 14:50:19 -08:00 |
Daniel Templeton
|
8cb7aa2b52
|
YARN-5931. Document timeout interfaces CLI and REST APIs (Contributed by Rohith Sharma K S via Daniel Templeton)
(cherry picked from commit 165d01a73e )
|
2016-12-30 08:56:03 -08:00 |
Robert Kanter
|
f9b48206dd
|
YARN-4882. Change the log level to DEBUG for recovering completed applications (templedf via rkanter)
(cherry picked from commit f216276d21 )
|
2016-12-28 15:29:06 -08:00 |
Daniel Templeton
|
47f0a0e15b
|
HADOOP-13932. Fix indefinite article in comments (Contributed by LiXin Ge via Daniel Templeton)
|
2016-12-28 07:03:51 -08:00 |
Sunil G
|
b3231b480d
|
YARN-6024. Capacity Scheduler 'continuous reservation looking' doesn't work when sum of queue's used and reserved resources is equal to max. Contributed by Wangda Tan.
(cherry picked from commit f6715b26b6 )
|
2016-12-28 16:00:52 +05:30 |
Wangda Tan
|
42f571728c
|
YARN-5756. Add state-machine implementation for scheduler queues. (Xuan Gong via wangda)
(cherry picked from commit 0840b4329b )
|
2016-12-27 21:19:10 -08:00 |
Robert Kanter
|
88597991b0
|
YARN-5257. Fix unreleased resources and null dereferences (yufeigu via rkanter)
(cherry picked from commit 9262797e86 )
|
2016-12-27 14:14:41 -08:00 |
Robert Kanter
|
8fbd36c60f
|
YARN-5962. Spelling errors in logging and exceptions for resource manager code (gsohn via rkanter)
(cherry picked from commit 1bbd023275 )
|
2016-12-27 13:35:55 -08:00 |
Karthik Kambatla
|
10a154cedd
|
YARN-5969. FairShareComparator: Cache value of getResourceUsage for better performance. (zhangshilong via kasha)
(cherry picked from commit c3973e7080 )
|
2016-12-27 12:30:50 -08:00 |
Akira Ajisaka
|
522bc98026
|
YARN-4994. Use MiniYARNCluster with try-with-resources in tests. Contributed by Andras Bokor.
(cherry picked from commit ae401539ea )
|
2016-12-23 04:06:53 +09:00 |
Junping Du
|
cc42dbb703
|
YARN-4990. Re-direction of a particular log file within in a container in NM UI does not redirect properly. Contributed by Xuan Gong.
(cherry picked from commit 736f54b727 )
|
2016-12-21 14:16:19 -08:00 |
Sunil G
|
238863c11b
|
YARN-5650. Render Application Timeout value in web UI. Contributed by Akhil PB.
|
2016-12-20 11:03:57 +05:30 |
Sunil G
|
23bd68a4a4
|
YARN-5970. Validate application update timeout request parameters. Contributed by Rohith Sharma K S.
|
2016-12-12 11:59:14 +05:30 |
Jian He
|
71fdca4600
|
YARN-5709. Cleanup leader election configs and pluggability. Contribtued by Karthik Kambatla
(cherry picked from commit b817c565c8be1d4a682d119bfac6f43ee09e87f0)
|
2016-12-09 16:59:52 -08:00 |
Robert Kanter
|
9cba7c6d71
|
YARN-5963. Spelling errors in logging and exceptions for node manager, client, web-proxy, common, and app history code (gsohn via rkanter)
(cherry picked from commit 72fe546841 )
Conflicts:
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/client/api/impl/TimelineClientImpl.java
|
2016-12-07 15:09:37 -08:00 |
Sunil
|
a636a87270
|
YARN-5965. Retrospect ApplicationReport#getApplicationTimeouts. Contributed by Rohith Sharma K S
(cherry picked from commit ab923a53fc )
|
2016-12-08 00:34:45 +05:30 |
Daniel Templeton
|
d8b4961515
|
YARN-5136. Error in handling event type APP_ATTEMPT_REMOVED to the scheduler
(Contributed by Wilfred Spiegelenburg via Daniel Templeton)
|
2016-12-07 11:01:09 -08:00 |
Rohith Sharma K S
|
602c998443
|
YARN-5932. Retrospect moveApplicationToQueue in align with YARN-5611. Contributed by Sunil G.
|
2016-12-07 22:45:25 +05:30 |
Naganarasimha
|
54c5880cf7
|
YARN-5921. Incorrect synchronization in RMContextImpl#setHAServiceState/getHAServiceState. Contributed by Varun Saxena
(cherry picked from commit f3b8ff54ab )
|
2016-12-06 11:01:14 +05:30 |
Jian He
|
0f6fbfc0db
|
YARN-5559. Analyse 2.8.0/3.0.0 jdiff reports and fix any issues. Contributed by Akira Ajisaka & Wangda Tan
(cherry picked from commit 43ebff2e35 )
|
2016-12-05 11:40:26 -08:00 |
Jian He
|
d58fca0102
|
YARN-5746. The state of the parentQueue and its childQueues should be synchronized. Contributed by Xuan Gong
|
2016-12-02 16:18:39 -08:00 |
Daniel Templeton
|
1216bad0f7
|
YARN-5929. Missing scheduling policy in the FS queue metric. (Contributed by Yufei Gu via Daniel Templeton)
(cherry picked from commit 9b076327eac9da244f94e226816465e7d17fda54)
|
2016-12-02 14:02:35 -08:00 |
Li Lu
|
8ffe86f780
|
YARN-5761. Separate QueueManager from Scheduler. (Xuan Gong via gtcarrera9)
(cherry picked from commit 69fb70c31a )
|
2016-11-30 14:02:31 -08:00 |
Daniel Templeton
|
c22ceb0a9b
|
YARN-5851. TestContainerManagerSecurity testContainerManager[1] failed (Contributed by Haibo Chen via Daniel Templeton)
(cherry picked from commit dd9a96cb17 )
|
2016-11-29 14:23:42 -08:00 |
Daniel Templeton
|
803aba03f2
|
YARN-5890. FairScheduler should log information about AM-resource-usage and max-AM-share for queues
(Contributed by Yufei Gu via Daniel Templeton)
|
2016-11-29 14:14:43 -08:00 |
Daniel Templeton
|
b8bebb8607
|
YARN-5774. MR Job stuck in ACCEPTED status without any progress in Fair Scheduler
if set yarn.scheduler.minimum-allocation-mb to 0. (Contributed by Yufei Gu via Daniel Templeton)
(cherry picked from commit 25f9872be6 )
|
2016-11-29 10:12:10 -08:00 |
Sunil
|
c28dc5e5a4
|
YARN-4206. Add Application timeouts in Application report and CLI. Contributed by Rohith Sharma K S.
(cherry picked from commit eb0a483ed0 )
|
2016-11-24 18:27:50 +05:30 |
Sunil
|
7b676c5632
|
YARN-5649. Add REST endpoints for updating application timeouts. Contributed by Rohith Sharma K S
|
2016-11-24 17:37:36 +05:30 |
Rohith Sharma K S
|
6b47a7fb8e
|
YARN-5920. Fix deadlock in TestRMHA.testTransitionedToStandbyShouldNotHang. Contributed by Varun Saxena.
(cherry picked from commit e15c20edba )
|
2016-11-24 12:19:19 +05:30 |
Rohith Sharma K S
|
87bb3c51d6
|
Reverting for fixing compilation errors in branch-2.
Revert "YARN-5649. Add REST endpoints for updating application timeouts. Contributed by Rohith Sharma K S"
This reverts commit 4379658042 .
|
2016-11-24 09:18:07 +05:30 |
Jian He
|
4379658042
|
YARN-5649. Add REST endpoints for updating application timeouts. Contributed by Rohith Sharma K S
|
2016-11-23 16:27:12 -08:00 |
Rohith Sharma K S
|
2d068f1793
|
YARN-5865. Retrospect updateApplicationPriority api to handle state store exception in align with YARN-5611. Contributed by Sunil G.
|
2016-11-23 23:29:39 +05:30 |
Naganarasimha
|
2d94f938c5
|
YARN-4330. MiniYARNCluster is showing multiple Failed to instantiate default resource calculator warning messages. Contributed by Varun Saxena
(cherry picked from commit 3541ed8068 )
|
2016-11-23 14:14:56 +05:30 |
Daniel Templeton
|
06f5d27bd6
|
YARN-5722. FairScheduler hides group resolution exceptions when assigning queue (Contributed by Wilfred Spiegelenburg via Daniel Templeton)
(cherry picked from commit 83cc7263af )
|
2016-11-22 11:17:39 -08:00 |
Jason Lowe
|
38024eb8f7
|
YARN-5859. TestResourceLocalizationService#testParallelDownloadAttemptsForPublicResource sometimes fails. Contributed by Eric Badger
(cherry picked from commit 009452bb6d )
|
2016-11-21 16:37:59 +00:00 |