Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
12,561 Commits 326 Branches 371 Tags
Commit Graph

2172 Commits

Author SHA1 Message Date
Arun Suresh
bd348d20b2 Revert "YARN-5049. Extend NMStateStore to save queued container information. (Konstantinos Karanasos via asuresh)" 
This reverts commit 307cda70dbde6a8e377794b395a0d958603df5d7.
 2016-08-24 10:23:06 -07:00
Rohith Sharma K S
a19859c3f5 YARN-5544. TestNodeBlacklistingOnAMFailures fails on trunk. Contributed by Sunil G. 
(cherry picked from commit 0d5997d2b98eb89e72828dfcd78f02aa4e7e1e67)
 2016-08-23 14:39:19 +05:30
Wangda Tan
c7d782d2f6 YARN-3388. Allocation in LeafQueue could get stuck because DRF calculator isn't well supported when computing user-limit. (Nathan Roberts via wangda) 
(cherry picked from commit 444b2ea7afebf9f6c3d356154b71abfd0ea95b23)
 2016-08-19 16:47:03 -07:00
Varun Saxena
928cccb9f9 YARN-5533. JMX AM Used metrics for queue wrong when app submited to nodelabel partition (Bibin A Chundatt via Varun Saxena) 2016-08-19 17:32:23 +05:30
Varun Saxena
a746775e9a Revert "YARN-5533. JMX AM Used metrics for queue wrong when app submited to nodelabel partition (Bibin A Chundatt via Varun Saxena)" 
This reverts commit 613048a8a24fe08554d2fcdd8b5bc57f7aadaf2f.
 2016-08-19 16:40:48 +05:30
Varun Saxena
613048a8a2 YARN-5533. JMX AM Used metrics for queue wrong when app submited to nodelabel partition (Bibin A Chundatt via Varun Saxena) 2016-08-19 15:18:42 +05:30
Junping Du
d464483bf7 YARN-4676. Automatic and Asynchronous Decommissioning Nodes Status Tracking. Contributed by Diniel Zhi. 2016-08-18 07:23:29 -07:00
Karthik Kambatla
07d5ab16df YARN-4702. FairScheduler: Allow setting maxResources for ad hoc queues. (Daniel Templeton via kasha) 
(cherry picked from commit 20f0eb871c57cc4c5a6d19aae0e3745b6175509b)
 2016-08-17 17:54:28 -07:00
Varun Vasudev
3ee1fb774e YARN-5455. Update Javadocs for LinuxContainerExecutor. Contributed by Daniel Templeton. 
(cherry picked from commit 7f05ff7a4e654693eaaa216ee5fc6e24112e0e23)
 2016-08-17 15:35:23 +05:30
Varun Saxena
354afbb9df YARN-5521. Fix random failure of TestCapacityScheduler#testKillAllAppsInQueue (sandflee via Varun Saxena) 2016-08-16 00:04:40 +05:30
Varun Saxena
3c7cf5cd77 YARN-5491. Fix random failure of TestCapacityScheduler#testCSQueueBlocked (Bibin A Chundatt via Varun Saxena) 2016-08-15 03:56:31 +05:30
Varun Saxena
918a0f12fa YARN-5476. Non existent application reported as ACCEPTED by YarnClientImpl (Junping Du via Varun Saxena) 2016-08-13 00:19:00 +05:30
Naganarasimha
b63d3dcac9 YARN-4833. For Queue AccessControlException client retries multiple times on both RM. Contributed by Bibin A Chundatt 2016-08-12 20:16:15 +05:30
Rohith Sharma K S
0937715f7f YARN-5492. TestSubmitApplicationWithRMHA is failing sporadically during precommit builds. Contributed by Vrushali C. 
(cherry picked from commit 5199db387d59f7233a0e52ac298df31e8ed8af20)
 2016-08-11 11:51:56 +05:30
Ray Chiang
372f6f8456 YARN-5137. Make DiskChecker pluggable in NodeManager. (Yufei Gu via rchiang) 
(cherry picked from commit dbe9e70cc084220ea1f68da850cdb092281b5e96)
 2016-08-10 19:26:49 -07:00
Jason Lowe
2b31f6fb2c YARN-5382. RM does not audit log kill request for active applications. Contributed by Vrushali C 
(cherry picked from commit 5c95bb315ba605b3bed77966a99a63854234e2c5)
 2016-08-10 18:27:25 +00:00
Jason Lowe
3d401206cf YARN-5483. Optimize RMAppAttempt#pullJustFinishedContainers. Contributed by sandflee 2016-08-10 18:06:56 +00:00
Karthik Kambatla
447ba47640 YARN-5343. TestContinuousScheduling#testSortedNodes fails intermittently. (Yufei Gu via kasha) 
(cherry picked from commit 7992c0b42ceb10fd3ca6c4ced4f59b8e8998e046)
 2016-08-09 16:51:27 -07:00
Varun Vasudev
c599f6215e YARN-5394. Remove bind-mount /etc/passwd for Docker containers. Contributed by Zhankun Tang. 
(cherry picked from commit 522ddbde79cd453cac066b6136f004f54e2123b0)
 2016-08-09 16:05:03 +05:30
Arun Suresh
5f7edb79d1 YARN-5457. Refactor DistributedScheduling framework to pull out common functionality. (asuresh) 
(cherry picked from commit 82c9e061017c32e633e0b0cbb7978749a6df4fb2)
 2016-08-09 00:46:08 -07:00
Naganarasimha
93b768d0d1 YARN-5287. LinuxContainerExecutor fails to set proper permission. Contributed by Ying Zhang. 2016-08-09 06:48:39 +05:30
Varun Saxena
ce8df272f4 YARN-4910. Fix incomplete log info in ResourceLocalizationService (Jun Gong via Varun Saxena) 2016-08-08 22:14:56 +05:30
Naganarasimha
991823482f YARN-4624. NPE in PartitionQueueCapacitiesInfo while accessing Schduler UI. Contributed by Brahma Reddy Battula 
(cherry picked from commit d81b8163b4e5c0466a6af6e1068f512c5fd24a61)
 2016-08-06 07:04:30 +05:30
Wangda Tan
a73e118437 YARN-4888. Changes in scheduler to identify resource-requests explicitly by allocation-id. (Subru Krishnan via wangda) 
(cherry picked from commit 3f100d76ff5df020dbb8ecd4f5b4f9736a0a8270)
 2016-08-05 10:44:07 -07:00
Rohith Sharma K S
69da77c357 YARN-5333. Some recovered apps are put into default queue when RM HA. Contributed by Jun Gong. 
(cherry picked from commit d9a354c2f39274b2810144d1ae133201e44e3bfc)
 2016-08-05 21:37:05 +05:30
Varun Vasudev
19d894538d YARN-5459. Add support for docker rm. Contributed by Shane Kumpf. 
(cherry picked from commit 08e33381f5342590a68c65504c79c296b40fe5af)
 2016-08-04 14:18:01 +05:30
Jason Lowe
65a91c8527 YARN-5469. Increase timeout of TestAmFilter.testFilter. Contributed by Eric Badger 
(cherry picked from commit db4a61dc617954cf448a0d44cb4ac79f2abf9db3)
 2016-08-03 19:53:28 +00:00
Jason Lowe
1ea03411c2 YARN-5462. TestNodeStatusUpdater.testNodeStatusUpdaterRetryAndNMShutdown fails intermittently. Contributed by Eric Badger 
(cherry picked from commit db646540f094077941b56ed681a4f3e5853f5b7f)
 2016-08-03 19:18:50 +00:00
Jason Lowe
9a0ac56a5c YARN-4280. CapacityScheduler reservations may not prevent indefinite postponement on a busy cluster. Contributed by Kuhu Shukla 
(cherry picked from commit 4d92aefd35d4517d9435d81bafdec0d77905a7a0)
 2016-08-03 19:00:06 +00:00
Varun Vasudev
1087745d79 YARN-5460. Change container runtime type logging in DelegatingLinuxContainerRuntime to debug. Contributed by Shane Kumpf. 
(cherry picked from commit d848184e905d70835293ceac7a01b5a0ca21cc0a)
 2016-08-03 12:03:31 +05:30
Varun Vasudev
b63e6c8027 YARN-5458. Rename DockerStopCommandTest to TestDockerStopCommand. Contributed by Shane Kumpf. 
(cherry picked from commit 7fc70c6422da3602ad9d4364493f25454a1de50c)
 2016-08-02 17:02:17 +05:30
Varun Vasudev
4e5409a2bb YARN-5443. Add support for docker inspect command. Contributed by Shane Kumpf. 
(cherry picked from commit 2e7c2a13a853b8195bc4f51f6c3c1f61656c2b33)
 2016-08-02 17:01:59 +05:30
Varun Vasudev
7ecb1635b4 YARN-5444. Fix failing unit tests in TestLinuxContainerExecutorWithMocks. Contributed by Yufei Gu. 
(cherry picked from commit 4455aa7c86a36b6e017e288479a7d4ced889faa0)
 2016-08-01 16:01:10 +05:30
Arun Suresh
f197378f81 YARN-5113. Refactoring and other clean-up for distributed scheduling. (Konstantinos Karanasos via asuresh) 
(cherry picked from commit e5766b1dbee02ae0ef89618e172f3fb227af19e8)
 2016-07-31 11:49:09 -07:00
Subru Krishnan
2f4df2b851 YARN-5203.Return ResourceRequest JAXB object in ResourceManager Cluster Applications REST API. Contributed by Ellen Hui. 
(cherry picked from commit 4e756d72719ec3c6d64a1e3daccbc0b8e8de998c)
 2016-07-28 16:04:30 -07:00
Junping Du
932bf79244 YARN-5432. Lock already held by another process while LevelDB cache store creation for dag. Contributed by Li Lu. 
(cherry picked from commit 7f3c306e2ed9e865171324898decb9b587d90e73)
 2016-07-28 06:36:31 -07:00
Subru Krishnan
4ecfd05095 YARN-5441. Fixing minor Scheduler test case failures 
(cherry picked from commit d2cbfd7de33fde526089a395550deafb4628fc6f)
 2016-07-27 18:26:29 -07:00
Wangda Tan
77e0b6d1bf YARN-5195. RM intermittently crashed with NPE while handling APP_ATTEMPT_REMOVED event when async-scheduling enabled in CapacityScheduler. (sandflee via wangda) 
(cherry picked from commit d62e121ffc0239e7feccc1e23ece92c5fac685f6)
 2016-07-26 21:36:37 -07:00
Wangda Tan
55fa19d576 YARN-5342. Improve non-exclusive node partition resource allocation in Capacity Scheduler. (Sunil G via wangda) 
(cherry picked from commit 49969b16cdba0f251b9f8bf3d8df9906e38b5c61)
 2016-07-26 21:16:12 -07:00
Arun Suresh
df509a8066 YARN-5392. Replace use of Priority in the Scheduling infrastructure with an opaque ShedulerRequestKey. (asuresh and subru) 
(cherry picked from commit 5aace38b748ba71aaadd2c4d64eba8dc1f816828)
 2016-07-26 14:58:54 -07:00
Rohith Sharma K S
eff65463de YARN-5092. TestRMDelegationTokens fails intermittently. Contributed by Jason Lowe. 
(cherry picked from commit 557a245d83c358211f51b3ab1950d707a70679d9)
 2016-07-21 12:49:06 +05:30
Akira Ajisaka
2bf5c4eb1a YARN-4883. Make consistent operation name in AdminService. Contributed by Kai Sasaki. 
(cherry picked from commit c63afdbe14df7359841aa4b213252a8a275e8c4b)
 2016-07-20 16:51:44 -07:00
Vinod Kumar Vavilapalli
5641c28c1c YARN-5340. Fixed a race condition in RollingLevelDBTimelineStore that caused loss of Timeline events. Contributed by Li Lu. 
(cherry picked from commit 1c9d2ab503ea5a3f16757351af9603041059b390)
 2016-07-20 08:38:56 -07:00
Arun Suresh
586cd0daa1 YARN-5350. Distributed Scheduling: Ensure sort order of allocatable nodes returned by the RM is not lost. (asuresh) 
(cherry picked from commit 8fbe6ece24e38ee24fee0abdbed5f7dc5d3c16da)
 2016-07-19 23:22:47 -07:00
Varun Saxena
2153c9f04c YARN-4996. Make TestNMReconnect.testCompareRMNodeAfterReconnect() scheduler agnostic (Kai Sasaki via Varun Saxena) 2016-07-19 16:07:56 +05:30
Ray Chiang
66a501be5e YARN-5272. Handle queue names consistently in FairScheduler. (Wilfred Spiegelenburg via rchiang) 
(cherry picked from commit 2df1b1e72b18422606e38a9fbe311988637cb9a5)
 2016-07-15 14:39:28 -07:00
Arun Suresh
9d31c0b53f YARN-5181. ClusterNodeTracker: add method to get list of nodes matching a specific resourceName. (kasha via asuresh) 
(cherry picked from commit e905a42a2c6c88210b5c2120d7daf0bb3739cd1d)
 2016-07-15 14:38:26 -07:00
Wangda Tan
e34e1aa4fe YARN-4484. Available Resource calculation for a queue is not correct when used with labels. (Sunil G via wangda) 
(cherry picked from commit 24db9167f16ba643a186624b33a6b9b80020f476)
 2016-07-15 11:41:35 -07:00
Varun Saxena
8b0337b499 YARN-5383. Fix findbugs and checkstyle issues in ContainerExecutor. (Vrushali C via Varun Saxena) 2016-07-15 23:30:36 +05:30
Akira Ajisaka
6664077727 YARN-5159. Wrong Javadoc tag in MiniYarnCluster. Contributed by Andras Bokor. 
(cherry picked from commit 6cf017558a3d06240b95d1b56c953591ece97c92)
 2016-07-14 10:45:39 -07:00