Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
12,514 Commits 326 Branches 371 Tags
Commit Graph

3019 Commits

Author SHA1 Message Date
Jian He
9942ca2bf0 YARN-3141. Improve locks in SchedulerApplicationAttempt/FSAppAttempt/FiCaSchedulerApp. Contributed by Wangda Tan 
(cherry picked from commit b8a30f2f170ffbd590e7366c3c944ab4919e40df)
 2016-09-19 17:08:57 +08:00
Arun Suresh
dfaac56433 YARN-5637. Changes in NodeManager to support Container rollback and commit. (asuresh) 
(cherry picked from commit 3552c2b99dff4f21489ff284f9dcba40e897a1e5)
 2016-09-18 11:06:38 -07:00
Arun Suresh
00759f50be YARN-5657. Fix TestDefaultContainerExecutor. (asuresh) 
(cherry picked from commit f67237cbe7bc48a1b9088e990800b37529f1db2a)
 2016-09-17 09:32:55 -07:00
Naganarasimha
20729ead91 YARN-5642. Typos in 9 log messages. Contributed by Mehran Hassani 2016-09-17 10:37:42 +05:30
Naganarasimha
656b520dc6 YARN-4232. TopCLI console support for HA mode. Contributed by Bibin A Chundatt 
(cherry picked from commit ade7c2bc9ccf09d843ccb3dfa56c1453a9e87318)
 2016-09-17 09:54:29 +05:30
Wangda Tan
ee101e49fa YARN-4091. Add REST API to retrieve scheduler activity. (Chen Ge via wangda) 2016-09-15 14:49:03 -07:00
Arun Suresh
16aecc699d YARN-5620. Core changes in NodeManager to support re-initialization of Containers with new launchContext. (asuresh) 
(cherry picked from commit 40b5a59b726733df456330a26f03d5174cc0bc1c)
 2016-09-15 08:11:14 -07:00
Jason Lowe
4f2f0eb0bb YARN-5630. NM fails to start after downgrade from 2.8 to 2.7. Contributed by Jason Lowe 
(cherry picked from commit e7933097354a246b080b46f1a4ca2ef0f39f3b38)
 2016-09-13 14:43:21 +00:00
Rohith Sharma K S
8c8ff0cfa3 YARN-5631. Missing refreshClusterMaxPriority usage in rmadmin help message. Contributed by Kai Sasaki. 
(cherry picked from commit 729de3e6b6ae1fcfe1c6bec7102d758ad489df47)
 2016-09-13 15:27:20 +05:30
Karthik Kambatla
a064375e68 YARN-5616. Clean up WeightAdjuster. (Yufei Gu via kasha) 
(cherry picked from commit c0e492e50fa98d423c8a61c94d2d1f9553558b6d)
 2016-09-06 22:40:49 -07:00
Varun Vasudev
ec3a651b17 YARN-5576. Allow resource localization while container is running. Contributed by Jian He. 2016-09-06 20:07:54 +05:30
Rohith Sharma K S
de9f046598 YARN-5608. TestAMRMClient.setup() fails with ArrayOutOfBoundsException. Contributed by Daniel Templeton. 
(cherry picked from commit f9557127b3660e138cab8d9535a589677809384a)
 2016-09-06 14:13:41 +05:30
Karthik Kambatla
a5748eec7b YARN-5264. Store all queue-specific information in FSQueue. (Yufei Gu via kasha) 
(cherry picked from commit f6ea9be5473ab66798b0536317d2f32c5348eb57)
 2016-09-02 15:02:20 -07:00
Ray Chiang
4ee1729cb0 YARN-5549. AMLauncher#createAMContainerLaunchContext() should not log the command to be launched indiscriminately. (Daniel Templeton via rchiang) 2016-09-02 14:57:05 -07:00
Varun Vasudev
1222433729 YARN-5555. Scheduler UI: "% of Queue" is inaccurate if leaf queue is hierarchically nested. Contributed by Eric Payne. 
(cherry picked from commit 05f5c0f631680cffc36a79550c351620615445db)

 Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/common/fica/FiCaSchedulerApp.java
 2016-09-02 16:16:31 +05:30
Karthik Kambatla
736dd1646d YARN-5566. Client-side NM graceful decom is not triggered when jobs finish. (Robert Kanter via kasha) 
(cherry picked from commit 74f4bae45597f4794e99e33309130ddff647b21f)
 2016-09-01 14:44:41 -07:00
Varun Vasudev
34f9330651 YARN-5596. Fix failing unit test in TestDockerContainerRuntime. Contributed by Sidharta Seethana. 
(cherry picked from commit 08f55ccbb075b90a6e534f4ac0f9840f2e6890d5)
 2016-09-01 14:10:18 +05:30
Arun Suresh
b279f42d79 YARN-5221. Expose UpdateResourceRequest API to allow AM to request for change in container properties. (asuresh) 
(cherry picked from commit d6d9cff21b7b6141ed88359652cf22e8973c0661)
 2016-08-30 16:33:31 -07:00
Zhe Zhang
3ad4f0823c YARN-5550. TestYarnCLI#testGetContainers should format according to CONTAINER_PATTERN. Contributed by Jonathan Hung. 
(cherry picked from commit ed6ff5cd789cab621fbfb88c8e8de4f215cd2961)
 2016-08-29 14:49:03 -07:00
Jason Lowe
eeb18b0a46 YARN-5560. Clean up bad exception catching practices in TestYarnClient. Contributed by Sean Po 
(cherry picked from commit 4cbe61407dcb71f099bc7ec6ae87560d786ee714)
 2016-08-29 16:15:55 +00:00
Wangda Tan
07e1527cc1 YARN-4889. Changes in AMRMClient for identifying resource-requests explicitly. (Arun Suresh via wangda) 
(cherry picked from commit 19c743c1bbcaf3df8f1d63e557143c960a538c42)
 2016-08-26 17:23:55 -07:00
Subru Krishnan
3ad7cb3e1c YARN-5327. API changes required to support recurring reservations in the YARN ReservationSystem. (Sangeetha Abdu Jyothi via Subru). 
(cherry picked from commit b930dc3ec06afa479a249490976e3e127d201706)
 2016-08-26 17:01:37 -07:00
Karthik Kambatla
d9b42248de YARN-5373. NPE listing wildcard directory in containerLaunch. (Daniel Templeton via kasha) 
(cherry picked from commit cde3a00526c562a500308232e2b93498d22c90d7)
 2016-08-26 11:08:16 -07:00
Junping Du
af1502fcab YARN-5557. Add localize API to the ContainerManagementProtocol. Contributed by Jian He. 
(cherry picked from commit 9ef632f3b0b0e0808116cd1c7482a205b7ebef7d)
 2016-08-26 09:05:33 -07:00
Naganarasimha
026027166e YARN-3940. Application moveToQueue should check NodeLabel permission. Contributed by Bibin A Chundatt 
(cherry picked from commit 46e02ab719d06f2708c0a61e8011b8f261235193)
 2016-08-26 20:23:01 +05:30
Varun Vasudev
49a97a76f5 YARN-5430. Return container's ip and host from NM ContainerStatus call. Contributed by Jian He. 2016-08-26 16:33:21 +05:30
Naganarasimha
ee3358402a YARN-5564. Fix typo in RM_SCHEDULER_RESERVATION_THRESHOLD_INCREMENT_MULTIPLE. Contributed by Ray Chiang 
(cherry picked from commit 27c3b86252386c9c064a6420b3c650644cbb9ef3)
 2016-08-26 08:53:42 +05:30
Jason Lowe
4037b22b7c YARN-5389. TestYarnClient#testReservationDelete fails. Contributed by Sean Po 2016-08-25 15:10:23 +00:00
Jason Lowe
6de262cdc4 Revert "YARN-5389. TestYarnClient#testReservationDelete fails. Contributed by Sean Po" 
This reverts commit 782aeabcd55b1e1e933f0b924633d68662b50765.
 2016-08-25 14:59:20 +00:00
Jason Lowe
782aeabcd5 YARN-5389. TestYarnClient#testReservationDelete fails. Contributed by Sean Po 
(cherry picked from commit 3d86110a5ccfdaff8671fb6ad8f67b4ab66f33da)
 2016-08-25 14:47:40 +00:00
Varun Vasudev
952c309dd9 YARN-5042. Mount /sys/fs/cgroup into Docker containers as read only mount. Contributed by luhuichun. 
(cherry picked from commit 42d9876471ff0bf0ea240cd48fe483cda8aa1ec7)
 2016-08-25 14:18:12 +05:30
Varun Saxena
42feab2436 YARN-5537. Fix intermittent failure of TestAMRMClient#testAMRMClientWithContainerResourceChange (Bibin A Chundatt via Varun Saxena) 2016-08-25 14:12:28 +05:30
Arun Suresh
bd348d20b2 Revert "YARN-5049. Extend NMStateStore to save queued container information. (Konstantinos Karanasos via asuresh)" 
This reverts commit 307cda70dbde6a8e377794b395a0d958603df5d7.
 2016-08-24 10:23:06 -07:00
Naganarasimha
5fa241daa0 YARN-4491. yarn list command to support filtering by tags. Contributed by Varun Saxena 
(cherry picked from commit 143c59e4c5a811eb2c12cf6626d558f9b8796e03)
 2016-08-24 01:55:24 +05:30
Rohith Sharma K S
a19859c3f5 YARN-5544. TestNodeBlacklistingOnAMFailures fails on trunk. Contributed by Sunil G. 
(cherry picked from commit 0d5997d2b98eb89e72828dfcd78f02aa4e7e1e67)
 2016-08-23 14:39:19 +05:30
Wangda Tan
3e511f39c2 YARN-4685. Disable AM blacklisting by default to mitigate situations that application get hanged. (Rohith Sharma K S via wangda) 
(cherry picked from commit 2da32a6ef9edebd86ca9672d10ce35b5a46818cc)
 2016-08-19 16:47:42 -07:00
Wangda Tan
c7d782d2f6 YARN-3388. Allocation in LeafQueue could get stuck because DRF calculator isn't well supported when computing user-limit. (Nathan Roberts via wangda) 
(cherry picked from commit 444b2ea7afebf9f6c3d356154b71abfd0ea95b23)
 2016-08-19 16:47:03 -07:00
Varun Saxena
928cccb9f9 YARN-5533. JMX AM Used metrics for queue wrong when app submited to nodelabel partition (Bibin A Chundatt via Varun Saxena) 2016-08-19 17:32:23 +05:30
Varun Saxena
a746775e9a Revert "YARN-5533. JMX AM Used metrics for queue wrong when app submited to nodelabel partition (Bibin A Chundatt via Varun Saxena)" 
This reverts commit 613048a8a24fe08554d2fcdd8b5bc57f7aadaf2f.
 2016-08-19 16:40:48 +05:30
Varun Saxena
613048a8a2 YARN-5533. JMX AM Used metrics for queue wrong when app submited to nodelabel partition (Bibin A Chundatt via Varun Saxena) 2016-08-19 15:18:42 +05:30
Junping Du
d464483bf7 YARN-4676. Automatic and Asynchronous Decommissioning Nodes Status Tracking. Contributed by Diniel Zhi. 2016-08-18 07:23:29 -07:00
Varun Saxena
5fa7a14da9 YARN=5526. DrainDispacher#serviceStop blocked if setDrainEventsOnStop invoked (sandflee via Varun Saxena) 2016-08-18 12:23:34 +05:30
Karthik Kambatla
07d5ab16df YARN-4702. FairScheduler: Allow setting maxResources for ad hoc queues. (Daniel Templeton via kasha) 
(cherry picked from commit 20f0eb871c57cc4c5a6d19aae0e3745b6175509b)
 2016-08-17 17:54:28 -07:00
Varun Saxena
9dcb7197d4 YARN-5523. Yarn running container log fetching causes OutOfMemoryError (Xuan Gong via Varun Saxena) 2016-08-18 01:53:55 +05:30
Varun Vasudev
3ee1fb774e YARN-5455. Update Javadocs for LinuxContainerExecutor. Contributed by Daniel Templeton. 
(cherry picked from commit 7f05ff7a4e654693eaaa216ee5fc6e24112e0e23)
 2016-08-17 15:35:23 +05:30
Varun Saxena
96e9f8bec9 YARN-5475. Fix test failure of TestAggregatedLogFormat#testReadAcontainerLogs1 (Jun Gong via Varun Saxena) 2016-08-16 20:28:02 +05:30
Varun Saxena
da70d6f25d YARN-5514. Clarify DecommissionType.FORCEFUL comment (Vrushali C via Varun Saxena) 2016-08-16 14:09:47 +05:30
Varun Saxena
354afbb9df YARN-5521. Fix random failure of TestCapacityScheduler#testKillAllAppsInQueue (sandflee via Varun Saxena) 2016-08-16 00:04:40 +05:30
Varun Saxena
3c7cf5cd77 YARN-5491. Fix random failure of TestCapacityScheduler#testCSQueueBlocked (Bibin A Chundatt via Varun Saxena) 2016-08-15 03:56:31 +05:30
Varun Saxena
918a0f12fa YARN-5476. Non existent application reported as ACCEPTED by YarnClientImpl (Junping Du via Varun Saxena) 2016-08-13 00:19:00 +05:30