Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
17,065 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

4068 Commits

Author SHA1 Message Date
Daniel Templeton 9bcc9e3f4d YARN-7458. TestContainerManagerSecurity is still flakey 
(Contributed by Robert Kanter via Daniel Templeton)

Change-Id: Ibb1975ad086c3a33f8af0b4f8b9a13c3cdca3f7d
(cherry picked from commit 49b4c0b334)
 2017-11-08 17:32:34 -08:00
Daniel Templeton d2b16e3e83 YARN-7166. Container REST endpoints should report resource types 
Change-Id: If9c2fe58d4cf758bb6b6cf363dc01f35f8720987
(cherry picked from commit 0de10680b7)
 2017-11-08 16:51:20 -08:00
Arun Suresh 91e726c07f YARN-7453. Fix issue where RM fails to switch to active after first successful start. (Rohith Sharma K S via asuresh) 
(cherry picked from commit a9c70b0e84)
 2017-11-08 08:01:54 -08:00
Daniel Templeton 4e7b5824b4 YARN-7401. Reduce lock contention in ClusterNodeTracker#getClusterCapacity() 
(cherry picked from commit 8db9d61ac2)
 2017-11-07 14:58:56 -08:00
Haibo Chen 91e95dc484 YARN-7360. TestRM.testNMTokenSentForNormalContainer() should be scheduler agnostic. 
(cherry picked from commit 8f214dc4f8)
 2017-11-06 15:54:14 -08:00
Wangda Tan df27824b80 YARN-7410. Cleanup FixedValueResource to avoid dependency to ResourceUtils. (wangda) 2017-11-06 15:26:49 -08:00
Wangda Tan 170b6a48c4 YARN-7307. Allow client/AM update supported resource types via YARN APIs. (Sunil G via wangda) 2017-11-06 10:01:10 -08:00
bibinchundatt e49509f024 Add containerId to Localizer failed logs. Contributed by Prabhu Joseph 
(cherry picked from commit dcd99c4b9a)
 2017-11-06 23:07:16 +05:30
Inigo Goiri 3e70fd9af0 YARN-7434. Router getApps REST invocation fails with multiple RMs. Contributed by Inigo Goiri. 
(cherry picked from commit 6e2259264ad9525eeec2a14055d53236711659d7)
 2017-11-02 21:30:20 -07:00
Subru Krishnan 1b6de3fac5 YARN-7432. Fix DominantResourceFairnessPolicy serializable findbugs issues. (Daniel Templeton via Subru). 
(cherry picked from commit ad0fff2b41)
 2017-11-02 17:40:03 -07:00
Eric Payne 3d923d66e8 YARN-7370: Preemption properties should be refreshable. Contrubted by Gergely Novák. 
(cherry picked from commit e6ec02001f)
 2017-11-02 12:48:07 -05:00
Wangda Tan fb442e9a7c YARN-7364. Queue dash board in new YARN UI has incorrect values. (Sunil G via wangda) 
Change-Id: Ia5336f407147d2985a61b5f9f1e69b5b35f398a4
(cherry picked from commit 752f000e0f)
 2017-11-02 09:50:57 -07:00
Jason Lowe b7dee1f060 YARN-7286. Add support for docker to have no capabilities. Contributed by Eric Badger 
(cherry picked from commit d00b6f7c1f)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/linux/runtime/TestDockerContainerRuntime.java
 2017-11-02 09:47:26 -05:00
Rohith Sharma K S 9efe9bd3d8 addendum patch for YARN-7289. 
(cherry picked from commit 940ffe3f9c)
 2017-11-02 14:02:48 +05:30
Eric Yang be7cfe57fc YARN-7412. Fix unit test for docker mount check on ubuntu. (Contributed by Eric Badger) 2017-11-01 18:45:24 -04:00
Junping Du 552f74e6b7 YARN-7400. Incorrect log preview displayed in jobhistory server ui. Contributed by Xuan Gong. 
(cherry picked from commit d57dba9942)
 2017-11-01 15:02:50 -07:00
Inigo Goiri 08c3efa4a0 YARN-7276. Federation Router Web Service fixes. Contributed by Inigo Goiri. 
(cherry picked from commit 8be5707067)
 2017-11-01 13:42:12 -07:00
Inigo Goiri 8d41875219 YARN-7276 addendum to add timeline service depencies. Contributed by Inigo Goiri. 
(cherry picked from commit 70f1a9470c)
 2017-11-01 13:28:50 -07:00
Daniel Templeton c025c9ac62 YARN-7336. Unsafe cast from long to int Resource.hashCode() method 
(Contributed by Miklos Szegedi via Daniel Templeton)

(cherry picked from commit d64736d589)
 2017-10-31 15:06:18 -07:00
Daniel Templeton 7689d4781a YARN-6927. Add support for individual resource types requests in MapReduce 
(Contributed by Gergo Repas via Daniel Templeton)

(cherry picked from commit 9a7e810838)
 2017-10-31 15:06:18 -07:00
Daniel Templeton 77401022a7 YARN-7374. Improve performance of DRF comparisons for resource types in fair scheduler 
(cherry picked from commit 9711b78998)
 2017-10-31 15:06:18 -07:00
Daniel Templeton ab93bf5b00 YARN-7397. Reduce lock contention in FairScheduler#getAppWeight() 
(cherry picked from commit e62bbbca7a)
 2017-10-31 15:06:18 -07:00
Daniel Templeton c818c85238 YARN-6984. DominantResourceCalculator.isAnyMajorResourceZero() should test all resources 
(Contributed by Sunil G via Daniel Templeton)

(cherry picked from commit 679f99b145)
 2017-10-31 15:06:18 -07:00
Daniel Templeton 68585156dc YARN-7270 addendum: Reapplied changes after YARN-3926 backports 2017-10-31 15:06:18 -07:00
Wangda Tan 6f41843906 YARN-7172. ResourceCalculator.fitsIn() should not take a cluster resource parameter. (Sen Zhao via wangda) 
Change-Id: Icc3670c9381ce7591ca69ec12da5aa52d3612d34
(cherry picked from commit e81596d06d)
 2017-10-31 15:06:18 -07:00
Yufei Gu f30f78a736 YARN-6612. Update fair scheduler policies to be aware of resource types. (Contributed by Daniel Templeton via Yufei Gu) 
(cherry picked from commit 09b476e6da)
 2017-10-31 15:06:18 -07:00
Sunil G 74030d808c YARN-7137. [YARN-3926] Move newly added APIs to unstable in YARN-3926 branch. Contributed by Wangda Tan. 
(cherry picked from commit da0b6a354b)
 2017-10-31 15:06:17 -07:00
Daniel Templeton 0db9ddb728 YARN-7136. Additional Performance Improvement for Resource Profile Feature 
(Contributed by Wangda Tan via Daniel Templeton)

(cherry picked from commit bf2b687412)
 2017-10-31 15:06:17 -07:00
Wangda Tan 335e3a6334 YARN-7056. [Partial backport] Document Resource Profiles feature. (Sunil G via wangda) 
Change-Id: I5f5d52cdf7aba4ac09684aab573e6916dbad183e
(cherry picked from commit 6b88cd1901)
 2017-10-31 15:06:17 -07:00
Sunil G 4bf29910a8 YARN-6933. [YARN-3926] ResourceUtils.DISALLOWED_NAMES check is duplicated. Contributed by Manikandan R. 
(cherry picked from commit 805095496d)
 2017-10-31 15:06:17 -07:00
Wangda Tan 00fcc8593b YARN-7093. Improve log message in ResourceUtils. (Sunil G via wangda) 
Change-Id: I88928a747ee3eec17bc76fb71e9aaa632d091f0f
(cherry picked from commit 53df3eac50)
 2017-10-31 15:06:17 -07:00
Wangda Tan 57bbdbeb80 YARN-7039. Fix javac and javadoc errors in YARN-3926 branch. (Sunil G via wangda) 
Change-Id: I442bf6d838b3aba83f1f6779cf9dcf8596a2102d
(cherry picked from commit e490602e9b)
 2017-10-31 15:06:17 -07:00
Sunil G 5dd008ca2e YARN-7067. [YARN-3926] Optimize ResourceType information display in UI. Contributed by Wangda Tan. 
(cherry picked from commit a333ba54e3)
 2017-10-31 15:06:17 -07:00
Wangda Tan 605fcde012 YARN-7043. [Partial backport] Cleanup ResourceProfileManager. (wangda) 
Change-Id: I463356f37bf1f6a3f1fc3c594c79916e8c0ab913
(cherry picked from commit 39240b61a1)
 2017-10-31 15:06:17 -07:00
Sunil G f2b881a505 YARN-6781. [YARN-3926] ResourceUtils#initializeResourcesMap takes an unnecessary Map parameter. Contributed by Yu-Tang Lin. 
(cherry picked from commit 758b771943)
 2017-10-31 15:06:17 -07:00
Wangda Tan 4af3deaeb0 YARN-6789. Add Client API to get all supported resource types from RM. (Sunil G via wangda) 
Change-Id: I366d8db6f6700acd087db5acb7a1be7e41b2b68d
(cherry picked from commit df3855541a)
 2017-10-31 15:06:17 -07:00
Wangda Tan 255668a2a6 YARN-7042. Clean up unit tests after YARN-6610. (Daniel Templeton via wangda) 
Change-Id: I8e40f704b6fcdd5b14faa9548a27986501044fa1
(cherry picked from commit b1fe3a222e)
 2017-10-31 15:06:17 -07:00
Sunil G 8827d93ca1 YARN-7030. [YARN-3926] Performance optimizations in Resource and ResourceUtils class. Contributed by Wangda Tan. 
(cherry picked from commit a6989af1d9)
 2017-10-31 15:06:17 -07:00
Sunil G 1ba85a9305 YARN-6610. [YARN-3926] DominantResourceCalculator#getResourceAsValue dominant param is updated to handle multiple resources. Contributed by Daniel Templeton. 
(cherry picked from commit a0030c8c6f)
 2017-10-31 15:06:17 -07:00
Sunil G 5231c43bdb YARN-6892. [YARN-3926] Improve API implementation in Resources and DominantResourceCalculator class. Contributed by Sunil G. 
(cherry picked from commit 2b51b262ab)
 2017-10-31 15:06:16 -07:00
Yufei Gu 9c4505f3fa YARN-6994. [YARN-3926] Remove last uses of Long from resource types code. (Daniel Templeton via Yufei Gu) 
(cherry picked from commit d5e9939ebb)
 2017-10-31 15:06:16 -07:00
Daniel Templeton 99c292403d YARN-6788. [YARN-3926] Improve performance of resource profile branch 
(Contributed by Sunil Govindan via Daniel Templeton)

(cherry picked from commit 3aeaafecb8)
 2017-10-31 15:06:16 -07:00
Sunil G 58f2c07028 YARN-6786. [YARN-3926] ResourcePBImpl imports cleanup. Contributed by Yeliang Cang. 
(cherry picked from commit 4e5632d28e)
 2017-10-31 15:06:16 -07:00
Sunil G 5fa0dc35c3 YARN-6761. Fix build for YARN-3926 branch. Contributed by Varun Vasudev. 
(cherry picked from commit ca2808d8bb)
 2017-10-31 15:06:16 -07:00
Sunil G 48ddb8f5b4 YARN-6445. [YARN-3926] Performance improvements in resource profile branch with respect to SLS. Contributed by Varun Vasudev. 
(cherry picked from commit 58da54640e)
 2017-10-31 15:06:16 -07:00
Sunil G bda5486dad YARN-6232. Update resource usage and preempted resource calculations to take into account all resource types. Contributed by Varun Vasudev. 
(cherry picked from commit dae65f3bef)
 2017-10-31 15:06:16 -07:00
Sunil G 4045ef047d YARN-5588. [Partial backport] [YARN-3926] Add support for resource profiles in distributed shell. Contributed by Varun Vasudev. 
(cherry picked from commit 7805deed48)
 2017-10-31 15:06:16 -07:00
Arun Suresh a9fa0349a0 YARN-5587. [Partial backport] Add support for resource profiles. (vvasudev via asuresh) 
(cherry picked from commit 6708ac3301)
 2017-10-31 15:06:16 -07:00
Rohith Sharma K S 3d1b59e04a YARN-5586. Update the Resources class to consider all resource types. Contributed by Varun Vasudev. 
(cherry picked from commit 239c1824a0)
 2017-10-31 15:06:16 -07:00
Rohith Sharma K S feb6d00e2a YARN-5242. Update DominantResourceCalculator to consider all resource types in calculations. Contributed by Varun Vasudev. 
(cherry picked from commit 9e4ba6aff5)
 2017-10-31 15:06:16 -07:00