Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
17,033 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

17033 Commits

Author SHA1 Message Date
Inigo Goiri 8d41875219 YARN-7276 addendum to add timeline service depencies. Contributed by Inigo Goiri. 
(cherry picked from commit 70f1a9470c)
 2017-11-01 13:28:50 -07:00
Weiwei Yang b2f717d967 HDFS-12744. More logs when short-circuit read is failed and disabled. Contributed by Weiwei Yang. 
(cherry picked from commit 56b88b0670)
 2017-11-01 16:53:07 +08:00
Yiqun Lin 5cada4564a
HDFS-12219. Javadoc for FSNamesystem#getMaxObjects is incorrect. Contributed by Erik Krogen. 
(cherry picked from commit 20304b91cc)
 2017-11-01 16:43:44 +09:00
John Zhuge 0ec172b42f HDFS-12714. Hadoop 3 missing fix for HDFS-5169. Contributed by Joe McDonnell. 
(cherry picked from commit b8c8b5bc27)
 2017-10-31 22:46:26 -07:00
Lei Xu 9ee04006cb HDFS-12482. Provide a configuration to adjust the weight of EC recovery tasks to adjust the speed of recovery. (lei) 2017-10-31 22:03:44 -07:00
Daniel Templeton c025c9ac62 YARN-7336. Unsafe cast from long to int Resource.hashCode() method 
(Contributed by Miklos Szegedi via Daniel Templeton)

(cherry picked from commit d64736d589)
 2017-10-31 15:06:18 -07:00
Daniel Templeton 7689d4781a YARN-6927. Add support for individual resource types requests in MapReduce 
(Contributed by Gergo Repas via Daniel Templeton)

(cherry picked from commit 9a7e810838)
 2017-10-31 15:06:18 -07:00
Daniel Templeton 77401022a7 YARN-7374. Improve performance of DRF comparisons for resource types in fair scheduler 
(cherry picked from commit 9711b78998)
 2017-10-31 15:06:18 -07:00
Daniel Templeton ab93bf5b00 YARN-7397. Reduce lock contention in FairScheduler#getAppWeight() 
(cherry picked from commit e62bbbca7a)
 2017-10-31 15:06:18 -07:00
Daniel Templeton c818c85238 YARN-6984. DominantResourceCalculator.isAnyMajorResourceZero() should test all resources 
(Contributed by Sunil G via Daniel Templeton)

(cherry picked from commit 679f99b145)
 2017-10-31 15:06:18 -07:00
Daniel Templeton 68585156dc YARN-7270 addendum: Reapplied changes after YARN-3926 backports 2017-10-31 15:06:18 -07:00
Wangda Tan 6f41843906 YARN-7172. ResourceCalculator.fitsIn() should not take a cluster resource parameter. (Sen Zhao via wangda) 
Change-Id: Icc3670c9381ce7591ca69ec12da5aa52d3612d34
(cherry picked from commit e81596d06d)
 2017-10-31 15:06:18 -07:00
Yufei Gu f30f78a736 YARN-6612. Update fair scheduler policies to be aware of resource types. (Contributed by Daniel Templeton via Yufei Gu) 
(cherry picked from commit 09b476e6da)
 2017-10-31 15:06:18 -07:00
Sunil G 74030d808c YARN-7137. [YARN-3926] Move newly added APIs to unstable in YARN-3926 branch. Contributed by Wangda Tan. 
(cherry picked from commit da0b6a354b)
 2017-10-31 15:06:17 -07:00
Daniel Templeton 0db9ddb728 YARN-7136. Additional Performance Improvement for Resource Profile Feature 
(Contributed by Wangda Tan via Daniel Templeton)

(cherry picked from commit bf2b687412)
 2017-10-31 15:06:17 -07:00
Wangda Tan 335e3a6334 YARN-7056. [Partial backport] Document Resource Profiles feature. (Sunil G via wangda) 
Change-Id: I5f5d52cdf7aba4ac09684aab573e6916dbad183e
(cherry picked from commit 6b88cd1901)
 2017-10-31 15:06:17 -07:00
Sunil G 4bf29910a8 YARN-6933. [YARN-3926] ResourceUtils.DISALLOWED_NAMES check is duplicated. Contributed by Manikandan R. 
(cherry picked from commit 805095496d)
 2017-10-31 15:06:17 -07:00
Wangda Tan 00fcc8593b YARN-7093. Improve log message in ResourceUtils. (Sunil G via wangda) 
Change-Id: I88928a747ee3eec17bc76fb71e9aaa632d091f0f
(cherry picked from commit 53df3eac50)
 2017-10-31 15:06:17 -07:00
Wangda Tan 57bbdbeb80 YARN-7039. Fix javac and javadoc errors in YARN-3926 branch. (Sunil G via wangda) 
Change-Id: I442bf6d838b3aba83f1f6779cf9dcf8596a2102d
(cherry picked from commit e490602e9b)
 2017-10-31 15:06:17 -07:00
Sunil G 5dd008ca2e YARN-7067. [YARN-3926] Optimize ResourceType information display in UI. Contributed by Wangda Tan. 
(cherry picked from commit a333ba54e3)
 2017-10-31 15:06:17 -07:00
Wangda Tan 605fcde012 YARN-7043. [Partial backport] Cleanup ResourceProfileManager. (wangda) 
Change-Id: I463356f37bf1f6a3f1fc3c594c79916e8c0ab913
(cherry picked from commit 39240b61a1)
 2017-10-31 15:06:17 -07:00
Sunil G f2b881a505 YARN-6781. [YARN-3926] ResourceUtils#initializeResourcesMap takes an unnecessary Map parameter. Contributed by Yu-Tang Lin. 
(cherry picked from commit 758b771943)
 2017-10-31 15:06:17 -07:00
Wangda Tan 4af3deaeb0 YARN-6789. Add Client API to get all supported resource types from RM. (Sunil G via wangda) 
Change-Id: I366d8db6f6700acd087db5acb7a1be7e41b2b68d
(cherry picked from commit df3855541a)
 2017-10-31 15:06:17 -07:00
Wangda Tan 255668a2a6 YARN-7042. Clean up unit tests after YARN-6610. (Daniel Templeton via wangda) 
Change-Id: I8e40f704b6fcdd5b14faa9548a27986501044fa1
(cherry picked from commit b1fe3a222e)
 2017-10-31 15:06:17 -07:00
Sunil G 8827d93ca1 YARN-7030. [YARN-3926] Performance optimizations in Resource and ResourceUtils class. Contributed by Wangda Tan. 
(cherry picked from commit a6989af1d9)
 2017-10-31 15:06:17 -07:00
Sunil G 1ba85a9305 YARN-6610. [YARN-3926] DominantResourceCalculator#getResourceAsValue dominant param is updated to handle multiple resources. Contributed by Daniel Templeton. 
(cherry picked from commit a0030c8c6f)
 2017-10-31 15:06:17 -07:00
Sunil G 5231c43bdb YARN-6892. [YARN-3926] Improve API implementation in Resources and DominantResourceCalculator class. Contributed by Sunil G. 
(cherry picked from commit 2b51b262ab)
 2017-10-31 15:06:16 -07:00
Yufei Gu 9c4505f3fa YARN-6994. [YARN-3926] Remove last uses of Long from resource types code. (Daniel Templeton via Yufei Gu) 
(cherry picked from commit d5e9939ebb)
 2017-10-31 15:06:16 -07:00
Daniel Templeton 99c292403d YARN-6788. [YARN-3926] Improve performance of resource profile branch 
(Contributed by Sunil Govindan via Daniel Templeton)

(cherry picked from commit 3aeaafecb8)
 2017-10-31 15:06:16 -07:00
Sunil G 58f2c07028 YARN-6786. [YARN-3926] ResourcePBImpl imports cleanup. Contributed by Yeliang Cang. 
(cherry picked from commit 4e5632d28e)
 2017-10-31 15:06:16 -07:00
Sunil G 5fa0dc35c3 YARN-6761. Fix build for YARN-3926 branch. Contributed by Varun Vasudev. 
(cherry picked from commit ca2808d8bb)
 2017-10-31 15:06:16 -07:00
Sunil G 48ddb8f5b4 YARN-6445. [YARN-3926] Performance improvements in resource profile branch with respect to SLS. Contributed by Varun Vasudev. 
(cherry picked from commit 58da54640e)
 2017-10-31 15:06:16 -07:00
Sunil G bda5486dad YARN-6232. Update resource usage and preempted resource calculations to take into account all resource types. Contributed by Varun Vasudev. 
(cherry picked from commit dae65f3bef)
 2017-10-31 15:06:16 -07:00
Sunil G 4045ef047d YARN-5588. [Partial backport] [YARN-3926] Add support for resource profiles in distributed shell. Contributed by Varun Vasudev. 
(cherry picked from commit 7805deed48)
 2017-10-31 15:06:16 -07:00
Arun Suresh a9fa0349a0 YARN-5587. [Partial backport] Add support for resource profiles. (vvasudev via asuresh) 
(cherry picked from commit 6708ac3301)
 2017-10-31 15:06:16 -07:00
Rohith Sharma K S 3d1b59e04a YARN-5586. Update the Resources class to consider all resource types. Contributed by Varun Vasudev. 
(cherry picked from commit 239c1824a0)
 2017-10-31 15:06:16 -07:00
Rohith Sharma K S feb6d00e2a YARN-5242. Update DominantResourceCalculator to consider all resource types in calculations. Contributed by Varun Vasudev. 
(cherry picked from commit 9e4ba6aff5)
 2017-10-31 15:06:16 -07:00
Varun Vasudev 16beac12ad YARN-4830. Add support for resource types in the nodemanager. Contributed by Varun Vasudev. 
(cherry picked from commit 759114b006)
 2017-10-31 15:06:16 -07:00
Arun Suresh 92ca475fdc YARN-4829. Add support for binary units in Resource class.(vvasudev via asuresh) 
(cherry picked from commit 7ba698997b)
 2017-10-31 15:06:16 -07:00
Varun Vasudev f1f9b83e4c YARN-4715. Add support to read resource types from a config file. Contributed by Varun Vasudev. 
(cherry picked from commit ceb12c59a3)
 2017-10-31 15:06:15 -07:00
Wangda Tan 33fabe1e10 YARN-4172. Extend DominantResourceCalculator to account for all resources. (Varun Vasudev via wangda) 
(cherry picked from commit 32c91223f1)
 2017-10-31 15:06:15 -07:00
Wangda Tan 68da5218b7 YARN-4081. Add support for multiple resource types in the Resource class. (Varun Vasudev via wangda) 
(cherry picked from commit 1bbab7c157)
 2017-10-31 15:06:15 -07:00
Chris Douglas b5f66b005c Revert "HDFS-7878. API - expose a unique file identifier." 
This reverts commit 1ce0eb7d23.
 2017-10-31 13:56:41 -07:00
Carlo Curino 1fbc72704e YARN-3661. Basic Federation UI. (Contributed by Inigo Goiri via curino) 
(cherry picked from commit ceca9694f9)
 2017-10-31 13:42:36 -07:00
Haibo Chen e785e83270 YARN-7389. Make TestResourceManager Scheduler agnostic. (Robert Kanter via Haibo Chen) 
(cherry picked from commit d7f3737f3b)
 2017-10-31 13:41:44 -07:00
Wei-Chiu Chuang cba1fa496b HADOOP-14880. [KMS] Document&test missing KMS client side configs. Contributed by Gabor Bota. 
(cherry picked from commit 97c70c7ac6)
 2017-10-31 12:54:53 -07:00
Chen Liang af52a585f0 HADOOP-14915. method name is incorrect in ConfServlet. Contributed by Bharat Viswanadham. 
(cherry picked from commit 563dcdfc1d)
 2017-10-31 12:54:28 -07:00
Wei-Chiu Chuang 0b3e3e4895 HADOOP-14948. Document missing config key hadoop.treat.subject.external. Contributed by Ajay Kumar. 
(cherry picked from commit e906108fc9)
 2017-10-31 12:54:03 -07:00
Wei-Chiu Chuang 1347e83c90 HDFS-12485. expunge may fail to remove trash from encryption zone. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 8dbc8909c9)
 2017-10-31 12:52:58 -07:00
Manoj Govindassamy 166c75a0eb HDFS-12544. SnapshotDiff - support diff generation on any snapshot root descendant directory. 
(cherry picked from commit 075dd45a24)
 2017-10-31 12:50:54 -07:00