Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
14,150 Commits 326 Branches 371 Tags
Commit Graph

14150 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Inigo Goiri
89ad6adab3 YARN-3661. Basic Federation UI. Contributed by Inigo Goiri. 2017-10-24 13:55:13 -07:00
Robert Kanter
85eadec67b YARN-7385. TestFairScheduler#testUpdateDemand and TestFSLeafQueue#testUpdateDemand are failing with NPE (yufeigu via rkanter) 
(cherry picked from commit 03af442e7608db2f8e6eb85a15aa0ba42781edab)
 2017-10-24 13:43:27 -07:00
Robert Kanter
1d34a4805e YARN-7382. NoSuchElementException in FairScheduler after failover causes RM crash (rkanter) 
(cherry picked from commit 025c6565725c1819566377632753e8b9055617a6)
 2017-10-24 10:29:36 -07:00
Yiqun Lin
3d36f75f23 HDFS-12695. Add a link to HDFS router federation document in site.xml. Contributed by Yiqun Lin. 
(cherry picked from commit b90750cfb8887fecbd83caff3800455b4f911339)
 2017-10-24 10:50:39 +08:00
Daniel Templeton
08cfd010a3 YARN-7357. Several methods in TestZKRMStateStore.TestZKRMStateStoreTester.TestZKRMStateStoreInternal should have @Override annotations 
(Contributed by Sen Zhao via Daniel Templeton)

(cherry picked from commit 0553f5a012e14c8ceb40a16161440384f9f3a9a8)
(cherry picked from commit 9da9023371d0d6c9a1f507c04fc6b88e6c587005)
 2017-10-23 13:52:15 -07:00
Naganarasimha
2b04ae918c HADOOP-14966. Handle JDK-8071638 for hadoop-common. Contributed by Bibin A Chundatt. 
(cherry picked from commit 6b8122458ede9ececb138bed99d368580e5439a1)
 2017-10-23 23:47:33 +05:30
Arpit Agarwal
a373094bf9 HDFS-12683. DFSZKFailOverController re-order logic for logging Exception. Contributed by Bharat Viswanadham. 2017-10-23 10:47:35 -07:00
Eric Payne
ef0d6ff2e6 YARN-4163: Audit getQueueInfo and getApplications calls 
(cherry picked from commit 921338cd86e7215b0c4b1efdf2daf9449fb12c7b)
 2017-10-23 11:58:04 -05:00
Subru Krishnan
9bd77a6d9d YARN-6871. Add additional deSelects params in RMWebServices#getAppReport. (Tanuj Nayak via Subru). 2017-10-20 17:19:29 -07:00
Steve Loughran
062d9c9bab HADOOP-14942. DistCp#cleanup() should check whether jobFS is null. 
Contributed by Andras Bokor.

(cherry picked from commit f36cbc847560d53e7955ced9ce7ce2773c805793)
 2017-10-20 22:27:59 +01:00
vrushali
769087288a YARN-3368 YARN-7169 New YARN UI backported from trunk. See branch YARN-3368_branch2 for commits 2017-10-20 11:51:33 -07:00
Yufei Gu
93d71d97d4 YARN-7355. TestDistributedShell should be scheduler agnostic. (Contributed by Haibo) 
(cherry picked from commit 6b7c87c94592606966a4229313b3d0da48f16158)
 2017-10-20 11:49:34 -07:00
Yufei Gu
378fa3ac7d YARN-7261. Add debug message for better download latency monitoring. (Yufei Gu) 
(cherry picked from commit 0799fde35e7f3b9e8a85284ac0b30f6bdcbffad1)
 2017-10-20 11:49:34 -07:00
Yufei Gu
4c4f28c9e7 YARN-4090. Make Collections.sort() more efficient by caching resource usage. (Contributed by Yufei Gu, Shilong Zhang and Xianyin Xin) 
(cherry picked from commit 1f4cdf10681b6903207a63fb5c306c9665ed9464)
(cherry picked from commit 96106b8f5fe50e2d5c0c4df5dbddea4f89f278d9)
 2017-10-20 11:49:33 -07:00
Xiao Chen
c9f6a98b82 HADOOP-14944. Add JvmMetrics to KMS. 2017-10-20 11:22:34 -07:00
Inigo Goiri
b60c658b04 HDFS-12620. Backporting HDFS-10467 to branch-2. Contributed by Inigo Goiri. 2017-10-20 11:22:34 -07:00
Inigo Goiri
c954e6b7b2 HDFS-12577. Rename Router tooling. Contributed by Inigo Goiri. 
(cherry picked from commit 53e8d0d030525e4c7f3875e23807c6dbe778890f)
(cherry picked from commit 5d63a388d1c3ec8a658cb2fd9b34c240bddf15a0)
 2017-10-20 11:22:34 -07:00
Inigo Goiri
1772d4563d HDFS-12273. Federation UI. Contributed by Inigo Goiri. 
(cherry picked from commit adbb2e00c7b85524fd43bd68895d49814c16680a)
(cherry picked from commit 81601dac8ec7650bec14700b174910390a92fe1f)
 2017-10-20 11:22:34 -07:00
Inigo Goiri
9920a89e5f HDFS-12580. Rebasing HDFS-10467 after HDFS-12447. Contributed by Inigo Goiri. 
(cherry picked from commit b12440d3479f19138bc66ea59baf41eb89061906)
(cherry picked from commit 6c69e23dcdf1cdbddd47bacdf2dace5c9f06e3ad)
 2017-10-20 11:22:33 -07:00
Inigo Goiri
42e0ae0b80 HDFS-12381. [Documentation] Adding configuration keys for the Router. Contributed by Inigo Goiri. 
(cherry picked from commit c2d6aa79055ef72406fa598e1c743b0c994b5da8)
(cherry picked from commit ad41c8155940f4da0e51439c97c6cc9c808c28df)
 2017-10-20 11:22:33 -07:00
Inigo Goiri
07b2da96a6 HDFS-12450. Fixing TestNamenodeHeartbeat and support non-HA. Contributed by Inigo Goiri. 
(cherry picked from commit 928d1e87f9dbe64f89b858ccc1780723f3af58e7)
(cherry picked from commit 67785fe0063cfbfecab0e8deaae4a45d9c7c0073)
 2017-10-20 11:22:33 -07:00
Inigo Goiri
be43786942 HDFS-12430. Rebasing HDFS-10467 After HDFS-12269 and HDFS-12218. Contributed by Inigo Goiri. 
(cherry picked from commit 3302e792d469b7e8f3bfa10151e4e1c546589734)
(cherry picked from commit 1f06b81ecb14044964176dd16fafaa0ee96bfe3d)
 2017-10-20 11:22:33 -07:00
Inigo Goiri
673f685689 HDFS-12335. Federation Metrics. Contributed by Inigo Goiri. 
(cherry picked from commit 3b19e77752afce87936f5c0d1e6d272fba798d7b)
(cherry picked from commit bc9e588a19c0aaf518de8dab719362be4a8d6a54)
 2017-10-20 11:22:32 -07:00
Inigo Goiri
c778f9dd37 HDFS-12384. Fixing compilation issue with BanDuplicateClasses. Contributed by Inigo Goiri. 
(cherry picked from commit fabe02c8fafa807198054da0c02b2ebaafda76aa)
(cherry picked from commit cc58e7a983d8f1351089462f531993f7b4f0a9c5)
 2017-10-20 11:22:32 -07:00
Inigo Goiri
b71a753014 HDFS-10631. Federation State Store ZooKeeper implementation. Contributed by Jason Kace and Inigo Goiri. 
(cherry picked from commit 23c4ddee11ab1300325a6361124ee8ad6f68d7a4)
(cherry picked from commit 7cb6bdf09ed361e067ebf234230babd1391a7d4b)
 2017-10-20 11:22:32 -07:00
Inigo Goiri
368a7d3d42 HDFS-12312. Rebasing HDFS-10467 (2). Contributed by Inigo Goiri. 
(cherry picked from commit 90ba6843fb3ac5dc7576535e66a75a5e3433247b)
(cherry picked from commit 346c9fce43ebf6a90fc56e0dc7c403f97cc5391f)
 2017-10-20 11:22:32 -07:00
Inigo Goiri
568a32e5fe HDFS-11554. [Documentation] Router-based federation documentation. Contributed by Inigo Goiri. 
(cherry picked from commit ee3260211d94aed223dd6f2386a166eb2c7d67af)
(cherry picked from commit 67d10087aff9d4ab2748aefc1b97522495c148f8)
 2017-10-20 11:22:31 -07:00
Inigo Goiri
89c8018592 HDFS-10646. Federation admin tool. Contributed by Inigo Goiri. 
(cherry picked from commit ae27e31fbcf546481db0b0345772db2e9132372e)
(cherry picked from commit b3e6bd22e3c02b3e4f50396538f56a1bcb007638)
 2017-10-20 11:22:31 -07:00
Inigo Goiri
c77a04b10f HDFS-10880. Federation Mount Table State Store internal API. Contributed by Jason Kace and Inigo Goiri. 
(cherry picked from commit 58b97df661441150d35abd44b3a8606206b46441)
(cherry picked from commit 6f0de2731806628b5b01bd1350225692147590da)
 2017-10-20 11:22:31 -07:00
Inigo Goiri
6f787d262c HDFS-11826. Federation Namenode Heartbeat. Contributed by Inigo Goiri. 
(cherry picked from commit 928f8dab52191e733984d37f47b69719ccf11313)
(cherry picked from commit d8c81073320320a019fb3868be4f06f46aebea43)
 2017-10-20 11:22:31 -07:00
Inigo Goiri
366bf3c5dc HDFS-10687. Federation Membership State Store internal API. Contributed by Jason Kace and Inigo Goiri. 
(cherry picked from commit 95cae08849d23cf12c5d280c29f90908e6a90d40)
(cherry picked from commit 55da7fd7ebe2f3fa1c1c828dda727fddc75a1b81)
 2017-10-20 11:22:30 -07:00
Inigo Goiri
65593d58c4 HDFS-12223. Rebasing HDFS-10467. Contributed by Inigo Goiri. 
(cherry picked from commit 47db6e9d8e2c264671c89fdd6cb11a7c762d2cce)
(cherry picked from commit 0ec82b8cdfaaa5f23d1a0f7f7fb8c9187c5e309b)
 2017-10-20 11:22:30 -07:00
Inigo Goiri
e69897253d HDFS-11546. Federation Router RPC server. Contributed by Jason Kace and Inigo Goiri. 
(cherry picked from commit 8a9cdebebf26841a0f1e99fb08135f4597f2eba2)
(cherry picked from commit ca4f209b49e3aad6a80306f7342c9b6b560a79a7)
 2017-10-20 11:22:30 -07:00
Inigo Goiri
93687da438 HDFS-10630. Federation State Store FS Implementation. Contributed by Jason Kace and Inigo Goiri. 
(cherry picked from commit c6e0bd640cdaf83a660fa050809cad6f1d4c6f4d)
(cherry picked from commit 4bf877b03f0e01c4bcedc689c66689701e62b560)
 2017-10-20 11:22:29 -07:00
Inigo
04e3f38067 HDFS-10882. Federation State Store Interface API. Contributed by Jason Kace and Inigo Goiri. 
(cherry picked from commit 6d94c90ece1c1d23d4c97e72c54e9991f5dbc481)
(cherry picked from commit 2c740a684a23663962119726bf0e7ecef173f6f1)
 2017-10-20 11:22:29 -07:00
Inigo
2ab2452b72 HDFS-10881. Federation State Store Driver API. Contributed by Jason Kace and Inigo Goiri. 
(cherry picked from commit 0f88e049156dce173afc0dbda864e29190dd2210)
(cherry picked from commit 533b986633e0a9076cf3918fba3e3b591c6f65f2)
 2017-10-20 11:22:29 -07:00
Inigo
c51de708ab HDFS-10629. Federation Roter. Contributed by Jason Kace and Inigo Goiri. 
(cherry picked from commit 6821e801724ac38e9737538b2164c9ae88792282)
(cherry picked from commit 2761bbc91a7b0a36c42b1b6569c5ecd4f236281b)
 2017-10-20 11:22:29 -07:00
Yufei Gu
f462461d4e YARN-7359. TestAppManager.testQueueSubmitWithNoPermission() should be scheduler agnostic. (Contributed by Haibo Chen) 
(cherry picked from commit 7b4b0187806601e33f5a88d48991e7c12ee4419f)
 2017-10-20 11:22:28 -07:00
Yufei Gu
1000811bcb YARN-7294. TestSignalContainer#testSignalRequestDeliveryToNM fails intermittently with Fair Scheduler. (Contributed by Miklos Szegedi) 
(cherry picked from commit cbd2b73ef81a7e275c5d4f842cac5b81ff2f8c84)
 2017-10-20 11:22:28 -07:00
Wangda Tan
2f476f4b2c YARN-6623. Add support to turn off launching privileged containers in the container-executor. (Varun Vasudev via wangda) 2017-10-20 11:22:28 -07:00
Wei-Chiu Chuang
3ed7a2ca42 HDFS-12619. Do not catch and throw unchecked exceptions if IBRs fail to process. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 4ab0c8f96a41c573cc1f1e71c18871d243f952b9)
 2017-10-20 11:22:28 -07:00
Wei-Chiu Chuang
a47e8e660f HADOOP-14880. [KMS] Document&test missing KMS client side configs. Contributed by Gabor Bota. 
(cherry picked from commit 97c70c7ac6881f87eee1575bcbdd28b31ecac231)

Conflicts:
	hadoop-common-project/hadoop-kms/src/test/java/org/apache/hadoop/crypto/key/kms/server/TestKMS.java
 2017-10-20 11:22:27 -07:00
Zhe Zhang
86c2adc452 HDFS-12502. nntop should support a category based on FilesInGetListingOps. 
(cherry picked from commit 60bfee270ed3a653c44c0bc92396167b5022df6e)
(cherry picked from commit aecf6c50d351e7aed2008a682677a1edb104585d)
 2017-10-20 11:22:27 -07:00
Junping Du
e8c6ef01d3 HADOOP-14958. Fix source-level compatibility after HADOOP-11252. Contributed by Junping Du. 
(cherry picked from commit b016f08f67830ed3ca741bc6a10c3f5164781be5)
(cherry picked from commit 9433f9eb09af0ca61f01a2eb42ff3ffe31a94d5f)
 2017-10-20 11:22:27 -07:00
Arpit Agarwal
bc3ca4c106 HDFS-12420. Add an option to disallow 'namenode format -force'. Contributed by Ajay Kumar. 
(cherry picked from commit b6942cbe9b8c9469e8c2b64c3268d671f5a43e75)
(cherry picked from commit 5897095d539be086ed37df011f024e37eb37b0cd)
 2017-10-20 11:22:27 -07:00
Wangda Tan
6a3929f2b2 YARN-6608. Backport all SLS improvements from trunk to branch-2. (Carlo Curino via wangda) 2017-10-20 11:22:26 -07:00
Yufei Gu
20f5687e52 YARN-7355. TestDistributedShell should be scheduler agnostic. (Contributed by Haibo) 
(cherry picked from commit 6b7c87c94592606966a4229313b3d0da48f16158)
 2017-10-20 11:16:27 -07:00
Yufei Gu
c3946f29e7 YARN-7261. Add debug message for better download latency monitoring. (Yufei Gu) 
(cherry picked from commit 0799fde35e7f3b9e8a85284ac0b30f6bdcbffad1)
 2017-10-20 10:02:35 -07:00
Yufei Gu
01b2e8b9ca YARN-4090. Make Collections.sort() more efficient by caching resource usage. (Contributed by Yufei Gu, Shilong Zhang and Xianyin Xin) 
(cherry picked from commit 1f4cdf10681b6903207a63fb5c306c9665ed9464)
(cherry picked from commit 96106b8f5fe50e2d5c0c4df5dbddea4f89f278d9)
 2017-10-20 01:38:07 -07:00
Xiao Chen
a6370dde90 HADOOP-14944. Add JvmMetrics to KMS. 2017-10-19 22:37:35 -07:00