Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
14,157 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

14157 Commits

Author SHA1 Message Date
Subru Krishnan 04dfb4898d Reverting to 6aa7510681 as YARN-4849 pushed a stale LICENSE file. 2017-10-25 16:47:58 -07:00
Subru Krishnan 74aee8673f YARN-4827. Document configuration of ReservationSystem for FairScheduler. (Yufei Gu via Subru). 
(cherry picked from commit 3fae675383)
 2017-10-25 15:32:03 -07:00
Arun Suresh 774a575363 YARN-4687. Document Reservation ACLs (Contributed by Sean Po) 
(cherry picked from commit 2e1d0ff4e9)
 2017-10-25 15:29:32 -07:00
Carlo Curino fa86fdc3cc YARN-7339. LocalityMulticastAMRMProxyPolicy should handle cancel request properly. (Botong Huang via curino) 
Edited cherry-pick from 1c5c2b5dde
 2017-10-25 13:56:35 -07:00
Zhe Zhang 736fb3b66c Revert "HDFS-12502. nntop should support a category based on FilesInGetListingOps." 
This reverts commit 86c2adc452.
 2017-10-24 15:05:26 -07:00
Varun Saxena 0c8a2c2609 HADOOP-9657. NetUtils.wrapException to have special handling for 0.0.0.0 addresses and :0 ports. Contributed by Varun Saxena. 
(cherry picked from commit 67e7673750)
 2017-10-25 03:09:07 +05:30
Eric Yang f6d3c101a6 YARN-7353. Improved volume mount check for directories and unit test compatibility on RHEL7. Contributed by Eric Badger. 2017-10-24 17:01:08 -04:00
Inigo Goiri 89ad6adab3 YARN-3661. Basic Federation UI. Contributed by Inigo Goiri. 2017-10-24 13:55:13 -07:00
Robert Kanter 85eadec67b YARN-7385. TestFairScheduler#testUpdateDemand and TestFSLeafQueue#testUpdateDemand are failing with NPE (yufeigu via rkanter) 
(cherry picked from commit 03af442e76)
 2017-10-24 13:43:27 -07:00
Robert Kanter 1d34a4805e YARN-7382. NoSuchElementException in FairScheduler after failover causes RM crash (rkanter) 
(cherry picked from commit 025c656572)
 2017-10-24 10:29:36 -07:00
Yiqun Lin 3d36f75f23 HDFS-12695. Add a link to HDFS router federation document in site.xml. Contributed by Yiqun Lin. 
(cherry picked from commit b90750cfb8)
 2017-10-24 10:50:39 +08:00
Daniel Templeton 08cfd010a3 YARN-7357. Several methods in TestZKRMStateStore.TestZKRMStateStoreTester.TestZKRMStateStoreInternal should have @Override annotations 
(Contributed by Sen Zhao via Daniel Templeton)

(cherry picked from commit 0553f5a012e14c8ceb40a16161440384f9f3a9a8)
(cherry picked from commit 9da9023371)
 2017-10-23 13:52:15 -07:00
Naganarasimha 2b04ae918c HADOOP-14966. Handle JDK-8071638 for hadoop-common. Contributed by Bibin A Chundatt. 
(cherry picked from commit 6b8122458e)
 2017-10-23 23:47:33 +05:30
Arpit Agarwal a373094bf9 HDFS-12683. DFSZKFailOverController re-order logic for logging Exception. Contributed by Bharat Viswanadham. 2017-10-23 10:47:35 -07:00
Eric Payne ef0d6ff2e6 YARN-4163: Audit getQueueInfo and getApplications calls 
(cherry picked from commit 921338cd86)
 2017-10-23 11:58:04 -05:00
Subru Krishnan 9bd77a6d9d YARN-6871. Add additional deSelects params in RMWebServices#getAppReport. (Tanuj Nayak via Subru). 2017-10-20 17:19:29 -07:00
Steve Loughran 062d9c9bab HADOOP-14942. DistCp#cleanup() should check whether jobFS is null. 
Contributed by Andras Bokor.

(cherry picked from commit f36cbc8475)
 2017-10-20 22:27:59 +01:00
vrushali 769087288a YARN-3368 YARN-7169 New YARN UI backported from trunk. See branch YARN-3368_branch2 for commits 2017-10-20 11:51:33 -07:00
Yufei Gu 93d71d97d4 YARN-7355. TestDistributedShell should be scheduler agnostic. (Contributed by Haibo) 
(cherry picked from commit 6b7c87c945)
 2017-10-20 11:49:34 -07:00
Yufei Gu 378fa3ac7d YARN-7261. Add debug message for better download latency monitoring. (Yufei Gu) 
(cherry picked from commit 0799fde35e)
 2017-10-20 11:49:34 -07:00
Yufei Gu 4c4f28c9e7 YARN-4090. Make Collections.sort() more efficient by caching resource usage. (Contributed by Yufei Gu, Shilong Zhang and Xianyin Xin) 
(cherry picked from commit 1f4cdf1068)
(cherry picked from commit 96106b8f5f)
 2017-10-20 11:49:33 -07:00
Xiao Chen c9f6a98b82 HADOOP-14944. Add JvmMetrics to KMS. 2017-10-20 11:22:34 -07:00
Inigo Goiri b60c658b04 HDFS-12620. Backporting HDFS-10467 to branch-2. Contributed by Inigo Goiri. 2017-10-20 11:22:34 -07:00
Inigo Goiri c954e6b7b2 HDFS-12577. Rename Router tooling. Contributed by Inigo Goiri. 
(cherry picked from commit 53e8d0d030)
(cherry picked from commit 5d63a388d1)
 2017-10-20 11:22:34 -07:00
Inigo Goiri 1772d4563d HDFS-12273. Federation UI. Contributed by Inigo Goiri. 
(cherry picked from commit adbb2e00c7)
(cherry picked from commit 81601dac8e)
 2017-10-20 11:22:34 -07:00
Inigo Goiri 9920a89e5f HDFS-12580. Rebasing HDFS-10467 after HDFS-12447. Contributed by Inigo Goiri. 
(cherry picked from commit b12440d347)
(cherry picked from commit 6c69e23dcd)
 2017-10-20 11:22:33 -07:00
Inigo Goiri 42e0ae0b80 HDFS-12381. [Documentation] Adding configuration keys for the Router. Contributed by Inigo Goiri. 
(cherry picked from commit c2d6aa7905)
(cherry picked from commit ad41c81559)
 2017-10-20 11:22:33 -07:00
Inigo Goiri 07b2da96a6 HDFS-12450. Fixing TestNamenodeHeartbeat and support non-HA. Contributed by Inigo Goiri. 
(cherry picked from commit 928d1e87f9)
(cherry picked from commit 67785fe006)
 2017-10-20 11:22:33 -07:00
Inigo Goiri be43786942 HDFS-12430. Rebasing HDFS-10467 After HDFS-12269 and HDFS-12218. Contributed by Inigo Goiri. 
(cherry picked from commit 3302e792d4)
(cherry picked from commit 1f06b81ecb)
 2017-10-20 11:22:33 -07:00
Inigo Goiri 673f685689 HDFS-12335. Federation Metrics. Contributed by Inigo Goiri. 
(cherry picked from commit 3b19e77752)
(cherry picked from commit bc9e588a19)
 2017-10-20 11:22:32 -07:00
Inigo Goiri c778f9dd37 HDFS-12384. Fixing compilation issue with BanDuplicateClasses. Contributed by Inigo Goiri. 
(cherry picked from commit fabe02c8fa)
(cherry picked from commit cc58e7a983)
 2017-10-20 11:22:32 -07:00
Inigo Goiri b71a753014 HDFS-10631. Federation State Store ZooKeeper implementation. Contributed by Jason Kace and Inigo Goiri. 
(cherry picked from commit 23c4ddee11)
(cherry picked from commit 7cb6bdf09e)
 2017-10-20 11:22:32 -07:00
Inigo Goiri 368a7d3d42 HDFS-12312. Rebasing HDFS-10467 (2). Contributed by Inigo Goiri. 
(cherry picked from commit 90ba6843fb)
(cherry picked from commit 346c9fce43)
 2017-10-20 11:22:32 -07:00
Inigo Goiri 568a32e5fe HDFS-11554. [Documentation] Router-based federation documentation. Contributed by Inigo Goiri. 
(cherry picked from commit ee3260211d)
(cherry picked from commit 67d10087af)
 2017-10-20 11:22:31 -07:00
Inigo Goiri 89c8018592 HDFS-10646. Federation admin tool. Contributed by Inigo Goiri. 
(cherry picked from commit ae27e31fbc)
(cherry picked from commit b3e6bd22e3)
 2017-10-20 11:22:31 -07:00
Inigo Goiri c77a04b10f HDFS-10880. Federation Mount Table State Store internal API. Contributed by Jason Kace and Inigo Goiri. 
(cherry picked from commit 58b97df661)
(cherry picked from commit 6f0de27318)
 2017-10-20 11:22:31 -07:00
Inigo Goiri 6f787d262c HDFS-11826. Federation Namenode Heartbeat. Contributed by Inigo Goiri. 
(cherry picked from commit 928f8dab52)
(cherry picked from commit d8c8107332)
 2017-10-20 11:22:31 -07:00
Inigo Goiri 366bf3c5dc HDFS-10687. Federation Membership State Store internal API. Contributed by Jason Kace and Inigo Goiri. 
(cherry picked from commit 95cae08849)
(cherry picked from commit 55da7fd7eb)
 2017-10-20 11:22:30 -07:00
Inigo Goiri 65593d58c4 HDFS-12223. Rebasing HDFS-10467. Contributed by Inigo Goiri. 
(cherry picked from commit 47db6e9d8e)
(cherry picked from commit 0ec82b8cdf)
 2017-10-20 11:22:30 -07:00
Inigo Goiri e69897253d HDFS-11546. Federation Router RPC server. Contributed by Jason Kace and Inigo Goiri. 
(cherry picked from commit 8a9cdebebf)
(cherry picked from commit ca4f209b49)
 2017-10-20 11:22:30 -07:00
Inigo Goiri 93687da438 HDFS-10630. Federation State Store FS Implementation. Contributed by Jason Kace and Inigo Goiri. 
(cherry picked from commit c6e0bd640c)
(cherry picked from commit 4bf877b03f)
 2017-10-20 11:22:29 -07:00
Inigo 04e3f38067 HDFS-10882. Federation State Store Interface API. Contributed by Jason Kace and Inigo Goiri. 
(cherry picked from commit 6d94c90ece)
(cherry picked from commit 2c740a684a)
 2017-10-20 11:22:29 -07:00
Inigo 2ab2452b72 HDFS-10881. Federation State Store Driver API. Contributed by Jason Kace and Inigo Goiri. 
(cherry picked from commit 0f88e04915)
(cherry picked from commit 533b986633)
 2017-10-20 11:22:29 -07:00
Inigo c51de708ab HDFS-10629. Federation Roter. Contributed by Jason Kace and Inigo Goiri. 
(cherry picked from commit 6821e80172)
(cherry picked from commit 2761bbc91a)
 2017-10-20 11:22:29 -07:00
Yufei Gu f462461d4e YARN-7359. TestAppManager.testQueueSubmitWithNoPermission() should be scheduler agnostic. (Contributed by Haibo Chen) 
(cherry picked from commit 7b4b018780)
 2017-10-20 11:22:28 -07:00
Yufei Gu 1000811bcb YARN-7294. TestSignalContainer#testSignalRequestDeliveryToNM fails intermittently with Fair Scheduler. (Contributed by Miklos Szegedi) 
(cherry picked from commit cbd2b73ef8)
 2017-10-20 11:22:28 -07:00
Wangda Tan 2f476f4b2c YARN-6623. Add support to turn off launching privileged containers in the container-executor. (Varun Vasudev via wangda) 2017-10-20 11:22:28 -07:00
Wei-Chiu Chuang 3ed7a2ca42 HDFS-12619. Do not catch and throw unchecked exceptions if IBRs fail to process. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 4ab0c8f96a)
 2017-10-20 11:22:28 -07:00
Wei-Chiu Chuang a47e8e660f HADOOP-14880. [KMS] Document&test missing KMS client side configs. Contributed by Gabor Bota. 
(cherry picked from commit 97c70c7ac6)

Conflicts:
	hadoop-common-project/hadoop-kms/src/test/java/org/apache/hadoop/crypto/key/kms/server/TestKMS.java
 2017-10-20 11:22:27 -07:00
Zhe Zhang 86c2adc452 HDFS-12502. nntop should support a category based on FilesInGetListingOps. 
(cherry picked from commit 60bfee270e)
(cherry picked from commit aecf6c50d3)
 2017-10-20 11:22:27 -07:00