Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
14,169 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

14169 Commits

Author SHA1 Message Date
Junping Du 3793d2b9cf Add CHANGES.md and RELEASENOTES for 2.8.2 release. 2017-10-26 23:23:39 -07:00
Junping Du 1f2a2ba2be Add several jdiff xml files for 2.8.2 release. 
(cherry picked from commit a25b5aa0cf)
 2017-10-26 23:20:24 -07:00
Junping Du 4b75ebb68e Set jdiff stable version to 2.8.2. 
(cherry picked from commit 06b56f6493)
 2017-10-26 23:20:10 -07:00
Subru Krishnan a0dceec586 YARN-5516. Add REST API for supporting recurring reservations. (Sean Po via Subru). 
(cherry picked from commit 25932da6d1)
 2017-10-26 20:16:01 -07:00
Arun Suresh f6fde85c5c YARN-4823. Refactor the nested reservation id field in listReservation to simple string field. (subru via asuresh) 
(cherry picked from commit 00bebb7e58)
 2017-10-26 20:04:33 -07:00
Arun Suresh 098a6b8f19 YARN-4825. Remove redundant code in ClientRMService::listReservations. (subru via asuresh) 
(cherry picked from commit d82e797b65)
 2017-10-26 20:04:19 -07:00
Subru Krishnan 9897538a96 HADOOP-14840. Tool to estimate resource requirements of an application pipeline based on prior executions. (Rui Li via Subru). 
(cherry picked from commit 625039ef20)
 2017-10-26 19:14:24 -07:00
Robert Kanter 7c26ae506a YARN-7262. Add a hierarchy into the ZKRMStateStore for delegation token znodes to prevent jute buffer overflow (rkanter) 
(cherry picked from commit b1de78619f)
 2017-10-26 17:51:05 -07:00
John Zhuge 952aa3f168 HDFS-12710. HTTPFS HTTP max header size env variable is not respected in branch-2. Contributed by Istvan Fajth. 2017-10-26 17:43:01 -07:00
Robert Kanter 46783158f8 YARN-7358. TestZKConfigurationStore and TestLeveldbConfigurationStore should explicitly set capacity scheduler (haibochen via rkanter) 
(cherry picked from commit 2da654e34a)
 2017-10-26 10:49:57 -07:00
Akira Ajisaka 13f1a7e0ed
Revert "HADOOP-14840. Tool to estimate resource requirements of an application pipeline based on prior executions. (Rui Li via Subru)." 
This reverts commit da7f989d86.
 2017-10-26 15:33:53 +09:00
Subru Krishnan da7f989d86 HADOOP-14840. Tool to estimate resource requirements of an application pipeline based on prior executions. (Rui Li via Subru). 
(cherry picked from commit 625039ef20)
 2017-10-25 17:05:35 -07:00
Subru Krishnan 04dfb4898d Reverting to 6aa7510681 as YARN-4849 pushed a stale LICENSE file. 2017-10-25 16:47:58 -07:00
Subru Krishnan 74aee8673f YARN-4827. Document configuration of ReservationSystem for FairScheduler. (Yufei Gu via Subru). 
(cherry picked from commit 3fae675383)
 2017-10-25 15:32:03 -07:00
Arun Suresh 774a575363 YARN-4687. Document Reservation ACLs (Contributed by Sean Po) 
(cherry picked from commit 2e1d0ff4e9)
 2017-10-25 15:29:32 -07:00
Carlo Curino fa86fdc3cc YARN-7339. LocalityMulticastAMRMProxyPolicy should handle cancel request properly. (Botong Huang via curino) 
Edited cherry-pick from 1c5c2b5dde
 2017-10-25 13:56:35 -07:00
Zhe Zhang 736fb3b66c Revert "HDFS-12502. nntop should support a category based on FilesInGetListingOps." 
This reverts commit 86c2adc452.
 2017-10-24 15:05:26 -07:00
Varun Saxena 0c8a2c2609 HADOOP-9657. NetUtils.wrapException to have special handling for 0.0.0.0 addresses and :0 ports. Contributed by Varun Saxena. 
(cherry picked from commit 67e7673750)
 2017-10-25 03:09:07 +05:30
Eric Yang f6d3c101a6 YARN-7353. Improved volume mount check for directories and unit test compatibility on RHEL7. Contributed by Eric Badger. 2017-10-24 17:01:08 -04:00
Inigo Goiri 89ad6adab3 YARN-3661. Basic Federation UI. Contributed by Inigo Goiri. 2017-10-24 13:55:13 -07:00
Robert Kanter 85eadec67b YARN-7385. TestFairScheduler#testUpdateDemand and TestFSLeafQueue#testUpdateDemand are failing with NPE (yufeigu via rkanter) 
(cherry picked from commit 03af442e76)
 2017-10-24 13:43:27 -07:00
Robert Kanter 1d34a4805e YARN-7382. NoSuchElementException in FairScheduler after failover causes RM crash (rkanter) 
(cherry picked from commit 025c656572)
 2017-10-24 10:29:36 -07:00
Yiqun Lin 3d36f75f23 HDFS-12695. Add a link to HDFS router federation document in site.xml. Contributed by Yiqun Lin. 
(cherry picked from commit b90750cfb8)
 2017-10-24 10:50:39 +08:00
Daniel Templeton 08cfd010a3 YARN-7357. Several methods in TestZKRMStateStore.TestZKRMStateStoreTester.TestZKRMStateStoreInternal should have @Override annotations 
(Contributed by Sen Zhao via Daniel Templeton)

(cherry picked from commit 0553f5a012e14c8ceb40a16161440384f9f3a9a8)
(cherry picked from commit 9da9023371)
 2017-10-23 13:52:15 -07:00
Naganarasimha 2b04ae918c HADOOP-14966. Handle JDK-8071638 for hadoop-common. Contributed by Bibin A Chundatt. 
(cherry picked from commit 6b8122458e)
 2017-10-23 23:47:33 +05:30
Arpit Agarwal a373094bf9 HDFS-12683. DFSZKFailOverController re-order logic for logging Exception. Contributed by Bharat Viswanadham. 2017-10-23 10:47:35 -07:00
Eric Payne ef0d6ff2e6 YARN-4163: Audit getQueueInfo and getApplications calls 
(cherry picked from commit 921338cd86)
 2017-10-23 11:58:04 -05:00
Subru Krishnan 9bd77a6d9d YARN-6871. Add additional deSelects params in RMWebServices#getAppReport. (Tanuj Nayak via Subru). 2017-10-20 17:19:29 -07:00
Steve Loughran 062d9c9bab HADOOP-14942. DistCp#cleanup() should check whether jobFS is null. 
Contributed by Andras Bokor.

(cherry picked from commit f36cbc8475)
 2017-10-20 22:27:59 +01:00
vrushali 769087288a YARN-3368 YARN-7169 New YARN UI backported from trunk. See branch YARN-3368_branch2 for commits 2017-10-20 11:51:33 -07:00
Yufei Gu 93d71d97d4 YARN-7355. TestDistributedShell should be scheduler agnostic. (Contributed by Haibo) 
(cherry picked from commit 6b7c87c945)
 2017-10-20 11:49:34 -07:00
Yufei Gu 378fa3ac7d YARN-7261. Add debug message for better download latency monitoring. (Yufei Gu) 
(cherry picked from commit 0799fde35e)
 2017-10-20 11:49:34 -07:00
Yufei Gu 4c4f28c9e7 YARN-4090. Make Collections.sort() more efficient by caching resource usage. (Contributed by Yufei Gu, Shilong Zhang and Xianyin Xin) 
(cherry picked from commit 1f4cdf1068)
(cherry picked from commit 96106b8f5f)
 2017-10-20 11:49:33 -07:00
Xiao Chen c9f6a98b82 HADOOP-14944. Add JvmMetrics to KMS. 2017-10-20 11:22:34 -07:00
Inigo Goiri b60c658b04 HDFS-12620. Backporting HDFS-10467 to branch-2. Contributed by Inigo Goiri. 2017-10-20 11:22:34 -07:00
Inigo Goiri c954e6b7b2 HDFS-12577. Rename Router tooling. Contributed by Inigo Goiri. 
(cherry picked from commit 53e8d0d030)
(cherry picked from commit 5d63a388d1)
 2017-10-20 11:22:34 -07:00
Inigo Goiri 1772d4563d HDFS-12273. Federation UI. Contributed by Inigo Goiri. 
(cherry picked from commit adbb2e00c7)
(cherry picked from commit 81601dac8e)
 2017-10-20 11:22:34 -07:00
Inigo Goiri 9920a89e5f HDFS-12580. Rebasing HDFS-10467 after HDFS-12447. Contributed by Inigo Goiri. 
(cherry picked from commit b12440d347)
(cherry picked from commit 6c69e23dcd)
 2017-10-20 11:22:33 -07:00
Inigo Goiri 42e0ae0b80 HDFS-12381. [Documentation] Adding configuration keys for the Router. Contributed by Inigo Goiri. 
(cherry picked from commit c2d6aa7905)
(cherry picked from commit ad41c81559)
 2017-10-20 11:22:33 -07:00
Inigo Goiri 07b2da96a6 HDFS-12450. Fixing TestNamenodeHeartbeat and support non-HA. Contributed by Inigo Goiri. 
(cherry picked from commit 928d1e87f9)
(cherry picked from commit 67785fe006)
 2017-10-20 11:22:33 -07:00
Inigo Goiri be43786942 HDFS-12430. Rebasing HDFS-10467 After HDFS-12269 and HDFS-12218. Contributed by Inigo Goiri. 
(cherry picked from commit 3302e792d4)
(cherry picked from commit 1f06b81ecb)
 2017-10-20 11:22:33 -07:00
Inigo Goiri 673f685689 HDFS-12335. Federation Metrics. Contributed by Inigo Goiri. 
(cherry picked from commit 3b19e77752)
(cherry picked from commit bc9e588a19)
 2017-10-20 11:22:32 -07:00
Inigo Goiri c778f9dd37 HDFS-12384. Fixing compilation issue with BanDuplicateClasses. Contributed by Inigo Goiri. 
(cherry picked from commit fabe02c8fa)
(cherry picked from commit cc58e7a983)
 2017-10-20 11:22:32 -07:00
Inigo Goiri b71a753014 HDFS-10631. Federation State Store ZooKeeper implementation. Contributed by Jason Kace and Inigo Goiri. 
(cherry picked from commit 23c4ddee11)
(cherry picked from commit 7cb6bdf09e)
 2017-10-20 11:22:32 -07:00
Inigo Goiri 368a7d3d42 HDFS-12312. Rebasing HDFS-10467 (2). Contributed by Inigo Goiri. 
(cherry picked from commit 90ba6843fb)
(cherry picked from commit 346c9fce43)
 2017-10-20 11:22:32 -07:00
Inigo Goiri 568a32e5fe HDFS-11554. [Documentation] Router-based federation documentation. Contributed by Inigo Goiri. 
(cherry picked from commit ee3260211d)
(cherry picked from commit 67d10087af)
 2017-10-20 11:22:31 -07:00
Inigo Goiri 89c8018592 HDFS-10646. Federation admin tool. Contributed by Inigo Goiri. 
(cherry picked from commit ae27e31fbc)
(cherry picked from commit b3e6bd22e3)
 2017-10-20 11:22:31 -07:00
Inigo Goiri c77a04b10f HDFS-10880. Federation Mount Table State Store internal API. Contributed by Jason Kace and Inigo Goiri. 
(cherry picked from commit 58b97df661)
(cherry picked from commit 6f0de27318)
 2017-10-20 11:22:31 -07:00
Inigo Goiri 6f787d262c HDFS-11826. Federation Namenode Heartbeat. Contributed by Inigo Goiri. 
(cherry picked from commit 928f8dab52)
(cherry picked from commit d8c8107332)
 2017-10-20 11:22:31 -07:00
Inigo Goiri 366bf3c5dc HDFS-10687. Federation Membership State Store internal API. Contributed by Jason Kace and Inigo Goiri. 
(cherry picked from commit 95cae08849)
(cherry picked from commit 55da7fd7eb)
 2017-10-20 11:22:30 -07:00