Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
17,065 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

17065 Commits

Author SHA1 Message Date
Chris Douglas 1660a638f0 HADOOP-14986. Enforce JDK limitations. 
(cherry picked from commit b50def3697)
 2017-10-27 21:39:27 -07:00
Chris Douglas 34512b2d7a HDFS-12582. Replace HdfsFileStatus constructor with a builder pattern. Contributed by Bharat Viswanadham 
(cherry picked from commit d55a84951a)
 2017-10-27 15:36:18 -07:00
Jason Lowe 00345eed50 YARN-7244. ShuffleHandler is not aware of disks that are added. Contributed by Kuhu Shukla 
(cherry picked from commit 665bb147aa)
 2017-10-27 17:00:31 -05:00
Rohith Sharma K S d9b636f2f4 YARN-7289. Application lifetime does not work with FairScheduler. Contributed by Miklos Szegedi. 
(cherry picked from commit 5c799ecf09)
 2017-10-27 23:14:55 +05:30
Sunil G e084d43550 YARN-7375. Possible NPE in RMWebapp when HA is enabled and the active RM fails. Contributed by Chandni Singh. 
(cherry picked from commit 792388e1c0)
 2017-10-27 20:54:58 +05:30
Arpit Agarwal 2510fc1801 HDFS-9914. Fix configurable WebhDFS connect/read timeout. Contributed by Xiaoyu Yao. 2017-10-27 07:49:18 -07:00
Junping Du ce10c1ef05 Add several jdiff xml files for 2.8.2 release. 
(cherry picked from commit a25b5aa0cf)
 2017-10-26 23:18:50 -07:00
Junping Du 3760f9cfb3 Set jdiff stable version to 2.8.2. 
(cherry picked from commit 06b56f6493)
 2017-10-26 23:18:37 -07:00
Junping Du f36b2c6990 Update CHANGES.md and RELEASENOTES for 2.8.2 release. 
(cherry picked from commit 1ad863e220)
 2017-10-26 23:18:23 -07:00
Robert Kanter aa65f6c1ad YARN-7262. Add a hierarchy into the ZKRMStateStore for delegation token znodes to prevent jute buffer overflow (rkanter) 
(cherry picked from commit b1de78619f)
 2017-10-26 17:47:51 -07:00
Robert Kanter cd9078df68 YARN-7320. Duplicate LiteralByteStrings in SystemCredentialsForAppsProto.credentialsForApp_ Addendum (misha@cloudera.com via rkanter) 
(cherry picked from commit 088ffee716)
 2017-10-26 15:55:23 -07:00
Subru Krishnan 9665971a65 YARN-5516. Add REST API for supporting recurring reservations. (Sean Po via Subru). 
(cherry picked from commit 25932da6d1)
 2017-10-26 12:11:08 -07:00
Robert Kanter d92dddaf7c YARN-7358. TestZKConfigurationStore and TestLeveldbConfigurationStore should explicitly set capacity scheduler (haibochen via rkanter) 
(cherry picked from commit 2da654e34a)
 2017-10-26 10:45:23 -07:00
Subru Krishnan 82c9b3bbb5 HADOOP-14840. Tool to estimate resource requirements of an application pipeline based on prior executions. (Rui Li via Subru). 
(cherry picked from commit 625039ef20)
 2017-10-25 16:01:13 -07:00
Subru Krishnan 926b188871 YARN-4827. Document configuration of ReservationSystem for FairScheduler. (Yufei Gu via Subru). 
(cherry picked from commit 3fae675383)
 2017-10-25 15:08:19 -07:00
Xiao Chen e18d2c548b HADOOP-14957. ReconfigurationTaskStatus is exposing guava Optional in its public api. Contributed by Haibo Chen, Xiao Chen. 
(cherry picked from commit e3f25f361720b544b464c5e4fbeb4f31e6c53c67)
 2017-10-25 14:11:38 -07:00
Akira Ajisaka 20ca6773f1 HADOOP-14977. Xenial dockerfile needs ant in main build for findbugs 
Signed-off-by: Allen Wittenauer <aw@apache.org>
 2017-10-25 08:10:26 -07:00
Akira Ajisaka ed93af8965
HADOOP-14979. Upgrade maven-dependency-plugin to 3.0.2. Contributed by liyunzhang. 
(cherry picked from commit 54b72acd77)
 2017-10-25 23:42:02 +09:00
Akira Ajisaka 79ea3e8ea7
HADOOP-14030. PreCommit TestKDiag failure. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 4c970088af)
 2017-10-25 17:18:49 +09:00
Zhe Zhang f3409e71d9 Revert "HDFS-12502. nntop should support a category based on FilesInGetListingOps." 
This reverts commit aecf6c50d3.
 2017-10-24 15:06:01 -07:00
Varun Saxena 5be228e43b HADOOP-9657. NetUtils.wrapException to have special handling for 0.0.0.0 addresses and :0 ports. Contributed by Varun Saxena. 
(cherry picked from commit 67e7673750)
 2017-10-25 03:22:18 +05:30
Eric Yang 107afed848 YARN-7353. Improved volume mount check for directories and unit test compatibility on RHEL7. Contributed by Eric Badger. 2017-10-24 16:59:17 -04:00
Yufei Gu 6e953eb6a3 YARN-7045. Remove FSLeafQueue#addAppSchedulable. (Contributed by Sen Zhao via Yufei Gu) 
(cherry picked from commit a92ef030a2)
 2017-10-24 13:52:02 -07:00
Robert Kanter c5eeb2e4ce YARN-7385. TestFairScheduler#testUpdateDemand and TestFSLeafQueue#testUpdateDemand are failing with NPE (yufeigu via rkanter) 
(cherry picked from commit 03af442e76)
 2017-10-24 13:40:06 -07:00
Carlo Curino 8b200ab395 YARN-7339. LocalityMulticastAMRMProxyPolicy should handle cancel request properly. (Botong Huang via curino) 
(cherry picked from commit 1c5c2b5dde)
 2017-10-24 10:53:08 -07:00
Robert Kanter 4bae02a97d YARN-7382. NoSuchElementException in FairScheduler after failover causes RM crash (rkanter) 
(cherry picked from commit 025c656572)
 2017-10-24 10:25:43 -07:00
Yiqun Lin 1e7ea66044 HDFS-12695. Add a link to HDFS router federation document in site.xml. Contributed by Yiqun Lin. 
(cherry picked from commit b90750cfb8)
 2017-10-24 10:48:19 +08:00
Robert Kanter 61aba4f0c1 YARN-7320. Duplicate LiteralByteStrings in SystemCredentialsForAppsProto.credentialsForApp_ (misha@cloudera.com via rkanter) 
(cherry picked from commit 5da295a34e)
 2017-10-23 18:02:11 -07:00
Wei-Chiu Chuang b8a2fd37dc HDFS-12249. dfsadmin -metaSave to output maintenance mode blocks. Contributed by Wellington Chevreuil. 
(cherry picked from commit 0f2a69127a)
 2017-10-23 15:24:54 -07:00
Daniel Templeton 9da9023371 YARN-7357. Several methods in TestZKRMStateStore.TestZKRMStateStoreTester.TestZKRMStateStoreInternal should have @Override annotations 
(Contributed by Sen Zhao via Daniel Templeton)

(cherry picked from commit 0553f5a012e14c8ceb40a16161440384f9f3a9a8)
 2017-10-23 13:51:39 -07:00
Naganarasimha faf23e6298 HADOOP-14966. Handle JDK-8071638 for hadoop-common. Contributed by Bibin A Chundatt. 
(cherry picked from commit 6b8122458e)
 2017-10-23 23:43:57 +05:30
Eric Payne 3f315a526b YARN-4163: Audit getQueueInfo and getApplications calls 
(cherry picked from commit 921338cd86)
 2017-10-23 11:48:41 -05:00
Sunil G 4b872e5e9f YARN-6871. Add additional deSelects params in RMWebServices#getAppReport. Contributed by Tanuj Nayak. 
(cherry picked from commit 8facf1f976)
 2017-10-20 17:20:39 -07:00
Xiao Chen a7e34be69a HDFS-12518. Re-encryption should handle task cancellation and progress better. 
(cherry picked from commit 0f5287bb2fe71b35f70f977a06c31094b352512c)
 2017-10-20 16:25:39 -07:00
Wangda Tan 881263260c YARN-7318. Fix shell check warnings of SLS. (Gergely Novák via wangda) 
(cherry picked from commit 281d83604d)
 2017-10-20 16:02:04 -07:00
Steve Loughran 2bacb429a1 HADOOP-14942. DistCp#cleanup() should check whether jobFS is null. 
Contributed by Andras Bokor.

(cherry picked from commit f36cbc8475)
 2017-10-20 22:29:22 +01:00
Andrew Wang ea149c10cf HDFS-12497. Re-enable TestDFSStripedOutputStreamWithFailure tests. Contributed by Huafeng Wang. 
(cherry picked from commit 0477eff8be)
 2017-10-20 13:27:29 -07:00
Yufei Gu d375645d50 YARN-7355. TestDistributedShell should be scheduler agnostic. (Contributed by Haibo) 
(cherry picked from commit 6b7c87c945)
 2017-10-20 11:17:05 -07:00
Yufei Gu 2a0ef092d3 YARN-7261. Add debug message for better download latency monitoring. (Yufei Gu) 
(cherry picked from commit 0799fde35e)
 2017-10-20 10:01:52 -07:00
Yufei Gu 96106b8f5f YARN-4090. Make Collections.sort() more efficient by caching resource usage. (Contributed by Yufei Gu, Shilong Zhang and Xianyin Xin) 
(cherry picked from commit 1f4cdf1068)
 2017-10-20 01:34:05 -07:00
Wangda Tan dc2ae3f20b YARN-7170. Improve bower dependencies for YARN UI v2. (Sunil G via wangda) 
(cherry picked from commit 4afd308b62)
 2017-10-19 21:59:28 -07:00
Kai Zheng b7cb58a21d HDFS-12448. Make sure user defined erasure coding policy ID will not overflow. Contributed by Huafeng Wang 2017-10-20 09:34:58 +08:00
Inigo Goiri f4a2f0ee9f HDFS-12620. Backporting HDFS-10467 to branch-2. Contributed by Inigo Goiri. 
(cherry picked from commit 0f1c037618)
 2017-10-19 18:10:47 -07:00
Yufei Gu b2f516118c YARN-7359. TestAppManager.testQueueSubmitWithNoPermission() should be scheduler agnostic. (Contributed by Haibo Chen) 
(cherry picked from commit 7b4b018780)
 2017-10-19 16:53:10 -07:00
Chris Douglas 612350eb95 HADOOP-14816. Update Dockerfile to use Xenial. Contributed by Allen Wittenauer 
(cherry picked from commit ca8ddc6aa4)
 2017-10-19 16:47:19 -07:00
Yufei Gu 288d2fc309 YARN-7294. TestSignalContainer#testSignalRequestDeliveryToNM fails intermittently with Fair Scheduler. (Contributed by Miklos Szegedi) 
(cherry picked from commit cbd2b73ef8)
 2017-10-19 16:40:36 -07:00
Wangda Tan 73cbc373e0 YARN-7345. GPU Isolation: Incorrect minor device numbers written to devices.deny file. (Jonathan Hung via wangda) 
(cherry picked from commit c1b08ba720)
 2017-10-19 14:51:22 -07:00
Wangda Tan 03fee4de9e YARN-7338. Support same origin policy for cross site scripting prevention. (Sunil G via wangda) 
(cherry picked from commit 298b174f66)
 2017-10-19 14:51:14 -07:00
Haibo Chen 362f67c1f3 HADOOP-14771. hadoop-client does not include hadoop-yarn-client. (Ajay Kumar via Haibo Chen) 
(cherry picked from commit 3dd3d1dd77)
 2017-10-19 13:39:44 -07:00
Zhe Zhang aecf6c50d3 HDFS-12502. nntop should support a category based on FilesInGetListingOps. 
(cherry picked from commit 60bfee270e)
 2017-10-18 23:52:07 -07:00