Commit Graph

16241 Commits

Author SHA1 Message Date
Robert Kanter faf36776c7 YARN-6602. Impersonation does not work if standby RM is contacted first (rkanter) 2017-06-08 10:44:42 -07:00
Yufei Gu 7851ae12cf YARN-6249. TestFairSchedulerPreemption fails inconsistently. (Tao Jie via Yufei Gu) 2017-06-08 10:44:42 -07:00
Mingliang Liu 08d32a76bf HDFS-11803. Add -v option for du command to show header line. Contributed by Xiaobing Zhou 2017-06-08 10:44:42 -07:00
Yufei Gu 9bc4df69ee YARN-6540. Resource Manager is spelled "Resource Manger" in ResourceManagerRestart.md and ResourceManagerHA.md. (Grant Sohn via Yufei Gu) 2017-06-08 10:44:42 -07:00
Mingliang Liu d1b23b3dca HADOOP-14432. S3A copyFromLocalFile to be robust, tested. Contributed by Steve Loughran 2017-06-08 10:44:42 -07:00
Eric Payne 3b481de001 YARN-6618. TestNMLeveldbStateStoreService#testCompactionCycle can fail if compaction occurs more than once. Contributed by Jason Lowe. 2017-06-08 10:44:42 -07:00
Chris Douglas 83fef23141 HADOOP-11869. Suppress ParameterNumber checkstyle violations for overridden methods. Contributed by Jonathan Eagles 2017-06-08 10:44:42 -07:00
Yongjun Zhang 1252aa3781 HADOOP-14407. DistCp - Introduce a configurable copy buffer size. (Omkar Aradhya K S via Yongjun Zhang) 2017-06-08 10:44:42 -07:00
Sunil G 8bee566786 YARN-6560. SLS doesn't honor node total resource specified in sls-runner.xml. Contributed by Wangda Tan. 2017-06-08 10:44:42 -07:00
Steve Loughran bbd9e9d7d5 HADOOP-11572. s3a delete() operation fails during a concurrent delete of child entries.
Contributed by Steve Loughran.

(cherry picked from commit 2ac5aab8d7)
2017-06-08 10:44:42 -07:00
Varun Vasudev 244274bff2 Sanitize arguments before launching Docker containers. 2017-06-08 10:44:41 -07:00
Varun Vasudev da43530012 Validate docker image name before launching container. 2017-06-08 10:44:41 -07:00
Chris Douglas 714963f003 YARN-6577. Remove unused ContainerLocalization classes. Contributed by ZhangBing Lin 2017-06-08 10:44:41 -07:00
Arpit Agarwal c3f029c1d8 HDFS-11842. TestDataNodeOutlierDetectionViaMetrics UT fails intermittently. Controbuted by Hanisha Koneru. 2017-06-08 10:44:41 -07:00
Chris Douglas 27845d5269 HADOOP-14434. Use MoveFileEx to allow renaming a file when the destination exists. Contributed by Lukas Majercak 2017-06-08 10:44:41 -07:00
Mingliang Liu 37d7afc29b HADOOP-14427. Avoid reloading of Configuration in ViewFileSystem creation. Contributed by Vinayakumar B 2017-06-08 10:44:41 -07:00
Akira Ajisaka cdf35ee06b HADOOP-14415. Use java.lang.AssertionError instead of junit.framework.AssertionFailedError. Contributed by Chen Liang. 2017-06-08 10:44:41 -07:00
Akira Ajisaka d423ac2604 MAPREDUCE-6459. Native task crashes when merging spilled file on ppc64. Contributed by Tao Jie and Ayappan. 2017-06-08 10:44:41 -07:00
Akira Ajisaka f560d46e3a HADOOP-14419. Remove findbugs report from docs profile. Contributed by Andras Bokor. 2017-06-08 10:44:41 -07:00
Rohith Sharma K S a1ad4ea273 HADOOP-14412. HostsFileReader#getHostDetails is very expensive on large clusters. Contributed by Jason Lowe. 2017-06-08 10:44:41 -07:00
Arpit Agarwal 5ea7e16fa4 HDFS-11827. NPE is thrown when log level changed in BlockPlacementPolicyDefault#chooseRandom() method. Contributed by xupeng. 2017-06-08 10:44:41 -07:00
Robert Kanter e774688409 YARN-6447. Provide container sandbox policies for groups (gphillips via rkanter) 2017-06-08 10:44:41 -07:00
Robert Kanter 3defe7d85b YARN-6535. Program needs to exit when SLS finishes. (yufeigu via rkanter) 2017-06-08 10:44:41 -07:00
Mingliang Liu 5d20b2eeab HADOOP-14416. Path starting with 'wasb:///' not resolved correctly while authorizing with WASB-Ranger. Contributed by Sivaguru Sankaridurg 2017-06-08 10:44:41 -07:00
Jian He f8be02703a YARN-6306. NMClient API change for container upgrade. Contributed by Arun Suresh 2017-06-08 10:44:40 -07:00
Akira Ajisaka 1c6ec991b5 HDFS-11696. Fix warnings from Spotbugs in hadoop-hdfs. Contributed by Yiqun Lin. 2017-06-08 10:44:40 -07:00
Kihwal Lee 915b9f7fcf HDFS-11641. Reduce cost of audit logging by using FileStatus instead of HdfsFileStatus. Contributed by Daryn Sharp. 2017-06-08 10:44:40 -07:00
Akira Ajisaka eec43a8c56 HDFS-11833. HDFS architecture documentation descibes outdated placement policy. Contributed by Chen Liang. 2017-06-08 10:44:40 -07:00
Jason Lowe b5cedb7022 YARN-6603. NPE in RMAppsBlock. Contributed by Jason Lowe 2017-06-08 10:44:40 -07:00
Jonathan Eagles 229cb89c31 YARN-6598. History server getApplicationReport NPE when fetching report for pre-2.8 job (Jason Lowe via jeagles) 2017-06-08 10:44:40 -07:00
Carlo Curino 571bcfe6d3 YARN-6587. Refactor of ResourceManager#startWebApp in a Util class. (Giovanni Matteo Fumarola via curino). 2017-06-08 10:44:40 -07:00
Jason Lowe 0fe0687c3e HDFS-11818. TestBlockManager.testSufficientlyReplBlocksUsesNewRack fails intermittently. Contributed by Nathan Roberts 2017-06-08 10:44:40 -07:00
Jason Lowe 192f1e6318 HADOOP-14376. Memory leak when reading a compressed file using the native library. Contributed by Eli Acherkan 2017-06-08 10:44:40 -07:00
Haibo Chen 15c7526e2c YARN-6580. Incorrect logger for FairSharePolicy. (Vrushali C via Haibo Chen) 2017-06-08 10:44:40 -07:00
Akira Ajisaka d7cbd2e985 HADOOP-14375. Remove tomcat support from hadoop-functions.sh. Contributed by John Zhuge. 2017-06-08 10:44:40 -07:00
Vinayakumar B be303c2990 HDFS-11674. reserveSpaceForReplicas is not released if append request failed due to mirror down and replica recovered (Contributed by Vinayakumar B) 2017-06-08 10:44:40 -07:00
Akira Ajisaka ccdcc34490 HADOOP-14401. maven-project-info-reports-plugin can be removed. Contributed by Andras Bokor. 2017-06-08 10:44:39 -07:00
Andrew Wang b78d4b20fd HDFS-11757. Query StreamCapabilities when creating balancer's lock file. Contributed by SammiChen. 2017-06-08 10:44:39 -07:00
Daniel Templeton 37ea21449c YARN-6380. FSAppAttempt keeps redundant copy of the queue 2017-06-08 10:44:39 -07:00
Min Shen 412bb9c1a6 YARN-5543. ResourceManager SchedulingMonitor could potentially terminate the preemption checker thread. Contributed by Min Shen. 2017-06-08 10:44:39 -07:00
Daniel Templeton d76fedffd7 HADOOP-14413. Add Javadoc comment for jitter parameter on CachingGetSpaceUsed
(Contributed by Erik Krogen via Daniel Templeton)
2017-06-08 10:44:39 -07:00
Brahma Reddy Battula 9247aa23ef HADOOP-14410. Correct spelling of 'beginning' and variants. Contributed By Dongtao Zhang 2017-06-08 10:44:39 -07:00
Chris Douglas 39e6331772 HDFS-11681. DatanodeStorageInfo#getBlockIterator() should return an iterator to an unmodifiable set Contributed by Virajith Jalaparti 2017-06-08 10:44:39 -07:00
Mingliang Liu aa6f3238d6 HADOOP-14361. Azure: NativeAzureFileSystem.getDelegationToken() call fails sometimes when invoked concurrently. Contributed by Santhosh G Nayak 2017-06-08 10:44:39 -07:00
Carlo Curino e66c430510 YARN-6473. Create ReservationInvariantChecker to validate ReservationSystem + Scheduler operations. 2017-06-08 10:44:39 -07:00
Daniel Templeton 5a7176ad3b YARN-6571. Fix JavaDoc issues in SchedulingPolicy
(Contributed by Weiwei Yang via Daniel Templeton)
2017-06-08 10:44:39 -07:00
Mingliang Liu d6624931bf HDFS-11800. Document output of 'hdfs count -u' should contain PATHNAME. Contributed by Xiaobing Zhou 2017-06-08 10:44:39 -07:00
Kihwal Lee 070a4830f6 HDFS-11755. Underconstruction blocks can be considered missing. Contributed by Nathan Roberts. 2017-06-08 10:44:39 -07:00
Jason Lowe b7b758ab11 HDFS-11745. Increase HDFS test timeouts from 1 second to 10 seconds. Contributed by Eric Badger 2017-06-08 10:44:39 -07:00
Daniel Templeton 35ee4f56ad YARN-6475. Fix some long function checkstyle issues
(Contributed by Soumabrata Chakraborty via Daniel Templeton)
2017-06-08 10:44:38 -07:00