Commit Graph

16252 Commits

Author SHA1 Message Date
Arpit Agarwal 641d6c0822 HDFS-11419. Performance analysis of new DFSNetworkTopology#chooseRandom. Contributed by Chen Liang. 2017-06-08 10:44:43 -07:00
Arpit Agarwal 8348d2b13b HDFS-11866. JournalNode Sync should be off by default in hdfs-default.xml. Contributed by Hanisha Koneru. 2017-06-08 10:44:43 -07:00
Wangda Tan 4a8814b7e1 YARN-6493. Print requested node partition in assignContainer logs. (Jonathan Hung via wangda)
Change-Id: Ib20326daac10acad363befb0ae0998441fa5b32d
2017-06-08 10:44:43 -07:00
Wangda Tan 56785ab28d YARN-2113. Add cross-user preemption within CapacityScheduler's leaf-queue. (Sunil G via wangda)
Change-Id: I9b19f69788068be05b3295247cdd7b972f8a573c
2017-06-08 10:44:43 -07:00
Brahma Reddy Battula 9b09503c8b HDFS-11849. JournalNode startup failure exception should be logged in log file. Contributed By Surendra Singh Lilhore. 2017-06-08 10:44:43 -07:00
Brahma Reddy Battula 811b451229 HDFS-11863. Document missing metrics for blocks count in pending IBR. Contributed By Yiqun Lin. 2017-06-08 10:44:43 -07:00
Sunil G 8ec366b0f8 YARN-6584. Correct license headers in hadoop-common, hdfs, yarn and mapreduce. Contributed by Yeliang Cang. 2017-06-08 10:44:43 -07:00
Yufei Gu c87683d5fd YARN-6111. Rumen input does't work in SLS. Contributed by Yufei Gu. 2017-06-08 10:44:43 -07:00
Sunil G 29cbb8cb77 YARN-5705. Show timeline data from ATS v2 in new web UI. Contributed by Akhil PB. 2017-06-08 10:44:43 -07:00
Mingliang Liu aab300609e HDFS-11862. Option -v missing for du command in FileSystemShell.md. Contributed by Yiqun Lin 2017-06-08 10:44:42 -07:00
Jian He 952b26d7c5 YARN-6627. Use deployed webapp folder to launch new YARN UI. Contributed by Sunil G 2017-06-08 10:44:42 -07:00
Robert Kanter faf36776c7 YARN-6602. Impersonation does not work if standby RM is contacted first (rkanter) 2017-06-08 10:44:42 -07:00
Yufei Gu 7851ae12cf YARN-6249. TestFairSchedulerPreemption fails inconsistently. (Tao Jie via Yufei Gu) 2017-06-08 10:44:42 -07:00
Mingliang Liu 08d32a76bf HDFS-11803. Add -v option for du command to show header line. Contributed by Xiaobing Zhou 2017-06-08 10:44:42 -07:00
Yufei Gu 9bc4df69ee YARN-6540. Resource Manager is spelled "Resource Manger" in ResourceManagerRestart.md and ResourceManagerHA.md. (Grant Sohn via Yufei Gu) 2017-06-08 10:44:42 -07:00
Mingliang Liu d1b23b3dca HADOOP-14432. S3A copyFromLocalFile to be robust, tested. Contributed by Steve Loughran 2017-06-08 10:44:42 -07:00
Eric Payne 3b481de001 YARN-6618. TestNMLeveldbStateStoreService#testCompactionCycle can fail if compaction occurs more than once. Contributed by Jason Lowe. 2017-06-08 10:44:42 -07:00
Chris Douglas 83fef23141 HADOOP-11869. Suppress ParameterNumber checkstyle violations for overridden methods. Contributed by Jonathan Eagles 2017-06-08 10:44:42 -07:00
Yongjun Zhang 1252aa3781 HADOOP-14407. DistCp - Introduce a configurable copy buffer size. (Omkar Aradhya K S via Yongjun Zhang) 2017-06-08 10:44:42 -07:00
Sunil G 8bee566786 YARN-6560. SLS doesn't honor node total resource specified in sls-runner.xml. Contributed by Wangda Tan. 2017-06-08 10:44:42 -07:00
Steve Loughran bbd9e9d7d5 HADOOP-11572. s3a delete() operation fails during a concurrent delete of child entries.
Contributed by Steve Loughran.

(cherry picked from commit 2ac5aab8d7)
2017-06-08 10:44:42 -07:00
Varun Vasudev 244274bff2 Sanitize arguments before launching Docker containers. 2017-06-08 10:44:41 -07:00
Varun Vasudev da43530012 Validate docker image name before launching container. 2017-06-08 10:44:41 -07:00
Chris Douglas 714963f003 YARN-6577. Remove unused ContainerLocalization classes. Contributed by ZhangBing Lin 2017-06-08 10:44:41 -07:00
Arpit Agarwal c3f029c1d8 HDFS-11842. TestDataNodeOutlierDetectionViaMetrics UT fails intermittently. Controbuted by Hanisha Koneru. 2017-06-08 10:44:41 -07:00
Chris Douglas 27845d5269 HADOOP-14434. Use MoveFileEx to allow renaming a file when the destination exists. Contributed by Lukas Majercak 2017-06-08 10:44:41 -07:00
Mingliang Liu 37d7afc29b HADOOP-14427. Avoid reloading of Configuration in ViewFileSystem creation. Contributed by Vinayakumar B 2017-06-08 10:44:41 -07:00
Akira Ajisaka cdf35ee06b HADOOP-14415. Use java.lang.AssertionError instead of junit.framework.AssertionFailedError. Contributed by Chen Liang. 2017-06-08 10:44:41 -07:00
Akira Ajisaka d423ac2604 MAPREDUCE-6459. Native task crashes when merging spilled file on ppc64. Contributed by Tao Jie and Ayappan. 2017-06-08 10:44:41 -07:00
Akira Ajisaka f560d46e3a HADOOP-14419. Remove findbugs report from docs profile. Contributed by Andras Bokor. 2017-06-08 10:44:41 -07:00
Rohith Sharma K S a1ad4ea273 HADOOP-14412. HostsFileReader#getHostDetails is very expensive on large clusters. Contributed by Jason Lowe. 2017-06-08 10:44:41 -07:00
Arpit Agarwal 5ea7e16fa4 HDFS-11827. NPE is thrown when log level changed in BlockPlacementPolicyDefault#chooseRandom() method. Contributed by xupeng. 2017-06-08 10:44:41 -07:00
Robert Kanter e774688409 YARN-6447. Provide container sandbox policies for groups (gphillips via rkanter) 2017-06-08 10:44:41 -07:00
Robert Kanter 3defe7d85b YARN-6535. Program needs to exit when SLS finishes. (yufeigu via rkanter) 2017-06-08 10:44:41 -07:00
Mingliang Liu 5d20b2eeab HADOOP-14416. Path starting with 'wasb:///' not resolved correctly while authorizing with WASB-Ranger. Contributed by Sivaguru Sankaridurg 2017-06-08 10:44:41 -07:00
Jian He f8be02703a YARN-6306. NMClient API change for container upgrade. Contributed by Arun Suresh 2017-06-08 10:44:40 -07:00
Akira Ajisaka 1c6ec991b5 HDFS-11696. Fix warnings from Spotbugs in hadoop-hdfs. Contributed by Yiqun Lin. 2017-06-08 10:44:40 -07:00
Kihwal Lee 915b9f7fcf HDFS-11641. Reduce cost of audit logging by using FileStatus instead of HdfsFileStatus. Contributed by Daryn Sharp. 2017-06-08 10:44:40 -07:00
Akira Ajisaka eec43a8c56 HDFS-11833. HDFS architecture documentation descibes outdated placement policy. Contributed by Chen Liang. 2017-06-08 10:44:40 -07:00
Jason Lowe b5cedb7022 YARN-6603. NPE in RMAppsBlock. Contributed by Jason Lowe 2017-06-08 10:44:40 -07:00
Jonathan Eagles 229cb89c31 YARN-6598. History server getApplicationReport NPE when fetching report for pre-2.8 job (Jason Lowe via jeagles) 2017-06-08 10:44:40 -07:00
Carlo Curino 571bcfe6d3 YARN-6587. Refactor of ResourceManager#startWebApp in a Util class. (Giovanni Matteo Fumarola via curino). 2017-06-08 10:44:40 -07:00
Jason Lowe 0fe0687c3e HDFS-11818. TestBlockManager.testSufficientlyReplBlocksUsesNewRack fails intermittently. Contributed by Nathan Roberts 2017-06-08 10:44:40 -07:00
Jason Lowe 192f1e6318 HADOOP-14376. Memory leak when reading a compressed file using the native library. Contributed by Eli Acherkan 2017-06-08 10:44:40 -07:00
Haibo Chen 15c7526e2c YARN-6580. Incorrect logger for FairSharePolicy. (Vrushali C via Haibo Chen) 2017-06-08 10:44:40 -07:00
Akira Ajisaka d7cbd2e985 HADOOP-14375. Remove tomcat support from hadoop-functions.sh. Contributed by John Zhuge. 2017-06-08 10:44:40 -07:00
Vinayakumar B be303c2990 HDFS-11674. reserveSpaceForReplicas is not released if append request failed due to mirror down and replica recovered (Contributed by Vinayakumar B) 2017-06-08 10:44:40 -07:00
Akira Ajisaka ccdcc34490 HADOOP-14401. maven-project-info-reports-plugin can be removed. Contributed by Andras Bokor. 2017-06-08 10:44:39 -07:00
Andrew Wang b78d4b20fd HDFS-11757. Query StreamCapabilities when creating balancer's lock file. Contributed by SammiChen. 2017-06-08 10:44:39 -07:00
Daniel Templeton 37ea21449c YARN-6380. FSAppAttempt keeps redundant copy of the queue 2017-06-08 10:44:39 -07:00