16200 Commits

Author SHA1 Message Date
Wangda Tan
4a8814b7e1 YARN-6493. Print requested node partition in assignContainer logs. (Jonathan Hung via wangda)
Change-Id: Ib20326daac10acad363befb0ae0998441fa5b32d
2017-06-08 10:44:43 -07:00
Wangda Tan
56785ab28d YARN-2113. Add cross-user preemption within CapacityScheduler's leaf-queue. (Sunil G via wangda)
Change-Id: I9b19f69788068be05b3295247cdd7b972f8a573c
2017-06-08 10:44:43 -07:00
Brahma Reddy Battula
9b09503c8b HDFS-11849. JournalNode startup failure exception should be logged in log file. Contributed By Surendra Singh Lilhore. 2017-06-08 10:44:43 -07:00
Brahma Reddy Battula
811b451229 HDFS-11863. Document missing metrics for blocks count in pending IBR. Contributed By Yiqun Lin. 2017-06-08 10:44:43 -07:00
Sunil G
8ec366b0f8 YARN-6584. Correct license headers in hadoop-common, hdfs, yarn and mapreduce. Contributed by Yeliang Cang. 2017-06-08 10:44:43 -07:00
Yufei Gu
c87683d5fd YARN-6111. Rumen input does't work in SLS. Contributed by Yufei Gu. 2017-06-08 10:44:43 -07:00
Sunil G
29cbb8cb77 YARN-5705. Show timeline data from ATS v2 in new web UI. Contributed by Akhil PB. 2017-06-08 10:44:43 -07:00
Mingliang Liu
aab300609e HDFS-11862. Option -v missing for du command in FileSystemShell.md. Contributed by Yiqun Lin 2017-06-08 10:44:42 -07:00
Jian He
952b26d7c5 YARN-6627. Use deployed webapp folder to launch new YARN UI. Contributed by Sunil G 2017-06-08 10:44:42 -07:00
Robert Kanter
faf36776c7 YARN-6602. Impersonation does not work if standby RM is contacted first (rkanter) 2017-06-08 10:44:42 -07:00
Yufei Gu
7851ae12cf YARN-6249. TestFairSchedulerPreemption fails inconsistently. (Tao Jie via Yufei Gu) 2017-06-08 10:44:42 -07:00
Mingliang Liu
08d32a76bf HDFS-11803. Add -v option for du command to show header line. Contributed by Xiaobing Zhou 2017-06-08 10:44:42 -07:00
Yufei Gu
9bc4df69ee YARN-6540. Resource Manager is spelled "Resource Manger" in ResourceManagerRestart.md and ResourceManagerHA.md. (Grant Sohn via Yufei Gu) 2017-06-08 10:44:42 -07:00
Mingliang Liu
d1b23b3dca HADOOP-14432. S3A copyFromLocalFile to be robust, tested. Contributed by Steve Loughran 2017-06-08 10:44:42 -07:00
Eric Payne
3b481de001 YARN-6618. TestNMLeveldbStateStoreService#testCompactionCycle can fail if compaction occurs more than once. Contributed by Jason Lowe. 2017-06-08 10:44:42 -07:00
Chris Douglas
83fef23141 HADOOP-11869. Suppress ParameterNumber checkstyle violations for overridden methods. Contributed by Jonathan Eagles 2017-06-08 10:44:42 -07:00
Yongjun Zhang
1252aa3781 HADOOP-14407. DistCp - Introduce a configurable copy buffer size. (Omkar Aradhya K S via Yongjun Zhang) 2017-06-08 10:44:42 -07:00
Sunil G
8bee566786 YARN-6560. SLS doesn't honor node total resource specified in sls-runner.xml. Contributed by Wangda Tan. 2017-06-08 10:44:42 -07:00
Steve Loughran
bbd9e9d7d5 HADOOP-11572. s3a delete() operation fails during a concurrent delete of child entries.
Contributed by Steve Loughran.

(cherry picked from commit 2ac5aab8d725f761a9f9723471a4426f6b5d78c4)
2017-06-08 10:44:42 -07:00
Varun Vasudev
244274bff2 Sanitize arguments before launching Docker containers. 2017-06-08 10:44:41 -07:00
Varun Vasudev
da43530012 Validate docker image name before launching container. 2017-06-08 10:44:41 -07:00
Chris Douglas
714963f003 YARN-6577. Remove unused ContainerLocalization classes. Contributed by ZhangBing Lin 2017-06-08 10:44:41 -07:00
Arpit Agarwal
c3f029c1d8 HDFS-11842. TestDataNodeOutlierDetectionViaMetrics UT fails intermittently. Controbuted by Hanisha Koneru. 2017-06-08 10:44:41 -07:00
Chris Douglas
27845d5269 HADOOP-14434. Use MoveFileEx to allow renaming a file when the destination exists. Contributed by Lukas Majercak 2017-06-08 10:44:41 -07:00
Mingliang Liu
37d7afc29b HADOOP-14427. Avoid reloading of Configuration in ViewFileSystem creation. Contributed by Vinayakumar B 2017-06-08 10:44:41 -07:00
Akira Ajisaka
cdf35ee06b HADOOP-14415. Use java.lang.AssertionError instead of junit.framework.AssertionFailedError. Contributed by Chen Liang. 2017-06-08 10:44:41 -07:00
Akira Ajisaka
d423ac2604 MAPREDUCE-6459. Native task crashes when merging spilled file on ppc64. Contributed by Tao Jie and Ayappan. 2017-06-08 10:44:41 -07:00
Akira Ajisaka
f560d46e3a HADOOP-14419. Remove findbugs report from docs profile. Contributed by Andras Bokor. 2017-06-08 10:44:41 -07:00
Rohith Sharma K S
a1ad4ea273 HADOOP-14412. HostsFileReader#getHostDetails is very expensive on large clusters. Contributed by Jason Lowe. 2017-06-08 10:44:41 -07:00
Arpit Agarwal
5ea7e16fa4 HDFS-11827. NPE is thrown when log level changed in BlockPlacementPolicyDefault#chooseRandom() method. Contributed by xupeng. 2017-06-08 10:44:41 -07:00
Robert Kanter
e774688409 YARN-6447. Provide container sandbox policies for groups (gphillips via rkanter) 2017-06-08 10:44:41 -07:00
Robert Kanter
3defe7d85b YARN-6535. Program needs to exit when SLS finishes. (yufeigu via rkanter) 2017-06-08 10:44:41 -07:00
Mingliang Liu
5d20b2eeab HADOOP-14416. Path starting with 'wasb:///' not resolved correctly while authorizing with WASB-Ranger. Contributed by Sivaguru Sankaridurg 2017-06-08 10:44:41 -07:00
Jian He
f8be02703a YARN-6306. NMClient API change for container upgrade. Contributed by Arun Suresh 2017-06-08 10:44:40 -07:00
Akira Ajisaka
1c6ec991b5 HDFS-11696. Fix warnings from Spotbugs in hadoop-hdfs. Contributed by Yiqun Lin. 2017-06-08 10:44:40 -07:00
Kihwal Lee
915b9f7fcf HDFS-11641. Reduce cost of audit logging by using FileStatus instead of HdfsFileStatus. Contributed by Daryn Sharp. 2017-06-08 10:44:40 -07:00
Akira Ajisaka
eec43a8c56 HDFS-11833. HDFS architecture documentation descibes outdated placement policy. Contributed by Chen Liang. 2017-06-08 10:44:40 -07:00
Jason Lowe
b5cedb7022 YARN-6603. NPE in RMAppsBlock. Contributed by Jason Lowe 2017-06-08 10:44:40 -07:00
Jonathan Eagles
229cb89c31 YARN-6598. History server getApplicationReport NPE when fetching report for pre-2.8 job (Jason Lowe via jeagles) 2017-06-08 10:44:40 -07:00
Carlo Curino
571bcfe6d3 YARN-6587. Refactor of ResourceManager#startWebApp in a Util class. (Giovanni Matteo Fumarola via curino). 2017-06-08 10:44:40 -07:00
Jason Lowe
0fe0687c3e HDFS-11818. TestBlockManager.testSufficientlyReplBlocksUsesNewRack fails intermittently. Contributed by Nathan Roberts 2017-06-08 10:44:40 -07:00
Jason Lowe
192f1e6318 HADOOP-14376. Memory leak when reading a compressed file using the native library. Contributed by Eli Acherkan 2017-06-08 10:44:40 -07:00
Haibo Chen
15c7526e2c YARN-6580. Incorrect logger for FairSharePolicy. (Vrushali C via Haibo Chen) 2017-06-08 10:44:40 -07:00
Akira Ajisaka
d7cbd2e985 HADOOP-14375. Remove tomcat support from hadoop-functions.sh. Contributed by John Zhuge. 2017-06-08 10:44:40 -07:00
Vinayakumar B
be303c2990 HDFS-11674. reserveSpaceForReplicas is not released if append request failed due to mirror down and replica recovered (Contributed by Vinayakumar B) 2017-06-08 10:44:40 -07:00
Akira Ajisaka
ccdcc34490 HADOOP-14401. maven-project-info-reports-plugin can be removed. Contributed by Andras Bokor. 2017-06-08 10:44:39 -07:00
Andrew Wang
b78d4b20fd HDFS-11757. Query StreamCapabilities when creating balancer's lock file. Contributed by SammiChen. 2017-06-08 10:44:39 -07:00
Daniel Templeton
37ea21449c YARN-6380. FSAppAttempt keeps redundant copy of the queue 2017-06-08 10:44:39 -07:00
Min Shen
412bb9c1a6 YARN-5543. ResourceManager SchedulingMonitor could potentially terminate the preemption checker thread. Contributed by Min Shen. 2017-06-08 10:44:39 -07:00
Daniel Templeton
d76fedffd7 HADOOP-14413. Add Javadoc comment for jitter parameter on CachingGetSpaceUsed
(Contributed by Erik Krogen via Daniel Templeton)
2017-06-08 10:44:39 -07:00