13240 Commits

Author SHA1 Message Date
Brahma Reddy Battula
e3a65b24bf HADOOP-14449. The ASF Header in ComparableVersion.java and SSLHostnameVerifier.java is not correct. Contributed by ZhangBing Lin.
(cherry picked from commit b7a0c0e7019528fac492e1cb32d374ed014f8673)
2017-05-25 01:04:06 +08:00
Jason Lowe
96a97e7eb2 YARN-6615. AmIpFilter drops query parameters on redirect. Contributed by Wilfred Spiegelenburg
(cherry picked from commit 8bf1949c0efed700781eb47cf18f9f88443ed506)
2017-05-24 11:24:00 -05:00
Brahma Reddy Battula
d61418f34a HDFS-11864. Document Metrics to track usage of memory for writes. Contributed by Yiqun Lin.
(cherry picked from commit 52661e0912a79d1e851afc2b46c941ce952ca63f)
2017-05-23 23:53:27 +08:00
Sunil G
ec346d6377 YARN-6584. Correct license headers in hadoop-common, hdfs, yarn and mapreduce. Contributed by Yeliang Cang. 2017-05-23 07:57:36 +05:30
Wangda Tan
9a8fdfa385 YARN-6493. Print requested node partition in assignContainer logs. (Jonathan Hung via wangda)
Change-Id: Ib20326daac10acad363befb0ae0998441fa5b32d
(cherry picked from commit 8e0f83e49a8987cf45a72c8a9bb8587b86e4c0ed)
2017-05-22 14:43:44 -07:00
Brahma Reddy Battula
ec2468ced1 HDFS-11849. JournalNode startup failure exception should be logged in log file. Contributed By Surendra Singh Lilhore.
(cherry picked from commit 9cab42cc797986081fef184748044f1790a4f039)
2017-05-23 02:40:11 +08:00
Brahma Reddy Battula
2755255744 HDFS-11863. Document missing metrics for blocks count in pending IBR. Contributed By Yiqun Lin.
(cherry picked from commit 2a8fcf0c9a9b5293238a8ab76c19d74a6a3bae72)
2017-05-23 02:23:54 +08:00
Yongjun Zhang
fe185e2c3a HADOOP-14407. DistCp - Introduce a configurable copy buffer size. (Omkar Aradhya K S via Yongjun Zhang) 2017-05-19 21:11:38 -07:00
Robert Kanter
2719cc0388 YARN-6602. Impersonation does not work if standby RM is contacted first (rkanter)
(cherry picked from commit 9855225a790e66835c79816712f432ffa8c599b4)
2017-05-19 15:43:43 -07:00
Yufei Gu
50e263a316 YARN-6249. TestFairSchedulerPreemption fails inconsistently. (Tao Jie via Yufei Gu)
(cherry picked from commit 66bba8c0244e5b17d496e2fa3999991705c11bc7)
2017-05-19 15:22:14 -07:00
Eric Payne
46c54bf200 YARN-6618. TestNMLeveldbStateStoreService#testCompactionCycle can fail if compaction occurs more than once. Contributed by Jason Lowe.
(cherry picked from commit 19482e0d0990feb719678d71971aa849095982fd)
2017-05-19 11:29:02 -05:00
John Zhuge
dad7d0e2ff HADOOP-13911. Remove TRUSTSTORE_PASSWORD related scripts from KMS. Contributed by John Zhuge.
(cherry picked from commit 30f85d7a88a110637757cf7a1f4cdc9ed40f59fb)

Conflicts:
	hadoop-common-project/hadoop-kms/src/main/sbin/kms.sh
	hadoop-common-project/hadoop-kms/src/main/tomcat/ssl-server.xml
2017-05-18 21:33:59 -07:00
John Zhuge
85f7b7e8e4 HDFS-11579. Make HttpFS Tomcat SSL property sslEnabledProtocols and clientAuth configurable. Contributed by John Zhuge. 2017-05-18 18:04:05 -07:00
John Zhuge
145d716a2b HADOOP-14242. Make KMS Tomcat SSL property sslEnabledProtocols and clientAuth configurable. Contributed by John Zhuge. 2017-05-18 18:03:54 -07:00
Steve Loughran
2ac5aab8d7
HADOOP-11572. s3a delete() operation fails during a concurrent delete of child entries.
Contributed by Steve Loughran.
2017-05-18 15:38:46 +01:00
Varun Vasudev
cd1a04e3c6 Sanitize arguments before launching Docker containers. 2017-05-18 11:46:03 +05:30
Varun Vasudev
603a0a316c Validate docker image name before launching container. 2017-05-18 11:31:12 +05:30
Chris Douglas
3d2afb209c YARN-6577. Remove unused ContainerLocalization classes. Contributed by ZhangBing Lin
(cherry picked from commit b23fcc86c670aa896151a2bd8878154d7bb45d13)
2017-05-17 20:40:20 -07:00
Arpit Agarwal
3db695d400 HDFS-11842. TestDataNodeOutlierDetectionViaMetrics UT fails intermittently. Controbuted by Hanisha Koneru. 2017-05-17 19:38:54 -07:00
Chris Douglas
4bb0565443 HADOOP-14434. Use MoveFileEx to allow renaming a file when the destination exists. Contributed by Lukas Majercak
(cherry picked from commit ef9e536a7137d209985d25a4769712c2db2c52bf)
2017-05-17 17:24:36 -07:00
Mingliang Liu
94755e2d6d HADOOP-14427. Avoid reloading of Configuration in ViewFileSystem creation. Contributed by Vinayakumar B
(cherry picked from commit eb7791b4743c593ac7d0f0d08962132723ffe3c6)
2017-05-17 13:21:34 -07:00
Akira Ajisaka
b295924d49
HADOOP-14419. Remove findbugs report from docs profile. Contributed by Andras Bokor.
(cherry picked from commit e6f6682aa864635b9f70b387872701c064455ad5)
2017-05-17 07:41:47 -04:00
Rohith Sharma K S
379e5bd26f HADOOP-14412. HostsFileReader#getHostDetails is very expensive on large clusters. Contributed by Jason Lowe. 2017-05-17 08:27:50 +05:30
Arpit Agarwal
0e95ff78c3 HDFS-11827. NPE is thrown when log level changed in BlockPlacementPolicyDefault#chooseRandom() method. Contributed by xupeng. 2017-05-16 19:51:17 -07:00
Kihwal Lee
82ea3f4545 HDFS-11641. Reduce cost of audit logging by using FileStatus instead of HdfsFileStatus. Contributed by Daryn Sharp. 2017-05-16 15:45:41 -05:00
Mingliang Liu
f3015425d0 HADOOP-14416. Path starting with 'wasb:///' not resolved correctly while authorizing with WASB-Ranger. Contributed by Sivaguru Sankaridurg
(cherry picked from commit b415c6fe743242acf1d1d3eb7ea7091d90d2c0d4)
2017-05-16 11:28:12 -07:00
Jian He
82751ff0cb YARN-6306. NMClient API change for container upgrade. Contributed by Arun Suresh 2017-05-16 10:49:12 -07:00
Akira Ajisaka
c17cb03a23
HDFS-11833. HDFS architecture documentation descibes outdated placement policy. Contributed by Chen Liang.
(cherry picked from commit 1d1c52b42feae5a4271ef4b771d0d8de43e83c15)
2017-05-16 11:53:55 -04:00
Jason Lowe
feb7e92121 YARN-6603. NPE in RMAppsBlock. Contributed by Jason Lowe
(cherry picked from commit 489f85933c508bc26de607b921e56e23b979fce8)
2017-05-16 09:28:42 -05:00
John Zhuge
da7c900fe3 HDFS-11816. Update default SSL cipher list for HttpFS. Contributed by John Zhuge. 2017-05-15 16:26:39 -07:00
John Zhuge
2be559b842 HADOOP-14417. Update default SSL cipher list for KMS. Contributed by John Zhuge. 2017-05-15 16:24:45 -07:00
Jonathan Eagles
d370edc6aa YARN-6598. History server getApplicationReport NPE when fetching report for pre-2.8 job (Jason Lowe via jeagles)
(cherry picked from commit c48f2976a3de60b95c4a5ada4f0131c4cdde177a)
2017-05-15 10:32:47 -05:00
Andrew Wang
18b89e902b HDFS-11644. Support for querying outputstream capabilities. Contributed by Manoj Govindassamy. 2017-05-13 21:41:11 -07:00
Jason Lowe
aeca471ec1 HDFS-11818. TestBlockManager.testSufficientlyReplBlocksUsesNewRack fails intermittently. Contributed by Nathan Roberts 2017-05-12 17:47:17 -05:00
Jason Lowe
955e8316d5 HADOOP-14376. Memory leak when reading a compressed file using the native library. Contributed by Eli Acherkan
(cherry picked from commit 7bc217224891b7f7f0a2e35e37e46b36d8c5309d)
2017-05-12 16:55:49 -05:00
Haibo Chen
6284cc4663 YARN-6580. Incorrect logger for FairSharePolicy. (Vrushali C via Haibo Chen)
(cherry picked from commit 6c35001b9f93fd85a02c3465e87bfd1612f4cce9)
2017-05-12 13:07:17 -07:00
Vinayakumar B
53d9f56a18 HDFS-11674. reserveSpaceForReplicas is not released if append request failed due to mirror down and replica recovered (Contributed by Vinayakumar B)
(cherry picked from commit 1411612aa4e70c704b941723217ed4efd8a0125b)
2017-05-12 07:44:11 +05:30
Daniel Templeton
717f03ecf7 YARN-6380. FSAppAttempt keeps redundant copy of the queue
(cherry picked from commit 90cb5b4635b7a0849912458afad052f569131a59)
2017-05-11 13:48:46 -07:00
Min Shen
9310d24b08 YARN-5543. ResourceManager SchedulingMonitor could potentially terminate the preemption checker thread. Contributed by Min Shen.
(cherry picked from commit 2ada100da7cfe12946e43da2929bd80c2a8bd833)
2017-05-11 13:29:02 -07:00
Daniel Templeton
7213c935c6 HADOOP-14413. Add Javadoc comment for jitter parameter on CachingGetSpaceUsed
(Contributed by Erik Krogen via Daniel Templeton)

(cherry picked from commit 09f28da2d2aae1487bae85ff110794f8346f92a4)
2017-05-11 12:06:39 -07:00
Brahma Reddy Battula
3766e54893 HADOOP-14410. Correct spelling of 'beginning' and variants. Contributed By Dongtao Zhang
(cherry picked from commit 4aae2d40a3e2e732e09b4b8a82623cacc0dc8861)
2017-05-11 23:38:18 +05:30
Allen Wittenauer
5ef3f97c58 HADOOP-11703. git should ignore .DS_Store files on Mac OS X (Abin Shahab via aw)
(cherry picked from commit 344d7cb6dcd3b1752c82b62271799be9e4e10416)
2017-05-10 19:52:25 -07:00
Mingliang Liu
586126956b HADOOP-14361. Azure: NativeAzureFileSystem.getDelegationToken() call fails sometimes when invoked concurrently. Contributed by Santhosh G Nayak
(cherry picked from commit eed731496f63537350206274af09d2118b116a17)
2017-05-10 15:05:54 -07:00
Daniel Templeton
df3d7415c0 YARN-6571. Fix JavaDoc issues in SchedulingPolicy
(Contributed by Weiwei Yang via Daniel Templeton)

(cherry picked from commit 18d54b5ae2f76513548c453e05cdd6d87777cd06)
2017-05-10 14:37:36 -07:00
Mingliang Liu
214f3abe23 HDFS-11800. Document output of 'hdfs count -u' should contain PATHNAME. Contributed by Xiaobing Zhou
(cherry picked from commit 3873904a943fbbd5dcfd154e923b90c0610ed05b)
2017-05-10 14:34:11 -07:00
Kihwal Lee
dfaaa14a47 HDFS-11755. Underconstruction blocks can be considered missing. Contributed by Nathan Roberts. 2017-05-10 14:20:26 -05:00
Jason Lowe
0a4021387f HDFS-11745. Increase HDFS test timeouts from 1 second to 10 seconds. Contributed by Eric Badger
(cherry picked from commit fab73748a1ce982904d332e6ddd46169f186ad54)
2017-05-10 13:03:33 -05:00
Jason Lowe
48b5faa705 MAPREDUCE-6882. Increase MapReduce test timeouts from 1 second to 10 seconds. Contributed by Eric Badger
(cherry picked from commit 1e71fe8c42b7945170c47023e82a0412397ff57e)
2017-05-10 09:58:51 -05:00
Jason Lowe
3230dd1ab6 YARN-6552. Increase YARN test timeouts from 1 second to 10 seconds. Contributed by Eric Badger
(cherry picked from commit 6099deebcb0ea23adc0f0c62db749c8f528869e9)
2017-05-10 08:48:47 -05:00
Akira Ajisaka
d9c3c78b78
HADOOP-14373. License error in org.apache.hadoop.metrics2.util.Servers. Contributed by hu xiaodong.
(cherry picked from commit a5fa954684f517bdf0a50f3fa7a0314f24cc7049)
2017-05-10 05:30:37 -05:00