Commit Graph

12243 Commits

Author SHA1 Message Date
Wangda Tan 679652fcbd Addendum patch for fix javadocs failure which is caused by YARN-3141. (wangda)
(cherry picked from commit e45307c9a0)
2016-09-20 11:21:47 -07:00
Jason Lowe 7231000149 YARN-5655. TestContainerManagerSecurity#testNMTokens is asserting. Contributed by Robert Kanter
(cherry picked from commit c6d1d742e7)
2016-09-20 14:16:47 +00:00
Jian He 3acd30df71 YARN-3140. Improve locks in AbstractCSQueue/LeafQueue/ParentQueue. Contributed by Wangda Tan
(cherry picked from commit 2b66d9ec5b)
2016-09-20 15:05:54 +08:00
Xiao Chen 4e376f162f HDFS-10875. Optimize du -x to cache intermediate result. Contributed by Xiao Chen.
(cherry picked from commit e52d6e7a46)
2016-09-19 21:45:05 -07:00
Xiao Chen b6a60d715d HDFS-10489. Deprecate dfs.encryption.key.provider.uri for HDFS encryption zones. Contributed by Xiao Chen.
(cherry picked from commit ea839bd48e)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/HdfsConfiguration.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml
2016-09-19 16:38:18 -07:00
Chris Nauroth e19f910245 HADOOP-13169. Randomize file list in SimpleCopyListing. Contributed by Rajesh Balamohan.
(cherry picked from commit 98bdb51397)
2016-09-19 15:16:56 -07:00
Jason Lowe 035f5f8f1d YARN-5540. Scheduler spends too much time looking at empty priorities. Contributed by Jason Lowe
(cherry picked from commit 7558dbbb48)
2016-09-19 20:33:59 +00:00
Jian He 9942ca2bf0 YARN-3141. Improve locks in SchedulerApplicationAttempt/FSAppAttempt/FiCaSchedulerApp. Contributed by Wangda Tan
(cherry picked from commit b8a30f2f17)
2016-09-19 17:08:57 +08:00
Arun Suresh dfaac56433 YARN-5637. Changes in NodeManager to support Container rollback and commit. (asuresh)
(cherry picked from commit 3552c2b99d)
2016-09-18 11:06:38 -07:00
Arun Suresh 00759f50be YARN-5657. Fix TestDefaultContainerExecutor. (asuresh)
(cherry picked from commit f67237cbe7)
2016-09-17 09:32:55 -07:00
Naganarasimha 20729ead91 YARN-5642. Typos in 9 log messages. Contributed by Mehran Hassani 2016-09-17 10:37:42 +05:30
Naganarasimha fa80972efb MAPREDUCE-6777. Typos in 4 log messages. Contributed by Mehran Hassani 2016-09-17 10:21:13 +05:30
Naganarasimha 656b520dc6 YARN-4232. TopCLI console support for HA mode. Contributed by Bibin A Chundatt
(cherry picked from commit ade7c2bc9c)
2016-09-17 09:54:29 +05:30
Andrew Wang b03a0be7a3 HDFS-10823. Implement HttpFSFileSystem#listStatusIterator.
(cherry picked from commit 8a40953058)
2016-09-16 15:37:49 -07:00
Wei-Chiu Chuang 031d5f6c5b HADOOP-13580. If user is unauthorized, log "unauthorized" instead of "Invalid signed text:". Contributed by Wei-Chiu Chuang.
(cherry picked from commit f6f3a447bf)
2016-09-16 14:53:50 -07:00
Wei-Chiu Chuang 40089eadf5 HADOOP-13412. Move dev-support/checkstyle/suppressions.xml to hadoop-build-tools. Contributed by John Zhuge.
(cherry picked from commit cd099a63d5)
2016-09-16 14:42:13 -07:00
Steve Loughran 523bc88a28 HADOOP-13160. Suppress checkstyle JavadocPackage check for test source. John Zhuge via stevel
(cherry picked from commit dcbb7009b6)
2016-09-16 14:39:00 -07:00
Wei-Chiu Chuang 1a2c771501 HADOOP-13411. Checkstyle suppression by annotation or comment. Contributed by John Zhuge.
(cherry picked from commit 0e68e14d55)
2016-09-16 14:17:20 -07:00
Akira Ajisaka 214b6d16d5 HDFS-10862. Typos in 4 log messages. Contributed by Mehran Hassani.
(cherry picked from commit b09a03cd7d)
2016-09-16 16:12:19 +09:00
Wangda Tan ee101e49fa YARN-4091. Add REST API to retrieve scheduler activity. (Chen Ge via wangda) 2016-09-15 14:49:03 -07:00
Arun Suresh 16aecc699d YARN-5620. Core changes in NodeManager to support re-initialization of Containers with new launchContext. (asuresh)
(cherry picked from commit 40b5a59b72)
2016-09-15 08:11:14 -07:00
Akira Ajisaka e485ace0dd HADOOP-13616. Broken code snippet area in Hadoop Benchmarking. Contributed by Kai Sasaki.
(cherry picked from commit 7cad7b7046)
2016-09-15 23:43:20 +09:00
Arpit Agarwal 853e1e6946 HDFS-10805. Reduce runtime for append test. Contributed by Gergely Novak. 2016-09-14 09:31:24 -07:00
Steve Loughran 3b9268cfba HADOOP-13606 swift FS to add a service load metadata file. Contributed by Steve Loughran 2016-09-14 15:44:45 +01:00
Akira Ajisaka 3f36ac9f33 HADOOP-13598. Add eol=lf for unix format files in .gitattributes. Contributed by Yiqun Lin.
(cherry picked from commit 696bc0e0ab)
2016-09-14 11:15:27 +09:00
Jing Zhao 55600b38a8 HADOOP-13546. Override equals and hashCode of the default retry policy to avoid connection leakage. Contributed by Xiaobing Zhou.
(cherry picked from commit 08d8e0ba25)
2016-09-13 11:13:37 -07:00
Andrew Wang abaad976cd HDFS-10837. Standardize serializiation of WebHDFS DirectoryListing.
(cherry picked from commit db6d243cf8)
2016-09-13 11:02:43 -07:00
Jason Lowe 4f2f0eb0bb YARN-5630. NM fails to start after downgrade from 2.8 to 2.7. Contributed by Jason Lowe
(cherry picked from commit e793309735)
2016-09-13 14:43:21 +00:00
Rohith Sharma K S 8c8ff0cfa3 YARN-5631. Missing refreshClusterMaxPriority usage in rmadmin help message. Contributed by Kai Sasaki.
(cherry picked from commit 729de3e6b6)
2016-09-13 15:27:20 +05:30
Akira Ajisaka 764cf431ca HDFS-10856. Update the comment of BPServiceActor$Scheduler#scheduleNextBlockReport. Contributed by Yiqun Lin.
(cherry picked from commit f0876b8b60)
2016-09-13 14:51:04 +09:00
Yongjun Zhang 223ce108a1 HDFS-10657. testAclCLI.xml setfacl test should expect mask r-x. (John Zhuge via Yongjun Zhang)
(cherry picked from commit d2466ec3e0)
2016-09-12 21:46:09 -07:00
Arpit Agarwal 6948691ad1 HDFS-10830. FsDatasetImpl#removeVolumes crashes with IllegalMonitorStateException when vol being removed is in use. (Arpit Agarwal and Manoj Govindassamy) 2016-09-10 18:22:15 -07:00
Arpit Agarwal 012b266e5e HDFS-10742. Measure lock time in FsDatasetImpl. Contributed by Chen Liang. 2016-09-10 18:04:00 -07:00
Arpit Agarwal ad0ac6cced HDFS-10682. Replace FsDatasetImpl object lock with a separate lock object. (Contributed by Chen Liang) 2016-09-10 17:48:27 -07:00
Xiao Chen bb6d866207 HDFS-9781. FsDatasetImpl#getBlockReports can occasionally throw NullPointerException. Contributed by Manoj Govindassamy. 2016-09-09 18:25:35 -07:00
Andrew Wang f448ce2a89 HDFS-10832. Propagate ACL bit and isEncrypted bit in HttpFS FileStatus permissions.
(cherry picked from commit cba973f036)
2016-09-09 12:16:08 -07:00
Chris Douglas 806a8dea38 MAPREDUCE-6628. Potential memory leak in CryptoOutputStream. Contributed by Mariappan Asokan
(cherry picked from commit 9f192cc5ac)
2016-09-09 11:14:30 -07:00
Steve Loughran 6a016faf59 HADOOP-13540 improve section on troubleshooting s3a auth problems. Contributed by Steve Loughran 2016-09-09 18:54:34 +01:00
Kihwal Lee d234990208 HADOOP-10940. RPC client does no bounds checking of responses. Contributed by Daryn Sharp.
(cherry picked from commit d4d076876a)
2016-09-09 10:46:37 -05:00
Andrew Wang 72ea641468 HDFS-10831. Add log when URLConnectionFactory.openConnection failed. Contributed by yunjiong zhao.
(cherry picked from commit b07c266dca)
2016-09-08 18:30:26 -07:00
Akira Ajisaka c0756dfef6 HDFS-10847. Complete the document for FileDistribution processor in OfflineImageViewer. Contributed by Yiqun Lin.
(cherry picked from commit 20a20c2f6e)
2016-09-09 01:35:36 +09:00
Akira Ajisaka fe6dd66174 HDFS-10778. Add -format option to make the output of FileDistribution processor human-readable in OfflineImageViewer.
(cherry picked from commit 63f594892e)
2016-09-08 15:18:25 +09:00
Steve Loughran 5f8b6f0313 HADOOP-13541 explicitly declare the Joda time version S3A depends on. Contributed by Stevel Loughran 2016-09-07 12:24:15 +01:00
Karthik Kambatla a064375e68 YARN-5616. Clean up WeightAdjuster. (Yufei Gu via kasha)
(cherry picked from commit c0e492e50f)
2016-09-06 22:40:49 -07:00
Xiao Chen d157733082 HADOOP-13558. UserGroupInformation created from a Subject incorrectly tries to renew the Kerberos ticket. Contributed by Xiao Chen.
(cherry picked from commit 680be58aac)
2016-09-06 20:54:38 -07:00
Arpit Agarwal f9415b7a7e HDFS-9038. DFS reserved space is erroneously counted towards non-DFS used. (Brahma Reddy Battula) 2016-09-06 13:44:22 -07:00
Xiao Chen 3025992bd3 HDFS-10841. Remove duplicate or unused variable in appendFile(). Contributed by Kihwal Lee.
(cherry picked from commit f6c0b7543f)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirAppendOp.java
2016-09-06 11:52:30 -07:00
Chris Nauroth e28930a38b HADOOP-13447. Refactor S3AFileSystem to support introduction of separate metadata repository and tests. Contributed by Chris Nauroth.
(cherry picked from commit d152557cf7)
2016-09-06 09:40:41 -07:00
Kihwal Lee 614f9a62c4 HADOOP-13549. Eliminate intermediate buffer for server-side PB encoding. Contributed by Daryn Sharp.
(cherry picked from commit 39d1b1d747)
2016-09-06 10:15:57 -05:00
Varun Vasudev ec3a651b17 YARN-5576. Allow resource localization while container is running. Contributed by Jian He. 2016-09-06 20:07:54 +05:30