Commit Graph

11833 Commits

Author SHA1 Message Date
Colin Patrick Mccabe 8280e3bcc2 HDFS-10525. Fix NPE in CacheReplicationMonitor#rescanCachedBlockMap (Xiao Chen via cmccabe)
(cherry picked from commit 2ca73445f5)
2016-06-15 22:50:36 -07:00
Colin Patrick Mccabe 17301ab395 HDFS-10505. OIV's ReverseXML processor should support ACLs (Surendra Singh Lilhore via cmccabe)
(cherry picked from commit 2449db507d)
2016-06-15 22:42:19 -07:00
Akira Ajisaka d1c475ddd4 HADOOP-12892. fix/rewrite create-release. Contributed by Allen Wittenauer. 2016-06-16 14:03:57 +09:00
Ming Ma 32b115da1d HDFS-9922. Upgrade Domain placement policy status marks a good block in violation when there are decommissioned nodes. (Chris Trezzo via mingma)
(cherry picked from commit b48f27e794)
2016-06-15 22:03:20 -07:00
Junping Du 6dd34baf3c YARN-5237. Fix missing log files issue in rolling log aggregation. Contributed by Xuan Gong.
(cherry picked from commit 5dfc38ff57)
2016-06-15 16:20:07 -07:00
Jitendra Pandey 14b849489a HADOOP-12291. Add support for nested groups in LdapGroupsMapping. Contributed by Esther Kundin. 2016-06-15 13:29:29 -07:00
Varun Vasudev 75235149af YARN-5223. Container line in yarn logs output for a live application should include the hostname for the container. Contributed by Xuan Gong.
(cherry picked from commit 25064fb2fb)
2016-06-15 12:43:26 +05:30
Varun Vasudev 5bd39d2f3c YARN-5122. "yarn logs" for running containers should print an explicit footer saying that the log may be incomplete. Contributed by Jian He.
(cherry picked from commit d6284428e8)
2016-06-15 12:37:51 +05:30
Akira Ajisaka 6ffb557521 HADOOP-12893. Verify LICENSE.txt and NOTICE.txt. Contributed by Xiao Chen, Andrew Wang, and Akira Ajisaka. 2016-06-15 13:32:13 +09:00
Ming Ma b7436f4468 HDFS-9016. Display upgrade domain information in fsck. (mingma) 2016-06-14 20:07:37 -07:00
Wangda Tan 863bfa4d6a YARN-1942. Deprecate toString/fromString methods from ConverterUtils and move them to records classes like ContainerId/ApplicationId, etc. (wangda) 2016-06-14 15:12:00 -07:00
Masatake Iwasaki 9c66fffe4a HADOOP-13244. o.a.h.ipc.Server#Server should honor handlerCount when queueSizePerHandler is specified in consturctor. Contributed by Kai Sasaki.
(cherry picked from commit 20b13d109a)
2016-06-14 19:46:33 +09:00
Vinayakumar B 06b76f1586 HADOOP-13179. GenericOptionsParser is not thread-safe because commons-cli OptionBuilder is not thread-safe. (Contributed by hongbin ma)
(cherry picked from commit 5cd19e429e7aef8751599dc5f54ffe29a9dc3ea9)
2016-06-14 15:59:07 +05:30
Wangda Tan cd3bdbc70a YARN-4887. Add allocation request ID to AM-RM protocol for identifying resource-requests explicitly. (Subru Krishnan via wangda)
(cherry picked from commit eec835ec17)
2016-06-13 21:57:55 -07:00
Akira Ajisaka d219550e8b HADOOP-13270. BZip2CompressionInputStream finds the same compression marker twice in corner case, causing duplicate data blocks. Contributed by Kai Sasaki.
(cherry picked from commit e3ba9ad3f1)
2016-06-14 10:20:43 +09:00
Andrew Wang ff4466fe15 HDFS-10516. Fix bug when warming up EDEK cache of more than one encryption zone. Contributed by Xiao Chen.
(cherry picked from commit 709a814fe0)
2016-06-13 11:50:25 -07:00
Andrew Wang 6a8d3233fc HADOOP-13079. Add -q option to Ls to print ? instead of non-printable characters. Contributed by John Zhuge.
(cherry picked from commit 0accc3306d)
2016-06-13 11:43:56 -07:00
Rohith Sharma K S c540b9bd7b YARN-4989. TestWorkPreservingRMRestart#testCapacitySchedulerRecovery fails intermittently. Contributed by Ajith S.
(cherry picked from commit 28b66ae919)
2016-06-13 11:23:10 +05:30
Karthik Kambatla 63da641910 HADOOP-13243. TestRollingFileSystemSink.testSetInitialFlushTime() fails intermittently. (Daniel Templeton via kasha)
(cherry picked from commit 49b4064644)
2016-06-12 14:28:19 -07:00
Karthik Kambatla a92be02c2e YARN-5124. Modify AMRMClient to set the ExecutionType in the ResourceRequest. Addendum to fix compilation. (Arun Suresh via kasha) 2016-06-12 14:28:14 -07:00
Arun Suresh f3c7a99e33 YARN-5212. Run existing ContainerManager tests using QueuingContainerManagerImpl. (Konstantinos Karanasos via asuresh)
(cherry picked from commit 7dae2b3bc4)
2016-06-12 10:06:18 -07:00
Arun Suresh fccb641942 YARN-5124. Modify AMRMClient to set the ExecutionType in the ResourceRequest. (asuresh)
(cherry picked from commit 5143277958)
2016-06-12 09:43:19 -07:00
Arun Suresh 5985221b46 YARN-5082. Limit ContainerId increase in fair scheduler if the num of node app reserved reached the limit (sandflee via asuresh)
(cherry picked from commit 5279af7cd4)
2016-06-10 22:34:33 -07:00
Rohith Sharma K S efdfa68911 YARN-5197. RM leaks containers if running container disappears from node update. Contributed by Jason Lowe.
(cherry picked from commit e0f4620cc7)
2016-06-11 10:31:00 +05:30
Akira Ajisaka 035eea4d12 HADOOP-13213. Small Documentation bug with AuthenticatedURL in hadoop-auth. Contributed by Tom Ellis.
This closes #97.

(cherry picked from commit 8a1dccecce)
2016-06-11 03:33:19 +09:00
Jing Zhao 9c7002b122 HADOOP-13249. RetryInvocationHandler need wrap InterruptedException in IOException when call Thread.sleep. Contributed by Zhihai Xu.
(cherry picked from commit 0bbb4ddd79)
2016-06-10 10:40:53 -07:00
Wangda Tan e91e9e596d YARN-3426. Add jdiff support to YARN. (vinodkv via wangda)
(cherry picked from commit 03fc6b1bb0)
2016-06-10 09:53:40 -07:00
Wangda Tan a4094ddb5a YARN-5208. Run TestAMRMClient TestNMClient TestYarnClient TestClientRMTokens TestAMAuthorization tests with hadoop.security.token.service.use_ip enabled. (Rohith Sharma K S via wangda)
(cherry picked from commit 244506f9c8)
2016-06-10 09:37:35 -07:00
Akira Ajisaka db2d96b378 MAPREDUCE-6741. Refactor UncompressedSplitLineReader.fillBuffer(). Contributed by Daniel Templeton.
(cherry picked from commit 0b7b8a3776)
2016-06-10 19:17:05 +09:00
Chris Nauroth 1925942294 Revert "HADOOP-12666. Support Microsoft Azure Data Lake - as a file system in Hadoop. Contributed by Vishwajeet Dusane."
This reverts commit a8f03ef7ea.
2016-06-09 15:17:18 -07:00
Chris Nauroth a8f03ef7ea HADOOP-12666. Support Microsoft Azure Data Lake - as a file system in Hadoop. Contributed by Vishwajeet Dusane.
(cherry picked from commit 9581fb715c)

Conflicts:
	hadoop-tools/hadoop-tools-dist/pom.xml
	hadoop-tools/pom.xml
2016-06-09 14:49:05 -07:00
Steve Loughran 6350e4b1fb HADOOP-12537 S3A to support Amazon STS temporary credentials. Contributed by Sean Mackrory. 2016-06-09 20:59:54 +01:00
Vinod Kumar Vavilapalli f6cd1bcf89 YARN-5191. Renamed the newly added “download=true” option for getting logs via NMWebServices and AHSWebServices to be a better "format" option. (Xuan Gong via vinodkv)
(cherry picked from commit 9378d9428f)
2016-06-09 12:32:53 -07:00
Wangda Tan aef6e455b1 YARN-4837. User facing aspects of 'AM blacklisting' feature need fixing. (vinodkv via wangda) 2016-06-09 10:08:31 -07:00
Steve Loughran df29f77846 HADOOP-13237: s3a initialization against public bucket fails if caller lacks any credentials. Contributed by Chris Nauroth 2016-06-09 16:36:27 +01:00
Allen Wittenauer a086fd9040 HADOOP-12743. Fix git environment check during test-patch (aw)
(cherry picked from commit d323639686)
2016-06-09 23:27:07 +09:00
Masatake Iwasaki 0b7388b5d2 HDFS-10508. DFSInputStream should set thread's interrupt status after catching InterruptException from sleep. Contributed by Jing Zhao.
(cherry picked from commit 8ea9bbce26)
2016-06-09 14:53:56 +09:00
Naganarasimha 27fc225558 YARN-4308. ContainersAggregated CPU resource utilization reports negative usage in first few heartbeats. Contributed by Sunil G
(cherry picked from commit 1500a0a300)
2016-06-09 05:44:41 +05:30
Gera Shegalov 5a9929e19b MAPREDUCE-6240. Hadoop client displays confusing error message. (gera)
(cherry picked from commit 0af96a1c08)
2016-06-08 13:49:31 -07:00
Ravi Prakash 9c5f7f290e HDFS-10220. A large number of expired leases can make namenode unresponsive and cause failover (Nicolas Fraison via raviprak)
(cherry picked from commit ae047655f4)
2016-06-08 13:46:41 -07:00
Andrew Wang 9319665461 Remove redundant TestMiniDFSCluster.testDualClusters. Contributed by Jiayi Zhou.
(cherry picked from commit 1ee9ea0026)
2016-06-08 12:58:59 -07:00
Vinod Kumar Vavilapalli 67dbd4c466 YARN-5080. Addendum fix to the original patch to fix YARN logs CLI. Contributed by Xuan Gong
(cherry picked from commit 5a43583c0b)
2016-06-08 09:51:36 -07:00
Arun Suresh c29fbdd8ac YARN-5204. Properly report status of killed/stopped queued containers. (Konstantinos Karanasos via asuresh)
(cherry picked from commit 3344ba70e0)
2016-06-08 08:32:17 -07:00
Jason Lowe c6f33e096e YARN-5206. RegistrySecurity includes id:pass in exception text if considered invalid. Contributed by Steve Loughran
(cherry picked from commit 8c8a377cac)
2016-06-08 14:13:19 +00:00
Arun Suresh 154c7c343b YARN-5176. More test cases for queuing of containers at the NM. (Konstantinos Karanasos via asuresh)
(cherry picked from commit 76f0800c21)
2016-06-07 17:17:22 -07:00
Xuan 10f0c0475e YARN-5199. Close LogReader in in AHSWebServices#getStreamingOutput and
FileInputStream in NMWebServices#getLogs. Contributed by Xuan Gong

(cherry picked from commit 58be55b6e0)
2016-06-07 16:08:54 -07:00
Arun Suresh 6a9f38ebaf Addendum patch for YARN-5180 updating findbugs-exclude.xml
(cherry picked from commit 8554aee1be)
2016-06-07 16:00:59 -07:00
Jing Zhao 8b34040cb9 HDFS-10468. HDFS read ends up ignoring an interrupt. Contributed by Jing Zhao
(cherry picked from commit be34e85e68)
2016-06-07 10:52:33 -07:00
Junping Du 19eb997f67 HADOOP-10048. LocalDirAllocator should avoid holding locks while accessing the filesystem. Contributed by Jason Lowe.
(cherry picked from commit c14c1b298e)
2016-06-07 09:20:51 -07:00
Zhe Zhang 0499907466 HDFS-10458. getFileEncryptionInfo should return quickly for non-encrypted cluster.
(cherry picked from commit 6de9213df1)
(cherry picked from commit 06e38c835d)
2016-06-07 08:57:27 -07:00