Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
11,624 Commits 326 Branches 371 Tags
Commit Graph

11624 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Colin Patrick Mccabe
b07cd9c6a9 HADOOP-13284. FileSystemStorageStatistics must not attempt to read non-existent rack-aware read stats in branch-2.8 (Mingliang Liu via cmccabe) 2016-06-16 16:45:41 -07:00
Colin Patrick Mccabe
cc53ca8d69 HDFS-9466. TestShortCircuitCache#testDataXceiverCleansUpSlotsOnFailure is flaky (Wei-Chiu Chuang via cmccabe) 
(cherry picked from commit c7921c9bddb79c9db5059b6c3f7a3a586a3cd95b)
(cherry picked from commit 49c0d9b325a21fc0a05da58bb9d4c76d82181a5d)
 2016-06-16 13:53:55 -07:00
Ravi Prakash
605443c913 HADOOP-3733. "s3x:" URLs break when Secret Key contains a slash, even if encoded. Contributed by Steve Loughran. 2016-06-16 20:45:59 +01:00
Chris Nauroth
eddefbd01b HADOOP-13241. document s3a better. Contributed by Steve Loughran. 
(cherry picked from commit 127d2c7281917f23bce17afa6098a2d678a16441)
(cherry picked from commit e4b63ed7b4a001b9a41f68fc4846e971a9a8eb51)
 2016-06-16 11:19:00 -07:00
Wangda Tan
93b406b66d YARN-4844. Addendum patch, revert few changes to public and evolving APIs to avoid breaking downstream projects as much as possible. 
(cherry picked from commit 7eb524ddee4af80c87b134070945977bf73e950f)
 2016-06-16 11:10:46 -07:00
Arpit Agarwal
394dae17ac HDFS-10532. Typo in RollingUpgrade docs. (Contributed by Yiqun Lin) 2016-06-16 10:11:05 -07:00
Junping Du
810470508b YARN-5237. Fix missing log files issue in rolling log aggregation. Contributed by Xuan Gong. 2016-06-16 07:18:36 -07:00
Colin Patrick Mccabe
ea2e7321d6 HDFS-10525. Fix NPE in CacheReplicationMonitor#rescanCachedBlockMap (Xiao Chen via cmccabe) 
(cherry picked from commit 2ca73445f5c2929d9c2ff4232dca58a63a0570a0)
(cherry picked from commit 8280e3bcc21adbbbb21e091bd4ec786bf3beb72b)
 2016-06-15 22:51:27 -07:00
Colin Patrick Mccabe
ef08eb9031 HDFS-10505. OIV's ReverseXML processor should support ACLs (Surendra Singh Lilhore via cmccabe) 
(cherry picked from commit 2449db507d84b1c4fac70a800fb2ad8905cf3db7)
(cherry picked from commit 17301ab3958d0b36fc6179efe1090a3b12b34772)
 2016-06-15 22:44:41 -07:00
Akira Ajisaka
b35c7cdd14 HADOOP-12892. fix/rewrite create-release. Contributed by Allen Wittenauer. 2016-06-16 14:06:08 +09:00
Akira Ajisaka
9128137142 HADOOP-12893. Verify LICENSE.txt and NOTICE.txt. Contributed by Xiao Chen, Andrew Wang, and Akira Ajisaka. 
(cherry picked from commit 6ffb557521af2ea0c21cfc90d8edbd7cb7305f0f)
 2016-06-15 13:33:10 +09:00
Ming Ma
03ed3f9b66 Revert "HDFS-9016. Display upgrade domain information in fsck. (mingma)" 
This reverts commit 68ab0aa9d0b9bd03768dcd7c422ef201ad3f58f6.
 2016-06-14 20:14:00 -07:00
Ming Ma
68ab0aa9d0 HDFS-9016. Display upgrade domain information in fsck. (mingma) 
(cherry picked from commit b7436f44682442e4d431ec3c97e4753e03435f3e)
 2016-06-14 20:08:29 -07:00
Wangda Tan
d838c6443d YARN-1942. Deprecate toString/fromString methods from ConverterUtils and move them to records classes like ContainerId/ApplicationId, etc. (wangda) 2016-06-14 15:21:41 -07:00
Masatake Iwasaki
3c9d31c55a HADOOP-13244. o.a.h.ipc.Server#Server should honor handlerCount when queueSizePerHandler is specified in consturctor. Contributed by Kai Sasaki. 
(cherry picked from commit 20b13d109a1f66d8911936d26bdde38d81a1c4c6)
 2016-06-14 19:52:48 +09:00
Vinayakumar B
3bf5379adb HADOOP-13179. GenericOptionsParser is not thread-safe because commons-cli OptionBuilder is not thread-safe. (Contributed by hongbin ma) 
(cherry picked from commit 5cd19e429e7aef8751599dc5f54ffe29a9dc3ea9)
(cherry picked from commit 06b76f15869e072261ba10b3e9059bbafae8c7f8)
 2016-06-14 15:59:36 +05:30
Akira Ajisaka
8295351e54 HADOOP-13270. BZip2CompressionInputStream finds the same compression marker twice in corner case, causing duplicate data blocks. Contributed by Kai Sasaki. 
(cherry picked from commit e3ba9ad3f116306910f74645ded91506345b9f6e)
(cherry picked from commit d219550e8bf4c24be68a74f7b8032b6a8b8af0fc)
 2016-06-14 10:24:53 +09:00
Andrew Wang
56e29d2711 HDFS-10516. Fix bug when warming up EDEK cache of more than one encryption zone. Contributed by Xiao Chen. 
(cherry picked from commit 709a814fe0153e86a37806796ea27c8252d9c6d1)
(cherry picked from commit ff4466fe15c338e56bab2e4afd61c46b634843b3)
 2016-06-13 11:50:27 -07:00
Andrew Wang
08ff8d7482 HADOOP-13079. Add -q option to Ls to print ? instead of non-printable characters. Contributed by John Zhuge. 
(cherry picked from commit 0accc3306d830c3f2b16c4b8abf68729c7aba6cb)
(cherry picked from commit 6a8d3233fc248e3606930ecbdb07d3d926f550a7)
 2016-06-13 11:44:08 -07:00
Akira Ajisaka
f5cdf94725 HADOOP-13213. Small Documentation bug with AuthenticatedURL in hadoop-auth. Contributed by Tom Ellis. 
This closes #97.

(cherry picked from commit 8a1dcceccea5cfe9fb0c94daa2517cd64a16b3c0)
(cherry picked from commit 035eea4d126f2dfe4b01f47f8ee670fd58127320)
 2016-06-11 03:33:40 +09:00
Wangda Tan
9436548152 YARN-3426. Add jdiff support to YARN. (vinodkv via wangda) 2016-06-10 09:56:18 -07:00
Akira Ajisaka
3bea925cea MAPREDUCE-6741. Refactor UncompressedSplitLineReader.fillBuffer(). Contributed by Daniel Templeton. 
(cherry picked from commit 0b7b8a377611b2a3041a2995504a437c36dfa6e6)
(cherry picked from commit db2d96b378d6a4ba9a504b4daaca5d8ff6f5f227)
 2016-06-10 19:17:26 +09:00
Steve Loughran
faf9a9f4e0 HADOOP-12537 S3A to support Amazon STS temporary credentials. Contributed by Sean Mackrory. 2016-06-09 20:58:30 +01:00
Junping Du
2be48e7d15 YARN-5199. Close LogReader in NMWebServices#getLogs. Contributed by Xuan Gong. 2016-06-09 12:29:25 -07:00
Steve Loughran
7e09601a90 HADOOP-13237: s3a initialization against public bucket fails if caller lacks any credentials. Contributed by Chris Nauroth 2016-06-09 16:36:51 +01:00
Allen Wittenauer
3b2a25bc4b HADOOP-12743. Fix git environment check during test-patch (aw) 
(cherry picked from commit d323639686eab28f1510031e52e4390f82d78989)
(cherry picked from commit a086fd90408c0dca13d22d66ab528a68b4f57f42)
 2016-06-09 23:27:23 +09:00
Andrew Wang
f583fa5f4e Remove redundant TestMiniDFSCluster.testDualClusters. Contributed by Jiayi Zhou. 
(cherry picked from commit 1ee9ea002609971ad58082bf525d57fca8a37035)
(cherry picked from commit 9319665461201ca84c7fa007c09f087f5753c8cc)
 2016-06-08 12:59:08 -07:00
Xuan
11b4d1e486 Revert "YARN-4920. ATS/NM should support a link to dowload/get the logs in text format. Contributed by Xuan Gong." 
This reverts commit 22ac37615a933f9cee8cf19ad0182586a037b690.
 2016-06-08 11:23:12 -07:00
Vinod Kumar Vavilapalli
593d2c66c4 YARN-5080. Addendum fix to the original patch to fix YARN logs CLI. Contributed by Xuan Gong 
(cherry picked from commit 5a43583c0bbb9650ea6a9f48d9544ec3ec24b580)
 2016-06-08 09:52:37 -07:00
Jason Lowe
fb31aaef63 YARN-5206. RegistrySecurity includes id:pass in exception text if considered invalid. Contributed by Steve Loughran 
(cherry picked from commit 8c8a377cac10b086a7ff37ee366b79e6b04d2738)
 2016-06-08 14:13:48 +00:00
Wangda Tan
19e578870d YARN-4844. Add getMemorySize/getVirtualCoresSize to o.a.h.y.api.records.Resource. (wangda) 2016-06-07 12:41:50 -07:00
Junping Du
333490ba45 HADOOP-10048. LocalDirAllocator should avoid holding locks while accessing the filesystem. Contributed by Jason Lowe. 
(cherry picked from commit c14c1b298e29e799f7c8f15ff24d7eba6e0cd39b)
(cherry picked from commit 19eb997f675a843a2bfe21094ef524f8c5870919)
 2016-06-07 09:26:05 -07:00
Zhe Zhang
72addd8d5c HDFS-10458. getFileEncryptionInfo should return quickly for non-encrypted cluster. 
(cherry picked from commit 6de9213df111a9a4ed875db995d67af72d08a798)
(cherry picked from commit 06e38c835d0ad9619d4bea662f2dd7d0f62007a9)
(cherry picked from commit 0499907466e78a5b674ac72a5503af892adc348f)
 2016-06-07 09:09:18 -07:00
Jason Lowe
738b67e9d3 HDFS-9580. TestComputeInvalidateWork#testDatanodeReRegistration failed due to unexpected number of invalidate blocks. Contributed by Wei-Chiu Chuang. 
Change-Id: I9411dfb1dd4605cbcc515ca3361218d35d7c5fe3
(cherry picked from commit 0087734cc1e18e029ea39f06ca25c8a7d60af004)

Conflicts:

	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2016-06-07 15:36:53 +00:00
Wangda Tan
e91eba2f81 Revert "HDFS-10458. getFileEncryptionInfo should return quickly for non-encrypted cluster." 
This reverts commit 0274636529cfac4d64582a7c21631aebbf4deb1b.
 2016-06-06 22:13:02 -07:00
Arun Suresh
51a16b1ff0 YARN-4525. Fix bug in RLESparseResourceAllocation.getRangeOverlapping(). (Ishai Menache and Carlo Curino via asuresh) 
(cherry picked from commit 3a154f75ed85d864b3ffd35818992418f2b6aa59)
(cherry picked from commit d3655f41230fd5a5f3bdb0124d5754459e593e82)
 2016-06-06 21:19:48 -07:00
Arun Suresh
934bd8989b YARN-5185. StageAllocaterGreedyRLE: Fix NPE in corner case. (Carlo Curino via asuresh) 
(cherry picked from commit 7a9b7372a1a917c7b5e1beca7e13c0419e3dbfef)
(cherry picked from commit f0a869b52a4e4ad7e02143a7e703700a4f4b1f88)
 2016-06-06 21:08:52 -07:00
Zhe Zhang
0274636529 HDFS-10458. getFileEncryptionInfo should return quickly for non-encrypted cluster. 
(cherry picked from commit 6de9213df111a9a4ed875db995d67af72d08a798)
(cherry picked from commit 06e38c835d0ad9619d4bea662f2dd7d0f62007a9)
 2016-06-06 15:54:36 -07:00
Ming Ma
ec4f9a14f9 MAPREDUCE-5044. Have AM trigger jstack on task attempts that timeout before killing them. (Eric Payne and Gera Shegalov via mingma) 
(cherry picked from commit 4a1cedc010d3fa1d8ef3f2773ca12acadfee5ba5)
(cherry picked from commit 74e2b5efa26f27027fed212b4b2108f0e95587fb)
 2016-06-06 14:49:43 -07:00
Steve Loughran
f9478c95bd HADOOP-12807 S3AFileSystem should read AWS credentials from environment variables. Contributed by Tobin Baker. 2016-06-06 23:40:49 +02:00
Tsz-Wo Nicholas Sze
49535c0683 Revert "Revert "HADOOP-13226 Support async call retry and failover."" 
This reverts commit 886e2396062ef076b3ea4aa93395cc90287efd4f.
 2016-06-06 16:54:02 +08:00
Tsz-Wo Nicholas Sze
359a316736 Revert "Revert "HDFS-10430. Reuse FileSystem#access in TestAsyncDFS. Contributed by Xiaobing Zhou."" 
This reverts commit f176311366eab0364458d055f248fb5796bdec23.
 2016-06-06 16:53:56 +08:00
Tsz-Wo Nicholas Sze
025f62afcc Revert "Revert "HDFS-10431 Refactor and speedup TestAsyncDFSRename. Contributed by Xiaobing Zhou"" 
This reverts commit 0af02cfd37a564b4a0701dbc6d562fe237565bd5.
 2016-06-06 16:53:51 +08:00
Tsz-Wo Nicholas Sze
79beac49ec Revert "Revert "HDFS-10390. Implement asynchronous setAcl/getAclStatus for DistributedFileSystem. Contributed by Xiaobing Zhou"" 
This reverts commit 1de712f22abbe313692cca6bece7f265da96aee5.
 2016-06-06 16:53:46 +08:00
Tsz-Wo Nicholas Sze
c949001eee Revert "Revert "HADOOP-13168. Support Future.get with timeout in ipc async calls."" 
This reverts commit 308d28640d8c797f07aa41a8adc5dcd9420f1d0a.
 2016-06-06 16:53:41 +08:00
Tsz-Wo Nicholas Sze
5b054b1bfc Revert "Revert "HDFS-10346. Implement asynchronous setPermission/setOwner for DistributedFileSystem. Contributed by Xiaobing Zhou"" 
This reverts commit ffa85f28a2ec612a3d63c890806a17cfd3a2e7e2.
 2016-06-06 16:53:36 +08:00
Tsz-Wo Nicholas Sze
8ccc8aeb6c Revert "Revert "HADOOP-12957. Limit the number of outstanding async calls. Contributed by Xiaobing Zhou"" 
This reverts commit 8a07026e7792e43e692409c3ec998a306b7733ff.
 2016-06-06 16:53:31 +08:00
Tsz-Wo Nicholas Sze
2cf663bb59 Revert "Revert "HDFS-10224. Implement asynchronous rename for DistributedFileSystem. Contributed by Xiaobing Zhou"" 
This reverts commit d740a90260d9d26a67688b004e5fcda60cc30723.
 2016-06-06 16:53:24 +08:00
Andrew Wang
d740a90260 Revert "HDFS-10224. Implement asynchronous rename for DistributedFileSystem. Contributed by Xiaobing Zhou" 
This reverts commit bdc45bef646cafdc04a59c19e23dcba3bb16b20c.
 2016-06-03 18:17:33 -07:00
Andrew Wang
8a07026e77 Revert "HADOOP-12957. Limit the number of outstanding async calls. Contributed by Xiaobing Zhou" 
This reverts commit a1ba6eee38420ae9436f9e9ecc3db83702fbe762.
 2016-06-03 18:17:33 -07:00