Commit Graph

4050 Commits

Author SHA1 Message Date
Akira Ajisaka 96dca785fa HDFS-10561. test_native_mini_dfs fails by NoClassDefFoundError. (aajisaka)
(cherry picked from commit ff07b10803)
2016-06-23 15:49:55 +09:00
Akira Ajisaka ad50a64ded HDFS-7597. DelegationTokenIdentifier should cache the TokenIdentifier to UGI mapping. Contributed by Daryn Sharp, Bob Hansen, and Xiao Chen.
(cherry picked from commit d433b16ce6)
2016-06-22 11:02:31 +09:00
Brahma Reddy Battula ee0f389ecd HDFS-9530. ReservedSpace is not cleared for abandoned Blocks (Contributed by Brahma Reddy Battula)
(cherry picked from commit f2ac132d6a)
2016-06-21 15:44:45 +05:30
Colin Patrick Mccabe 4e11f33ccc HDFS-10448. CacheManager#addInternal tracks bytesNeeded incorrectly when dealing with replication factors other than 1 (Yiqun Lin via cmccabe)
(cherry picked from commit 46f1602e89)
2016-06-20 18:31:40 -07:00
Colin Patrick Mccabe 0914658eb8 HDFS-10328. Add per-cache-pool default replication num configuration (xupeng via cmccabe)
(cherry picked from commit 5f6b4157a4)
2016-06-20 18:12:41 -07:00
Jitendra Pandey f2ef1145c5 HDFS-10538. Remove AsyncDistributedFileSystem. Contributed by Xiaobing Zhou and Jitendra Pandey. 2016-06-20 18:04:05 -07:00
Jitendra Pandey 8f93bbcb11 HADOOP-13291. Probing stats in DFSOpsCountStatistics/S3AStorageStatistics should be correctly implemented. Contributed by Mingliang Liu. 2016-06-20 16:28:55 -07:00
Brahma Reddy Battula 3f27f40503 HDFS-10474. hftp copy fails when file name with Chinese+special char in branch-2 (Contributed by Brahma Reddy Battula) 2016-06-20 12:38:18 +05:30
Arpit Agarwal bd33cc0179 HDFS-10437. ReconfigurationProtocol not covered by HDFSPolicyProvider. (Arpit Agarwal) 2016-06-18 16:17:10 -07:00
Andrew Wang 94759470b8 Fix hadoop-hdfs-native-client compilation on Windows. Contributed by Brahma Reddy Battula.
(cherry picked from commit 3ff0510ffd)
2016-06-17 15:54:57 -07:00
Kihwal Lee 35c6b725db HDFS-10493. Add links to datanode web UI in namenode datanodes page. Contributed by Weiwei Yang.
(cherry picked from commit 280069510b)
2016-06-17 11:12:16 -05:00
Akira Ajisaka a36aa920f4 HADOOP-12943. Add -w -r options in dfs -test command. Contributed by Weiwei Yang.
(cherry picked from commit 09e82acaf9)
2016-06-17 16:21:05 +09:00
Colin Patrick Mccabe 49c0d9b325 HDFS-9466. TestShortCircuitCache#testDataXceiverCleansUpSlotsOnFailure is flaky (Wei-Chiu Chuang via cmccabe)
(cherry picked from commit c7921c9bdd)
2016-06-16 13:52:38 -07:00
Arpit Agarwal 159b249a3d HDFS-10532. Typo in RollingUpgrade docs. (Contributed by Yiqun Lin) 2016-06-16 10:10:49 -07:00
Vinayakumar B 6ab1f545fb HDFS-10256. Use GenericTestUtils.getTestDir method in tests for temporary directories (Contributed by Vinayakumar B)
(cherry picked from commit cc6c265171)
2016-06-16 16:56:27 +05:30
Colin Patrick Mccabe 8280e3bcc2 HDFS-10525. Fix NPE in CacheReplicationMonitor#rescanCachedBlockMap (Xiao Chen via cmccabe)
(cherry picked from commit 2ca73445f5)
2016-06-15 22:50:36 -07:00
Colin Patrick Mccabe 17301ab395 HDFS-10505. OIV's ReverseXML processor should support ACLs (Surendra Singh Lilhore via cmccabe)
(cherry picked from commit 2449db507d)
2016-06-15 22:42:19 -07:00
Akira Ajisaka d1c475ddd4 HADOOP-12892. fix/rewrite create-release. Contributed by Allen Wittenauer. 2016-06-16 14:03:57 +09:00
Ming Ma 32b115da1d HDFS-9922. Upgrade Domain placement policy status marks a good block in violation when there are decommissioned nodes. (Chris Trezzo via mingma)
(cherry picked from commit b48f27e794)
2016-06-15 22:03:20 -07:00
Ming Ma b7436f4468 HDFS-9016. Display upgrade domain information in fsck. (mingma) 2016-06-14 20:07:37 -07:00
Andrew Wang ff4466fe15 HDFS-10516. Fix bug when warming up EDEK cache of more than one encryption zone. Contributed by Xiao Chen.
(cherry picked from commit 709a814fe0)
2016-06-13 11:50:25 -07:00
Masatake Iwasaki 0b7388b5d2 HDFS-10508. DFSInputStream should set thread's interrupt status after catching InterruptException from sleep. Contributed by Jing Zhao.
(cherry picked from commit 8ea9bbce26)
2016-06-09 14:53:56 +09:00
Ravi Prakash 9c5f7f290e HDFS-10220. A large number of expired leases can make namenode unresponsive and cause failover (Nicolas Fraison via raviprak)
(cherry picked from commit ae047655f4)
2016-06-08 13:46:41 -07:00
Andrew Wang 9319665461 Remove redundant TestMiniDFSCluster.testDualClusters. Contributed by Jiayi Zhou.
(cherry picked from commit 1ee9ea0026)
2016-06-08 12:58:59 -07:00
Jing Zhao 8b34040cb9 HDFS-10468. HDFS read ends up ignoring an interrupt. Contributed by Jing Zhao
(cherry picked from commit be34e85e68)
2016-06-07 10:52:33 -07:00
Zhe Zhang 0499907466 HDFS-10458. getFileEncryptionInfo should return quickly for non-encrypted cluster.
(cherry picked from commit 6de9213df1)
(cherry picked from commit 06e38c835d)
2016-06-07 08:57:27 -07:00
Jason Lowe 5b4c80b27e HDFS-9580. TestComputeInvalidateWork#testDatanodeReRegistration failed due to unexpected number of invalidate blocks. Contributed by Wei-Chiu Chuang.
Change-Id: I9411dfb1dd4605cbcc515ca3361218d35d7c5fe3
(cherry picked from commit 0087734cc1)

Conflicts:

	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
2016-06-07 15:33:43 +00:00
Akira Ajisaka b8c1db6f63 HDFS-10485. Fix findbugs warning in FSEditLog.java. (aajisaka)
(cherry picked from commit e620530301)
2016-06-07 17:53:09 +09:00
Wangda Tan d30e194dda Revert "HDFS-10458. getFileEncryptionInfo should return quickly for non-encrypted cluster."
This reverts commit 06e38c835d.
2016-06-06 22:17:30 -07:00
Zhe Zhang 06e38c835d HDFS-10458. getFileEncryptionInfo should return quickly for non-encrypted cluster.
(cherry picked from commit 6de9213df1)
2016-06-06 15:53:12 -07:00
Tsz-Wo Nicholas Sze 074588d78b Revert "Revert "HADOOP-13226 Support async call retry and failover.""
This reverts commit 5bfadb8e6b.
2016-06-06 16:52:24 +08:00
Tsz-Wo Nicholas Sze 48323b6636 Revert "Revert "HDFS-10430. Reuse FileSystem#access in TestAsyncDFS. Contributed by Xiaobing Zhou.""
This reverts commit 6f8f40b2a5.
2016-06-06 16:52:19 +08:00
Tsz-Wo Nicholas Sze 6762855f67 Revert "Revert "HDFS-10431 Refactor and speedup TestAsyncDFSRename. Contributed by Xiaobing Zhou""
This reverts commit 8e2245d0a4.
2016-06-06 16:52:14 +08:00
Tsz-Wo Nicholas Sze 136d3b6414 Revert "Revert "HDFS-10390. Implement asynchronous setAcl/getAclStatus for DistributedFileSystem. Contributed by Xiaobing Zhou""
This reverts commit 87ea0784eb.
2016-06-06 16:52:09 +08:00
Tsz-Wo Nicholas Sze 09a543fc86 Revert "Revert "HADOOP-13168. Support Future.get with timeout in ipc async calls.""
This reverts commit 071aeab585.
2016-06-06 16:52:02 +08:00
Tsz-Wo Nicholas Sze 428dc52e56 Revert "Revert "HDFS-10346. Implement asynchronous setPermission/setOwner for DistributedFileSystem. Contributed by Xiaobing Zhou""
This reverts commit 2529cabf12.
2016-06-06 16:51:54 +08:00
Tsz-Wo Nicholas Sze 7b9062f405 Revert "Revert "HADOOP-12957. Limit the number of outstanding async calls. Contributed by Xiaobing Zhou""
This reverts commit 7d4c16bae9.
2016-06-06 16:51:48 +08:00
Tsz-Wo Nicholas Sze c1947a71ff Revert "Revert "HDFS-10224. Implement asynchronous rename for DistributedFileSystem. Contributed by Xiaobing Zhou""
This reverts commit c11c2ee649.
2016-06-06 16:51:41 +08:00
Andrew Wang c11c2ee649 Revert "HDFS-10224. Implement asynchronous rename for DistributedFileSystem. Contributed by Xiaobing Zhou"
This reverts commit d316f44059.
2016-06-03 18:11:12 -07:00
Andrew Wang 7d4c16bae9 Revert "HADOOP-12957. Limit the number of outstanding async calls. Contributed by Xiaobing Zhou"
This reverts commit 7e0824faa9.
2016-06-03 18:10:49 -07:00
Andrew Wang 2529cabf12 Revert "HDFS-10346. Implement asynchronous setPermission/setOwner for DistributedFileSystem. Contributed by Xiaobing Zhou"
This reverts commit 69768bf9e0.
2016-06-03 18:10:49 -07:00
Andrew Wang 071aeab585 Revert "HADOOP-13168. Support Future.get with timeout in ipc async calls."
This reverts commit 658072d62e.
2016-06-03 18:10:49 -07:00
Andrew Wang 87ea0784eb Revert "HDFS-10390. Implement asynchronous setAcl/getAclStatus for DistributedFileSystem. Contributed by Xiaobing Zhou"
This reverts commit 56745a0cf4.
2016-06-03 18:10:48 -07:00
Andrew Wang 8e2245d0a4 Revert "HDFS-10431 Refactor and speedup TestAsyncDFSRename. Contributed by Xiaobing Zhou"
This reverts commit 72773f8ea8.
2016-06-03 18:10:48 -07:00
Andrew Wang 6f8f40b2a5 Revert "HDFS-10430. Reuse FileSystem#access in TestAsyncDFS. Contributed by Xiaobing Zhou."
This reverts commit 193f822b9a.
2016-06-03 18:10:48 -07:00
Andrew Wang 5bfadb8e6b Revert "HADOOP-13226 Support async call retry and failover."
This reverts commit f7189d6a1c.
2016-06-03 18:10:47 -07:00
Andrew Wang d5609e3499 HDFS-10481. HTTPFS server should correctly impersonate as end user to open file. Contributed by Xiao Chen.
(cherry picked from commit 47e0321ee9)
2016-06-03 17:21:27 -07:00
Andrew Wang 03c4724c88 HADOOP-13155. Implement TokenRenewer to renew and cancel delegation tokens in KMS. Contributed by Xiao Chen.
(cherry picked from commit 713cb71820)

 Conflicts:
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/crypto/key/KeyProviderDelegationTokenExtension.java
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DFSUtilClient.java
2016-06-03 17:01:11 -07:00
Akira Ajisaka b6d5546e24 HDFS-10341. Add a metric to expose the timeout number of pending replication blocks. (aajisaka) 2016-06-03 16:04:11 +09:00
Akira Ajisaka cddf6b4fc7 HDFS-10471. DFSAdmin#SetQuotaCommand's help msg is not correct. Contributed by Yiqun Lin.
(cherry picked from commit 1df6f5735c)
2016-06-03 04:11:03 +09:00