Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
12,117 Commits 326 Branches 371 Tags
Commit Graph

4295 Commits

Author SHA1 Message Date
Tsz-Wo Nicholas Sze
359a316736 Revert "Revert "HDFS-10430. Reuse FileSystem#access in TestAsyncDFS. Contributed by Xiaobing Zhou."" 
This reverts commit f176311366eab0364458d055f248fb5796bdec23.
 2016-06-06 16:53:56 +08:00
Tsz-Wo Nicholas Sze
025f62afcc Revert "Revert "HDFS-10431 Refactor and speedup TestAsyncDFSRename. Contributed by Xiaobing Zhou"" 
This reverts commit 0af02cfd37a564b4a0701dbc6d562fe237565bd5.
 2016-06-06 16:53:51 +08:00
Tsz-Wo Nicholas Sze
79beac49ec Revert "Revert "HDFS-10390. Implement asynchronous setAcl/getAclStatus for DistributedFileSystem. Contributed by Xiaobing Zhou"" 
This reverts commit 1de712f22abbe313692cca6bece7f265da96aee5.
 2016-06-06 16:53:46 +08:00
Tsz-Wo Nicholas Sze
c949001eee Revert "Revert "HADOOP-13168. Support Future.get with timeout in ipc async calls."" 
This reverts commit 308d28640d8c797f07aa41a8adc5dcd9420f1d0a.
 2016-06-06 16:53:41 +08:00
Tsz-Wo Nicholas Sze
5b054b1bfc Revert "Revert "HDFS-10346. Implement asynchronous setPermission/setOwner for DistributedFileSystem. Contributed by Xiaobing Zhou"" 
This reverts commit ffa85f28a2ec612a3d63c890806a17cfd3a2e7e2.
 2016-06-06 16:53:36 +08:00
Tsz-Wo Nicholas Sze
8ccc8aeb6c Revert "Revert "HADOOP-12957. Limit the number of outstanding async calls. Contributed by Xiaobing Zhou"" 
This reverts commit 8a07026e7792e43e692409c3ec998a306b7733ff.
 2016-06-06 16:53:31 +08:00
Tsz-Wo Nicholas Sze
2cf663bb59 Revert "Revert "HDFS-10224. Implement asynchronous rename for DistributedFileSystem. Contributed by Xiaobing Zhou"" 
This reverts commit d740a90260d9d26a67688b004e5fcda60cc30723.
 2016-06-06 16:53:24 +08:00
Andrew Wang
d740a90260 Revert "HDFS-10224. Implement asynchronous rename for DistributedFileSystem. Contributed by Xiaobing Zhou" 
This reverts commit bdc45bef646cafdc04a59c19e23dcba3bb16b20c.
 2016-06-03 18:17:33 -07:00
Andrew Wang
8a07026e77 Revert "HADOOP-12957. Limit the number of outstanding async calls. Contributed by Xiaobing Zhou" 
This reverts commit a1ba6eee38420ae9436f9e9ecc3db83702fbe762.
 2016-06-03 18:17:33 -07:00
Andrew Wang
ffa85f28a2 Revert "HDFS-10346. Implement asynchronous setPermission/setOwner for DistributedFileSystem. Contributed by Xiaobing Zhou" 
This reverts commit ac049004507b8df5d22694300fa845427d757866.
 2016-06-03 18:12:31 -07:00
Andrew Wang
308d28640d Revert "HADOOP-13168. Support Future.get with timeout in ipc async calls." 
This reverts commit fa7c7f25105bc157c652a2f44ac49620fc61c0f4.
 2016-06-03 18:12:31 -07:00
Andrew Wang
1de712f22a Revert "HDFS-10390. Implement asynchronous setAcl/getAclStatus for DistributedFileSystem. Contributed by Xiaobing Zhou" 
This reverts commit 339b803a52ed5e867b8c405a7e7a92adcfe6c4df.
 2016-06-03 18:12:31 -07:00
Andrew Wang
0af02cfd37 Revert "HDFS-10431 Refactor and speedup TestAsyncDFSRename. Contributed by Xiaobing Zhou" 
This reverts commit 2e755a7f0ebb05d7f79ec30aba2d6b288936dacc.
 2016-06-03 18:12:31 -07:00
Andrew Wang
f176311366 Revert "HDFS-10430. Reuse FileSystem#access in TestAsyncDFS. Contributed by Xiaobing Zhou." 
This reverts commit de69b1da34ed419946b56f63efa82a6162788df9.
 2016-06-03 18:12:30 -07:00
Andrew Wang
886e239606 Revert "HADOOP-13226 Support async call retry and failover." 
This reverts commit a8941d7790b2209ac779c9372298b833ededd132.
 2016-06-03 18:12:30 -07:00
Andrew Wang
6f69113417 HDFS-10481. HTTPFS server should correctly impersonate as end user to open file. Contributed by Xiao Chen. 
(cherry picked from commit 47e0321ee91149331e6ae72e7caa41d1de078b6c)
(cherry picked from commit d5609e34995edf08624d8c3ce8ce6630a7713e79)
 2016-06-03 17:21:34 -07:00
Andrew Wang
d712b2ee3b HADOOP-13155. Implement TokenRenewer to renew and cancel delegation tokens in KMS. Contributed by Xiao Chen. 
(cherry picked from commit 713cb71820ad94a5436f35824d07aa12fcba5cc6)

 Conflicts:
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/crypto/key/KeyProviderDelegationTokenExtension.java
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DFSUtilClient.java

(cherry picked from commit 03c4724c884b133eeb1114e417f7d49d239f4783)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DFSUtilClient.java
 2016-06-03 17:03:40 -07:00
Akira Ajisaka
d0dc5aaa2d HDFS-10341. Add a metric to expose the timeout number of pending replication blocks. (aajisaka) 
(cherry picked from commit b6d5546e2414009311ca7e92203b7b4a6b29e165)
 2016-06-03 16:04:40 +09:00
Akira Ajisaka
a8a2f4b500 HDFS-10471. DFSAdmin#SetQuotaCommand's help msg is not correct. Contributed by Yiqun Lin. 
(cherry picked from commit 1df6f5735c9d85e644d99d3ebfc4459490657004)
(cherry picked from commit cddf6b4fc7c2abe93355716c380c05495f4aeb4c)
 2016-06-03 04:11:13 +09:00
Masatake Iwasaki
5b3d9ca0cd HDFS-10367. TestDFSShell.testMoveWithTargetPortEmpty fails with Address bind exception. Contributed by Brahma Reddy Battula. 
(cherry picked from commit aadb77e412ab9d4ad05a0bd8b37d547ba5adad03)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDFSShell.java

(cherry picked from commit 37409744135186a9b90865436a731366b259ea81)
 2016-06-02 21:04:48 +09:00
Akira Ajisaka
fe4ad4a39c HDFS-9476. TestDFSUpgradeFromImage#testUpgradeFromRel1BBWImage occasionally fail. Contributed by Masatake Iwasaki. 
(cherry picked from commit 69555fca066815053dd9168ebe15868a5c02cdcd)
(cherry picked from commit 3dd557e4b6b852ee99f6acc29cca1088dc3a39ff)
 2016-06-02 18:53:42 +09:00
Colin Patrick Mccabe
6fe1c67fa1 HADOOP-13137. TraceAdmin should support Kerberized cluster (Wei-Chiu Chuang via cmccabe) 
(cherry picked from commit 8ceb06e2392763726210f96bb1c176e6a9fe7b53)
(cherry picked from commit a64e1425ed12edc7434b2f40d111111caf1db274)
 2016-05-31 18:26:37 -07:00
Colin Patrick Mccabe
0d6a65a40a HDFS-10415. TestDistributedFileSystem#MyDistributedFileSystem attempts to set up statistics before initialize() is called (Mingliang Liu via cmccabe) 
(cherry picked from commit 14907d9b8cf5ad7a8241aa66db79cc8e79767cbe)
 2016-05-31 17:27:14 -07:00
Tsz-Wo Nicholas Sze
a8941d7790 HADOOP-13226 Support async call retry and failover. 2016-05-31 17:16:44 -07:00
Chris Nauroth
de69b1da34 HDFS-10430. Reuse FileSystem#access in TestAsyncDFS. Contributed by Xiaobing Zhou. 
(cherry picked from commit 21890c4239b6a82fd6aab3454ce3922226efe7b5)
(cherry picked from commit 193f822b9a6e95575e90e2703e30abde70c6ba6c)
 2016-05-27 14:20:50 -07:00
Yongjun Zhang
3e4c7906c2 HDFS-10276. HDFS should not expose path info that user has no permission to see. (Yuanbo Liu via Yongjun Zhang) 
(cherry picked from commit 5ea6fd85c7aff6df28b87789f607bb57ee920639)
 2016-05-27 10:18:47 -07:00
Tsz-Wo Nicholas Sze
2e755a7f0e HDFS-10431 Refactor and speedup TestAsyncDFSRename. Contributed by Xiaobing Zhou 2016-05-26 12:24:21 -07:00
Tsz-Wo Nicholas Sze
339b803a52 HDFS-10390. Implement asynchronous setAcl/getAclStatus for DistributedFileSystem. Contributed by Xiaobing Zhou 2016-05-26 12:23:05 -07:00
Tsz-Wo Nicholas Sze
fa7c7f2510 HADOOP-13168. Support Future.get with timeout in ipc async calls. 2016-05-26 12:22:57 -07:00
Tsz-Wo Nicholas Sze
ac04900450 HDFS-10346. Implement asynchronous setPermission/setOwner for DistributedFileSystem. Contributed by Xiaobing Zhou 2016-05-26 12:20:31 -07:00
Tsz-Wo Nicholas Sze
f6dfb71762 HDFS-8057 Move BlockReader implementation to the client implementation package. Contributed by Takanobu Asanuma 2016-05-25 12:26:25 -07:00
Vinayakumar B
00011e6a98 HDFS-10217. show 'blockScheduled' tooltip in datanodes table. 
(cherry picked from commit 2dab64da2ff50bbb7937aad2d376eacd4ed320aa)
(cherry picked from commit e28a51e988beb27741c801641be7d96faaf6b191)
 2016-05-25 12:35:42 +05:30
Tsz-Wo Nicholas Sze
2ab789b19e HDFS-9365. Balaner does not work with the HDFS-6376 HA setup. 2016-05-24 13:11:32 -07:00
Masatake Iwasaki
1ab79e255c HDFS-10439. Update setOwner doc in HdfsPermissionsGuide. Contributed by John Zhuge. 
(cherry picked from commit 12eb5a7b11c36df5a57a3894a3a44bf47f47b954)
 2016-05-22 19:43:47 +09:00
Chris Nauroth
5b907a17ed HDFS-10438. When NameNode HA is configured to use the lifeline RPC server, it should log the address of that server. Contributed by Chris Nauroth. 
(cherry picked from commit 500e946729e1b85fdc0ce8475d8ce118ba886f46)
(cherry picked from commit e7b56cf93c7ac269e40b556875f16d0c5ad2f819)
 2016-05-20 13:02:06 -07:00
Chris Nauroth
877af3ec7e HDFS-10424. DatanodeLifelineProtocol not able to use under security cluster. Contributed by Chris Nauroth. 
(cherry picked from commit bcde1562d25c4f5595f4e3436dc3630315b1ceed)
(cherry picked from commit d38f2090fa998b716a5d7a8d2314927d6eb30e41)
 2016-05-20 12:50:23 -07:00
Kihwal Lee
a81150ae9e HDFS-10417. Improve error message from checkBlockLocalPathAccess. Contributed by Tianyin Xu. 
(cherry picked from commit 204de430bf6a931e5688789c7a783c9c568a98c2)
 2016-05-19 15:54:18 -05:00
Arpit Agarwal
01a0730996 HDFS-9926. MiniDFSCluster leaks dependency Mockito via DataNodeTestUtils. (Contributed by Josh Elser) 2016-05-18 09:25:33 -07:00
Xiaoyu Yao
ccb1cade5b HDFS-10383. Safely close resources in DFSTestUtil. Contributed by Mingliang Liu. 2016-05-17 18:00:18 -07:00
Yongjun Zhang
2bcf1eb36a HDFS-10381, DataStreamer DataNode exclusion log message should be warning. (John Zhuge via Yongjun Zhang) 
(cherry picked from commit 16c07cc68a3e0a06f57b7f4c7207cc8e5dce211f)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/StripedDataStreamer.java

(cherry picked from commit 456fe08a6dcf1168f478a1bdd9f2dc3b4ff59810)
 2016-05-17 16:00:49 -07:00
Kihwal Lee
01de843a31 Revert "HDFS-10417. Improve error message from checkBlockLocalPathAccess. Contributed by Tianyin Xu." 
This reverts commit cb5a1edd1cfebec389110a192aa0e5359abeff0e.
 2016-05-17 15:21:41 -05:00
Kihwal Lee
cb5a1edd1c HDFS-10417. Improve error message from checkBlockLocalPathAccess. Contributed by Tianyin Xu. 
(cherry picked from commit 0942954e8ab6bef636c2648d0d5a0227a50f799c)
 2016-05-17 15:11:40 -05:00
Kihwal Lee
362a778bf5 HDFS-10303. DataStreamer#ResponseProcessor calculates packet ack latency incorrectly. Contributed by Surendra Singh Lilhore. 
(cherry picked from commit 4a5819dae2b0ca8f8b6d94ef464882d079d86593)
 2016-05-17 09:00:59 -05:00
Akira Ajisaka
388b2010ae HDFS-10242. Cannot create space quota of zero. Contributed by Takashi Ohnishi. 
(cherry picked from commit 9fe5828f05accc6746cb08a43916f7557dac533a)
(cherry picked from commit 7f03c1c90e3816b3957dbf121c6d7bc3ce07cabd)
 2016-05-17 15:56:36 +09:00
Andrew Wang
29ed65ff9b HDFS-10333. Intermittent org.apache.hadoop.hdfs.TestFileAppend failure in trunk. Contributed by Yiqun Lin. 
(cherry picked from commit 45788204ae2ac82ccb3b4fe2fd22aead1dd79f0d)
(cherry picked from commit 413f3dabbd398b7d837893963556d9e6dd9e10e2)
 2016-05-15 22:15:18 -07:00
Colin Patrick Mccabe
5f04795aed HADOOP-13065. Add a new interface for retrieving FS and FC Statistics (Mingliang Liu via cmccabe) 
(cherry picked from commit 687233f20d24c29041929dd0a99d963cec54b6df)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/WebHdfsFileSystem.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDistributedFileSystem.java

(cherry picked from commit 15bfcde23832189accce8293a053c8f0ef1aeaae)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DistributedFileSystem.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDistributedFileSystem.java
 2016-05-11 14:24:51 -07:00
Colin Patrick Mccabe
154332bb54 HDFS-10377. CacheReplicationMonitor shutdown log message should use INFO level (Yiqun Lin via cmccabe) 
(cherry picked from commit f0252ad2525c90b2b89ae2ff1de12482da2c8ddd)
(cherry picked from commit 43f32d3f4a86d8f2a302530831003496c78fd561)
 2016-05-10 11:21:16 -07:00
Akira Ajisaka
a84c4d7d4b HDFS-6187. Update the document of hftp/hsftp in branch-2 to mention that they are deprecated. Contributed by Gergely Novák. 
(cherry picked from commit 901588542b573cbefa91f7e0e6032f7163160a85)
 2016-05-10 09:33:55 -07:00
Akira Ajisaka
1622fc1373 Revert "HDFS-6187. Update the document of hftp/hsftp in branch-2 to mention that they are deprecated." 
This reverts commit f25dcb935e9dbc0ad2dfe4466302d8b65868e172.
 2016-05-10 09:33:18 -07:00
Akira Ajisaka
f25dcb935e HDFS-6187. Update the document of hftp/hsftp in branch-2 to mention that they are deprecated. 
(cherry picked from commit c297df59951dcde44474fed341fa495bb6308936)
 2016-05-10 09:29:47 -07:00