Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
11,726 Commits 326 Branches 371 Tags
Commit Graph

4071 Commits

Author SHA1 Message Date
Kihwal Lee
48be0ff67a HDFS-10303. DataStreamer#ResponseProcessor calculates packet ack latency incorrectly. Contributed by Surendra Singh Lilhore. 
(cherry picked from commit 4a5819dae2b0ca8f8b6d94ef464882d079d86593)
 2016-05-17 08:58:53 -05:00
Akira Ajisaka
7f03c1c90e HDFS-10242. Cannot create space quota of zero. Contributed by Takashi Ohnishi. 
(cherry picked from commit 9fe5828f05accc6746cb08a43916f7557dac533a)
 2016-05-17 15:56:21 +09:00
Sangjin Lee
9330a7b4de HDFS-10208. Addendum for HDFS-9579: to handle the case when client machine can't resolve network path (Ming Ma via sjlee) 
(cherry picked from commit 61f46be071e42f9eb49a54b1bd2e54feac59f808)
 2016-05-16 18:59:19 -07:00
Lei Xu
09a613b023 HDFS-10410. RedundantEditLogInputStream.LOG is set to wrong class. (John Zhuge via lei) 
(cherry picked from commit 6a6e74acf5c38a4995c4622148721cfe2f1fbdad)
 2016-05-16 17:07:03 -07:00
Andrew Wang
413f3dabbd HDFS-10333. Intermittent org.apache.hadoop.hdfs.TestFileAppend failure in trunk. Contributed by Yiqun Lin. 
(cherry picked from commit 45788204ae2ac82ccb3b4fe2fd22aead1dd79f0d)
 2016-05-15 22:15:10 -07:00
Lei Xu
782441d47e HDFS-9389. Add maintenance states to AdminStates. (Ming Ma via lei) 
(cherry picked from commit a2774debf71b809f9cd9202c0e75a41a8dd191d0)
 2016-05-12 15:44:07 -07:00
Tsz-Wo Nicholas Sze
69768bf9e0 HDFS-10346. Implement asynchronous setPermission/setOwner for DistributedFileSystem. Contributed by Xiaobing Zhou 2016-05-11 17:57:20 -07:00
Colin Patrick Mccabe
15bfcde238 HADOOP-13065. Add a new interface for retrieving FS and FC Statistics (Mingliang Liu via cmccabe) 
(cherry picked from commit 687233f20d24c29041929dd0a99d963cec54b6df)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/WebHdfsFileSystem.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDistributedFileSystem.java
 2016-05-11 14:02:03 -07:00
Colin Patrick Mccabe
43f32d3f4a HDFS-10377. CacheReplicationMonitor shutdown log message should use INFO level (Yiqun Lin via cmccabe) 
(cherry picked from commit f0252ad2525c90b2b89ae2ff1de12482da2c8ddd)
 2016-05-10 11:20:46 -07:00
Akira Ajisaka
901588542b HDFS-6187. Update the document of hftp/hsftp in branch-2 to mention that they are deprecated. Contributed by Gergely Novák. 2016-05-10 09:32:33 -07:00
Akira Ajisaka
a5bfb2dd25 Revert "HDFS-6187. Update the document of hftp/hsftp in branch-2 to mention that they are deprecated." 
This reverts commit c297df59951dcde44474fed341fa495bb6308936.
 2016-05-10 09:32:20 -07:00
Akira Ajisaka
c297df5995 HDFS-6187. Update the document of hftp/hsftp in branch-2 to mention that they are deprecated. 2016-05-10 09:29:30 -07:00
Kihwal Lee
2c782fdb17 HDFS-10372. Fix for failing TestFsDatasetImpl#testCleanShutdownOfVolume. Contributed by Rushabh Shah. 
(cherry picked from commit b9e5a32fa14b727b44118ec7f43fb95de05a7c2c)
 2016-05-09 15:51:42 -05:00
Masatake Iwasaki
4ecbe2e9bf HDFS-2043. TestHFlush failing intermittently. Contributed by Lin Yiqun. 
(cherry picked from commit 2835f146b551f911ea13307e7762759813898757)
 2016-05-06 15:47:51 +09:00
Xiaoyu Yao
35859872b7 HDFS-10324. Trash directory in an encryption zone should be pre-created with correct permissions. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit dacd1f50feb24ccdf6155b2b7a6126fe21a47ad0)
 2016-05-05 18:15:32 -07:00
Ming Ma
5b53833171 HDFS-10320. Rack failures may result in NN terminate. (Xiao Chen via mingma) 
(cherry picked from commit 1268cf5fbe4458fa75ad0662512d352f9e8d3470)
 2016-05-04 17:04:44 -07:00
Arpit Agarwal
313b4dbf28 HDFS-9902. Support different values of dfs.datanode.du.reserved per storage type. (Contributed by Brahma Reddy Battula) 2016-05-03 16:52:56 -07:00
Xiaoyu Yao
ceb9a49d03 HDFS-10344. DistributedFileSystem#getTrashRoots should skip encryption zone that does not have .Trash. Contributed by Xiaoyu Yao. 
(cherry picked from commit 45a753ccf79d334513c7bc8f2b81c89a4697075d)
 2016-05-02 19:37:48 -07:00
Harsh J
89c00da611 HDFS-2580. NameNode#main(...) can make use of GenericOptionsParser. Contributed by harsh. (harsh) 
(cherry picked from commit 54e612bfb9f877e58f7f153c43cb4147876826d3)
 2016-05-02 17:54:31 -07:00
Tsz-Wo Nicholas Sze
7e0824faa9 HADOOP-12957. Limit the number of outstanding async calls. Contributed by Xiaobing Zhou 2016-05-02 11:20:10 -07:00
Kihwal Lee
74938b537d HDFS-10347. Namenode report bad block method doesn't log the bad block or datanode. Contributed by Rushabh Shah. 
(cherry picked from commit 7da540d03eccc2f97950bf47e8b35ce8c889d1e0)
 2016-04-29 15:58:07 -05:00
Tsz-Wo Nicholas Sze
fe3c2886be HDFS-10335 Mover$Processor#chooseTarget() always chooses the first matching target storage group. Contributed by Mingliang Liu 2016-04-29 11:24:32 -07:00
Kihwal Lee
0b9057e1d3 HDFS-10260. TestFsDatasetImpl#testCleanShutdownOfVolume often fails. Contributed by Rushabh Shah. 
(cherry picked from commit af9b000535cc987f66327e2b2bfe08923ba24c13)
 2016-04-29 09:59:58 -05:00
Kihwal Lee
f715f14185 HDFS-9958. BlockManager#createLocatedBlocks can throw NPE for corruptBlocks on failed storages. Contributed by Kuhu Shukla. 2016-04-28 16:39:48 -05:00
Lei Xu
4289cb8b36 HDFS-3702. Add an option for NOT writing the blocks locally if there is a datanode on the same box as the client. (Contributed by Lei (Eddy) Xu) 
(cherry picked from commit 0a152103f19a3e8e1b7f33aeb9dd115ba231d7b7)
 2016-04-27 15:06:35 -07:00
Kihwal Lee
e181092b86 HDFS-10330. Add Corrupt Blocks Information in Metasave output. Contributed by Kuhu Shukla. 
(cherry picked from commit 919a1d824a0a61145dc7ae59cfba3f34d91f2681)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestBlockManager.java
 2016-04-27 08:29:30 -05:00
Tsz-Wo Nicholas Sze
d316f44059 HDFS-10224. Implement asynchronous rename for DistributedFileSystem. Contributed by Xiaobing Zhou 2016-04-26 17:21:20 -07:00
Andrew Wang
088a78241b HDFS-10297. Increase default balance bandwidth and concurrent moves. Contributed by John Zhuge. 
(cherry picked from commit 6be22ddbf1b6f3c19ec70c63ddb8f5519d18dd72)
 2016-04-26 13:04:21 -07:00
Kihwal Lee
c991beac64 HDFS-10329. Bad initialisation of StringBuffer in RequestHedgingProxyProvider. Contributed by Lin Yiqun. 
(cherry picked from commit c6a2430b47692a72c500373d6fc1bce78652675b)
 2016-04-26 11:46:46 -05:00
Kihwal Lee
f6bd9e07d2 HDFS-10318. TestJMXGet hides the real error in case of test failure. Contributed by Andras Bokor. 
(cherry picked from commit 10f0f7851a3255caab775777e8fb6c2781d97062)
 2016-04-25 11:41:40 -05:00
Ravi Prakash
88e1427a03 HDFS-9525. hadoop utilities need to support provided delegation tokens. Contributed by HeeSoo Kim 2016-04-23 20:50:56 -07:00
Masatake Iwasaki
96111caca9 HDFS-9905. WebHdfsFileSystem#runWithRetry should display original stack trace on error. (Wei-Chiu Chuang via iwasakims) 
(cherry picked from commit 6fcde2e38da04cae3aad6b13cf442af211f71506)
 2016-04-23 23:50:01 +09:00
Kihwal Lee
43cfe5943b HDFS-9555. LazyPersistFileScrubber should still sleep if there are errors in the clear progress. Contributed by Phil Yang. 
(cherry picked from commit 5d4255a80156d2cacfea8184b41805070223d3a9)
 2016-04-22 11:10:06 -05:00
Jing Zhao
5353289c8c HDFS-9894. Add unsetStoragePolicy API to FileContext/AbstractFileSystem and derivatives. Contributed by Xiaobing Zhou. 
(cherry picked from commit 7149cdb3c2d9dd390cd8668883cbe5db94090e0a)
 2016-04-21 20:16:02 -07:00
Tsz-Wo Nicholas Sze
a96ea528cc HDFS-10309 Balancer doesn't honor dfs.blocksize value defined with suffix k(kilo), m(mega), g(giga). Contributed by Amit Anand 2016-04-21 15:44:01 -07:00
Tsz-Wo Nicholas Sze
5245254a46 HDFS-10319. Balancer should not try to pair storages with different types. 2016-04-21 15:21:45 -07:00
Xiaoyu Yao
432531dcf7 HDFS-10207. Support enable Hadoop IPC backoff without namenode restart. Contributed by Xiaobing Zhou. 
(cherry picked from commit b4be288c5d6801988f555a566c2eb793c88a15a4)
 2016-04-21 10:19:35 -07:00
Xiaoyu Yao
a2a65922dd HADOOP-12985. Support MetricsSource interface for DecayRpcScheduler Metrics. Contributed by Xiaoyu Yao. 
(cherry picked from commit 5bd7b592e5fbe4d448fd127c15d29f3121b8a833)
 2016-04-20 23:11:42 -07:00
Chris Nauroth
cc56bed686 HDFS-10312. Large block reports may fail to decode at NameNode due to 64 MB protobuf maximum length restriction. Contributed by Chris Nauroth. 
(cherry picked from commit 63ac2db59af2b50e74dc892cae1dbc4d2e061423)
 2016-04-20 13:55:03 -07:00
Colin Patrick Mccabe
76d963acb4 HDFS-10308. TestRetryCacheWithHA#testRetryCacheOnStandbyNN failing (Rakesh R via cmccabe) 
(cherry picked from commit ad36fa6f42870c517526618a30204b443bfc6b5a)
 2016-04-20 11:52:26 -07:00
Arpit Agarwal
b776db36f7 HDFS-10264. Logging improvements in FSImageFormatProtobuf.Saver. (Contributed by Xiaobing Zhou) 2016-04-19 11:27:36 -07:00
Walter Su
09a508beee HDFS-9744. TestDirectoryScanner#testThrottling occasionally time out after 300 seconds. Contributed by Lin Yiqun. 
(cherry picked from commit 90d1af141666ba12f18d44464cb6169c445d0902)
 2016-04-19 18:56:08 +08:00
Walter Su
d31a0d7443 HDFS-10284. o.a.h.hdfs.server.blockmanagement.TestBlockManagerSafeMode.testCheckSafeMode fails intermittently. Contributed by Mingliang Liu. 
(cherry picked from commit 4b4df2cd48649b2d9cbdd97907c8d5f813cacdb1)
 2016-04-19 18:08:52 +08:00
Jing Zhao
bf4403e034 HDFS-10306. SafeModeMonitor should not leave safe mode if name system is starting active service. Contributed by Mingliang Liu. 
(cherry picked from commit be0bce1b7171c49e2dca22f56d4e750e606862fc)
 2016-04-18 18:06:10 -07:00
Colin Patrick Mccabe
a69b6b1e8b HDFS-10265. OEV tool fails to read edit xml file if OP_UPDATE_BLOCKS has no BLOCK tag (Wan Chang via cmccabe) 
(cherry picked from commit cb3ca460efb97be8c031bdb14bb7705cc25f2117)
 2016-04-18 13:48:24 -07:00
Kihwal Lee
aa846bd492 HDFS-10302. BlockPlacementPolicyDefault should use default replication considerload value. Contributed by Lin Yiqun. 
(cherry picked from commit d8b729e16fb253e6c84f414d419b5663d9219a43)
 2016-04-18 08:00:44 -05:00
Walter Su
a06ee5a71d HDFS-10275. TestDataNodeMetrics failing intermittently due to TotalWriteTime counted incorrectly. Contributed by Lin Yiqun. 
(cherry picked from commit ab903029a9d353677184ff5602966b11ffb408b9)
 2016-04-18 20:31:55 +08:00
Steve Loughran
dd64769699 HDFS-10291 TestShortCircuitLocalRead failing (stevel) 2016-04-18 10:26:58 +01:00
Walter Su
a6d0e9e56a HDFS-9412. getBlocks occupies FSLock and takes too long to complete. Contributed by He Tianyi. 
(cherry picked from commit 67523ffcf491f4f2db5335899c00a174d0caaa9b)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestGetBlocks.java
 2016-04-18 09:34:01 +08:00
Jing Zhao
eba7ecc993 HDFS-10283. o.a.h.hdfs.server.namenode.TestFSImageWithSnapshot#testSaveLoadImageWithAppending fails intermittently. Contributed by Mingliang Liu. 
(cherry picked from commit 89a838769ff5b6c64565e6949b14d7fed05daf54)
 2016-04-15 10:50:58 -07:00