3629 Commits

Author SHA1 Message Date
Kihwal Lee
937a43dc29 HDFS-9445. Datanode may deadlock while handling a bad volume. Contributed by Walter Su.
(cherry picked from commit a48301791e9564363bc2abad4e89e344b0d7a5ff)
2015-12-11 08:46:42 -06:00
Uma Mahesh
d028295414 HDFS-9472. concat() API does not give proper exception messages on ./reserved relative path (Rakesh R via umamahesh)
(cherry picked from commit e363417e7b7abdd5d149f303f729ecf3e95ef8f3)
2015-12-11 00:02:49 -08:00
Tsz-Wo Nicholas Sze
26c8950fb4 HDFS-9527. The return type of FSNamesystem.getBlockCollection should be changed to INodeFile. 2015-12-09 18:14:07 -08:00
Vinod Kumar Vavilapalli
469bf56801 HDFS-9273. Moving to 2.6.3 CHANGES section to reflect the backport. 2015-12-08 11:35:28 -08:00
Arpit Agarwal
43241bf8e5 HDFS-9214. Add missing license header 2015-12-04 15:33:30 -08:00
Arpit Agarwal
da3dfd77fd HDFS-9214. Support reconfiguring dfs.datanode.balance.max.concurrent.moves without DN restart. (Contributed by Xiaobing Zhou) 2015-12-04 14:47:01 -08:00
Yongjun Zhang
560d49da8f HDFS-9474. TestPipelinesFailover should not fail when printing debug message. (John Zhuge via Yongjun Zhang)
(cherry picked from commit 59dbe8b3e96d13c2322cabd87c7f893c5a3812ba)
2015-12-04 14:02:28 -08:00
Tsz-Wo Nicholas Sze
afc76eb218 HDFS-9294. DFSClient deadlock when close file and failed to renew lease. Contributed by Brahma Reddy Battula 2015-12-03 11:35:29 -08:00
Colin Patrick Mccabe
228ad84e9c HDFS-9429. Tests in TestDFSAdminWithHA intermittently fail with EOFException (Xiao Chen via Colin P. McCabe)
(cherry picked from commit 53e3bf7e704c332fb119f55cb92520a51b644bfc)
(cherry picked from commit 9b516a2a0501242b27f10a8f3e8551ed85a11320)
2015-12-02 15:40:49 -08:00
Junping Du
12fb8b4cc5 Add 2.6.4 as release entry to CHANGES.txt 2015-12-02 07:38:03 -08:00
Arpit Agarwal
05d7202b1e HDFS-6533. TestBPOfferService#testBasicFunctionalitytest fails intermittently. (Contributed by Wei-Chiu Chuang) 2015-12-01 15:29:42 -08:00
Kihwal Lee
b70b380f37 HDFS-9426. Rollingupgrade finalization is not backward compatible (Contributed by Kihwal Lee)
(cherry picked from commit c62d42cd8bb09a5ffc0c5eefa2d87913e71b9e7e)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocolPB/DatanodeProtocolClientSideTranslatorPB.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocolPB/DatanodeProtocolServerSideTranslatorPB.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/proto/DatanodeProtocol.proto
(cherry picked from commit 9f256d1d716a7e17606245fcfc619901a8fa299a)
2015-12-01 16:43:27 -06:00
Zhe Zhang
456426fe6b HDFS-9269. Update the documentation and wrapper for fuse-dfs. Contributed by Wei-Chiu Chuang.
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt

Change-Id: Idebd3b5d2ab09910c71cfde19e4b4d88f7ce1efb
2015-12-01 14:41:57 -08:00
Jing Zhao
084ad2b420 HDFS-9485. Make BlockManager#removeFromExcessReplicateMap accept BlockInfo instead of Block. Contributed by Mingliang Liu.
(cherry picked from commit 830eb252aaa4fec7ef2ec38cb66f669e8e1ecaa5)
(cherry picked from commit 7e416aa70d76c39dcbc582d1b5bc4b36f557454e)
2015-12-01 13:10:56 -08:00
Allen Wittenauer
81a7ad45c9 HADOOP-12366. expose calculated paths (aw) 2015-12-01 08:15:57 -08:00
Akira Ajisaka
745772c975 HDFS-9336. deleteSnapshot throws NPE when snapshotname is null. Contributed by Brahma Reddy Battula.
(cherry picked from commit 1c05393b51748033279bff31dbc5c5cae7fc3a86)
(cherry picked from commit 402a2f2d6463383b623cd4c59c6631768907e299)
2015-12-01 11:30:26 +08:00
Andrew Wang
8676959d13 HDFS-9470. Encryption zone on root not loaded from fsimage after NN restart. Xiao Chen via wang.
(cherry picked from commit 9b8e50b424d060e16c1175b1811e7abc476e2468)
(cherry picked from commit ce1111ceea830cce5f0833db55201e0e88c3b199)
2015-11-30 18:04:46 -08:00
Vinod Kumar Vavilapalli
efaef45a24 Reverting previous commit which added 2.9.0 entries. Don't need that in branch-2.8.
Revert "Adding release 2.8.0 to CHANGES.txt"

This reverts commit 767815f3176c4776ea828994a662404df303f890.
2015-11-25 17:49:48 -08:00
Vinod Kumar Vavilapalli
767815f317 Adding release 2.8.0 to CHANGES.txt
(cherry picked from commit d57fd181c75c2578775fda0ec575b66da416adff)
2015-11-25 17:37:47 -08:00
Jing Zhao
288cf8437b HDFS-9467. Fix data race accessing writeLockHeldTimeStamp in FSNamesystem. Contributed by Mingliang Liu.
(cherry picked from commit e556c35b0596700f9ec9d0a51cf5027259d531b5)
2015-11-25 14:23:06 -08:00
Konstantin V Shvachko
9c1ef648a9 HDFS-9407. TestFileTruncate should not use fixed NN port. Contributed by Brahma Reddy Battula. 2015-11-25 14:16:03 -08:00
Xiaoyu Yao
4f1f9f7eff HDFS-8512. WebHDFS : GETFILESTATUS should return LocatedBlock with storage type info. Contributed by Xiaoyu Yao.
(cherry picked from commit e3d673901b396cf5bbede5ed6f607ce68301ec0a)
2015-11-25 13:54:22 -08:00
Haohui Mai
15caaa7d0a HDFS-9459. hadoop-hdfs-native-client fails test build on Windows after transition to ctest. Contributed by Chris Nauroth. 2015-11-25 10:32:13 -08:00
Yongjun Zhang
48b294c58e HDFS-9438. TestPipelinesFailover assumes Linux ifconfig. (John Zhuge via Yongjun Zhang)
(cherry picked from commit 8176ea7dc694841a993f2bfc30669fe22f9ec1d2)
2015-11-25 08:50:02 -08:00
Yongjun Zhang
7ac8d8f510 HDFS-6694. Addendum. Update CHANGES.txt for cherry-picking to 2.8.
(cherry picked from commit 84d01ad7f43bc498bc2e9d3afe68aed7f4a4d462)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
2015-11-25 08:49:26 -08:00
arp
566ceac1ff HDFS-6694. TestPipelinesFailover.testPipelineRecoveryStress tests fail intermittently with various symptoms - debugging patch (Contributed by Yongjun Zhang)
(cherry picked from commit c5d9a4a91e4e0faae3a8530408da35b591396060)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
2015-11-25 08:45:59 -08:00
Tom Zeng
d6f7d22929 HADOOP-12415. Add io.netty dependency to hadoop-nfs and to hadoop-hdfs, needed to build Bigtop successfuly, see BIGTOP-2049
Signed-off-by: Konstantin Boudnik <cos@boudnik.org>
(cherry picked from commit b4c6b511e705230dfe4580288addacb81f5c5c5f)
2015-11-24 18:39:01 -08:00
Tsz-Wo Nicholas Sze
79e55fb47f HDFS-8807. dfs.datanode.data.dir does not handle spaces between storageType and URI correctly. Contributed by Anu Engineer 2015-11-24 16:05:21 -08:00
Haohui Mai
b07c91a16b HDFS-8335. FSNamesystem should construct FSPermissionChecker only if permission is enabled. Contributed by Gabor Liptak. 2015-11-24 13:07:45 -08:00
Tsz-Wo Nicholas Sze
15ecbc95bf Move HDFS-9434 to 2.6.3 in CHANGES.txt. 2015-11-24 12:44:37 -08:00
Ming Ma
85d04dc464 HDFS-9314. Improve BlockPlacementPolicyDefault's picking of excess replicas. (Xiao Chen via mingma)
(cherry picked from commit 0e54b164a8d8acf09aca8712116bf7a554cb4846)
2015-11-24 10:31:23 -08:00
cnauroth
c79f017752 HDFS-6101. TestReplaceDatanodeOnFailure fails occasionally. Contributed by Wei-Chiu Chuang.
(cherry picked from commit 1777608fa075a807c645619fda87cb8de1b0350c)
2015-11-24 09:39:37 -08:00
Uma Mahesh
52c889ac14 HDFS-9433. DFS getEZForPath API on a non-existent file should throw FileNotFoundException (Rakesh R via umamahesh)
(cherry picked from commit 411e2b2e7cd63273a3819f99a3275821dfbcc9ce)
2015-11-23 18:46:48 -08:00
Haohui Mai
d469e9e4ca HDFS-7988. Replace usage of ExactSizeInputStream with LimitInputStream. Contributed by Walter Su. 2015-11-23 10:50:23 -08:00
Steve Loughran
331ed6998b Revert "HDFS-9423. Fix intermittent failure of TestEditLogTailer. Contributed by Masatake Iwasaki."
This reverts commit de3b33e121a685e2b27576ef8e8c2187c5065a5f.
2015-11-23 12:28:25 +00:00
Walter Su
de3b33e121 HDFS-9423. Fix intermittent failure of TestEditLogTailer. Contributed by Masatake Iwasaki.
(cherry picked from commit 201f14e2714895ad8262507f5b9deb3521770e91)
2015-11-23 18:50:29 +08:00
Walter Su
040c582b99 HDFS-9435. TestBlockRecovery#testRBWReplicas is failing intermittently. Contributed by Rakesh R.
(cherry picked from commit 001ecf962cc93f4b880922b6eb03a5ca5d21f661)
2015-11-23 15:50:57 +08:00
Walter Su
846de7d842 HDFS-9428. Fix intermittent failure of TestDNFencing.testQueueingWithAppend. Contributed by Masatake Iwasaki.
(cherry picked from commit 5aba093361dcf6bb642e533700f772b9a94154ad)
2015-11-23 15:38:41 +08:00
Haohui Mai
c07fab5f6f HDFS-9024. Deprecate the TotalFiles metric. Contributed by Akira Ahisaka. 2015-11-22 23:03:05 -08:00
Haohui Mai
5ce7e72145 HDFS-9356. Decommissioning node does not have Last Contact value in the UI. Contributed by Surendra Singh Lilhore. 2015-11-22 22:59:12 -08:00
Haohui Mai
529103c51f HDFS-7897. Shutdown metrics when stopping JournalNode. Contributed by zhouyingchao. 2015-11-22 19:12:32 -08:00
Haohui Mai
8aa12772d4 HDFS-6885. Fix wrong use of BytesWritable in FSEditLogOp#RenameOp. Contributed by Yi Liu. 2015-11-22 17:17:01 -08:00
Haohui Mai
53f6a9e134 HDFS-3302. Review and improve HDFS trash documentation. Contributed by Harsh J. 2015-11-22 16:30:46 -08:00
Haohui Mai
2a4cd27bdc HDFS-7796. Include X-editable for slick contenteditable fields in the web UI. Contributed by Ravi Prakash. 2015-11-22 16:22:14 -08:00
Haohui Mai
469fef2a4f HDFS-9153. Pretty-format the output for DFSIO. Contributed by Kai Zheng. 2015-11-22 16:18:16 -08:00
Haohui Mai
049ccf71ce HDFS-8914. Document HA support in the HDFS HdfsDesign.md. Contributed by Lars Francke. 2015-11-22 16:10:38 -08:00
Haohui Mai
f504d95e87 HDFS-9402. Switch DataNode.LOG to use slf4j. Contributed by Walter Su. 2015-11-22 15:57:23 -08:00
Haohui Mai
2c185222f9 HDFS-9443. Disabling HDFS client socket cache causes logging message printed to console for CLI commands. Contributed by Chris Nauroth. 2015-11-22 15:06:36 -08:00
Tsz-Wo Nicholas Sze
bf82a8de30 HDFS-9434. Recommission a datanode with 500k blocks may pause NN for 30 seconds for printing info log messags. 2015-11-19 14:54:59 -08:00
Yongjun Zhang
0664782025 HDFS-9439. Include status of closeAck into exception message in DataNode#run. (Xiao Chen via Yongjun Zhang)
(cherry picked from commit 31dc5c650e3fcfd5b581cbc1132b895d3eadaf49)
2015-11-19 14:22:44 -08:00