Commit Graph

5163 Commits

Author SHA1 Message Date
Arpit Agarwal 9d817fa1b1 HDFS-9214. Support reconfiguring dfs.datanode.balance.max.concurrent.moves without DN restart. (Contributed by Xiaobing Zhou) 2015-12-04 14:46:46 -08:00
Yongjun Zhang 59dbe8b3e9 HDFS-9474. TestPipelinesFailover should not fail when printing debug message. (John Zhuge via Yongjun Zhang) 2015-12-04 13:45:01 -08:00
Colin P. McCabe e02bbeb886 HDFS-9267. TestDiskError should get stored replicas through FsDatasetTestUtils. (Lei (Eddy) Xu via Colin P. McCabe) 2015-12-04 12:51:19 -08:00
Xiaoyu Yao cbc7b6bf97 HDFS-8831. Trash Support for deletion in HDFS encryption zone. Contributed by Xiaoyu Yao. 2015-12-04 10:39:45 -08:00
Lei Xu 0ac8fb4b33 HDFS-9490. MiniDFSCluster should change block generation stamp via FsDatasetTestUtils. (Tony Wu via lei) 2015-12-04 10:24:55 -08:00
Ming Ma 3fa33b5c2c HDFS-9430 Remove waitForLoadingFSImage since checkNNStartup has ensured image loaded and namenode started. (Brahma Reddy Battula via mingma) 2015-12-04 09:47:57 -08:00
Konstantin V Shvachko 924a33d02d HDFS-9484. NNThroughputBenchmark$BlockReportStats should not send empty block reports. Contributed by Mingliang Liu. 2015-12-03 15:03:34 -08:00
Konstantin V Shvachko e71aa717d4 HDFS-9436. Make NNThroughputBenchmark$BlockReportStats run with 10 datanodes by default. Contributed by Mingliang. 2015-12-03 15:03:33 -08:00
Tsz-Wo Nicholas Sze e8bd1ba74b HDFS-9294. DFSClient deadlock when close file and failed to renew lease. Contributed by Brahma Reddy Battula 2015-12-02 17:39:28 -08:00
Colin Patrick Mccabe 53e3bf7e70 HDFS-9429. Tests in TestDFSAdminWithHA intermittently fail with EOFException (Xiao Chen via Colin P. McCabe) 2015-12-01 23:21:21 -08:00
Jing Zhao 3c4a34e90c Move HDFS-9129 to trunk in CHANGES.txt 2015-12-01 16:15:08 -08:00
Jing Zhao a49cc74b4c HDFS-9129. Move the safemode block count into BlockManager. Contributed by Mingliang Liu. 2015-12-01 16:09:19 -08:00
Arpit Agarwal 58f6f54eea HDFS-6533. TestBPOfferService#testBasicFunctionalitytest fails intermittently. (Contributed by Wei-Chiu Chuang) 2015-12-01 13:32:32 -08:00
Jing Zhao 830eb252aa HDFS-9485. Make BlockManager#removeFromExcessReplicateMap accept BlockInfo instead of Block. Contributed by Mingliang Liu. 2015-12-01 13:05:22 -08:00
Zhe Zhang 1cc7e61431 HDFS-9269. Update the documentation and wrapper for fuse-dfs. Contributed by Wei-Chiu Chuang.
Change-Id: Ia9ec512de2464bf94725cc7c15c378c59d0f04c4
2015-12-01 10:24:49 -08:00
Junping Du 028894281b Creating 2.6.4 entries in CHANGES.txt files. 2015-12-01 08:16:39 -08:00
Akira Ajisaka 1c05393b51 HDFS-9336. deleteSnapshot throws NPE when snapshotname is null. Contributed by Brahma Reddy Battula. 2015-12-01 11:29:09 +08:00
Andrew Wang 9b8e50b424 HDFS-9470. Encryption zone on root not loaded from fsimage after NN restart. Xiao Chen via wang. 2015-11-30 14:32:51 -08:00
Vinayakumar B 9f256d1d71 HDFS-9426. Rollingupgrade finalization is not backward compatible (Contributed by Kihwal Lee)
(cherry picked from commit c62d42cd8b)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocolPB/DatanodeProtocolClientSideTranslatorPB.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocolPB/DatanodeProtocolServerSideTranslatorPB.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/proto/DatanodeProtocol.proto
2015-11-26 09:39:47 +05:30
Vinod Kumar Vavilapalli d57fd181c7 Adding release 2.8.0 to CHANGES.txt 2015-11-25 17:33:26 -08:00
Jing Zhao e556c35b05 HDFS-9467. Fix data race accessing writeLockHeldTimeStamp in FSNamesystem. Contributed by Mingliang Liu. 2015-11-25 14:22:12 -08:00
Konstantin V Shvachko fc799ab16c HDFS-9407. TestFileTruncate should not use fixed NN port. Contributed by Brahma Reddy Battula. 2015-11-25 13:52:09 -08:00
Xiaoyu Yao e3d673901b HDFS-8512. WebHDFS : GETFILESTATUS should return LocatedBlock with storage type info. Contributed by Xiaoyu Yao. 2015-11-25 13:41:06 -08:00
Haohui Mai b21dffb1fe HDFS-9451. Clean up depreated umasks and related unit tests. Contributed by Wei-Chiu Chuang. 2015-11-25 12:47:24 -08:00
Haohui Mai 95d5227c75 HDFS-9459. hadoop-hdfs-native-client fails test build on Windows after transition to ctest. Contributed by Chris Nauroth. 2015-11-25 10:32:48 -08:00
Yongjun Zhang 84d01ad7f4 HDFS-6694. Addendum. Update CHANGES.txt for cherry-picking to 2.8. 2015-11-25 08:41:39 -08:00
Yongjun Zhang 8176ea7dc6 HDFS-9438. TestPipelinesFailover assumes Linux ifconfig. (John Zhuge via Yongjun Zhang) 2015-11-25 07:40:16 -08:00
Tom Zeng b4c6b511e7 HADOOP-12415. Add io.netty dependency to hadoop-nfs and to hadoop-hdfs, needed to build Bigtop successfuly, see BIGTOP-2049
Signed-off-by: Konstantin Boudnik <cos@boudnik.org>
2015-11-24 18:36:34 -08:00
Tsz-Wo Nicholas Sze 78ec38b2ed HDFS-8807. dfs.datanode.data.dir does not handle spaces between storageType and URI correctly. Contributed by Anu Engineer 2015-11-24 16:01:55 -08:00
Haohui Mai 977e0b3c4c HDFS-8335. FSNamesystem should construct FSPermissionChecker only if permission is enabled. Contributed by Gabor Liptak. 2015-11-24 13:14:49 -08:00
Xiaoyu Yao fe5624b85d HDFS-8855. Webhdfs client leaks active NameNode connections. Contributed by Xiaobing Zhou. 2015-11-24 12:47:57 -08:00
Tsz-Wo Nicholas Sze 56493cda04 Move HDFS-9434 to 2.6.3 in CHANGES.txt. 2015-11-24 12:42:57 -08:00
Haohui Mai db4cab21f4 HDFS-5165. Remove the TotalFiles metrics. Contributed by Akira AJISAKA. 2015-11-24 11:41:57 -08:00
Ming Ma 0e54b164a8 HDFS-9314. Improve BlockPlacementPolicyDefault's picking of excess replicas. (Xiao Chen via mingma) 2015-11-24 10:30:24 -08:00
cnauroth 1777608fa0 HDFS-6101. TestReplaceDatanodeOnFailure fails occasionally. Contributed by Wei-Chiu Chuang. 2015-11-24 09:39:21 -08:00
Walter Su f80dc6f499 CHANGES.txt: move HDFS-9423 to trunk 2015-11-24 13:46:16 +08:00
Uma Mahesh 411e2b2e7c HDFS-9433. DFS getEZForPath API on a non-existent file should throw FileNotFoundException (Rakesh R via umamahesh) 2015-11-23 17:54:31 -08:00
Haohui Mai 298a8cb096 HDFS-7988. Replace usage of ExactSizeInputStream with LimitInputStream. Contributed by Walter Su. 2015-11-23 10:50:12 -08:00
Walter Su 201f14e271 HDFS-9423. Fix intermittent failure of TestEditLogTailer. Contributed by Masatake Iwasaki. 2015-11-23 18:49:40 +08:00
Walter Su 001ecf962c HDFS-9435. TestBlockRecovery#testRBWReplicas is failing intermittently. Contributed by Rakesh R. 2015-11-23 15:49:58 +08:00
Walter Su 5aba093361 HDFS-9428. Fix intermittent failure of TestDNFencing.testQueueingWithAppend. Contributed by Masatake Iwasaki. 2015-11-23 15:37:45 +08:00
Haohui Mai 8228697857 HDFS-9024. Deprecate the TotalFiles metric. Contributed by Akira Ahisaka. 2015-11-22 23:02:50 -08:00
Haohui Mai 04c14b5dc4 HDFS-9356. Decommissioning node does not have Last Contact value in the UI. Contributed by Surendra Singh Lilhore. 2015-11-22 22:58:58 -08:00
Haohui Mai a4bd54f9d7 HDFS-7897. Shutdown metrics when stopping JournalNode. Contributed by zhouyingchao. 2015-11-22 19:12:23 -08:00
Haohui Mai bfbcfe7364 HDFS-6885. Fix wrong use of BytesWritable in FSEditLogOp#RenameOp. Contributed by Yi Liu. 2015-11-22 17:16:51 -08:00
Haohui Mai 2326171ea8 HDFS-3302. Review and improve HDFS trash documentation. Contributed by Harsh J. 2015-11-22 16:30:39 -08:00
Haohui Mai 38146a6cdb HDFS-7796. Include X-editable for slick contenteditable fields in the web UI. Contributed by Ravi Prakash. 2015-11-22 16:22:06 -08:00
Haohui Mai 000e12f6fa HDFS-9153. Pretty-format the output for DFSIO. Contributed by Kai Zheng. 2015-11-22 16:18:07 -08:00
Haohui Mai 0c7340f377 HDFS-8914. Document HA support in the HDFS HdfsDesign.md. Contributed by Lars Francke. 2015-11-22 16:10:27 -08:00
Haohui Mai 66428d33a7 HADOOP-11218. Add TLSv1.1,TLSv1.2 to KMS, HttpFS, SSLFactory. Contributed by Vijay Singh. 2015-11-22 16:00:34 -08:00
Haohui Mai 176ff5ce90 HDFS-9402. Switch DataNode.LOG to use slf4j. Contributed by Walter Su. 2015-11-22 15:54:41 -08:00
Haohui Mai 6039059c37 HDFS-9443. Disabling HDFS client socket cache causes logging message printed to console for CLI commands. Contributed by Chris Nauroth. 2015-11-22 15:03:35 -08:00
Uma Mahesh 5b714a2819 HDFS-9348. Erasure Coding: DFS GetErasureCodingPolicy API on a non-existent file should be handled properly. (Rakesh R via umamahesh) 2015-11-21 22:38:36 -08:00
Tsz-Wo Nicholas Sze 8e03e855b6 HDFS-9434. Recommission a datanode with 500k blocks may pause NN for 30 seconds for printing info log messags. 2015-11-19 14:54:01 -08:00
Yongjun Zhang 31dc5c650e HDFS-9439. Include status of closeAck into exception message in DataNode#run. (Xiao Chen via Yongjun Zhang) 2015-11-19 14:20:33 -08:00
Ming Ma 1c4951a7a0 HDFS-8056. Decommissioned dead nodes should continue to be counted as dead after NN restart. (mingma) 2015-11-19 10:04:01 -08:00
Akira Ajisaka ac1aa6c819 HDFS-9431. DistributedFileSystem#concat fails if the target path is relative. Contributed by Kazuho Fujii. 2015-11-19 20:55:01 +09:00
cnauroth bad2afe39a HDFS-9400. TestRollingUpgradeRollback fails on branch-2. Contributed by Brahma Reddy Battula. 2015-11-18 10:59:31 -08:00
Colin Patrick Mccabe dfbde3fc51 HDFS-9252. Change TestFileTruncate to use FsDatasetTestUtils to get block file size and genstamp. (Lei (Eddy) Xu via cmccabe) 2015-11-17 10:48:15 -08:00
Akira Ajisaka b82a6cee4b Move HDFS-8615 from 2.8.0 to 2.6.3 in CHANGES.txt. 2015-11-17 16:33:07 +09:00
Arpit Agarwal 007c6ce1af HDFS-9397. Fix typo for readChecksum() LOG.warn in BlockSender.java. (Contributed by Enrique Flores) 2015-11-16 21:02:00 -08:00
Walter Su 621cbb4f69 HDFS-9358. TestNodeCount#testNodeCount timed out. Contributed by Masatake Iwasaki. 2015-11-17 10:51:29 +08:00
Xiaoyu Yao a4f62a2d58 HDFS-9421. NNThroughputBenchmark replication test NPE with -namenode option. Contributed by Mingliang Liu. 2015-11-16 16:42:15 -08:00
Xiaoyu Yao 2701f2d255 HDFS-9387. Fix namenodeUri parameter parsing in NNThroughputBenchmark. Contributed by Mingliang Liu. 2015-11-16 16:29:47 -08:00
Ming Ma 02653add98 HDFS-9413. getContentSummary() on standby should throw StandbyException. (Brahma Reddy Battula via mingma) 2015-11-16 09:32:40 -08:00
Walter Su cccf88480b HDFS-9410. Some tests should always reset sysout and syserr. Contributed by Xiao Chen. 2015-11-13 14:26:43 +08:00
Zhe Zhang 7b00c8e20e HDFS-8968. Erasure coding: a comprehensive I/O throughput benchmark tool. Contributed by Rui Li.
Change-Id: I01ff5b04727fd79e6373582d4815c5e7b2096c67
2015-11-12 11:30:39 -08:00
Kihwal Lee a2a104f3d3 HDFS-9396. Total files and directories on jmx and web UI on standby is uninitialized. Contributed by Kihwal Lee. 2015-11-11 15:24:43 -06:00
Xiaoyu Yao 6e4562b844 HDFS-9245. Fix findbugs warnings in hdfs-nfs/WriteCtx. Contributed by Mingliang Liu. 2015-11-10 16:35:06 -08:00
Haohui Mai a06e6b81e0 HDFS-9369. Use ctest to run tests for hadoop-hdfs-native-client. Contributed by Haohui Mai. 2015-11-10 14:53:05 -08:00
Zhe Zhang 73b94d7899 HDFS-9364. Unnecessary DNS resolution attempts when creating NameNodeProxies. Contributed by Xiao Chen.
Change-Id: I9e42f724f27924cf73891425a832de37ce014a1e
2015-11-10 09:55:29 -08:00
Walter Su 2fda45b9dc HDFS-9401. Fix findbugs warnings in BlockRecoveryWorker. Contributed by Brahma Reddy Battula. 2015-11-10 14:48:08 +08:00
Haohui Mai 94a1833638 HDFS-2261. AOP unit tests are not getting compiled or run. Contributed by Haohui Mai. 2015-11-09 15:25:19 -08:00
Yongjun Zhang 2741a2109b HDFS-9249. NPE is thrown if an IOException is thrown in NameNode constructor. (Wei-Chiu Chuang via Yongjun Zhang) 2015-11-09 14:04:03 -08:00
Xiaoyu Yao 41d3f8899d HDFS-9234. WebHdfs: getContentSummary() should give quota for storage types. Contributed by Surendra Singh Lilhore. 2015-11-09 09:57:56 -08:00
Kihwal Lee ef926b2e38 HDFS-9383. TestByteArrayManager#testByteArrayManager fails. Contributed by Tsz Wo Nicholas Sze. 2015-11-09 08:56:04 -06:00
Lei Xu 655d43442f Fix CHANGES.txt for HADOOP-11684. 2015-11-08 11:30:01 -08:00
Vinayakumar B 6d2332ae37 HDFS-9057. allow/disallow snapshots via webhdfs (Contributed by Brahma Reddy Battula) 2015-11-08 16:24:27 +05:30
Allen Wittenauer b76b0ce51e HADOOP-12366. expose calculated paths (aw) 2015-11-07 08:32:56 -08:00
cnauroth 1ee2db5c41 HDFS-9394. branch-2 hadoop-hdfs-client fails during FileSystem ServiceLoader initialization, because HftpFileSystem is missing. Contributed by Mingliang Liu. 2015-11-07 07:38:42 -08:00
Tsz-Wo Nicholas Sze 9614dea71a HDFS-9398. Make ByteArraryManager log message in one-line format. Contributed by Mingliang Liu 2015-11-07 22:21:28 +08:00
Arpit Agarwal 2801b42a7e HDFS-9379. Make NNThroughputBenchmark support more than 10 datanodes. (Contributed by Mingliang Liu) 2015-11-06 18:58:49 -08:00
Kihwal Lee bf6aa30a15 HDFS-9318. considerLoad factor can be improved. Contributed by Kuhu Shukla. 2015-11-06 13:30:33 -06:00
Yongjun Zhang b64242c0d2 HDFS-9236. Missing sanity check for block size during block recovery. (Tony Wu via Yongjun Zhang) 2015-11-06 11:15:54 -08:00
Arpit Agarwal 0b18e5e8c6 HDFS-6481. DatanodeManager#getDatanodeStorageInfos() should check the length of storageIDs. (Contributed by szetszwo) 2015-11-06 10:15:23 -08:00
cnauroth 66c0967310 HDFS-9384. TestWebHdfsContentLength intermittently hangs and fails due to TCP conversation mismatch between client and server. Contributed by Chris Nauroth. 2015-11-05 22:07:08 -08:00
Yongjun Zhang 286cc6483f HDFS-9377. Fix findbugs warnings in FSDirSnapshotOp. (Mingliang Liu via Yongjun Zhang) 2015-11-05 14:36:12 -08:00
Lei Xu 46e78a7a16 HDFS-9282. Make data directory count and storage raw capacity related tests FsDataset-agnostic. (Tony Wu via lei) 2015-11-05 10:47:33 -08:00
Haohui Mai efc73d7896 HDFS-9372. Remove dead code in DataStorage.recoverTransitionRead. Contributed by Duo Zhang. 2015-11-05 10:00:01 -08:00
Kihwal Lee ff47f35dee HDFS-4937. ReplicationMonitor can infinite-loop in BlockPlacementPolicyDefault#chooseRandom(). Contributed by Kihwal Lee. 2015-11-05 09:25:20 -06:00
cnauroth c563401796 HDFS-9378. hadoop-hdfs-client tests do not write logs. Contributed by Chris Nauroth. 2015-11-05 06:47:58 -08:00
Xiaoyu Yao ea5bb48326 HDFS-9360. Storage type usage isn't updated properly after file deletion. Contributed by Ming Ma. 2015-11-05 01:30:13 -08:00
Lei Xu 5667129276 HDFS-9363. Add fetchReplica to FsDatasetTestUtils to return FsDataset-agnostic replica. (Tony Wu via lei) 2015-11-04 10:49:28 -08:00
Lei Xu e2a5441b06 HDFS-9331. Modify TestNameNodeMXBean#testNameNodeMXBeanInfo() to account for filesystem entirely allocated for DFS use. (Tony Wu via lei) 2015-11-04 10:27:35 -08:00
Lei Xu ec414600ed HDFS-9007. Fix HDFS Balancer to honor upgrade domain policy. (Ming Ma via lei) 2015-11-04 10:22:17 -08:00
Haohui Mai 88beb46cf6 Revert "HDFS-8855. Webhdfs client leaks active NameNode connections. Contributed by Xiaobing Zhou."
This reverts commit 84cbd72afd.
2015-11-04 10:21:13 -08:00
Kihwal Lee 3fb1ece4e9 fix up CHANGES.txt 2015-11-04 12:15:10 -06:00
Haohui Mai 0eed886a16 HDFS-9357. NN UI renders icons of decommissioned DN incorrectly. Contributed by Surendra Singh Lilhore. 2015-11-04 09:16:43 -08:00
Jason Lowe 0383a3973b Add 2.7.3 release to CHANGES.txt 2015-11-04 16:26:14 +00:00
Varun Vasudev 73b9c7b82b HADOOP-10787. Rename/remove non-HADOOP_*, etc from the shell scripts. Contributed by Allen Wittenauer. 2015-11-04 15:56:17 +05:30