Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
10,408 Commits 326 Branches 371 Tags
Commit Graph

3620 Commits

Author SHA1 Message Date
Walter Su
040c582b99 HDFS-9435. TestBlockRecovery#testRBWReplicas is failing intermittently. Contributed by Rakesh R. 
(cherry picked from commit 001ecf962cc93f4b880922b6eb03a5ca5d21f661)
 2015-11-23 15:50:57 +08:00
Walter Su
846de7d842 HDFS-9428. Fix intermittent failure of TestDNFencing.testQueueingWithAppend. Contributed by Masatake Iwasaki. 
(cherry picked from commit 5aba093361dcf6bb642e533700f772b9a94154ad)
 2015-11-23 15:38:41 +08:00
Haohui Mai
c07fab5f6f HDFS-9024. Deprecate the TotalFiles metric. Contributed by Akira Ahisaka. 2015-11-22 23:03:05 -08:00
Haohui Mai
5ce7e72145 HDFS-9356. Decommissioning node does not have Last Contact value in the UI. Contributed by Surendra Singh Lilhore. 2015-11-22 22:59:12 -08:00
Haohui Mai
529103c51f HDFS-7897. Shutdown metrics when stopping JournalNode. Contributed by zhouyingchao. 2015-11-22 19:12:32 -08:00
Haohui Mai
8aa12772d4 HDFS-6885. Fix wrong use of BytesWritable in FSEditLogOp#RenameOp. Contributed by Yi Liu. 2015-11-22 17:17:01 -08:00
Haohui Mai
53f6a9e134 HDFS-3302. Review and improve HDFS trash documentation. Contributed by Harsh J. 2015-11-22 16:30:46 -08:00
Haohui Mai
2a4cd27bdc HDFS-7796. Include X-editable for slick contenteditable fields in the web UI. Contributed by Ravi Prakash. 2015-11-22 16:22:14 -08:00
Haohui Mai
469fef2a4f HDFS-9153. Pretty-format the output for DFSIO. Contributed by Kai Zheng. 2015-11-22 16:18:16 -08:00
Haohui Mai
049ccf71ce HDFS-8914. Document HA support in the HDFS HdfsDesign.md. Contributed by Lars Francke. 2015-11-22 16:10:38 -08:00
Haohui Mai
64add87f5c HADOOP-11218. Add TLSv1.1,TLSv1.2 to KMS, HttpFS, SSLFactory. Contributed by Vijay Singh. 2015-11-22 16:00:44 -08:00
Haohui Mai
f504d95e87 HDFS-9402. Switch DataNode.LOG to use slf4j. Contributed by Walter Su. 2015-11-22 15:57:23 -08:00
Haohui Mai
2c185222f9 HDFS-9443. Disabling HDFS client socket cache causes logging message printed to console for CLI commands. Contributed by Chris Nauroth. 2015-11-22 15:06:36 -08:00
Tsz-Wo Nicholas Sze
bf82a8de30 HDFS-9434. Recommission a datanode with 500k blocks may pause NN for 30 seconds for printing info log messags. 2015-11-19 14:54:59 -08:00
Yongjun Zhang
0664782025 HDFS-9439. Include status of closeAck into exception message in DataNode#run. (Xiao Chen via Yongjun Zhang) 
(cherry picked from commit 31dc5c650e3fcfd5b581cbc1132b895d3eadaf49)
 2015-11-19 14:22:44 -08:00
Ming Ma
5a3db21563 HDFS-8056. Decommissioned dead nodes should continue to be counted as dead after NN restart. (mingma) 
(cherry picked from commit 1c4951a7a09433fbbcfe26f243d6c2d8043c71bb)
 2015-11-19 10:04:40 -08:00
Akira Ajisaka
c74e42b4a2 HDFS-9431. DistributedFileSystem#concat fails if the target path is relative. Contributed by Kazuho Fujii. 
(cherry picked from commit ac1aa6c8197268ea83f44747199d560be9e299ae)
 2015-11-19 20:55:36 +09:00
cnauroth
7b94ae17ab HDFS-9400. TestRollingUpgradeRollback fails on branch-2. Contributed by Brahma Reddy Battula. 
(cherry picked from commit bad2afe39a3a589ca9d25de297a080b974645fea)
 2015-11-18 11:00:18 -08:00
Colin Patrick Mccabe
0f9f9ba3cb HDFS-9252. Change TestFileTruncate to use FsDatasetTestUtils to get block file size and genstamp. (Lei (Eddy) Xu via cmccabe) 
(cherry picked from commit dfbde3fc511495ac998f07d674a87355de75fc04)
 2015-11-17 10:54:32 -08:00
Akira Ajisaka
2babf12810 Move HDFS-8615 from 2.8.0 to 2.6.3 in CHANGES.txt. 
(cherry picked from commit b82a6cee4b74230322eb9fbf1b522947463cb343)
 2015-11-17 16:34:04 +09:00
Arpit Agarwal
efcaf9c28f HDFS-9397. Fix typo for readChecksum() LOG.warn in BlockSender.java. (Contributed by Enrique Flores) 2015-11-16 21:02:06 -08:00
Walter Su
bff9d08a43 HDFS-9358. TestNodeCount#testNodeCount timed out. Contributed by Masatake Iwasaki. 
(cherry picked from commit 621cbb4f69072bde259f213629f84494416ae12f)
 2015-11-17 10:53:50 +08:00
Xiaoyu Yao
dceed6b0a8 HDFS-9421. NNThroughputBenchmark replication test NPE with -namenode option. Contributed by Mingliang Liu. 
(cherry picked from commit a4f62a2d58d4e00cda3632411c6abda6eaa12a0e)
 2015-11-16 16:42:57 -08:00
Xiaoyu Yao
5ea3f03ecc HDFS-9387. Fix namenodeUri parameter parsing in NNThroughputBenchmark. Contributed by Mingliang Liu. 
(cherry picked from commit 2701f2d2558f3ade879539f3f7bedf749709f2f1)
 2015-11-16 16:31:06 -08:00
Ming Ma
42b55ff23e HDFS-9413. getContentSummary() on standby should throw StandbyException. (Brahma Reddy Battula via mingma) 
(cherry picked from commit 02653add98f34deedc27f4da2254d25e83e55b58)
 2015-11-16 09:34:03 -08:00
Walter Su
0f5aae5fd8 HDFS-9410. Some tests should always reset sysout and syserr. Contributed by Xiao Chen. 
(cherry picked from commit cccf88480b0df71f15fb36e9693d492c9e16c685)
 2015-11-13 14:29:25 +08:00
Kihwal Lee
8726a5e020 HDFS-9396. Total files and directories on jmx and web UI on standby is uninitialized. Contributed by Kihwal Lee. 
(cherry picked from commit a2a104f3d30182953db6690304146f0a582ed241)
 2015-11-11 15:37:11 -06:00
Xiaoyu Yao
f3a075e053 HDFS-9245. Fix findbugs warnings in hdfs-nfs/WriteCtx. Contributed by Mingliang Liu. 
(cherry picked from commit 6e4562b844dfbbbdc0074323900eb69ee2a3e9c2)
 2015-11-10 16:51:01 -08:00
Xiaoyu Yao
48a494cdc3 HDFS-9234. WebHdfs: getContentSummary() should give quota for storage types. Contributed by Surendra Singh Lilhore. 
(cherry picked from commit 41d3f8899d8b96568f56331eaf598bb356ecdae0)
 2015-11-10 16:48:06 -08:00
Haohui Mai
aaa38581f5 HDFS-9369. Use ctest to run tests for hadoop-hdfs-native-client. Contributed by Haohui Mai. 2015-11-10 14:53:22 -08:00
Zhe Zhang
edd4b2d458 HDFS-9364. Unnecessary DNS resolution attempts when creating NameNodeProxies. Contributed by Xiao Chen. 
Change-Id: I9e42f724f27924cf73891425a832de37ce014a1e
 2015-11-10 09:55:39 -08:00
Walter Su
e5420feb09 HDFS-9401. Fix findbugs warnings in BlockRecoveryWorker. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 2fda45b9dc9c0bf9bb1380134c80836e89d50471)
 2015-11-10 14:54:04 +08:00
Haohui Mai
c91bd3aabb HDFS-2261. AOP unit tests are not getting compiled or run. Contributed by Haohui Mai. 2015-11-09 15:26:01 -08:00
Yongjun Zhang
6bca317157 HDFS-9249. NPE is thrown if an IOException is thrown in NameNode constructor. (Wei-Chiu Chuang via Yongjun Zhang) 
(cherry picked from commit 2741a2109b98d0febb463cb318018ecbd3995102)
 2015-11-09 14:12:20 -08:00
Kihwal Lee
ceb062f093 HDFS-9383. TestByteArrayManager#testByteArrayManager fails. Contributed by Tsz Wo Nicholas Sze. 
(cherry picked from commit ef926b2e3824475581454c1e17a0d7c94529efde)
 2015-11-09 08:57:25 -06:00
cnauroth
385dcc4064 HDFS-9394. branch-2 hadoop-hdfs-client fails during FileSystem ServiceLoader initialization, because HftpFileSystem is missing. Contributed by Mingliang Liu. 
(cherry picked from commit 1ee2db5c41d2e608eb3102d0e13e132448c5ed8f)
 2015-11-07 07:39:45 -08:00
Tsz-Wo Nicholas Sze
9766fc988f HDFS-9398. Make ByteArraryManager log message in one-line format. Contributed by Mingliang Liu 2015-11-07 22:22:36 +08:00
Arpit Agarwal
1e0746e756 HDFS-9379. Make NNThroughputBenchmark support more than 10 datanodes. (Contributed by Mingliang Liu) 2015-11-06 18:59:03 -08:00
Kihwal Lee
481e7248de HDFS-9318. considerLoad factor can be improved. Contributed by Kuhu Shukla. 
(cherry picked from commit bf6aa30a156b3c5cac5469014a5989e0dfdc7256)
 2015-11-06 14:08:10 -06:00
Yongjun Zhang
41d0d9a32c HDFS-9236. Missing sanity check for block size during block recovery. (Tony Wu via Yongjun Zhang) 
(cherry picked from commit b64242c0d2cabd225a8fb7d25fed449d252e4fa1)
 2015-11-06 11:26:41 -08:00
Arpit Agarwal
33908c6f52 HDFS-6481. DatanodeManager#getDatanodeStorageInfos() should check the length of storageIDs. (Contributed by szetszwo) 2015-11-06 10:19:00 -08:00
cnauroth
75bcc8bcd8 HDFS-9384. TestWebHdfsContentLength intermittently hangs and fails due to TCP conversation mismatch between client and server. Contributed by Chris Nauroth. 
(cherry picked from commit 66c096731052fb187dc49f5bcaec8432c4b92d0c)
 2015-11-05 22:07:34 -08:00
Yongjun Zhang
1bb89cbac7 HDFS-9377. Fix findbugs warnings in FSDirSnapshotOp. (Mingliang Liu via Yongjun Zhang) 
(cherry picked from commit 286cc6483fe458894cdd22ff1d8822c304e0d94f)
 2015-11-05 14:54:29 -08:00
Lei Xu
489c920c9a HDFS-9282. Make data directory count and storage raw capacity related tests FsDataset-agnostic. (Tony Wu via lei) 
(cherry picked from commit 5a1a54c9f5d9a8f7585000fe33ef106e62dbb43a)
 2015-11-05 10:46:46 -08:00
Lei Xu
7a2a17cb5f HDFS-9363. Add fetchReplica to FsDatasetTestUtils to return FsDataset-agnostic replica. (Tony Wu via lei) 
(cherry picked from commit 4976a02841592b61f2d2b40d2aadd5146571322c)
 2015-11-05 10:46:46 -08:00
Haohui Mai
aa03030e4a HDFS-9372. Remove dead code in DataStorage.recoverTransitionRead. Contributed by Duo Zhang. 2015-11-05 10:00:18 -08:00
Kihwal Lee
37abd0e33b HDFS-4937. ReplicationMonitor can infinite-loop in BlockPlacementPolicyDefault#chooseRandom(). Contributed by Kihwal Lee. 
(cherry picked from commit ff47f35deed14ba6463cba76f0e6a6c15abb3eca)
 2015-11-05 09:26:53 -06:00
cnauroth
6edd41ac69 HDFS-9378. hadoop-hdfs-client tests do not write logs. Contributed by Chris Nauroth. 
(cherry picked from commit c563401796c58119d1b42dda55d6916bdab56dfe)
 2015-11-05 06:48:32 -08:00
Xiaoyu Yao
891be39993 HDFS-9360. Storage type usage isn't updated properly after file deletion. Contributed by Ming Ma. 
(cherry picked from commit ea5bb483269b51a349c358b71f84904c76693a66)
 2015-11-05 01:40:05 -08:00
Lei Xu
8ed1fd2171 HDFS-9331. Modify TestNameNodeMXBean#testNameNodeMXBeanInfo() to account for filesystem entirely allocated for DFS use. (Tony Wu via lei) 
(cherry picked from commit e2a5441b062fd0758138079d24a2740fc5e5e350)
 2015-11-04 10:28:00 -08:00