Commit Graph

6828 Commits

Author SHA1 Message Date
Weiwei Yang 2a94ce9124 HDFS-12466. Ozone: KSM: Make ozone.ksm.address as mandatory property for client. Contributed by Nandakumar. 2017-09-20 14:55:33 +08:00
Xiaoyu Yao d77c8107fe Merge branch 'trunk' of https://git-wip-us.apache.org/repos/asf/hadoop into HDFS-7240 2017-09-19 21:56:47 -07:00
Weiwei Yang 14e184a283 HDFS-12489. Ozone: OzoneRestClientException swallows exceptions which makes client hard to debug failures. Contributed by Weiwei Yang. 2017-09-20 10:42:58 +08:00
Weiwei Yang 68f7cc6206 HDFS-12329. Ozone: Ratis: Readonly calls in XceiverClientRatis should use sendReadOnly. Contributed by Mukul Kumar Singh. 2017-09-20 10:08:15 +08:00
Andrew Wang 12d9d7bc50 HDFS-12437. Fix test setup in TestLeaseRecoveryStriped. 2017-09-19 16:42:20 -07:00
Andrew Wang 51edaacd09 HDFS-12445. Correct spellings of choosen to chosen. Contributed by hu xiaodong. 2017-09-19 13:48:23 -07:00
Andrew Wang 59830ca772 HDFS-12444. Reduce runtime of TestWriteReadStripedFile. Contributed by Huafeng Wang and Andrew Wang. 2017-09-19 13:44:42 -07:00
Xiaoyu Yao f01017b5be HDFS-12256. Ozone : handle inactive containers on DataNode. Contributed by Chen Liang. 2017-09-19 13:07:17 -07:00
Lei Xu 7bbeacb75e HDFS-12449. TestReconstructStripedFile.testNNSendsErasureCodingTasks randomly cannot finish in 60s. (SammiChen via lei) 2017-09-19 11:50:01 -07:00
Brahma Reddy Battula fda1221c55 HDFS-11799. Introduce a config to allow setting up write pipeline with fewer nodes than replication factor. Contributed by Brahma Reddy Battula 2017-09-19 11:25:45 +05:30
Brahma Reddy Battula 31b58406ac HDFS-12480. TestNameNodeMetrics#testTransactionAndCheckpointMetrics Fails in trunk. Contributed by Hanisha Koneru 2017-09-19 10:37:07 +05:30
Xiaoyu Yao e5e7c454d5 HDFS-12385. Ozone: OzoneClient: Refactoring OzoneClient API. Contributed by Nadakumar. 2017-09-18 15:24:10 -07:00
Anu Engineer 19f7f87517 Merge branch 'trunk' into HDFS-7240
hadoop-common-project/hadoop-common/src/main/resources/core-default.xml
2017-09-18 15:11:06 -07:00
Anu Engineer 44d086733a HDFS-12481. Ozone: Corona: Support for variable key length in offline mode. Contributed by Nandakumar. 2017-09-18 14:43:35 -07:00
Xiaoyu Yao 1caf637897 HDFS-11873. Ozone: Object store handler supports reusing http client for multiple requests. Contributed by Xiaoyu Yao and Weiwei Yang. 2017-09-18 12:07:43 -07:00
Arpit Agarwal a2dcba1853 HDFS-12470. DiskBalancer: Some tests create plan files under system directory. Contributed by Hanisha Koneru. 2017-09-18 09:53:24 -07:00
Kai Zheng 0f9af246e8 HDFS-12460. Make addErasureCodingPolicy an idempotent operation. Contributed by Sammi Chen 2017-09-18 18:07:12 +08:00
Arpit Agarwal 8d7cc22ac2 HDFS-12472. Add JUNIT timeout to TestBlockStatsMXBean. Contributed by Bharat Viswanadham. 2017-09-16 10:09:27 -07:00
Andrew Wang ef8cd5dc56 HDFS-10701. TestDFSStripedOutputStreamWithFailure#testBlockTokenExpired occasionally fails. Contributed by SammiChen. 2017-09-15 16:20:36 -07:00
Erik Krogen 90894c7262 HDFS-12323. NameNode terminates after full GC thinking QJM unresponsive if full GC is much longer than timeout. Contributed by Erik Krogen. 2017-09-15 13:56:27 -07:00
Anu Engineer 8dbd0354c7 HDFS-11612. Ozone: Cleanup Checkstyle issues. Contributed by Shashikant Banerjee. 2017-09-15 13:49:12 -07:00
Lei Xu fbe06b5880 HDFS-12349. Improve log message when it could not alloc enough blocks for EC. (Lei (Eddy) Xu) 2017-09-15 12:12:42 -07:00
Nathan Roberts de197fc156 HDFS-12441. Supress UnresolvedPathException in namenode log. Contributed by Kihwal Lee. 2017-09-15 13:08:41 -05:00
Chen Liang 154530a08d Revert "HDFS-12268. Ozone: Add metrics for pending storage container requests. Contributed by Yiqun Lin." as it uses class not part of JRE.
This reverts commit c29aff44cf.
2017-09-15 10:18:48 -07:00
Weiwei Yang e760287190 HDFS-12465. Ozone: fix a KeySpaceManager startup message typo. Contributed by Nandakumar. 2017-09-16 01:00:58 +08:00
Weiwei Yang d06ec31dd0 HDFS-12468. Ozone: fix hard coded version in the Ozone GettingStarted guide. Contributed by Elek Marton. 2017-09-16 00:46:07 +08:00
Kihwal Lee 78bdf10ae4 HDFS-12424. Datatable sorting on the Datanode Information page in the Namenode UI is broken. Contributed by Shawna Martell. 2017-09-15 09:28:31 -05:00
Arpit Agarwal 50764ef3e4 HDFS-12456. TestNamenodeMetrics.testSyncAndBlockReportMetric fails. Contributed by Bharat Viswanadham. 2017-09-14 22:23:36 -07:00
Kai Zheng 08d996d3e9 HDFS-12395. Support erasure coding policy operations in namenode edit log. Contributed by Sammi Chen 2017-09-15 09:43:39 +08:00
Kai Zheng ae8f55b932 HDFS-7859. Erasure Coding: Persist erasure coding policies in NameNode. Contributed by Sammi Chen 2017-09-15 09:08:18 +08:00
Lei Xu 61cee3a0b9 HDFS-12378. TestClientProtocolForPipelineRecovery#testZeroByteBlockRecovery fails on trunk. (Lei (Eddy) Xu) 2017-09-14 17:03:25 -07:00
Andrew Wang 390c2b5df0 Revert "HDFS-11156. Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API. Contributed by Weiwei Yang."
This reverts commit 7fcc73fc0d.

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/WebHDFS.md
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHDFS.java
2017-09-14 15:12:26 -07:00
Xiaoyu Yao 31bbae96c5 HDFS-12426. Ozone: BlockManager MBean unregister failure upon shutdown. Contributed by Lokesh Jain. 2017-09-14 14:54:16 -07:00
John Zhuge 7ee02d1065 HADOOP-14864. FSDataInputStream#unbuffer UOE should include stream class name. Contributed by Bharat Viswanadham. 2017-09-14 11:26:49 -07:00
Arpit Agarwal 65a941008d Revert "HDFS-10391. Always enable NameNode service RPC port. Contributed by Gergely Novak."
This reverts commit aa4b6fbe75.
2017-09-14 11:17:08 -07:00
Kai Zheng e12f3e85bd HDFS-12438. Rename dfs.datanode.ec.reconstruction.stripedblock.threads.size to dfs.datanode.ec.reconstruction.threads. Contributed by Andrew Wang 2017-09-14 15:39:10 +08:00
ChenSammi e0b3c644e1 HDFS-12414. Ensure to use CLI command to enable/disable erasure coding policy. Contributed by Sammi Chen 2017-09-14 09:15:29 +08:00
Lei Xu 73aed34dff HDFS-12409. Add metrics of execution time of different stages in EC recovery task. (Lei (Eddy) Xu) 2017-09-13 17:14:13 -07:00
Chen Liang c29aff44cf HDFS-12268. Ozone: Add metrics for pending storage container requests. Contributed by Yiqun Lin. 2017-09-13 13:00:26 -07:00
Arpit Agarwal f153e60576 HADOOP-14867. Update HDFS Federation setup document, for incorrect property name for secondary name node http address. Contributed by Bharat Viswanadham. 2017-09-13 12:54:02 -07:00
Weiwei Yang 1aa7d3f5b2 HDFS-12019. Ozone: Misc : Make sure that ozone-site.xml is in etc/hadoop in tarball created from mvn package. Contributed by Mukul Kumar Singh. 2017-09-13 16:46:53 +08:00
Xiao Chen fa6cc43edd Revert "HADOOP-14521. KMS client needs retry logic. Contributed by Rushabh S Shah."
This reverts commit 0a6d5c0cf1.
2017-09-12 19:53:07 -07:00
Weiwei Yang 9a3159cb6a HDFS-12423. Ozone: TopN container choosing policy should ignore containers that has no pending deletion blocks. Contributed by Yiqun Lin. 2017-09-13 10:50:57 +08:00
Lei Xu 123342cd07 HDFS-12412. Change ErasureCodingWorker.stripedReadPool to cached thread pool. (Lei (Eddy) Xu) 2017-09-12 18:12:07 -07:00
Andrew Wang f4b6267465 HDFS-12222. Document and test BlockLocation for erasure-coded files. Contributed by Huafeng Wang. 2017-09-12 17:35:30 -07:00
Arpit Agarwal 68282c8eac HDFS-12407. Journal node fails to shutdown cleanly if JournalNodeHttpServer or JournalNodeRpcServer fails to start. Contributed by Ajay Kumar. 2017-09-12 16:18:41 -07:00
Andrew Wang 80ee89b287 HDFS-12417. Disable flaky TestDFSStripedOutputStreamWithFailure. 2017-09-12 11:20:56 -07:00
Weiwei Yang 830474fe38 HDFS-11676. Ozone: SCM CLI: Implement close container command. Contributed by Chen Liang. 2017-09-12 11:12:08 +08:00
Weiwei Yang d05d0788c2 HDFS-12389. Ozone: oz commandline list calls should return valid JSON format output. Contributed by Weiwei Yang. 2017-09-12 11:05:51 +08:00
Chen Liang 738c2a9682 HDFS-12406. dfsadmin command prints "Exception encountered" even if there is no exception, when debug is enabled. Contributed by Nandakumar. 2017-09-11 14:48:07 -07:00