Commit Graph

8053 Commits

Author SHA1 Message Date
Anu Engineer 2804435386 HDFS-12017. Ozone: Container: Move IPC port to 98xx range. Contributed by Nandakumar. 2018-04-26 05:36:04 -07:00
Xiaoyu Yao b2447f8dd9 HDFS-11614. Ozone: Cleanup javadoc issues. Contributed by Mukul Kumar Singh. 2018-04-26 05:36:04 -07:00
Chen Liang 9ff136bb02 HDFS-12210. Block Storage: volume creation times out while creating 3TB volume because of too many containers. Contributed by Mukul Kumar Singh. 2018-04-26 05:36:04 -07:00
Chen Liang dddded0016 Revert "Block Storage: volume creation times out while creating 3TB volume because of too many containers. Contributed by Mukul Kumar Singh." to fix commit message.
This reverts commit 087c69ba24.
2018-04-26 05:36:04 -07:00
Weiwei Yang d303b7f40f HDFS-12524. Ozone: Record number of keys scanned and hinted for getRangeKVs call. Contributed by Weiwei Yang. 2018-04-26 05:36:04 -07:00
Yiqun Lin 712bd70ac7 HDFS-12205. Ozone: List Key on an empty ozone bucket fails with command failed error. Contributed by Lokesh Jain. 2018-04-26 05:36:04 -07:00
Chen Liang 8052374e79 Block Storage: volume creation times out while creating 3TB volume because of too many containers. Contributed by Mukul Kumar Singh. 2018-04-26 05:36:04 -07:00
Weiwei Yang fd1564b87e HDFS-12506. Ozone: ListBucket is too slow. Contributed by Weiwei Yang. 2018-04-26 05:36:04 -07:00
Tsz-Wo Nicholas Sze bf6f0cd831 HDFS-11563. Ozone: enforce DependencyConvergence uniqueVersions. 2018-04-26 05:36:04 -07:00
Weiwei Yang 46b65ec4fb HDFS-12503. Ozone: some UX improvements to oz_debug. Contributed by Weiwei Yang. 2018-04-26 05:36:04 -07:00
Weiwei Yang 1c354e51ac HDFS-12477. Ozone: Some minor text improvement in SCM web UI. Contributed by Elek Marton. 2018-04-26 05:36:04 -07:00
Nandakumar 0313bdf886 HDFS-11897. Ozone: KSM: Changing log level for client calls in KSM. Contributed by Shashikant Banerjee. 2018-04-26 05:36:04 -07:00
Anu Engineer 27ec22e20d HDFS-12517. Ozone: mvn package is failing with out skipshade. Contributed by Bharat Viswanadham. 2018-04-26 05:36:04 -07:00
Weiwei Yang 3b290fe3bf HDFS-12466. Ozone: KSM: Make ozone.ksm.address as mandatory property for client. Contributed by Nandakumar. 2018-04-26 05:36:04 -07:00
Weiwei Yang 8ddf75da17 HDFS-12489. Ozone: OzoneRestClientException swallows exceptions which makes client hard to debug failures. Contributed by Weiwei Yang. 2018-04-26 05:36:04 -07:00
Weiwei Yang c329d3b4b4 HDFS-12329. Ozone: Ratis: Readonly calls in XceiverClientRatis should use sendReadOnly. Contributed by Mukul Kumar Singh. 2018-04-26 05:36:04 -07:00
Xiaoyu Yao 607d1fcd31 HDFS-12256. Ozone : handle inactive containers on DataNode. Contributed by Chen Liang. 2018-04-26 05:36:04 -07:00
Xiaoyu Yao 77d4b18700 HDFS-12385. Ozone: OzoneClient: Refactoring OzoneClient API. Contributed by Nadakumar. 2018-04-26 05:36:04 -07:00
Anu Engineer b984e903f3 HDFS-12481. Ozone: Corona: Support for variable key length in offline mode. Contributed by Nandakumar. 2018-04-26 05:36:04 -07:00
Xiaoyu Yao d9c3d9a5ef HDFS-11873. Ozone: Object store handler supports reusing http client for multiple requests. Contributed by Xiaoyu Yao and Weiwei Yang. 2018-04-26 05:36:04 -07:00
Anu Engineer fe4139bdc3 HDFS-11612. Ozone: Cleanup Checkstyle issues. Contributed by Shashikant Banerjee. 2018-04-26 05:36:04 -07:00
Chen Liang b127ecd1ba Revert "HDFS-12268. Ozone: Add metrics for pending storage container requests. Contributed by Yiqun Lin." as it uses class not part of JRE.
This reverts commit c29aff44cf.
2018-04-26 05:36:04 -07:00
Weiwei Yang eaf3732217 HDFS-12465. Ozone: fix a KeySpaceManager startup message typo. Contributed by Nandakumar. 2018-04-26 05:36:04 -07:00
Weiwei Yang c551025ed6 HDFS-12468. Ozone: fix hard coded version in the Ozone GettingStarted guide. Contributed by Elek Marton. 2018-04-26 05:36:04 -07:00
Xiaoyu Yao cf841286b8 HDFS-12426. Ozone: BlockManager MBean unregister failure upon shutdown. Contributed by Lokesh Jain. 2018-04-26 05:36:04 -07:00
Chen Liang f66a522695 HDFS-12268. Ozone: Add metrics for pending storage container requests. Contributed by Yiqun Lin. 2018-04-26 05:36:04 -07:00
Weiwei Yang efa25373d7 HDFS-12019. Ozone: Misc : Make sure that ozone-site.xml is in etc/hadoop in tarball created from mvn package. Contributed by Mukul Kumar Singh. 2018-04-26 05:36:04 -07:00
Weiwei Yang 80c50a1eac HDFS-12423. Ozone: TopN container choosing policy should ignore containers that has no pending deletion blocks. Contributed by Yiqun Lin. 2018-04-26 05:36:04 -07:00
Weiwei Yang 1087ce4cd2 HDFS-11676. Ozone: SCM CLI: Implement close container command. Contributed by Chen Liang. 2018-04-26 05:36:04 -07:00
Weiwei Yang 0c17776646 HDFS-12389. Ozone: oz commandline list calls should return valid JSON format output. Contributed by Weiwei Yang. 2018-04-26 05:36:04 -07:00
Weiwei Yang fec04f1158 HDFS-12370. Ozone: Implement TopN container choosing policy for BlockDeletionService. Contributed by Yiqun Lin. 2018-04-26 05:36:04 -07:00
Weiwei Yang 743be0d7c0 HDFS-12235. Ozone: DeleteKey-3: KSM SCM block deletion message and ACK interactions. Contributed by Weiwei Yang and Yuanbo Liu. 2018-04-26 05:36:04 -07:00
Weiwei Yang 3aa846412d HDFS-12397. Ozone: KSM: multiple delete methods in KSMMetadataManager. Contributed by Nandakumar. 2018-04-26 05:36:04 -07:00
Chen Liang e06a9a5bb1 HDFS-12391. Ozone: TestKSMSQLCli is not working as expected. Contributed by Weiwei Yang. 2018-04-26 05:36:04 -07:00
Anu Engineer 1a21136322 HDFS-12382. Ozone: SCM: BlockManager creates a new container for each allocateBlock call. Contributed by Nandakumar. 2018-04-26 05:36:04 -07:00
Anu Engineer 91a8f134b7 HDFS-11834. Ozone: Fix TestArchive#testArchive. Contributed by Xiaoyu Yao. 2018-04-26 05:36:04 -07:00
Anu Engineer 2e2e30373c HDFS-12333. Ozone: Extend Datanode web interface with SCM information. Contributed by Elek, Marton. 2018-04-26 05:36:04 -07:00
Anu Engineer ca72c2342c HDFS-12366. Ozone: Refactor KSM metadata class names to avoid confusion. Contributed by Weiwei Yang. 2018-04-26 05:36:04 -07:00
Weiwei Yang 7b3e7eb565 HDFS-12354. Ozone: Shuffle container list for datanode BlockDeletingService. Contributed by Yiqun Lin. 2018-04-26 05:36:04 -07:00
Chen Liang 8654698d74 HDFS-12365. Ozone: ListVolume displays incorrect createdOn time when the volume was created by OzoneRpcClient. Contributed by Weiwei Yang. 2018-04-26 05:36:04 -07:00
Weiwei Yang eef437d5e2 HDFS-12282. Ozone: DeleteKey-4: Block delete via HB between SCM and DN. Contributed by Weiwei Yang. 2018-04-26 05:36:04 -07:00
Anu Engineer 2f4dfbc8fb HDFS-12275. Ozone: Corona: Support for random validation of writes. Contributed by Nandakumar. 2018-04-26 05:36:04 -07:00
Anu Engineer 2dfd0a2f4f HDFS-12341. Ozone: maven dist compilation fails with "Duplicate classes found" error. Contributed by Mukul Kumar Singh. 2018-04-26 05:36:04 -07:00
Anu Engineer 532ced18fc HDFS-12280. Ozone: TestOzoneContainer#testCreateOzoneContainer fails. Contributed by Lokesh Jain. 2018-04-26 05:36:04 -07:00
Weiwei Yang 4d3b8d332d HDFS-12283. Ozone: DeleteKey-5: Implement SCM DeletedBlockLog. Contributed by Yuanbo Liu. 2018-04-26 05:36:04 -07:00
Xiaoyu Yao f51189e2bb HDFS-12324. Ozone: TestQueryNode#testStaleNodesCount is failing. Contributed by Xiaoyu Yao. 2018-04-26 05:36:04 -07:00
Xiaoyu Yao 02f8c2224f HDFS-11888. Ozone: SCM: use state machine for open containers allocated for key/blocks. Contributed by Xiaoyu Yao. 2018-04-26 05:36:04 -07:00
Anu Engineer f352b104f7 HDFS-12337. Ozone: Concurrent RocksDB open calls fail because of "No locks available". Contributed by Mukul Kumar Singh. 2018-04-26 05:36:04 -07:00
Weiwei Yang 9e733215a8 HDFS-12327. Ozone: support setting timeout in background service. Contributed by Yiqun Lin. 2018-04-26 05:36:04 -07:00
Anu Engineer 38bc1d1097 HDFS-12216. Ozone: TestKeys is failing consistently. Contributed by Mukul Kumar Singh. 2018-04-26 05:36:04 -07:00
Anu Engineer bd33038bf4 HDFS-12159. Ozone: SCM: Add create replication pipeline RPC. Contributed by Anu Engineer. 2018-04-26 05:36:04 -07:00
Xiaoyu Yao 795ba1b3b7 HDFS-12313. Ozone: SCM: move container/pipeline StateMachine to the right package. Contributed by Xiaoyu Yao. 2018-04-26 05:36:04 -07:00
Anu Engineer 3a661b7f82 HDFS-12238. Ozone: Add valid trace ID check in sendCommandAsync. Contributed by Ajay Kumar. 2018-04-26 05:36:04 -07:00
Chen Liang f9bce29dcc HDFS-12290. Block Storage: Change dfs.cblock.jscsi.server.address default bind address to 0.0.0.0. Contributed by Mukul Kumar Singh. 2018-04-26 05:36:04 -07:00
Chen Liang 6a16d7c7ab HDFS-12255. Block Storage: Cblock should generated unique trace ID for the ops. Contributed by Mukul Kumar Singh. 2018-04-26 05:36:04 -07:00
Weiwei Yang e61530f5d9 HDFS-12298. Ozone: Block deletion service floods the log when deleting large number of block files. Contributed by Yiqun Lin. 2018-04-26 05:36:04 -07:00
Weiwei Yang 25586607a1 HDFS-12230. Ozone: KSM: Add creation time field in bucket info. Contributed by Yiqun Lin. 2018-04-26 05:36:04 -07:00
Anu Engineer dcc21a4f93 HDFS-12005. Ozone: Web interface for SCM. Contributed by Elek, Marton. 2018-04-26 05:36:04 -07:00
Anu Engineer c9ea431267 HDFS-12281. Ozone: Ozone-default.xml has 3 properties that do not match the default Config value. Contributed by Ajay Yadav. 2018-04-26 05:36:04 -07:00
Weiwei Yang 639b4fb8a9 HDFS-12196. Ozone: DeleteKey-2: Implement block deleting service to delete stale blocks at background. Contributed by Weiwei Yang. 2018-04-26 05:36:04 -07:00
Weiwei Yang 285d61cd8d HDFS-12274. Ozone: Corona: move corona from test to tools package. Contributed by Nandakumar. 2018-04-26 05:36:04 -07:00
Xiaoyu Yao bb9a4793d3 HDFS-12259. Ozone: OzoneClient: Refactor move ozone client from hadoop-hdfs to hadoop-hdfs-client. Contributed by Nandakumar. 2018-04-26 05:36:04 -07:00
Xiaoyu Yao 7290324fc8 HDFS-12267. Ozone: XceiverClientManager should not close the connection if client holds the reference. Contributed by Nandakumar. 2018-04-26 05:36:04 -07:00
Xiaoyu Yao b4aecc1009 HDFS-12262. Ozone: KSM: Reduce default handler thread count from 200. Contributed by Ajay Yadav. 2018-04-26 05:36:04 -07:00
Anu Engineer bb5f1c4228 HDFS-12231. Ozone: KSM: Add creation time field in volume info. Contributed by Yiqun Lin. 2018-04-26 05:36:04 -07:00
Xiaoyu Yao 6f83e9c51e HDFS-12163. Ozone: Reduce MiniOzoneCluster handler thread count. Contributed by Weiwei Yang. 2018-04-26 05:36:04 -07:00
Xiaoyu Yao 89d8d20c73 HDFS-12246. Ozone: potential thread leaks. Contributed by Weiwei Yang. 2018-04-26 05:36:04 -07:00
Anu Engineer 23dee0f123 HDFS-11935. Ozone: TestStorageContainerManager#testRpcPermission fails when ipv6 address used. Contributed by Yiqun Lin. 2018-04-26 05:36:04 -07:00
Anu Engineer ccc1607424 HDFS-12178. Ozone: OzoneClient: Handling SCM container creationFlag at client side. Contributed by Nandakumar. 2018-04-26 05:36:04 -07:00
Xiaoyu Yao 37a0ab5ca3 HDFS-12247. Ozone: KeySpaceManager should unregister KSMMetrics upon stop. Contributed by Yiqun Lin. 2018-04-26 05:36:04 -07:00
Anu Engineer 9cf40547ce HDFS-11580. Ozone: Support asynchronus client API for SCM and containers. Contributed by Anu Engineer. 2018-04-26 05:36:04 -07:00
Weiwei Yang 1ad95cf2a9 HDFS-11984. Ozone: Ensures listKey lists all required key fields. Contributed by Yiqun Lin. 2018-04-26 05:36:04 -07:00
Anu Engineer acfae2716a HDFS-12034. Ozone: Web interface for KSM. Contributed by Elek, Marton. 2018-04-26 05:36:04 -07:00
Chen Liang 070f7e2e59 HDFS-11920. Ozone : add key partition. Contributed by Chen Liang. 2018-04-26 05:36:04 -07:00
Anu Engineer bc413a69cc HDFS-12195. Ozone: DeleteKey-1: KSM replies delete key request asynchronously. Contributed by Yuanbo Liu. 2018-04-26 05:36:04 -07:00
Anu Engineer 86b42907cf HDFS-12183. Ozone: KSM : Use proper defaults for block client address. Contributed by Lokesh Jain. 2018-04-26 05:36:04 -07:00
Chen Liang 7907fe1c80 HDFS-12059. Ozone: OzoneClient: OzoneClientImpl Add setBucketProperty and delete calls. Contributed by Nandakumar. 2018-04-26 05:36:04 -07:00
Anu Engineer fcd4537e63 HDFS-12180. Ozone: Corona: Add stats and progress bar to corona. Contributed by Nandakumar. 2018-04-26 05:36:04 -07:00
Weiwei Yang a4b3160efb HDFS-12145. Ozone: OzoneFileSystem: Ozone & KSM should support / delimited key names. Contributed by Mukul Kumar Singh.
(cherry picked from commit fe0a957e92d506330ba005abba18f665eb5ac1cc)
2018-04-26 05:36:04 -07:00
Yiqun Lin 8cf0c864c4 HDFS-12170. Ozone: OzoneFileSystem: KSM should maintain key creation time and modification time. Contributed by Mukul Kumar Singh. 2018-04-26 05:36:04 -07:00
Weiwei Yang 349a87ac9c HDFS-12192. Ozone: Fix the remaining failure tests for Windows caused by incorrect path generated. Contributed by Yiqun Lin. 2018-04-26 05:36:04 -07:00
Weiwei Yang d50a743015 HDFS-12155. Ozone : add RocksDB support to DEBUG CLI. Contributed by Chen Liang. 2018-04-26 05:36:04 -07:00
Anu Engineer 0cc166c053 HDFS-12115. Ozone: SCM: Add queryNode RPC Call. Contributed by Anu Engineer. 2018-04-26 05:36:04 -07:00
Weiwei Yang 539842ed8b HDFS-12187. Ozone : add support to DEBUG CLI for ksm.db. Contributed by Chen Liang. 2018-04-26 05:36:04 -07:00
Weiwei Yang b00830142b HDFS-12167. Ozone: Intermittent failure TestContainerPersistence#testListKey. Contributed by Surendra Singh Lilhore. 2018-04-26 05:36:04 -07:00
Anu Engineer 487aa2f7bf HDFS-12185. Ozone: Fix Leaking in TestXceiverClientManager. Contributed by Xiaoyu Yao. 2018-04-26 05:36:04 -07:00
Anu Engineer d02a4e9dd1 HDFS-12175. Ozone: Fix Leaking in TestStorageContainerManager#testRpcPermission. Contributed by Xiaoyu Yao. 2018-04-26 05:36:04 -07:00
Chen Liang d05b44f417 Revert "HDFS-12185. Ozone: Fix Leaking in TestXceiverClientManager. Contributed by Xiaoyu Yao"
This reverts commit f801454ad3.
2018-04-26 05:36:04 -07:00
Xiaoyu Yao eda559ffd2 HDFS-12181. Ozone: Fix TestContainerReplicationManager by setting proper log level for LogCapturer. Contributed by Mukul Kumar Singh. 2018-04-26 05:36:04 -07:00
Chen Liang ca096501bf HDFS-12185. Ozone: Fix Leaking in TestXceiverClientManager. Contributed by Xiaoyu Yao 2018-04-26 05:36:04 -07:00
Weiwei Yang f1e2592bf8 HDFS-12127. Ozone: Ozone shell: Add more testing for key shell commands. Contributed by Yiqun Lin. 2018-04-26 05:36:04 -07:00
Weiwei Yang a652a72286 HDFS-11936. Ozone: TestNodeManager times out before it is able to find all nodes. Contributed by Yuanbo Liu. 2018-04-26 05:36:04 -07:00
Anu Engineer bbbfc885e7 HDFS-12149. Ozone: RocksDB implementation of ozone metadata store. Contributed by Weiwei Yang. 2018-04-26 05:36:04 -07:00
Anu Engineer 6225622dee HDFS-12071. Ozone: Corona: Implementation of Corona. Contributed by Nandakumar. 2018-04-26 05:36:04 -07:00
Weiwei Yang d2ef3e40bc HDFS-12126. Ozone: Ozone shell: Add more testing for bucket shell commands. Contributed by Yiqun Lin. 2018-04-26 05:36:04 -07:00
Weiwei Yang 5604c3788f HDFS-11996. Ozone : add an UT to test partial read of chunks. Contributed by Chen Liang. 2018-04-26 05:36:04 -07:00
Anu Engineer 4d333f8db1 HDFS-12058. Ozone: OzoneClient: OzoneClientImpl add getDetails calls. Contributed by Nandakumar. 2018-04-26 05:36:04 -07:00
Chen Liang 27262d8889 HDFS-12118. Ozone: Ozone shell: Add more testing for volume shell commands. Contributed by Yiqun Lin. 2018-04-26 05:36:04 -07:00
Weiwei Yang db859e8172 HDFS-12148. Ozone: TestOzoneConfigurationFields is failing because ozone-default.xml has some missing properties. Contributed by Weiwei Yang. 2018-04-26 05:36:04 -07:00
Weiwei Yang 9522356b46 HDFS-12069. Ozone: Create a general abstraction for metadata store. Contributed by Weiwei Yang. 2018-04-26 05:36:04 -07:00
Anu Engineer b94b5021b8 HDFS-11989. Ozone: add TestKeysRatis, TestBucketsRatis and TestVolumeRatis. Contributed by Tsz Wo Nicholas Sze. 2018-04-26 05:36:04 -07:00
Anu Engineer ab3d510c1d HDFS-12123. Ozone: OzoneClient: Abstraction of OzoneClient and default implementation. Contributed by Nandakumar. 2018-04-26 05:36:04 -07:00
Anu Engineer 3d430a6076 HDFS-11493. Ozone: SCM: Add the ability to handle container reports. Contributed by Anu Engineer. 2018-04-26 05:36:04 -07:00
Yiqun Lin 58e850f262 HDFS-12083. Ozone: KSM: previous key has to be excluded from result in listVolumes, listBuckets and listKeys. Contributed by Nandakumar. 2018-04-26 05:36:04 -07:00
Weiwei Yang a4cbd33dd5 HDFS-12129. Ozone: SCM http server is not stopped with SCM#stop(). Contributed by Weiwei Yang. 2018-04-26 05:36:04 -07:00
Weiwei Yang ea5e24c925 HDFS-12105. Ozone: listVolumes doesn't work from ozone commandline. Contributed by Yiqun Lin. 2018-04-26 05:36:04 -07:00
Weiwei Yang 7afddca9d5 HDFS-12037. Ozone: Improvement rest API output format for better looking. Contributed by Weiwei Yang. 2018-04-26 05:36:04 -07:00
Weiwei Yang 25c1b296e6 HDFS-11679. Ozone: SCM CLI: Implement list container command. Contributed by Yuanbo Liu. 2018-04-26 05:36:04 -07:00
Weiwei Yang eb18b86e00 HDFS-12080. Ozone: Fix UT failure in TestOzoneConfigurationFields. Contributed by Mukul Kumar Singh. 2018-04-26 05:36:04 -07:00
Anu Engineer eab407beac HDFS-12057. Ozone: OzoneClient: Implementation of OzoneClient. Contributed by Nandakumar 2018-04-26 05:36:04 -07:00
Anu Engineer a353094ba4 HDFS-12076. Ozone: Review all cases where we are returning FAILED_INTERNAL_ERROR. Contributed by Chen Liang. 2018-04-26 05:36:04 -07:00
Anu Engineer 8caa5d1ac0 HDFS-12086. Ozone: Add the unit test for KSMMetrics. Contributed by Yiqun Lin. 2018-04-26 05:36:04 -07:00
Anu Engineer 5fe9143a0e HDFS-12081. Ozone: Add infoKey REST API document. Contributed by Weiwei Yang. 2018-04-26 05:36:04 -07:00
Anu Engineer 4c27dba08a HDFS-12053. Ozone: ozone server should create missing metadata directory if it has permission to. Contributed by Weiwei Yang. 2018-04-26 05:36:04 -07:00
Weiwei Yang 63ce883746 HDFS-12035. Ozone: listKey doesn't work from ozone commandline. Contributed by Yiqun Lin. 2018-04-26 05:36:04 -07:00
Weiwei Yang e07662cb04 HDFS-12048. Ozone:TestOzoneContainerRatis & TestRatisManager are failing consistently. Contributed by Mukul Kumar Singh. 2018-04-26 05:36:04 -07:00
Weiwei Yang d1ac8611c6 HDFS-12023. Ozone: Test if all the configuration keys are documented in ozone-defaults.xml. Contributed by Elek, Marton. 2018-04-26 05:36:04 -07:00
Weiwei Yang c398ab49d3 HDFS-12047. Ozone: Add REST API documentation. Contributed by Weiwei Yang. 2018-04-26 05:36:04 -07:00
Weiwei Yang 5379ffa8de HDFS-12030. Ozone: CLI: support infoKey command. Contributed by Yiqun Lin. 2018-04-26 05:36:04 -07:00
Weiwei Yang 4b63e3e504 HDFS-12002. Ozone : SCM cli misc fixes/improvements. Contributed by Chen Liang. 2018-04-26 05:36:04 -07:00
Anu Engineer c567e6766b HDFS-11955. Ozone: Set proper parameter default values for listBuckets http request. Contributed by Weiwei Yang. 2018-04-26 05:36:04 -07:00
Anu Engineer b7b8511bae HDFS-11773. Ozone: KSM : add listVolumes. Contributed by Weiwei Yang. 2018-04-26 05:36:04 -07:00
Chen Liang b49c165d28 HDFS-12063. Ozone: Ozone shell: Multiple RPC calls for put/get key. Contributed by Yiqun Lin. 2018-04-26 05:36:04 -07:00
Chen Liang 0a8c903d3f HDFS-12050. Ozone: StorageHandler: Implementation of close for releasing resources during shutdown. Contributed by Nandakumar. 2018-04-26 05:36:04 -07:00
Weiwei Yang 8ef1163eca HDFS-12031. Ozone: Rename OzoneClient to OzoneRestClient. Contributed by Nandakumar. 2018-04-26 05:36:04 -07:00
Weiwei Yang 7e834c839d HDFS-12018. Ozone: Misc: Add CBlocks defaults to ozone-defaults.xml. Contributed by Chen Liang. 2018-04-26 05:36:04 -07:00
Anu Engineer fea1ab6192 HDFS-12007. Ozone: Enable HttpServer2 for SCM and KSM. Contributed by Elek, Marton. 2018-04-26 05:36:04 -07:00
Xiaoyu Yao 723da57644 HDFS-12016. Ozone: SCM: Container metadata are not loaded properly after datanode restart. Contributed by Xiaoyu Yao. 2018-04-26 05:36:04 -07:00
Anu Engineer 77a4b248e4 HDFS-11990. Ozone: Add all configurable entries into ozone-default.xml. Contributed by Yiqun Lin. 2018-04-26 05:36:04 -07:00
Anu Engineer 77e3bb783b HDFS-11970. Ozone: TestXceiverClientManager.testFreeByEviction fails occasionally. Contributed by Mukul Kumar Singh. 2018-04-26 05:36:04 -07:00
Yiqun Lin 52aa60ed2f HDFS-11963. Ozone: Documentation: Add getting started page (addendum). Contributed by Yiqun Lin. 2018-04-26 05:36:04 -07:00
Yiqun Lin 3d2339de38 HDFS-11983. Ozone: Add documentation for metrics in KSMMetrics to OzoneMetrics.md. Contributed by Yiqun Lin. 2018-04-26 05:36:04 -07:00
Anu Engineer 3b0996e2a1 HDFS-11585. Ozone: Support force update a container. Contributed by Yuanbo Liu. 2018-04-26 05:36:04 -07:00
Anu Engineer 8d289df627 HDFS-11963. Ozone: Documentation: Add getting started page. Contributed by Anu Engineer. 2018-04-26 05:36:04 -07:00
Xiaoyu Yao e73d285567 HDFS-11782. Ozone: KSM: Add listKey. Contributed by Yiqun Lin. 2018-04-26 05:36:04 -07:00
Anu Engineer 721e7a6418 HDFS-11979. Ozone: TestContainerPersistence never uses MiniOzoneCluster. Contributed by Tsz Wo Nicholas Sze. 2018-04-26 05:36:04 -07:00
Anu Engineer 03606dd1a8 HDFS-11962. Ozone: Add stop-ozone.sh script. Contributed by Weiwei Yang. 2018-04-26 05:36:04 -07:00
Anu Engineer fc48e18151 HDFS-11961. Ozone: Add start-ozone.sh to quickly start ozone. Contributed by Weiwei Yang. 2018-04-26 05:36:04 -07:00
Xiaoyu Yao 18ddec6144 HDFS-11977. Ozone: cannot enable test debug/trace log. Contributed by Tsz Wo Nicholas Sze. 2018-04-26 05:36:04 -07:00
Anu Engineer 8916c70d90 HDFS-11969. Block Storage: Convert unnecessary info log levels to debug. Contributed by Mukul Kumar Singh. 2018-04-26 05:36:04 -07:00
Tsz-Wo Nicholas Sze 15cc4007b0 HDFS-11946. Ozone: Containers in different datanodes are mapped to the same location. Contributed by Nandakumar 2018-04-26 05:36:04 -07:00
Anu Engineer 938728744c HDFS-11845. Ozone: Output error when DN handshakes with SCM. Contributed by Weiwei Yang 2018-04-26 05:36:04 -07:00
Anu Engineer 863e4cfb56 HDFS-11958. Ozone: Ensure KSM is initiated using ProtobufRpcEngine. Contributed by Weiwei Yang. 2018-04-26 05:36:04 -07:00
Anu Engineer fa26dea89d HDFS-11185. Ozone: remove disabled tests. Contributed by Anu Engineer. 2018-04-26 05:36:04 -07:00
Xiaoyu Yao e3591aeec0 HDFS-11953. Remove Guava v21 usage from HDFS-7240. Contributed by Xiaoyu Yao. 2018-04-26 05:36:04 -07:00
Lei Xu 08460f1559 HDFS-11659. TestDataNodeHotSwapVolumes.testRemoveVolumeBeingWritten fail due to no DataNode available for pipeline recovery. Contributed by Lei (Eddy) Xu. 2018-04-26 05:36:04 -07:00
Rakesh Radhakrishnan 665f7c8b69 HDFS-11794. Add ec sub command -listCodec to show currently supported ec codecs. Contributed by SammiChen. 2018-04-26 05:36:04 -07:00
Arpit Agarwal d18909d338 HDFS-11866. JournalNode Sync should be off by default in hdfs-default.xml. Contributed by Hanisha Koneru. 2018-04-26 05:36:04 -07:00
Xiaoyu Yao ddc88eaf88 HDFS-11952. Ozone: Fix TestContainerSQLCli#testConvertContainerDB. Contributed by Weiwei Yang. 2018-04-26 05:36:04 -07:00
Weiwei Yang 0c37e05b10 HDFS-11779. Ozone: KSM: add listBuckets. Contributed by Weiwei Yang. 2018-04-26 05:36:04 -07:00
Xiaoyu Yao bacd1188f1 HDFS-11880. Ozone: KSM: Remove protobuf formats from KSM wrappers. Contributed by Nandakumar Vadivelu. 2018-04-26 05:36:04 -07:00
Xiaoyu Yao 2007e85d5b HDFS-11777. Ozone: KSM: add deleteBucket. Contributed by Nandakumar Vadivelu. 2018-04-26 05:36:04 -07:00
Anu Engineer 3c0ed97df9 HDFS-11926. Ozone: Implement a common helper to return a range of KVs in levelDB. Contributed by Weiwei Yang. 2018-04-26 05:36:04 -07:00
Anu Engineer f617b2dddb HDFS-11568. Ozone: Create metadata path automatically after null checking. Contributed by Mukul Kumar Singh. 2018-04-26 05:36:04 -07:00
Weiwei Yang d6dd557b24 HDFS-11887. Shared XceiverClient should be closed if there is no open clients to avoid resource leak. Contributed by Mukul Kumar Singh. 2018-04-26 05:36:04 -07:00
Anu Engineer f5d17b8f7c HDFS-11919. Ozone: SCM: TestNodeManager takes too long to execute. Contributed by Yiqun Lin. 2018-04-26 05:36:04 -07:00
Chen Liang d67542c115 HDFS-11822. Block Storage: Fix TestCBlockCLI, failing because of " Address already in use". Contributed by Mukul Kumar Singh. 2018-04-26 05:36:04 -07:00
Weiwei Yang bf8c168a80 HDFS-11781. Ozone: KSM: Add deleteKey. Contributed by Yuanbo Liu. 2018-04-26 05:36:04 -07:00
Anu Engineer 42eaecae55 HDFS-11771. Ozone: KSM: Add checkVolumeAccess. Contributed by Mukul Kumar Singh. 2018-04-26 05:36:04 -07:00
Anu Engineer 1b2d0b4fec HDFS-11796. Ozone: MiniOzoneCluster should set "ozone.handler.type" key correctly. Contributed by Mukul Kumar Singh. 2018-04-26 05:36:04 -07:00
Anu Engineer aa5722dc44 HDFS-11913. Ozone: TestKeySpaceManager#testDeleteVolume fails. Contributed by Weiwei Yang. 2018-04-26 05:36:04 -07:00
Anu Engineer 4893692972 HDFS-11597. Ozone: Add Ratis management API. Contributed by Tsz Wo Nicholas Sze. 2018-04-26 05:36:04 -07:00
Anu Engineer a8c0976fb4 HDFS-11894. Ozone: Cleanup imports. Contributed by Weiwei Yang. 2018-04-26 05:35:59 -07:00
Mingliang Liu 677dcf529c HDFS-11903. Ozone: Cleaning up local storage when closing MiniOzoneCluster. Contributed by Mingliang Liu 2018-04-26 05:34:18 -07:00
Xiaoyu Yao 6b9915fcbd HDFS-11774. Ozone: KSM: add deleteVolume. Contributed by Mukul Kumar Singh. 2018-04-26 05:34:18 -07:00
Xiaoyu Yao 236c410881 HDFS-11776. Ozone: KSM: add SetBucketProperty. Contributed by Nandakumar Vadivelu. 2018-04-26 05:34:18 -07:00
Xiaoyu Yao 72b228a9e6 HDFS-11853. Ozone: KSM: Add getKey. Contributed by Chen Liang. 2018-04-26 05:34:18 -07:00
Anu Engineer 59d273b175 HDFS-11655. Ozone: CLI: Guarantees user runs SCM commands has appropriate permission. Contributed by Weiwei Yang. 2018-04-26 05:34:18 -07:00
Tsz-Wo Nicholas Sze b71efcf1b0 HDFS-11865. Ozone: Do not initialize Ratis cluster during datanode startup. 2018-04-26 05:34:18 -07:00
Xiaoyu Yao e3c8f6a24d HDFS-11780. Ozone: KSM: Add putKey. Contributed by Chen Liang. 2018-04-26 05:34:18 -07:00
Xiaoyu Yao ff5dbeec07 HDFS-11846. Ozone: Fix Http connection leaks in ozone clients. Contributed by Weiwei Yang. 2018-04-26 05:34:18 -07:00
Xiaoyu Yao 84294de9a2 HDFS-11778. Ozone: KSM: add getBucketInfo. Contributed by Nandakumar Vadivelu. 2018-04-26 05:34:18 -07:00
Xiaoyu Yao 47c4867765 HDFS-11859. Ozone: SCM: Separate BlockLocationProtocol from ContainerLocationProtocol. Contributed by Xiaoyu Yao. 2018-04-26 05:34:18 -07:00
Chen Liang 0753e094d7 HDFS-11727. Block Storage: Retry Blocks should be requeued when cblock is restarted. Contributed by Mukul Kumar Singh. 2018-04-26 05:34:18 -07:00
Xiaoyu Yao 37642c12df HDFS-11770. Ozone: KSM: Add setVolumeProperty. Contributed by Mukul Kumar Singh. 2018-04-26 05:34:18 -07:00
Xiaoyu Yao 56966a0535 HDFS-11860. Ozone: SCM: SCMContainerPlacementCapacity#chooseNode sometimes does not remove chosen node from healthy list. Contributed by Xiaoyu Yao. 2018-04-26 05:34:18 -07:00
Chen Liang a0f51ee3d7 HDFS-11850. Ozone: Stack Overflow in XceiverClientManager because of race condition in accessing openClient. Contributed by Mukul Kumar Singh. 2018-04-26 05:34:18 -07:00
Weiwei Yang ae5242accb HDFS-11830. Ozone: Datanode needs to re-register to SCM if SCM is restarted. Contributed by Weiwei Yang. 2018-04-26 05:34:18 -07:00
Tsz-Wo Nicholas Sze 877e751c84 HDFS-11843. Ozone: XceiverClientRatis should implement XceiverClientSpi.connect(). 2018-04-26 05:34:18 -07:00
Chen Liang 4fb9064523 HDFS-11835. Block Storage: Overwrite of blocks fails. Contributed by Mukul Kumar Singh. 2018-04-26 05:34:18 -07:00
Xiaoyu Yao ca70300eea HDFS-11775. Ozone: KSM: add createBucket. Contributed by Nandakumar Vadivelu. 2018-04-26 05:34:18 -07:00
Weiwei Yang e9d09c209e HDFS-11824. Ozone: Fix javac warnings. Contributed by Yiqun Lin. 2018-04-26 05:34:18 -07:00
Xiaoyu Yao 7f0be64284 HDFS-11831. Ozone: Improve the way of getting test file path in unit tests for Windows. Contributed by Yiqun Lin. 2018-04-26 05:34:18 -07:00
Anu Engineer c9e6d4378d HDFS-11769. Ozone: KSM: Add createVolume API. Contributed by Mukul Kumar Singh. 2018-04-26 05:34:18 -07:00
Xiaoyu Yao 9c9be9f7f7 HDFS-11693. Ozone:Add archive support to containers. Contributed by Anu Engineer. 2018-04-26 05:34:18 -07:00
Chen Liang 162dac96ce HDFS-11650. Ozone: fix the consistently timeout test testUpgradeFromRel22Image. Contributed by Chen Liang. 2018-04-26 05:34:18 -07:00
Chen Liang dfb0dab966 HDFS-11694. Block Storage: Add Support for 2 BlockIDBuffers and also for periodic flush of BlockIDBuffer. Contributed by Mukul Kumar Singh 2018-04-26 05:34:18 -07:00
Xiaoyu Yao 821740e4d3 HDFS-11815. CBlockManager#main should join() after start() service. Contributed by Chen Liang. 2018-04-26 05:34:18 -07:00
Xiaoyu Yao a6013e2b5b HDFS-11805. Ensure LevelDB DBIterator is closed. Contributed by Chen Liang. 2018-04-26 05:34:18 -07:00
Xiaoyu Yao b592df6413 HDFS-11811. Ozone: SCM: Support Delete Block. Contributed by Xiaoyu Yao. 2018-04-26 05:34:18 -07:00
Chen Liang 9bc494b909 HDFS-11802. Ozone : add DEBUG CLI support for open container db file. Contributed by Chen Liang 2018-04-26 05:34:18 -07:00
Anu Engineer edff6c6a24 HDFS-11768. Ozone: KSM: Create Key Space manager service. Contributed by Anu Engineer. 2018-04-26 05:34:18 -07:00
Chen Liang 169713f3f3 HDFS-11788. Ozone : add DEBUG CLI support for nodepool db file. Contributed by Chen Liang 2018-04-26 05:34:18 -07:00
Anu Engineer 070960ed8a HDFS-11798. Ozone: Correct description for ozone.handler.type in ozone-default.xml. Contributed by Mukul Kumar Singh. 2018-04-26 05:34:18 -07:00
Anu Engineer 744a052dc2 HDFS-11783. Ozone: Fix spotbugs warnings. Contributed by Weiwei Yang. 2018-04-26 05:34:18 -07:00
Weiwei Yang 4be9710712 HDFS-11680. Ozone: SCM CLI: Implement info container command. Contributed by Yuanbo Liu. 2018-04-26 05:34:18 -07:00
Chen Liang 9fcaeceb54 HDFS-11756. Ozone : add DEBUG CLI support of blockDB file. Contributed by Chen Liang 2018-04-26 05:34:18 -07:00
Weiwei Yang c18229f0df HDFS-11716. Ozone: SCM: CLI: Revisit delete container API. Contributed by Weiwei Yang. 2018-04-26 05:34:18 -07:00
Anu Engineer 67c81a8b18 HDFS-11761. Ozone: Get container report should only report closed containers. Contributed by Weiwei Yang. 2018-04-26 05:34:18 -07:00
Weiwei Yang fc9130f6c5 HDFS-11759. Ozone : SCMNodeManager#close() should also close node pool manager object. Contributed by Chen Liang. 2018-04-26 05:34:18 -07:00
Anu Engineer d9be9a8c30 HDFS-11698. Ozone: SCM: CLI: Add Debug command. Contributed by Chen Liang. 2018-04-26 05:34:18 -07:00
Anu Engineer a28557ac03 HDFS-11712. Ozone: Reuse ObjectMapper instance to improve the performance. Contributed by Yiqun Lin. 2018-04-26 05:34:18 -07:00
Anu Engineer ee8708ca31 HDFS-11747. Ozone : need to fix OZONE_SCM_DEFAULT_PORT. Contributed by Chen Liang. 2018-04-26 05:34:18 -07:00
Weiwei Yang 3158f479d3 HDFS-11725. Ozone: Revise create container CLI specification and implementation. Contributed by Weiwei Yang 2018-04-26 05:34:18 -07:00
Weiwei Yang b581cde542 HDFS-11728. Ozone: add the DB names to OzoneConsts. Contributed by Chen Liang. 2018-04-26 05:34:18 -07:00
Anu Engineer 6b3da448eb HDFS-11675. Ozone: SCM CLI: Implement delete container command. Contributed by Weiwei Yang. 2018-04-26 05:34:18 -07:00
Chen Liang e9588c6422 HDFS-11627. Block Storage: Cblock cache should register with flusher to upload blocks to containers. Contributed by Mukul Kumar Singh. 2018-04-26 05:34:18 -07:00
Chen Liang 668b056984 HDFS-11667. Block Storage:Handling flushing of incomplete block id buffers during shutdown. Contributed by Mukul Kumar Singh. 2018-04-26 05:34:18 -07:00
Xiaoyu Yao 1a245accb5 HDFS-11668. Ozone: misc improvements for SCM CLI. Contributed by Weiwei Yang. 2018-04-26 05:34:18 -07:00
Yiqun Lin 5984d40b86 HDFS-11666. Ozone: Fix compile error due to inconsistent package name. Contributed by Yiqun Lin. 2018-04-26 05:34:18 -07:00
Xiaoyu Yao a9ba8b5ded HDFS-11504. Ozone: SCM: Add Block APIs. Contributed by Xiaoyu Yao. 2018-04-26 05:34:18 -07:00
Weiwei Yang 720e5c40f6 HDFS-11649. Ozone: SCM: CLI: Add shell code placeholder classes. Contributed by Chen Liang. 2018-04-26 05:34:18 -07:00
Anu Engineer 6c4bd1647c HDFS-11581. Ozone: Support force delete a container. Contributed by Yuanbo Liu. 2018-04-26 05:34:18 -07:00
Anu Engineer d3f93d55d9 HDFS-11631. Block Storage : allow cblock server to be started from hdfs commandline. Contributed by Chen Liang. 2018-04-26 05:34:18 -07:00
Anu Engineer 05b12c48cf HDFS-11657. Ozone: Add unit test for storage container metrics. Contributed by Yiqun Lin. 2018-04-26 05:34:18 -07:00
Anu Engineer 783b7c27b1 HDFS-11582. Block Storage : add SCSI target access daemon. Contributed by Chen Liang. 2018-04-26 05:34:18 -07:00
Anu Engineer 7d4a2d4104 HDFS-11569. Ozone: Implement listKey function for KeyManager. Contributed by Weiwei Yang. 2018-04-26 05:34:18 -07:00
Chen Liang cbb7cc26a5 HDFS-11642. Block Storage: fix TestCBlockCLI and TestCBlockServerPersistence cleanup. Contributed by Xiaoyu Yao. 2018-04-26 05:34:18 -07:00
Chen Liang 5b19a03f63 HDFS-11635. Block Storage: Add metrics for Container Flushes. Contributed by Mukul Kumar Singh. 2018-04-26 05:34:18 -07:00
Xiaoyu Yao 2129c6b276 HDFS-11062. Ozone:SCM: Remove null command. Contributed by Yuanbo Liu. 2018-04-26 05:34:18 -07:00
Chen Liang b7463924af HDFS-11618. Block Storage: Add Support for Direct I/O. Contributed by Mukul Kumar Singh. 2018-04-26 05:34:18 -07:00
Anu Engineer 57b2a9b17d HDFS-11006. Ozone: support setting chunk size in streaming API. Contributed by Yiqun Lin. 2018-04-26 05:34:18 -07:00
Anu Engineer cd361fa490 HDFS-11625. Ozone: Fix UT failures that caused by hard coded datanode data dirs. Contributed by Weiwei Yang. 2018-04-26 05:34:18 -07:00
Anu Engineer 7573a0bc61 HDFS-11620. Ozone: Allocate container for MiniOzone cluster fails because of insufficient space error. Contributed by Mukul Kumar Singh. 2018-04-26 05:34:18 -07:00
Anu Engineer fadfe37019 HDFS-11619. Ozone: Unit tests running failed in Windows. Contributed by Yiqun Lin. 2018-04-26 05:34:18 -07:00
Anu Engineer aa16380d71 HDFS-11566. Ozone: Document missing metrics for container operations. Contributed by Yiqun Lin. 2018-04-26 05:34:18 -07:00
Anu Engineer 82d814fa79 HDFS-11564. Ozone: SCM: Add Comparable Metric Support. Contributed by Anu Engineer. 2018-04-26 05:34:18 -07:00
Anu Engineer 68da45a789 HDFS-11519. Ozone: Implement XceiverServerSpi and XceiverClientSpi using Ratis. Contributed by Tsz Wo Nicholas Sze. 2018-04-26 05:34:18 -07:00
Chen Liang 3966f42895 HDFS-11591. Block Storage: fix TestCBlockServer test cleanup. Contributed by Xiaoyu Yao 2018-04-26 05:34:18 -07:00
Anu Engineer 7c59add3da HDFS-11594. Ozone: close container should call compactDB. Contributed by Anu Engineer. 2018-04-26 05:34:18 -07:00
Xiaoyu Yao bc9c313907 HDFS-11567. Ozone: SCM: Support update container. Contributed by Weiwei Yang. 2018-04-26 05:34:18 -07:00
Xiaoyu Yao 17a6e62629 HDFS-11537. Block Storage : add cache layer. Contributed by Chen Liang. 2018-04-26 05:34:18 -07:00
Anu Engineer 3598d4b8cf HDFS-11548. Ozone: SCM: Add node pool management API. Contributed by Xiaoyu Yao 2018-04-26 05:34:18 -07:00
Anu Engineer dc8e73a7d5 HDFS-11355. Block Storage : Merge configuration into ozone configuration classes. Contributed by Chen Liang. 2018-04-26 05:34:18 -07:00
Anu Engineer 860a4e0044 HDFS-11550. Ozone: Add a check to prevent removing a container that has keys in it. Contributed by Weiwei Yang. 2018-04-26 05:34:18 -07:00
Anu Engineer 23044c1db8 HDFS-11361. Block Storage: add cache interface. Contributed by Chen Liang. 2018-04-26 05:34:18 -07:00
Anu Engineer d251a55ff9 HDFS-11559. Ozone: MiniOzoneCluster prints too many log messages by default. Contributed by Tsz Wo Nicholas Sze. 2018-04-26 05:34:18 -07:00
Anu Engineer 1e892f5748 HDFS-11162. Block Storage: add command line tool. Contributed by Chen Liang. 2018-04-26 05:34:18 -07:00
Anu Engineer 85c2312e7d HDFS-11492. Ozone: Add the ability to handle sendContainerReport Command. Contributed by Anu Engineer. 2018-04-26 05:34:18 -07:00
Anu Engineer 98d3360e3a HDFS-11444. Ozone: Fix datanode ID handling in MiniOzoneCluster. Contributed by Weiwei Yang. 2018-04-26 05:34:18 -07:00
Xiaoyu Yao 88371ff07f HDFS-11491. Ozone: SCM: Add close container RPC. Contributed by Anu Engineer. 2018-04-26 05:34:18 -07:00
Anu Engineer 932423211f HDFS-11469. Ozone: SCM: Container allocation based on node report. Contributed by Xiaoyu Yao. 2018-04-26 05:34:18 -07:00
Xiaoyu Yao fc7d678d3d HDFS-11071. Ozone: SCM: Move SCM config keys to ScmConfig. Contributed by Weiwei Yang. 2018-04-26 05:34:18 -07:00
Tsz-Wo Nicholas Sze 7b7d186b82 HDFS-11513. Ozone: Separate XceiverServer and XceiverClient into interfaces and implementations. 2018-04-26 05:34:18 -07:00
Anu Engineer 1058aa2523 HDFS-10928. Ozone:SCM: Support MXBean for SCM and NodeManager. Contributed by Weiwei Yang. 2018-04-26 05:34:18 -07:00
Anu Engineer 386dbc11da HDFS-11196. Ozone: Improve logging and error handling in the container layer. Contributed by Anu Engineer. 2018-04-25 15:55:06 -07:00
Anu Engineer 32cc2b8f1a HDFS-11509. Ozone: Fix TestEndpoint test regression. Contributed by Anu Engineer. 2018-04-25 15:54:56 -07:00
Anu Engineer 9c57a61f68 HDFS-11424. Block Storage: add container representation to meta data. Contributed Chen Liang. 2018-04-25 15:54:56 -07:00
Anu Engineer 3e1317de02 HDFS-11451. Ozone: Add protobuf definitions for container reports. Contributed by Anu Engineer. 2018-04-25 15:54:56 -07:00
Anu Engineer 02fb9aed32 HDFS-11158. Ozone: TestDatanodeStateMachine is failing intermittently. Contributed by Weiwei Yang. 2018-04-25 15:54:56 -07:00
Anu Engineer 753979865b HDFS-11137. Ozone: SCM: Add negative tests cases for datanodeStatemachine. Contributed by Weiwei Yang. 2018-04-25 15:54:42 -07:00
Anu Engineer d55564143d HDFS-11484. Ozone: Fix flaky TestNodeManager#testScmNodeReportUpdate. Contributed by Xiaoyu Yao. 2018-04-25 15:54:42 -07:00
Anu Engineer a2328d36ac HDFS-11480. Ozone: TestEndpoint task failure. Contributed by Xiaoyu Yao. 2018-04-25 15:54:42 -07:00
Anu Engineer 2cba0daddc HDFS-11425. Ozone: add client-facing container APIs and container references. Contributed by Chen Liang. 2018-04-25 15:54:42 -07:00
Anu Engineer 56f011fd02 HDFS-11447. Ozone: SCM: Send node report to SCM with heartbeat.Contributed by Xiaoyu Yao. 2018-04-25 15:54:41 -07:00
Anu Engineer f4529316bd HDFS-11474. Ozone: TestContainerMapping needs to cleanup levelDB files.Contributed by Xiaoyu Yao. 2018-04-25 15:54:36 -07:00
Anu Engineer b29ae6e5f7 HDFS-11473. Ozone : exclude cblock protobuf files from findbugs check. Contributed by Xiaoyu Yao. 2018-04-25 15:54:36 -07:00
Anu Engineer b8b72241aa HDFS-11036. Ozone: reuse Xceiver connection. Contributed by Chen Liang. 2018-04-25 15:54:36 -07:00
Arpit Agarwal 754ed7d651 HDFS-11414. Ozone : move StorageContainerLocation protocol to hdfs-client. Contributed by Chen Liang. 2018-04-25 15:54:34 -07:00
Anu Engineer bb410de10c HDFS-11184. Ozone: SCM: Make SCM use container protocol. Contributed by Anu Engineer. 2018-04-25 15:54:26 -07:00
Anu Engineer c169dd1306 HDFS-11463. Ozone: Add metrics for container operations and export over JMX. Contributed by Mukul Kumar Singh. 2018-04-25 15:54:03 -07:00
Anu Engineer a7f82cba71 HDFS-11154. Block Storage: store server state to persistent storage. Contributed by Chen Liang 2018-04-25 15:53:58 -07:00
Anu Engineer 9997d36eb6 HDFS-11138. Block Storage: add block storage server. Contributed by Chen Liang 2018-04-25 15:53:58 -07:00
Anu Engineer 48db56adea HDFS-11133. Ozone: Add allocateContainer RPC. Contributed by Anu Engineer 2018-04-25 15:53:58 -07:00
Anu Engineer ca12aac5a4 HDFS-11126. Ozone: Add small file support RPC. Contributed by Anu Engineer. 2018-04-25 15:53:58 -07:00
Anu Engineer 05b44e1ad8 HDFS-11108. Ozone: use containers with the state machine. Contributed by Anu Engineer 2018-04-25 15:53:56 -07:00
Anu Engineer 8bd85268e6 HDFS-11081. Ozone:SCM: Add support for registerNode in datanode. Contributed by Anu Engineer. 2018-04-25 15:53:50 -07:00
Anu Engineer 2b8b3754f6 HDFS-11130. Block Storage : Add storage client to server protocol. Contributed by Chen Lian 2018-04-25 15:53:49 -07:00
Anu Engineer 3d83ee25c5 HDFS-11127. Block Storage : add block storage service protocol. Contributed by Chen Liang 2018-04-25 15:53:43 -07:00
Anu Engineer 8274ff356a HDFS-11103. Ozone: Cleanup some dependencies. Contributed by Anu Engineer. 2018-04-25 15:53:39 -07:00
Anu Engineer e49e305f25 HDFS-11001. Ozone:SCM: Add support for registerNode in SCM. Contributed by Anu Engineer. 2018-04-25 15:53:34 -07:00
Anu Engineer 964daed853 fix a build break due to merge 2018-04-25 15:53:34 -07:00
Anu Engineer b186fc81f7 HDFS-10938. Ozone:SCM: Add datanode protocol. Contributed by Anu Engineer. 2018-04-25 15:53:32 -07:00
Anu Engineer ee119ff60a HDFS-11004. Ozone : move Chunk IO and container protocol calls to hdfs-client. Contributed by Chen Liang. 2018-04-25 15:53:27 -07:00
Anu Engineer ed84388fca HDFS-10912. Ozone:SCM: Add chill mode support to NodeManager. Contributed by Anu Engineer. 2018-04-25 15:53:27 -07:00
Anu Engineer 5520f73dee Fixing merge conflicts due to HDFS-10637 2018-04-25 15:53:27 -07:00
Anu Engineer 56b0fddfbd HDFS-10995. Ozone: Move ozone XceiverClient to hdfs-client. Contributed by Chen Liang. 2018-04-25 15:53:25 -07:00
Anu Engineer d0422a74ea HDFS-10932. Ozone: fix XceiverClient slow shutdown. Contributed by Chen Liang. 2018-04-25 15:53:21 -07:00
Anu Engineer 4c95c3d6ab HDFS-10897. Ozone: SCM: Add NodeManager. Contributed by Anu Engineer. 2018-04-25 15:53:21 -07:00
Arpit Agarwal e3aa2b687c HDFS-10420. Fix Ozone unit tests to use MiniOzoneCluster. Contributed by Arpit Agarwal. 2018-04-25 15:53:21 -07:00
Anu Engineer 3beee0b3d1 HDFS-10363. Ozone: Introduce new config keys for SCM service endpoints. Contributed by Arpit Agarwal. 2018-04-25 15:53:19 -07:00
Arpit Agarwal 6c61902389 HDFS-10361. Support starting StorageContainerManager as a daemon. (Contributed by Arpit Agarwal) 2018-04-25 15:53:12 -07:00
Anu Engineer aa3ca951f9 HDFS-10351. Ozone: Optimize key writes to chunks by providing a bulk write implementation in ChunkOutputStream. Contributed by Chris Nauroth. 2018-04-25 15:53:07 -07:00
Chris Nauroth acf0b220ce HDFS-10349. Ozone: StorageContainerManager fails to compile after merge of HDFS-10312 maxDataLength enforcement. Contributed by Chris Nauroth. 2018-04-25 15:53:07 -07:00
Anu Engineer 7d661a289a HDFS-10232. Ozone: Make config key naming consistent. Contributed by Anu Engineer. 2018-04-25 15:53:05 -07:00
Anu Engineer 0ecbc13128 HDFS-10278. Ozone: Add paging support to list Volumes. Contributed by Anu Engineer. 2018-04-25 15:52:58 -07:00
Anu Engineer 7bb2ab7d7c HDFS-10251. Ozone: Shutdown cleanly. Contributed by Anu Engineer 2018-04-25 15:52:58 -07:00
Anu Engineer e11e824c9b HDFS-10268. Ozone: end-to-end integration for create/get volumes, buckets and keys. Contributed by Chris Nauroth. 2018-04-25 15:52:56 -07:00
Chris Nauroth 0addb1033e HDFS-10250. Ozone: Add key Persistence. Contributed by Anu Engineer. 2018-04-25 15:52:48 -07:00
Chris Nauroth c6fd5ea3f0 HDFS-10238. Ozone : Add chunk persistance. Contributed by Anu Engineer. 2018-04-25 15:52:48 -07:00
Anu Engineer 0744d0a947 HDFS-8210. Ozone: Implement storage container manager. Contributed by Chris Nauroth. 2018-04-25 15:52:46 -07:00
Chris Nauroth e758f90f93 HDFS-10195. Ozone: Add container persistence. Contributed by Anu Engineer. 2018-04-25 15:52:33 -07:00
Chris Nauroth c18c6801ef HDFS-10202. ozone : Add key commands to CLI. Contributed by Anu Engineer. 2018-04-25 15:52:25 -07:00
Chris Nauroth f69ce5f3c6 HDFS-10196. Ozone : Enable better error reporting for failed commands in ozone shell. Contributed by Anu Engineer. 2018-04-25 15:52:09 -07:00
Chris Nauroth fd2fe47b32 HDFS-10179. Ozone: Adding logging support. Contributed by Anu Engineer. 2018-04-25 15:52:07 -07:00
Chris Nauroth 7c55d7feb5 HDFS-9960. OzoneHandler : Add localstorage support for keys. Contributed by Anu Engineer. 2018-04-25 15:52:00 -07:00
Chris Nauroth 4009b66090 HDFS-10180. Ozone: Refactor container Namespace. Contributed by Anu Engineer. 2018-04-25 15:52:00 -07:00
Chris Nauroth 044cc47145 HDFS-9961. Ozone: Add buckets commands to CLI. Contributed by Anu Engineer. 2018-04-25 15:52:00 -07:00
Chris Nauroth bb47d03906 HDFS-9944. Ozone : Add container dispatcher. Contributed by Anu Engineer. 2018-04-25 15:52:00 -07:00
Chris Nauroth b9d53ed836 HDFS-9926. ozone : Add volume commands to CLI. Contributed by Anu Engineer. 2018-04-25 15:52:00 -07:00
Chris Nauroth 60fbef08ec HDFS-9925. Ozone: Add Ozone Client lib for bucket handling. Contributed by Anu Engineer.
Fix build break
2018-04-25 15:52:00 -07:00
Chris Nauroth a9879798a6 HDFS-9916. OzoneHandler : Add Key handler. Contributed by Anu Engineer. 2018-04-25 15:52:00 -07:00
Chris Nauroth 93201330b8 HDFS-9916. OzoneHandler : Add Key handler. Contributed by Anu Engineer. 2018-04-25 15:52:00 -07:00
Anu Engineer 2b387d622c HDFS-9920. Stop tracking CHANGES.txt in the HDFS-7240 feature branch. Contributed by Chris Nauroth. 2018-04-25 15:52:00 -07:00
Chris Nauroth 085c62545d HDFS-9891. Ozone: Add container transport client. Contributed by Anu Engineer. 2018-04-25 15:51:58 -07:00
Chris Nauroth 9b158f3b57 HDFS-9873. Ozone: Add container transport server. Contributed by Anu Engineer. 2018-04-25 15:51:53 -07:00
Anu Engineer 3c39c18a6d HDFS-9907. Exclude Ozone protobuf-generated classes from Findbugs analysis. Contributed by Chris Nauroth 2018-04-25 15:51:53 -07:00
Chris Nauroth 0a43e272f1 HDFS-9848. Ozone: Add Ozone Client lib for volume handling. Contributed by Anu Engineer. 2018-04-25 15:51:53 -07:00
Anu Engineer 3481897bde HDFS-9853. Ozone: Add container definitions. Contributed by Anu Engineer. 2018-04-25 15:51:51 -07:00
cnauroth 11a6cc2a4d HDFS-9845. OzoneHandler : Support List and Info Volumes. Contributed by Anu Engineer. 2018-04-25 15:51:39 -07:00
cnauroth f6ef841f74 HDFS-9834. OzoneHandler : Enable MiniDFSCluster based testing for Ozone. Contributed by Anu Engineer. 2018-04-25 15:51:39 -07:00
Anu Engineer f6b9c0f8a1 HDFS-8757 : OzoneHandler : Add localStorageHandler support for Buckets. Contributed by Anu Engineer 2018-04-25 15:51:39 -07:00
Anu Engineer ae109d1de7 HDFS-8527. OzoneHandler: Integration of REST interface and container data pipeline back-end. Contributed by Chris Nauroth 2018-04-25 15:51:36 -07:00
Anu Engineer a301827c6a HDFS-8695. OzoneHandler : Add Bucket REST Interface. (aengineer) 2018-04-25 15:51:00 -07:00
Anu Engineer 764ff0d505 HDFS-8753. Ozone: Unify StorageContainerConfiguration with ozone-default.xml & ozone-site.xml. Contributed by kanaka kumar avvaru 2018-04-25 15:51:00 -07:00
Arpit Agarwal 507e7274aa HDFS-8717. OzoneHandler : Add common bucket objects. (Contributed by Anu Engineer) 2018-04-25 15:51:00 -07:00
Arpit Agarwal 07213f4eb5 HDFS-8680. OzoneHandler : Add Local StorageHandler support for volumes. (Contributed by Anu Engineer) 2018-04-25 15:51:00 -07:00
Arpit Agarwal 835f872a0a HDFS-8654. OzoneHandler : Add ACL support. (Contributed by Anu Engineer) 2018-04-25 15:51:00 -07:00
Arpit Agarwal b1fa06aacb HDFS-8644. OzoneHandler : Add volume handler. (Contributed by Anu Engineer) 2018-04-25 15:51:00 -07:00
Arpit Agarwal 2793b4c96f HDFS-8634. OzoneHandler: Add userAuth Interface and Simple userAuth handler. (Contributed by Anu Engineer) 2018-04-25 15:51:00 -07:00
Arpit Agarwal d65b373ec4 HDFS-8637. OzoneHandler : Add Error Table. (Contributed by Anu Engineer) 2018-04-25 15:51:00 -07:00
cnauroth 2ea29ee062 HDFS-8448. Create REST Interface for Volumes. Contributed by Anu Engineer. 2018-04-25 15:51:00 -07:00
Arpit Agarwal 0a90e6d45c HDFS-8614. OzoneHandler : Add Quota Support. (Contributed by Anu Engineer) 2018-04-25 15:51:00 -07:00
Arpit Agarwal d41245ca56 HDFS-8456. Introduce STORAGE_CONTAINER_SERVICE as a new NodeType. (Contributed by Arpit Agarwal) 2018-04-25 15:50:52 -07:00
Yiqun Lin b06601acce HDFS-13490. RBF: Fix setSafeMode in the Router. Contributed by Inigo Goiri. 2018-04-24 11:25:23 +08:00
Inigo Goiri df92a17e02 HDFS-13336. Test cases of TestWriteToReplica failed in windows. Contributed by Xiao Liang. 2018-04-23 19:12:16 -07:00
Bharat Viswanadham 9b5375e0c1 HDFS-13356. Balancer:Set default value of minBlockSize to 10mb. Contributed by Bharat Viswanadham 2018-04-23 16:09:01 -07:00
Lei Xu 42e82f0281 Update CHANGES, RELEASENOTES, and jdiff for 3.0.2 release.
(cherry picked from commit f6ecb76d0b)

Conflicts:
	hadoop-project-dist/pom.xml
2018-04-23 14:14:05 -07:00
Chris Douglas f411de6a79 HDFS-13408. MiniDFSCluster to support being built on randomized base directory. Contributed by Xiao Liang 2018-04-23 11:13:18 -07:00
Arpit Agarwal c533c77047 HDFS-13433. webhdfs requests can be routed incorrectly in federated cluster. Contributed by Arpit Agarwal. 2018-04-23 10:08:53 -07:00
Inigo Goiri 63803e7051 HDFS-13388. RequestHedgingProxyProvider calls multiple configured NNs all the time. Contributed by Jinglun. 2018-04-22 19:49:35 -07:00
Arpit Agarwal 1c1ce63cda HDFS-13055. Aggregate usage statistics from datanodes. Contributed by Ajay Kumar. 2018-04-22 08:07:19 -07:00
Yiqun Lin b6dae26f44 HDFS-13478. RBF: Disabled Nameservice store API. Contributed by Inigo Goiri. 2018-04-21 13:19:09 +08:00
Sangjin Lee f40969a141 HDFS-10183. Prevent race condition during class initialization. Contributed by Pavel Avgustinov. 2018-04-20 20:33:10 -07:00
Inigo Goiri 1134af9ad1 HDFS-13453. RBF: getMountPointDates should fetch latest subdir time/date when parent dir is not present but /parent/child dirs are present in mount table. Contributed by Dibyendu Karmakar. 2018-04-19 14:56:36 -07:00
Shashikant Banerjee e4c39f3247
HADOOP-15396. Some java source files are executable
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-04-19 08:35:38 +09:00
Bharat Viswanadham bf7694d020 HDFS-13464. Fix javadoc in FsVolumeList#handleVolumeFailures. Contributed by Shashikant Banerjee 2018-04-18 08:23:45 -07:00
Mukul Kumar Singh bf2f493f81 HDFS-13463. Fix javadoc in FsDatasetImpl#checkAndUpdate. Contributed by Shashikant Banerjee. 2018-04-18 16:11:37 +05:30
Erik Krogen 2d9e791a90
HDFS-12828. OIV ReverseXML Processor fails with escaped characters
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-04-18 14:38:23 +09:00
Wei Yan e4313e7e47 HDFS-13466. RBF: Add more router-related information to the UI. 2018-04-17 15:01:07 -07:00
Inigo Goiri c9b33514b8 HDFS-13462. Add BIND_HOST configuration for JournalNode's HTTP and RPC Servers. Contributed by Lukas Majercak. 2018-04-17 14:19:23 -07:00
Bharat Viswanadham a68b04370f HDFS-13129. Add a test for DfsAdmin refreshSuperUserGroupsConfiguration. Contributed by Mukul Kumar Singh 2018-04-17 12:37:30 -07:00
Yiqun Lin c4d3636c21 HDFS-13435. RBF: Improve the error loggings for printing the stack trace. 2018-04-17 11:23:22 +08:00
Arpit Agarwal d907fdc3cd HDFS-13439. Add test case for read block operation when it is moved. Contributed by Ajay Kumar. 2018-04-16 14:16:59 -07:00
Wei-Chiu Chuang e66e287efe HDFS-13330. ShortCircuitCache#fetchOrCreate never retries. Contributed by Gabor Bota. 2018-04-13 09:17:34 -07:00
Xiao Chen 6503593711 HDFS-13430. Fix TestEncryptionZonesWithKMS failure due to HADOOP-14445. 2018-04-13 09:05:17 -07:00
Bharat Viswanadham fa8b88ab2b HDFS-13438. Fix javadoc in FsVolumeList#removeVolume. Contributed by Shashikant Banerjee. 2018-04-13 08:56:02 -07:00
Yiqun Lin 0725953efe HDFS-13418. NetworkTopology should be configurable when enable DFSNetworkTopology. Contributed by Tao Jie. 2018-04-13 17:55:45 +08:00
Akira Ajisaka 9b0b9f2af2
HDFS-13436. Fix javadoc of package-info.java 2018-04-13 13:23:51 +09:00
Inigo Goiri 044341b4e4 HDFS-13386. RBF: Wrong date information in list file(-ls) result. Contributed by Dibyendu Karmakar. 2018-04-12 09:30:11 -07:00
Inigo Goiri b5353c75d9 Revert "HDFS-13388. RequestHedgingProxyProvider calls multiple configured NNs all the time. Contributed by Jinglun."
This reverts commit ac32b3576d.
2018-04-12 09:28:23 -07:00
Inigo Goiri d272056fcb Revert "HDFS-13386. RBF: Wrong date information in list file(-ls) result. Contributed by Dibyendu Karmakar."
This reverts commit 18de6f2042.
2018-04-12 08:42:19 -07:00
Mukul Kumar Singh 7ed8511ad8 HDFS-13426. Fix javadoc in FsDatasetAsyncDiskService#removeVolume. Contributed by Shashikant Banerjee. 2018-04-12 20:12:31 +05:30
Akira Ajisaka 113af12cfb
HDFS-7101. Potential null dereference in DFSck#doWork(). Contributed by skrho and Ted Yu. 2018-04-12 17:47:37 +09:00
Akira Ajisaka c7cd362afd
HDFS-13427. Fix the section titles of transparent encryption document. 2018-04-12 10:44:56 +09:00
Inigo Goiri 18de6f2042 HDFS-13386. RBF: Wrong date information in list file(-ls) result. Contributed by Dibyendu Karmakar. 2018-04-11 12:03:14 -07:00
Inigo Goiri f7d5bace43 HDFS-13428. RBF: Remove LinkedList From StateStoreFileImpl.java. Contributed by BELUGA BEHR. 2018-04-11 10:43:43 -07:00
Wei Yan 0c93d43f3d HDFS-13045. RBF: Improve error message returned from subcluster. Contributed by Inigo Goiri. 2018-04-11 08:37:43 -07:00
James Clampffer eefe2a147c HDFS-13403: libhdfs++ Use hdfs::IoService object rather than asio::io_service. Contributed by James Clampffer. 2018-04-11 10:27:23 -04:00
Xiao Chen 7c9cdad6d0 HDFS-13056. Expose file-level composite CRCs in HDFS which are comparable across different instances/layouts. Contributed by Dennis Huo. 2018-04-10 21:31:48 -07:00
Xiao Chen e76c2aeb28 HDFS-13363. Record file path when FSDirAclOp throws AclException. Contributed by Gabor Bota. 2018-04-10 11:19:48 -07:00
Rakesh Radhakrishnan f89594f0b8 HDFS-13328. Abstract ReencryptionHandler recursive logic in separate class. Contributed by Surendra Singh Lilhore. 2018-04-10 23:35:00 +05:30
Weiwei Yang 6729047a8b HDFS-13420. License header is displayed in ArchivalStorage/MemoryStorage html pages. Contributed by Akira Ajisaka. 2018-04-10 22:10:44 +08:00
Yiqun Lin e87be8a2a4 HDFS-13384. RBF: Improve timeout RPC call mechanism. Contributed by Inigo Goiri. 2018-04-10 15:34:42 +08:00
Yiqun Lin a92200f4a6 HDFS-13410. RBF: Support federation with no subclusters. Contributed by Inigo Goiri. 2018-04-10 14:29:28 +08:00
Inigo Goiri e9b9f48dad HDFS-13380. RBF: mv/rm fail after the directory exceeded the quota limit. Contributed by Yiqun Lin. 2018-04-09 10:09:25 -07:00
Inigo Goiri ac32b3576d HDFS-13388. RequestHedgingProxyProvider calls multiple configured NNs all the time. Contributed by Jinglun. 2018-04-09 09:16:48 -07:00
Yiqun Lin 5700556cd6 HDFS-13402. RBF: Fix java doc for StateStoreFileSystemImpl. Contributed by Yiran Wu. 2018-04-08 12:01:55 +08:00
Surendra Singh Lilhore 70590cd8d9 HDFS-13292. Crypto command should give proper exception when trying to set key on existing EZ directory. Contributed by Ranith Sardar. 2018-04-07 11:23:49 +05:30
Wangda Tan 6cf023f9b7 Added CHANGES/RELEASES/Jdiff for 3.1.0 release
Change-Id: Ied5067a996151c04d15cad46c46ac98b60c37b39
(cherry picked from commit 2d96570452a72569befdf9cfe9b90c9fa2e0e261)
2018-04-05 15:52:39 -07:00
Wei Yan 3121e8c293 HDFS-13353. RBF: TestRouterWebHDFSContractCreate failed. Contributed by Takanobu Asanuma. 2018-04-05 12:00:52 -07:00
Lei Xu d737bf99d4 HDFS-13350. Negative legacy block ID will confuse Erasure Coding to be considered as striped block. (Contributed by Lei (Eddy) Xu). 2018-04-05 09:59:10 -07:00
Yiqun Lin 2be64eb201 HDFS-13364. RBF: Support NamenodeProtocol in the Router. Contributed by Inigo Goiri. 2018-04-03 15:08:40 +08:00
Xiao Chen 57374c4737 HADOOP-15317. Improve NetworkTopology chooseRandom's loop. 2018-04-02 22:48:26 -07:00
Inigo Goiri dc8e343201 HDFS-13289. RBF: TestConnectionManager#testCleanup() test case need correction. Contributed by Dibyendu Karmakar. 2018-03-31 09:46:13 -07:00
Konstantin V Shvachko acfd764fcc HADOOP-15253. Should update maxQueueSize when refresh call queue. Contributed by Tao Jie. 2018-03-30 18:55:35 -07:00
Xiao Chen 2c6cfad5a3 HDFS-13087. Snapshotted encryption zone information should be immutable. Contributed by LiXin Ge. 2018-03-29 15:46:34 -07:00
Wei-Chiu Chuang ad10cbd91b HDFS-13357. Improve AclException message "Invalid ACL: only directories may have a default ACL.". Contributed by Gabor Bota. 2018-03-29 07:08:22 -07:00
Arpit Agarwal a991e899fb HDFS-13314. NameNode should optionally exit if it detects FsImage corruption. Contributed by Arpit Agarwal. 2018-03-28 12:49:17 -07:00
Yiqun Lin a71656c1c1 HDFS-13347. RBF: Cache datanode reports. Contributed by Inigo Goiri. 2018-03-28 11:00:08 +08:00
Inigo Goiri 4cef01147f HDFS-13352. RBF: Add xsl stylesheet for hdfs-rbf-default.xml. Contributed by Takanobu Asanuma. 2018-03-27 10:31:03 -07:00
Inigo Goiri 947b282984 HDFS-13204. RBF: Optimize name service safe mode icon. Contributed by liuhongtong. 2018-03-26 09:42:51 -07:00
Yiqun Lin cfc3a1c8f0 HDFS-13291. RBF: Implement available space based OrderResolver. Contributed by Yiqun Lin. 2018-03-26 18:33:07 +08:00
Lei Xu 7616683db5 Update 3.0.1 jdiff file and jdiff stable api version 2018-03-23 11:48:36 -07:00
weiy 6e31a09084 HDFS-12512. RBF: Add WebHDFS. 2018-03-23 08:32:25 -07:00
James Clampffer 8620d2bdf9 HDFS-12110: libhdfs++: Rebase HDFS-8707 on trunk, minor conflict resolution in this patch. Contributed by Deepak Majeti and Anatoli Shein. 2018-03-22 17:19:47 -04:00
James fc5e44d9ed HDFS-12427: libhdfs++: Prevent requests from holding dangling pointer to RpcEngine. Contributed by James Clampffer. 2018-03-22 17:19:47 -04:00
James 48db24a430 HDFS-11294: libhdfs++: Segfault in HA failover if DNS lookup for both Namenodes fails. Contributed by James Clampffer. 2018-03-22 17:19:47 -04:00
James Clampffer 12942f679a HDFS-10787: libhdfs++: Public API should expose configuration parser. Original patch contributed by Mitchell Tracy, followup work and compile warning fixes contributed by Anatoli Shein. 2018-03-22 17:19:47 -04:00
James Clampffer eeb49d0ca7 HDFS-12237: libhdfs++: PROTOC_IS_COMPATIBLE check fails if protobuf library is built from source. Contributed by Anatoli Shein. 2018-03-22 17:19:47 -04:00
James Clampffer 22ea06a3dd HDFS-12134: libhdfs++: Add a synchronization interface for the GSSAPI. Contributed by James Clampffer. 2018-03-22 17:19:47 -04:00
James Clampffer 033433bce7 HDFS-12026: libhdfs++: Fix compilation errors and warnings when compiling with Clang. Contributed by Anatoli Shein. 2018-03-22 17:19:47 -04:00
James Clampffer 53e40bc718 HDFS-10874: libhdfs++: Public API headers should not depend on internal implementation. Contributed by James Clampffer 2018-03-22 17:19:47 -04:00
James Clampffer 3db261d45b HDFS-12103: libhdfs++: Provide workaround to support cancel on filesystem connect until HDFS-11437 is resolved. Contributed by James Clampffer. 2018-03-22 17:19:47 -04:00
James Clampffer 23afd50865 HDFS-11908: libhdfs++: Authentication failure when first NN of a kerberized HA cluster is standby. Contributed by James Clampffer 2018-03-22 17:19:47 -04:00
James Clampffer e64ba87486 HDFS-12104: libhdfs++: Make sure all steps in SaslProtocol end up calling AuthComplete. Contributed by James Clampffer. 2018-03-22 17:19:47 -04:00
James Clampffer 3c743b475e HDFS-12013: libhdfs++: read with offset at EOF should return 0 bytes instead of error. Contributed by Xiaowei Zhu 2018-03-22 17:19:47 -04:00
James Clampffer c5e7a69523 HDFS-11971: libhdfs++: [Fix] a few portability issues. Contributed by Anatoli Schein 2018-03-22 17:19:47 -04:00
James Clampffer 1c9b174663 HDFS-11518: libhdfs++: Add a build option to skip building examples, tests, and tools. Contributed by Anatoli Schein. 2018-03-22 17:19:47 -04:00
James Clampffer 869317be0a HDFS-10785: libhdfs++: Implement the rest of the tools. Contributed by Anatoli Schein 2018-03-22 17:19:47 -04:00
James Clampffer 52445fd4ee HDFS-11544: libhdfs++: Revert HDFS-11544.HDFS-8707.001.patch due to invalid memory access regression. Done by James Clampffer 2018-03-22 17:19:47 -04:00
James Clampffer c2386bc2f3 HDFS-11758: libhdfs++: Catch exceptions thrown by runtime hooks. Contributed by James Clampffer. 2018-03-22 17:19:47 -04:00
James 57cdad73de HDFS-11767: libhdfs++: SASL events should be scoped closer to usage. Contributed by James Clampffer 2018-03-22 17:19:47 -04:00
James b584e34f2f HDFS-11730: libhdfs++: RpcConnection should handle authorization error call id. Contributed by James Clampffer 2018-03-22 17:19:47 -04:00
James fdb88eb57e HDFS-11544: libhdfs++: Improve C API error reporting. Contributed by James Clampffer. 2018-03-22 17:19:47 -04:00
James 3e53da2d62 HDFS-11106: libhdfs++: Some refactoring to better organize files (part 2). Contributed by James Clampffer. 2018-03-22 17:19:47 -04:00
James 0f3f8db113 HDFS-11449: libhdfs++: Log Datanode read size when reading from an HDFS block. Contributed by Xiaowei Zhu. 2018-03-22 17:19:47 -04:00
James 606d20c6c0 HDFS-11436: libhdfs++: Fix race condition in ScopedResolver. Contributed by James Clampffer. 2018-03-22 17:19:47 -04:00
James 8783461e2e HDFS-11028: libhdfs++: FileSystem needs to be able to cancel pending connections. Contributed by James Clampffer 2018-03-22 17:19:47 -04:00
James 58de2df860 HDFS-10685: libhdfs++: return explicit error when non-secured client connects to secured server. Contributed by Kai Jiang. 2018-03-22 17:19:47 -04:00
James 69d55340f8 HDFS-11305: libhdfs++: Log Datanode information when reading an HDFS block. Contributed by Xiaowei Zhu. 2018-03-22 17:19:47 -04:00
James a30cf6a369 HDFS-10796: libhdfs++: Previous commit was missing test/hdfs_ioservice_test.cc, adding it. 2018-03-22 17:19:47 -04:00
James fbff671e0f HDFS-10796: libhdfs++: rationalize ioservice interactions. Contributed by James Clampffer. 2018-03-22 17:19:47 -04:00
James dd7837c429 HDFS-11106: libhdfs++: Some refactoring to better organize files. Contributed by James Clampffer. 2018-03-22 17:19:47 -04:00
James 2524afbc20 HDFS-11099: libhdfs++: Expose rack id in hdfsDNInfo. Contributed by Xiaowei Zhu. 2018-03-22 17:19:47 -04:00
James b7d9a0f827 HDFS-11027: libbhdfs++: Don't retry if there is an authentication failure. Contributed by Xiaowei Zhu. 2018-03-22 17:19:47 -04:00
James 59a3926946 HDFS-11014: libhdfs++: Make connection to HA clusters faster. Contributed by James Clampffer. 2018-03-22 17:19:47 -04:00
James 6dd47cae86 libhdfs++: Get rid of lock in RpcConnectionImpl destructor. Contributed by James Clampffer 2018-03-22 17:19:47 -04:00
James 7ebecaeede HDFS-10898: libhdfs++: Make log levels consistent. Contributed by James Clampffer 2018-03-22 17:19:47 -04:00
James 2a42eeb66f HDFS-10931: libhdfs++: Fix object lifecycle issues in the BlockReader (see follow up work in jira). Contributed by James Clampffer. 2018-03-22 17:19:47 -04:00
Bob Hansen 69cb05d292 HDFS-10595: libhdfs++: deconflate client name and client id 2018-03-22 17:19:47 -04:00
Bob Hansen d22e4b2eb7 HDFS-10450b: libhdfs++: Add Cyrus SASL support (engines). Contributed by Don Davis. 2018-03-22 17:19:47 -04:00
Bob Hansen 549a5dbce9 HDFS-10450: libhdfs++: Add Cyrus SASL support. Contributed by Don Davis. 2018-03-22 17:19:47 -04:00
James 9d1c902159 HDFS-10705: libhdfs++: FileSystem should have a convenience no-args ctor. Contributed by James Clampffer. 2018-03-22 17:19:47 -04:00
James 4f6cb5d1a1 HDFS-10754: libhdfs++: Create tools directory and implement hdfs_cat, hdfs_chgrp, hdfs_chown, hdfs_chmod and hdfs_find. Contributed by Anatoli Shein. 2018-03-22 17:19:47 -04:00
James 05ddb31081 HDFS-10761: libhdfs++: Fix broken logic in HA retry policy. Contributed by James Clampffer 2018-03-22 17:19:47 -04:00
James b9cf0e932d HDFS-10746: libhdfs++: synchronize access to working_directory and bytes_read_. Contributed by Anatoli Shein. 2018-03-22 17:19:47 -04:00
James cbb3e9fe58 HDFS-10740: libhdfs++: Implement recursive directory generator. Contributed by Anatoli Shein. 2018-03-22 17:19:47 -04:00
James 2a8edd4e52 HDFS-9271: libhdfs++: Implement basic NN operations. Contributed by Anatoli Shein. 2018-03-22 17:19:47 -04:00
James b1ed72e098 HDFS-10739: libhdfs++: In RpcEngine replace vector with deque for pending requests. Contributed by Anatoli Shein. 2018-03-22 17:19:47 -04:00
James 649aff11fe HDFS-10672: libhdfs++: reorder directories in src/main/libhdfspp/examples, and add C++ version of cat tool. Contributed by Anatoli Shein. 2018-03-22 17:19:47 -04:00
James 4cb0dad5e5 HDFS-10441: libhdfs++: HA namenode support. Contributed by James Clampffer. 2018-03-22 17:19:47 -04:00
James d75c835696 Revert HDFS-10543 patch due to correctness issues it caused. Done by James Clampffer 2018-03-22 17:19:47 -04:00
James a586ccbcfa HDFS-9890: libhdfs++: Add test suite to simulate network issues. Contributed by Xiaowei Zhu. 2018-03-22 17:19:47 -04:00
James a23e6b422b HDFS-10578. libhdfs++: Silence compile warnings from URI parser. Contributed by James Clampffer 2018-03-22 17:19:46 -04:00
James a0c7aee3b6 HDFS-10543: libhdfs++: hdfsRead stops at block boundary. Contributed by Xiaowei Zhu. 2018-03-22 17:19:46 -04:00
Bob Hansen d4c3cfbf47 HDFS-10524: libhdfs++: Implement chmod and chown. Contributed by Anatoli Shein. 2018-03-22 17:19:46 -04:00
Bob Hansen 88c5768f99 HDFS-10515: libhdfs++: Implement mkdirs, rmdir, rename, and remove 2018-03-22 17:19:46 -04:00
Bob Hansen 193314dc34 HDFS-10511: libhdfs++: make error returning mechanism consistent across all hdfs operations. Contributed by Anatoli Shein. 2018-03-22 17:19:46 -04:00
Bob Hansen 2616fe2025 HDFS-10526: libhdfs++: Add connect timeouts to async_connect calls. Contributed by Bob Hansen. 2018-03-22 17:19:46 -04:00
James de6fce7817 HDFS-10527: libhdfs++: hdfsGetBlockLocations doesn't null terminate ip address strings. Contributed by James Clampffer. 2018-03-22 17:19:46 -04:00
Bob Hansen 9ac66ccaa3 HDFS-10494: libhdfs++: Implement snapshot operations and GetFsStats. Contributed by Anatoli Shein. 2018-03-22 17:19:46 -04:00
James d64bbf983e Revert HDFS-9890. Needs some more work to reflect the current status of HDFS-8707. Done by James Clampffer 2018-03-22 17:19:46 -04:00
James 11b68ecebe HDFS-9890. libhdfs++: Add test suite to simulate network issues. Contributed by Xiaowei Zhu. 2018-03-22 17:19:46 -04:00
Bob Hansen 50aa4ea776 HDFS-10454: libhdfspp: Move NameNodeOp to a separate file. Contributed by Anatoli Shein. 2018-03-22 17:19:46 -04:00
Bob Hansen 0496bc5464 HDFS-10464: libhdfs++: Implement GetPathInfo and ListDirectory. Contributed by Anatoli Shein. 2018-03-22 17:19:46 -04:00
Bob Hansen 18f4d2f42e HDFS-10465: libhdfs++: Implement GetBlockLocations. Contributed by Bob Hansen 2018-03-22 17:19:46 -04:00
Bob Hansen f1f0b8f0f8 HDFS-10366: libhdfs++: Add SASL authentication. Contributed by Bob Hansen 2018-03-22 17:19:46 -04:00
James 93382381f6 HDFS-10188. libhdfs++: Implement debug allocators. Contributed by Xiaowei Zhu 2018-03-22 17:19:46 -04:00
James b9eeecc477 HDFS-10332. hdfs-native-client fails to build with CMake 2.8.11 or earlier. Contributed by Tibor Kiss 2018-03-22 17:19:46 -04:00
James cc51f2ce58 HDFS-10310. hdfsConnect hangs when given bad host or port. Contributed by James Clampffer. 2018-03-22 17:19:46 -04:00
James e542db66ee HDFS-10311: DatanodeConnection::Cancel should not delete the underlying socket. Contributed by James Clampffer 2018-03-22 17:19:46 -04:00
James 1cbfd6f962 libhdfs++: File length doesn't always count the last block if it's being written to. Contributed by Xiaowei Zhu. 2018-03-22 17:19:46 -04:00
James 60c3437267 HDFS-10247: libhdfs++: Datanode protocol version mismatch fix. Contributed by James Clampffer 2018-03-22 17:19:46 -04:00
Bob Hansen ed77d8d5df HDFS-10231: libhdfs++: Fix race conditions in RPC layer. Contributed by Bob Hansen. 2018-03-22 17:19:46 -04:00
James 015d93a715 HDFS-10222. libhdfs++: Shutdown sockets to avoid 'Connection reset by peer'. Contributed by James Clampffer 2018-03-22 17:19:46 -04:00
James 427edae365 HDFS-9616. libhdfs++: Add runtime hooks to allow a client application to add low level monitoring and tests. Contributed by Bob Hansen 2018-03-22 17:19:46 -04:00
James 0f1a278dd5 HDFS-9118: libhdfs++ Add logging system. Contributed by James Clampffer 2018-03-22 17:19:46 -04:00
Bob Hansen 8f4a66ab8f HDFS-9556: libhdfs++: pull Options from default configs by default. Contributed by Bob Hansen. 2018-03-22 17:19:46 -04:00
Bob Hansen f25bff50bf HDFS-9932: added uriparser2 library to HDFS-8707. Contributed by Bob Hansen. 2018-03-22 17:19:46 -04:00
Bob Hansen 69ee2e6a7e HDFS-9792: libhdfs++: EACCES not setting errno correctly. Contributed by Bob Hansen. 2018-03-22 17:19:46 -04:00
James 6a96f978eb HDFS-9699: libhdfs++: Add appropriate catch blocks for asio operations that throw. Contributed by Bob Hansen 2018-03-22 17:19:46 -04:00
Bob Hansen 1600e6bba8 HDFS-9791: libhdfs+_+: ConfigurationLoader throws parse_exception on invalid input. Contributed by Bob Hansen. 2018-03-22 17:19:46 -04:00
James 2cd7ab5e94 HDFS-9753. libhdfs++: Client fails to pass TokenProto from LocatedBlockProto to server when reading a block. Contributed by James Clampffer. 2018-03-22 17:19:46 -04:00
Bob Hansen 22ae319360 HDFS-9737: libhdfs++: Create examples of consuming libhdfs++ (pt 2). Contributed by Bob Hansen 2018-03-22 17:19:46 -04:00
Bob Hansen f591b95e08 HDFS-9749: libhdfs++: RPC engine will attempt to close an asio socket before it's been opened. Contributed by James Clampffer 2018-03-22 17:19:46 -04:00
Bob Hansen 288a9a9ee7 HDFS-9741: libhdfs++: GetLastError not returning meaningful messages after some failures. Contributed by Bob Hansen 2018-03-22 17:19:46 -04:00
Bob Hansen d807773752 HDFS-9738: libhdfs++: Implement simple authentication. Contributed by Bob Hansen 2018-03-22 17:19:46 -04:00
Bob Hansen 71b4f2ea25 HDFS-9737: libhdfs++: Create examples of consuming libhdfs++. Contributed by Bob Hansen 2018-03-22 17:19:46 -04:00
Bob Hansen 7e946c7e30 HDFS-9712. libhdfs++: Reimplement Status object as a normal struct 2018-03-22 17:19:46 -04:00
Bob Hansen ad23cf1490 HDFS-9679: Fix inconsistencies with libhdfs C API. Contributed by James Clampffer 2018-03-22 17:19:46 -04:00
James 166b3d49df HDFS-9643. libhdfs++: Support async cancellation of read operations. Contributed by James Clampffer. 2018-03-22 17:19:46 -04:00
James 5cd2a1766c HDFS-9687. libhdfs++: potential segfault after teardown. Contributed by Bob Hansen. 2018-03-22 17:19:46 -04:00
James 1017ccabeb HDFS-9628. libhdfs++: implement builder apis from C bindings. Contributed by Bob Hansen. 2018-03-22 17:19:46 -04:00
James dc335474a6 HDFS-9636. libhdfs++: for consistency, include files should be in hdfspp. Contributed by Bob Hansen. 2018-03-22 17:19:46 -04:00
James 11671c2bf6 HDFS-9627. libhdfs++: Add mechanism to retrieve human readable error messages through the C API. Contributed by James Clampffer. 2018-03-22 17:19:46 -04:00
James e376c022f4 HDFS-9609. libhdfs++: Allow seek to EOF. Contributed by Bob Hansen 2018-03-22 17:19:46 -04:00
James 7d8452040d HDFS-9325. libhdfs++ Allow the location of hadoop source tree resources to be passed to CMake during a build. Contributed by Bob Hansen. 2018-03-22 17:19:46 -04:00
James 5dc2da1e6f HDFS-9487. libhdfs++ Enable builds with no compiler optimizations. Contributed by Bob Hansen. 2018-03-22 17:19:46 -04:00
James e18db92398 HDFS-9523. libhdfs++: failure to connect to ipv6 host causes CI unit tests to fail. Contributed by Bob Hansen. 2018-03-22 17:19:46 -04:00
James 31d28e3105 HDFS-9524. libhdfs++ deadlocks in Filesystem::New if NN connection fails. Contributed by Bob Hansen. 2018-03-22 17:19:46 -04:00
James dba377bfcc HDFS-9448. Enable valgrind for libhdfspp unit tests. Contributed by Bob Hansen. 2018-03-22 17:19:46 -04:00
James 6c80d02a03 HDFS-9538. libhdfs: load configuration from files. Contributed by Bob Hansen. 2018-03-22 17:19:46 -04:00
James 567c3ed44f HDFS-9537. libhdfs++ implement HDFSConfiguration class. Contributed by Bob Hansen 2018-03-22 17:19:46 -04:00
James 6c33f89aea HDFS-9417. Clean up the RAT warnings in the HDFS-8707 branch. Contributed by Bob Hansen. 2018-03-22 17:19:46 -04:00
James 7cd98323ec HDFS-9489. Enable CI infrastructure to use libhdfs++ hdfsRead. Contributed by Stephen Walkauskas. 2018-03-22 17:19:46 -04:00
James d6a04cdbdd HDFS-9460. Suppress warnings from third-party libraries. Contributed by Bob Hansen. 2018-03-22 17:19:46 -04:00
James c59bd00a56 HDFS-9486. Fix valgrind failures when using more than 1 io_service worker thread. Contributed by James Clampffer. 2018-03-22 17:19:46 -04:00
James 58f2c7183e HDFS-9228. libhdfs++ should respect NN retry configuration settings. Contributed by Bob Hansen 2018-03-22 17:19:46 -04:00
James eb70a64362 HDFS-9504. Initialize BadNodeTracker in FileSystemImpl constructor. Contributed by James Clampffer. 2018-03-22 17:19:46 -04:00
James 8dac1094d8 HDFS-9497. move lib/proto/cpp_helpers to third-party since it won't have an ASF license. Contributed by Bob Hansen. 2018-03-22 17:19:46 -04:00
James d7ecf396c9 HDFS-9144. Refactoring libhdfs++ into stateful/ephemeral objects. Contributed by Bob Hansen. 2018-03-22 17:19:46 -04:00
James 5ba8e8ab7b Revert HDFS-9448. 2018-03-22 17:19:46 -04:00
James 9a0a34bbfa HDFS-9448. Enable valgrind for libhdfspp unit tests. Contributed by Bob Hansen. 2018-03-22 17:19:45 -04:00
James 584c2a204d HDFS-9452. libhdfs++ Fix memory stomp in OpenFileForRead. Contributed by James Clampffer 2018-03-22 17:19:45 -04:00
James 87362b1c17 HDFS-9117. Config file reader / options classes for libhdfs++. Contributed by Bob Hansen. 2018-03-22 17:19:45 -04:00
James a38703fdfc HDFS-9359. Test libhdfs++ with existing libhdfs tests. Contributed by Stephen Walkauskas. 2018-03-22 17:19:45 -04:00
James 64f0e78490 HDFS-9368. Implement reads with implicit offset state in libhdfs++. Contributed by James Clampffer. 2018-03-22 17:19:45 -04:00
Haohui Mai 6f44d92071 HDFS-9103. Retry reads on DN failure. Contributed by James Clampffer. 2018-03-22 17:19:45 -04:00
Haohui Mai 7dd29e548c HDFS-9408. Build both static and dynamic libraries for libhdfspp. Contributed by Stephen Walkauskas. 2018-03-22 17:19:45 -04:00
Haohui Mai af9bc25ac5 HDFS-9419. Import the optional library into libhdfs++. Contributed by Bob Hansen. 2018-03-22 17:19:45 -04:00
Haohui Mai a0b8f56317 HDFS-9328. Formalize coding standards for libhdfs++. Contributed by James Clampffer. 2018-03-22 17:19:45 -04:00
Haohui Mai a59714dcdb HDFS-9320. libhdfspp should use sizeof(int32_t) instead of sizeof(int) when parsing data. Contributed by James Clampffer. 2018-03-22 17:19:45 -04:00
Haohui Mai 5f1d0957b2 HDFS-9340. libhdfspp fails to compile after HDFS-9207. Contributed by Haohui Mai. 2018-03-22 17:19:45 -04:00
Haohui Mai dbd1d0c75b HDFS-8766. Implement a libhdfs(3) compatible API. Contributed by James Clampffer. 2018-03-22 17:19:45 -04:00
Haohui Mai 422a6e4ed5 HDFS-9288. Import RapidXML 1.13 for libhdfspp. Contributed by Bob Hansen. 2018-03-22 17:19:45 -04:00
Haohui Mai a14d1f741f HDFS-9265. InputStreamImpl should hold a shared_ptr of the BlockReader. Contributed by James Clampffer. 2018-03-22 17:19:45 -04:00
Haohui Mai 08794423e8 HDFS-9207. Move the implementation to the hdfs-native-client module. Contributed by Haohui Mai. 2018-03-22 17:19:45 -04:00
Haohui Mai 9e929a7a0d HDFS-9095. RPC client should fail gracefully when the connection is timed out or reset. Contributed by Haohui Mai. 2018-03-22 17:19:45 -04:00
Haohui Mai 06326b37c9 HDFS-9108. InputStreamImpl::ReadBlockContinuation stores wrong pointers of buffers. Contributed by Haohui Mai. 2018-03-22 17:19:45 -04:00
Haohui Mai 6294141aeb HDFS-9116. Suppress false positives from Valgrind on uninitialized variables in tests. Contributed by Haohui Mai. 2018-03-22 17:19:45 -04:00
Haohui Mai 9480c116ac HDFS-9093. Initialize protobuf fields in RemoteBlockReaderTest. Contributed by Haohui Mai. 2018-03-22 17:19:45 -04:00
Haohui Mai a559ef0243 HDFS-9025. Fix compilation issues on arch linux. Contributed by Owen O'Malley. 2018-03-22 17:19:45 -04:00
Haohui Mai bc47acc9d9 HDFS-8952. InputStream.PositionRead() should be aware of available DNs. Contributed by Haohui Mai. 2018-03-22 17:19:45 -04:00
Haohui Mai 1efb677976 HDFS-8774. Implement FileSystem and InputStream API for libhdfspp. Contributed by Haohui Mai. 2018-03-22 17:19:45 -04:00
Haohui Mai bccc640648 HDFS-8775. SASL support for data transfer protocol in libhdfspp. Contributed by Haohui Mai. 2018-03-22 17:19:45 -04:00
Haohui Mai 26d9f6cee3 HDFS-8788. Implement unit tests for remote block reader in libhdfspp. Contributed by Haohui Mai. 2018-03-22 17:19:45 -04:00
Haohui Mai 1bec75a13c HDFS-8764. Generate Hadoop RPC stubs from protobuf definitions. Contributed by Haohui Mai. 2018-03-22 17:19:45 -04:00
Haohui Mai 65b864f341 HDFS-8759. Implement remote block reader in libhdfspp. Contributed by Haohui Mai. 2018-03-22 17:19:45 -04:00
Haohui Mai a6b2fb64c4 HDFS-8758. Implement the continuation library in libhdfspp. Contributed by Haohui Mai. 2018-03-22 17:19:45 -04:00
Haohui Mai 63eee296c7 HDFS-8745. Use Doxygen to generate documents for libhdfspp. Contributed by Haohui Mai. 2018-03-22 17:19:45 -04:00
Haohui Mai 40a1f3631d HDFS-8737. Initial implementation of a Hadoop RPC v9 client. Contributed by Haohui Mai. 2018-03-22 17:19:45 -04:00
Haohui Mai 95b479b8c1 HDFS-8725. Use std::chrono to implement the timer in the asio library. Contributed by Haohui Mai. 2018-03-22 17:19:45 -04:00
Haohui Mai eb6c865516 HDFS-8724. Import third_party libraries into the repository. Contributed by Haohui Mai. 2018-03-22 17:19:45 -04:00
Haohui Mai d61e844c20 HDFS-8723. Integrate the build infrastructure with hdfs-client. Contributed by Haohui Mai. 2018-03-22 17:19:45 -04:00
Inigo Goiri e196d158a2 HDFS-12792. RBF: Test Router-based federation using HDFSContract. Contributed by Inigo Goiri. 2018-03-22 13:32:57 -07:00
Wei-Chiu Chuang f738d75a86 HDFS-11900. Hedged reads thread pool creation not synchronized. Contributed by John Zhuge. 2018-03-22 11:29:31 -07:00
Kihwal Lee 66461ed98b HDFS-13195. DataNode conf page cannot display the current value after reconfig. Contributed by maobaolong. 2018-03-22 12:21:10 -05:00
Inigo Goiri 3d0ee8b804 HDFS-13318. RBF: Fix FindBugs in hadoop-hdfs-rbf. Contributed by Ekanth S. 2018-03-22 09:21:52 -07:00
Konstantin V Shvachko 8d898ab25f HDFS-12884. BlockUnderConstructionFeature.truncateBlock should be of type BlockInfo. Contributed by chencan. 2018-03-21 16:46:03 -07:00
Xiaoyu Yao 389bc6d3da HDFS-11043. TestWebHdfsTimeouts fails. Contributed by Xiaoyu Yao and Chao Sun. 2018-03-21 13:53:35 -07:00
Yongjun Zhang 6c63cc7d30 HDFS-13315. Add a test for the issue reported in HDFS-11481 which is fixed by HDFS-10997. Contributed by Yongjun Zhang. 2018-03-20 23:04:05 -07:00
Yiqun Lin 2caba999bb HDFS-13250. RBF: Router to manage requests across multiple subclusters. Contributed by Inigo Goiri. 2018-03-21 11:32:05 +08:00
Yiqun Lin 69fe4407eb HDFS-13307. RBF: Improve the use of setQuota command. Contributed by liuhongtong. 2018-03-21 10:51:35 +08:00
weiy 6e2b5fa493 HDFS-13215. RBF: Move Router to its own module. Contributed by Wei Yan 2018-03-19 22:13:40 -07:00
Chris Douglas 3fc3fa9711 HADOOP-14667. Flexible Visual Studio support. Contributed by Allen Wittenauer 2018-03-19 16:05:55 -07:00
Inigo Goiri 08ff1586d5 HDFS-12886. Ignore minReplication for block recovery. Contributed by Lukas Majercak. 2018-03-16 10:29:19 -07:00
Xiaoyu Yao 78b05fde6c HDFS-13280. WebHDFS: Fix NPE in get snasphottable directory list call. Contributed by Lokesh Jain. 2018-03-15 11:02:27 -07:00
Inigo Goiri e71bc00a47 HDFS-13224. RBF: Resolvers to support mount points across multiple subclusters. Contributed by Inigo Goiri. 2018-03-15 10:32:30 -07:00
Xiaoyu Yao da777a5498 HDFS-13251. Avoid using hard coded datanode data dirs in unit tests(addendum). Contributed by Ajay Kumar. 2018-03-15 10:18:44 -07:00
Inigo Goiri 6de135169e HDFS-12723. TestReadStripedFileWithMissingBlocks#testReadFileWithMissingBlocks failing consistently. Contributed by Ajay Kumar. 2018-03-15 10:14:35 -07:00
fang zhenyi 5e013d50d1
HADOOP-15305. Replace FileUtils.writeStringToFile(File, String) with (File, String, Charset) to fix deprecation warnings.
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-03-15 16:12:07 +09:00
Xiao Chen 5ff22d4c3a HDFS-13246. FileInputStream redundant closes in readReplicasFromCache. Contributed by liaoyuxiangqin. 2018-03-14 21:59:51 -07:00
Yiqun Lin 3a0f4bc0d5 HDFS-13261. Fix incorrect null value check. Contributed by Jianfei Jiang. 2018-03-15 11:06:04 +08:00
Inigo Goiri 41fc7f80be HDFS-13198. RBF: RouterHeartbeatService throws out CachedStateStore related exceptions when starting router. Contributed by Wei Yan. 2018-03-14 13:14:36 -07:00
Xiaoyu Yao f83716b7f2 HDFS-13251. Avoid using hard coded datanode data dirs in unit tests. Contributed by Ajay Kumar. 2018-03-14 11:26:58 -07:00
Xiaoyu Yao 0be0f1ce1d HDFS-13275. Adding log for BlockPoolManager#refreshNamenodes failures. Contributed by Ajay Kumar. 2018-03-14 10:38:00 -07:00
Arpit Agarwal 4c57fb0cd9 HDFS-13257. Code cleanup: INode never throws QuotaExceededException. Contributed by Tsz Wo Nicholas Sze. 2018-03-14 09:42:48 -07:00
Xiaoyu Yao a34d83d2fd HDFS-13249. Document webhdfs support for getting snapshottable directory list. Contributed by Lokesh Jain. 2018-03-14 09:14:26 -07:00
Sammi Chen ad1b988a82 HDFS-11600. Refactor TestDFSStripedOutputStreamWithFailure test classes. Contributed by Sammi Chen. 2018-03-14 14:39:53 +08:00
Yiqun Lin 76be6cbf6c HDFS-12773. RBF: Improve State Store FS implementation. Contributed by Inigo Goiri. 2018-03-14 11:20:59 +08:00
Arpit Agarwal 9714fc1dd4 HDFS-336. dfsadmin -report should report number of blocks from datanode. Contributed by Bharat Viswanadham. 2018-03-13 16:39:17 -07:00
Arpit Agarwal 39537b7c84 HDFS-13235. DiskBalancer: Update Documentation to add newly added options. Contributed by Bharat Viswanadham. 2018-03-13 16:35:51 -07:00
Xiao Chen 8211a3d469 HDFS-12505. Extend TestFileStatusWithECPolicy with a random EC policy. Contributed by Takanobu Asanuma. 2018-03-13 10:48:45 -07:00
Xiao Chen f82d38dcb3 Revert "HDFS-12505. Extend TestFileStatusWithECPolicy with a random EC policy. Contributed by Takanobu Asanuma."
This reverts commit 84c1095586.
2018-03-13 10:36:16 -07:00
Xiao Chen 3b8dbc2cb7 HDFS-12587. Use Parameterized tests in TestBlockInfoStriped and TestLowRedundancyBlockQueues to test all EC policies. Contributed by Takanobu Asanuma. 2018-03-13 10:14:05 -07:00
Xiao Chen d6931c30c5 HDFS-13239. Fix non-empty dir warning message when setting default EC policy. Contributed by Bharat Viswanadham. 2018-03-13 10:07:26 -07:00
Xiao Chen 84c1095586 HDFS-12505. Extend TestFileStatusWithECPolicy with a random EC policy. Contributed by Takanobu Asanuma. 2018-03-13 09:58:03 -07:00
Chris Douglas b2b9ce5859 HDFS-13271. WebHDFS: Add constructor in SnapshottableDirectoryStatus with HdfsFileStatus as argument. Contributed by Lokesh Jain 2018-03-13 09:43:22 -07:00
Xiaoyu Yao 0355ec20eb HDFS-13141. WebHDFS: Add support for getting snasphottable directory list. Contributed by Lokesh Jain. 2018-03-12 20:41:37 -07:00
Chris Douglas 45d1b0fdcc HADOOP-14696. parallel tests don't work for Windows. Contributed by Allen Wittenauer 2018-03-12 20:05:39 -07:00
Yiqun Lin 19292bc264 HDFS-13226. RBF: Throw the exception if mount table entry validated failed. Contributed by maobaolong. 2018-03-13 11:03:31 +08:00
Yiqun Lin 7fab787de7 HDFS-13253. RBF: Quota management incorrect parent-child relationship judgement. Contributed by Yiqun Lin. 2018-03-13 10:30:20 +08:00
Akira Ajisaka 319defafc1
HDFS-12156. TestFSImage fails without -Pnative 2018-03-13 11:26:56 +09:00
Yiqun Lin 4afd50b106 HDFS-10803. TestBalancerWithMultipleNameNodes#testBalancing2OutOf3Blockpools fails intermittently due to no free space available. Contributed by Yiqun Lin. 2018-03-13 10:15:51 +08:00
Inigo Goiri 91c82c90f0 HDFS-13241. RBF: TestRouterSafemode failed if the port 8888 is in use. Contributed by maobaolong. 2018-03-12 17:28:15 -07:00
Chris Douglas 39a5fbae47 HDFS-12677. Extend TestReconstructStripedFile with a random EC policy. Contributed by Takanobu Asanuma 2018-03-12 14:29:44 -07:00
Chris Douglas ddb67ca707 HADOOP-14742. Document multi-URI replication Inode for ViewFS. Contributed by Gera Shegalov 2018-03-12 13:43:27 -07:00
Anu Engineer cceb68ffea HDFS-10618. TestPendingReconstruction#testPendingAndInvalidate is flaky due to race condition. Contributed by Eric Badger. 2018-03-12 12:07:22 -07:00
Inigo Goiri ac627f561f HDFS-11399. Many tests fails in Windows due to injecting disk failures. Contributed by Yiqun Lin. 2018-03-12 09:58:56 -07:00
Yiqun Lin 4743d4a2c7 HDFS-13240. RBF: Update some inaccurate document descriptions. Contributed by Yiqun Lin. 2018-03-10 11:28:55 +08:00
Inigo Goiri 8133cd5305 HDFS-13232. RBF: ConnectionPool should return first usable connection. Contributed by Ekanth S. 2018-03-09 18:25:05 -08:00
Inigo Goiri afe1a3ccd5 HDFS-13212. RBF: Fix router location cache issue. Contributed by Weiwei Wu. 2018-03-09 17:18:51 -08:00
Tsz-Wo Nicholas Sze ba0da2785d HDFS-13252. Code refactoring: Remove Diff.ListType. 2018-03-09 15:50:26 -08:00
Hanisha Koneru 4eeff62f69 HDFS-13244. Add stack, conf, metrics links to utilities dropdown in NN webUI. Contributed by Bharat Viswanadham. 2018-03-09 15:27:17 -08:00
Lokesh Jain 7b0dc31020
HDFS-13190. Document WebHDFS support for snapshot diff
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
Signed-off-by: Xiaoyu Yao <xyao@apache.org>
2018-03-09 15:06:15 -08:00
Hanisha Koneru 9a082fbe6e HDFS-11394. Support for getting erasure coding policy through WebHDFS#FileStatus. 2018-03-09 13:20:32 -08:00
Yiqun Lin 122805b43a HDFS-13233. RBF: MountTableResolver doesn't return the correct mount point of the given path. Contributed by wangzhiyuan. 2018-03-09 15:42:57 +08:00
Inigo Goiri 0c2b969e01 HDFS-13232. RBF: ConnectionManager's cleanup task will compare each pool's own active conns with its total conns. Contributed by Chao Sun. 2018-03-08 09:32:05 -08:00
Hanisha Koneru 19ae4429f9 HDFS-13225. StripeReader#checkMissingBlocks() 's IOException info is incomplete. Contributed by lufei. 2018-03-07 14:17:10 -08:00
Sean Mackrory 46d29e3d7e HDFS-13176. WebHdfs file path gets truncated when having semicolon (;) inside. Contributed by Zsolt Venczel. 2018-03-07 13:33:41 -07:00
Tsz-Wo Nicholas Sze 88fba00caa HDFS-13222. Update getBlocks method to take minBlockSize in RPC calls. Contributed by Bharat Viswanadham 2018-03-07 11:27:53 -08:00
Yiqun Lin 58ea2d7a65 HDFS-13214. RBF: Complete document of Router configuration. Contributed by Yiqun Lin. 2018-03-07 15:26:38 +08:00
Xiaoyu Yao edf9445708 HDFS-13109. Support fully qualified hdfs path in EZ commands. Contributed by Hanisha Koneru. 2018-03-06 16:44:20 -08:00
Tsz-Wo Nicholas Sze 346caa2095 HDFS-13227. Add a method to calculate cumulative diff over multiple snapshots in DirectoryDiffList. Contributed by Shashikant Banerjee 2018-03-06 13:35:03 -08:00
Tsz-Wo Nicholas Sze 871d0d39fa HDFS-13223. Reduce DiffListBySkipList memory usage. Contributed by Shashikant Banerjee 2018-03-06 12:23:03 -08:00
Xiao Chen 9276ef0665 HDFS-13170. Port webhdfs unmaskedpermission parameter to HTTPFS. Contributed by Stephen O'Donnell. 2018-03-06 09:57:35 -08:00
Inigo Goiri 7060725662 HDFS-13188. Disk Balancer: Support multiple block pools during block move. Contributed by Bharat Viswanadham. 2018-03-06 09:09:32 -08:00
Robert Kanter 21176a8ba7
HADOOP-15282. HADOOP-15235 broke TestHttpFSServerWebServer
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-03-04 07:33:47 -08:00
Arpit Agarwal a3c304c5dd HDFS-13178. Disk Balancer: Add a force option to DiskBalancer Execute command. Contributed by Bharat Viswanadham. 2018-03-03 15:42:16 -08:00
Tsz-Wo Nicholas Sze ba82e5c488 HDFS-13173. Replace ArrayList with DirectoryDiffList(SnapshotSkipList) to store DirectoryDiffs. Contributed by Shashikant Banerjee 2018-03-02 17:47:48 -08:00
Xiao Chen c75105f07b HDFS-13040. Kerberized inotify client fails despite kinit properly. Contributed by Istvan Fajth, Wei-Chiu Chuang, Xiao Chen. 2018-03-02 16:46:04 -08:00
Tsz-Wo Nicholas Sze 60080fbfcf HDFS-13171. Handle Deletion of nodes in SnasphotSkipList. Contributed by Shashikant Banerjee 2018-03-02 10:51:05 -08:00
Tsz-Wo Nicholas Sze 850b2f2567 HDFS-1686. Federation: Add more Balancer tests with federation setting. Contributed by Bharat Viswanadham 2018-03-02 10:42:39 -08:00
Yiqun Lin 55669515f6 HDFS-13210. Fix the typo in MiniDFSCluster class. Contributed by fang zhenyi. 2018-03-02 11:49:12 +08:00
Tsz-Wo Nicholas Sze 96e8f260ab HDFS-13211. Fix a bug in DirectoryDiffList.getMinListForRange. Contributed by Shashikant Banerjee 2018-03-01 14:12:15 -08:00
Yiqun Lin ececeea8f2 HDFS-13202. Fix the outdated javadocs in HAUtil. Contributed by Chao Sun. 2018-03-01 17:51:43 +08:00
Tsz-Wo Nicholas Sze 81d9446a92 HDFS-13102. Implement SnapshotSkipList class to store Multi level DirectoryDiffs. Contributed by Shashikant Banerjee 2018-02-28 13:42:58 -08:00
Xiaoyu Yao f20e10b2dd HDFS-13081. Datanode#checkSecureConfig should allow SASL and privileged HTTP. Contributed by Ajay Kumar. 2018-02-28 09:44:39 -08:00
Xiaoyu Yao 2574375bf5 HDFS-13114. CryptoAdmin#ReencryptZoneCommand should resolve Namespace info from path. Contributed by Hanisha Koneru. 2018-02-28 08:37:01 -08:00
Yiqun Lin a9c14b1119 HDFS-13194. CachePool permissions incorrectly checked. Contributed by Jianfei Jiang. 2018-02-28 10:17:43 +08:00
Inigo Goiri d86f301d46 HDFS-13199. RBF: Fix the hdfs router page missing label icon issue. Contributed by maobaolong. 2018-02-27 17:39:02 -08:00
Tsz-Wo Nicholas Sze 55c77bf722 HDFS-13143. SnapshotDiff - snapshotDiffReport might be inconsistent if the snapshotDiff calculation happens between a snapshot and the current tree. Contributed by Shashikant Banerjee 2018-02-27 15:28:41 -08:00
Arpit Agarwal 1cc9a58dda HDFS-13181. DiskBalancer: Add an configuration for valid plan hours . Contributed by Bharat Viswanadham. 2018-02-27 10:18:07 -08:00
Inigo Goiri cd4a97bf80 HDFS-13192. Change the code order in getFileEncryptionInfo to avoid unnecessary call of assignment. Contributed by LiXin Ge. 2018-02-27 08:53:00 -08:00
Inigo Goiri 225d877092 HDFS-13193. Various Improvements for BlockTokenSecretManager. Contributed by BELUGA BEHR. 2018-02-27 08:48:03 -08:00
Yiqun Lin 1e85a995d1 HDFS-13184. RBF: Improve the unit test TestRouterRPCClientRetries. Contributed by Yiqun Lin. 2018-02-27 10:48:52 +08:00
Chao Sun ae290a4bb4 HDFS-13145. SBN crash when transition to ANN with in-progress edit tailing enabled. Contributed by Chao Sun. 2018-02-26 16:15:00 -08:00
Wei Yan 6ce9f79cc9 HDFS-13187. RBF: Fix Routers information shown in the web UI. Contributed by Inigo Goiri and Wei Yan. 2018-02-26 15:13:41 -08:00
Arpit Agarwal 46c93453e9 HDFS-12781. After Datanode down, In Namenode UI Datanode tab is throwing warning message.. Contributed by Brahma Reddy Battula. 2018-02-26 13:56:34 -08:00
Kihwal Lee 451265a83d HDFS-12070. Failed block recovery leaves files open indefinitely and at risk for data loss. Contributed by Kihwal Lee. 2018-02-26 10:28:04 -06:00
Arpit Agarwal 2fa7963c3d HADOOP-15254. Correct the wrong word spelling 'intialize'. Contributed by fang zhenyi. 2018-02-24 14:41:55 -08:00
Arpit Agarwal c30a26abc5 HDFS-12865. RequestHedgingProxyProvider should handle case when none of the proxies are available. Contributed by Mukul Kumar Singh. 2018-02-24 14:25:56 -08:00
Xiaoyu Yao 1e84e46f16 HDFS-13052. WebHDFS: Add support for snasphot diff. Contributed by Lokesh Jain. 2018-02-23 19:35:12 -08:00
Xiao Chen 51088d3233 HDFS-13164. File not closed if streamer fail with DSQuotaExceededException. 2018-02-23 13:49:09 -08:00
Gabor Bota c36b4aa31c
HADOOP-15236. Fix typo in RequestHedgingProxyProvider and RequestHedgingRMFailoverProxyProvider
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-02-23 13:55:18 +09:00
Xiaoyu Yao 84a1321f6a HDFS-13136. Avoid taking FSN lock while doing group member lookup for FSD permission check. Contributed by Xiaoyu Yao. 2018-02-22 11:32:32 -08:00
Anu Engineer 121e1e1280 HDFS-13175. Add more information for checking argument in DiskBalancerVolume.
Contributed by  Lei (Eddy) Xu.
2018-02-20 19:16:30 -08:00
Inigo Goiri 6f81cc0bee HDFS-13167. DatanodeAdminManager Improvements. Contributed by BELUGA BEHR. 2018-02-20 15:18:27 -08:00
Inigo Goiri 17c592e6cf HDFS-13168. XmlImageVisitor - Prefer Array over LinkedList. Contributed by BELUGA BEHR. 2018-02-20 15:16:01 -08:00
Arpit Agarwal 9028ccaf83 HDFS-13159. TestTruncateQuotaUpdate fails in trunk. Contributed by Nanda kumar. 2018-02-20 11:40:20 -08:00
Yiqun Lin 8896d20b91 HDFS-13119. RBF: Manage unavailable clusters. Contributed by Yiqun Lin. 2018-02-20 09:37:08 +08:00
Tsz-Wo Nicholas Sze 83e2bb98ee HDFS-12998. SnapshotDiff - Provide an iterator-based listing API for calculating snapshotDiff. Contributed by Shashikant Banerjee 2018-02-19 11:42:10 +08:00
fang zhenyi 4d4dde5112
HADOOP-15223. Replace Collections.EMPTY* with empty* when available
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-02-18 22:19:39 +09:00
Chen Liang c008d10a11 HDFS-13161. Update comment in start-dfs.sh to mention correct variable for secure datanode user. Contributed by Ajay Kumar. 2018-02-16 16:04:50 -08:00
Arpit Agarwal 4c2119f04e HDFS-13058. Fix dfs.namenode.shared.edits.dir in TestJournalNode. Contributed by Bharat Viswanadham. 2018-02-16 10:29:22 -08:00
Arpit Agarwal 8d5ea7470a HDFS-13153. Enable HDFS diskbalancer by default. Contributed by Ajay Kumar. 2018-02-16 09:38:34 -08:00
Bharat Viswanadham a1e05e0292
HDFS-13151. Fix the javadoc error in ReplicaInfo
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-02-16 16:22:24 +09:00
Kihwal Lee 47473952e5 HDFS-13112. Token expiration edits may cause log corruption or deadlock. Contributed by Daryn Sharp. 2018-02-15 15:32:42 -06:00
Kihwal Lee da59acd8ca xattr api cleanup 2018-02-15 11:11:55 -06:00
Tsz-Wo Nicholas Sze 6ea7d78ccb HDFS-13142. Define and Implement a DiifList Interface to store and manage SnapshotDiffs. Contributed by Shashikant Banerjee 2018-02-15 19:33:44 +08:00
Steve Loughran f20dc0d577 HADOOP-10571. Use Log.*(Object, Throwable) overload to log exceptions.
Contributed by Andras Bokor.
2018-02-14 16:20:14 +00:00
Brahma Reddy Battula 35c17351ca HDFS-8693. Addendum patch to execute the command using UGI. Contributed by Brahma Reddy Battula. 2018-02-12 22:14:34 +05:30
Arpit Agarwal 96bb6a51ec HDFS-10453. ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.. Contributed by He Xiaoqiao. 2018-02-12 07:17:40 -08:00
Yiqun Lin 25fbec67d1 HDFS-13130. Log object instance get incorrectly in SlowDiskTracker. Contributed by Jianfei Jiang. 2018-02-11 12:02:10 +08:00
Wangda Tan 60f9e60b3b Preparing for 3.2.0 development
Change-Id: I6d0e01f3d665d26573ef2b957add1cf0cddf7938
2018-02-11 11:17:38 +08:00
Yiqun Lin 543f3abbee HDFS-13099. RBF: Use the ZooKeeper as the default State Store. Contributed by Yiqun Lin. 2018-02-09 13:57:42 +08:00
Steve Loughran 996796f104 HADOOP-15214. Make Hadoop compatible with Guava 21.0.
Contributed by Igor Dvorzhak
2018-02-08 10:55:54 -08:00
Xiaoyu Yao 8faf0b50d4 HDFS-13120. Snapshot diff could be corrupted after concat. Contributed by Xiaoyu Yao. 2018-02-08 08:59:48 -08:00
Yongjun Zhang f491f717e9 HDFS-13115. In getNumUnderConstructionBlocks(), ignore the inodeIds for which the inodes have been deleted. Contributed by Yongjun Zhang. 2018-02-07 12:58:09 -08:00
Jitendra Pandey b061215ecf HDFS-11701. NPE from Unresolved Host causes permanent DFSInputStream failures. Contributed by Lokesh Jain. 2018-02-07 11:22:36 -08:00
Brahma Reddy Battula 01bd6ab18f HDFS-12935. Get ambiguous result for DFSAdmin command in HA mode when only one namenode is up. Contributed by Jianfei Jiang. 2018-02-07 23:10:33 +05:30
Xiao Chen e5c2fdddd6 HDFS-12933. Improve logging when DFSStripedOutputStream failed to write some blocks. Contributed by chencan. 2018-02-06 22:54:53 -08:00
Tsz-Wo Nicholas Sze 4fadcf1631 HDFS-13107. Add Mover Cli Unit Tests for Federated cluster. Contributed by Bharat Viswanadham 2018-02-06 16:59:26 -08:00
Sean Mackrory b14db95c35 HDFS-13106. Need to exercise all HDFS APIs for EC. Contributed by Haibo Yan. 2018-02-06 16:39:00 -07:00
Tsz-Wo Nicholas Sze 4d1bf33d0f HDFS-12947. Limit the number of Snapshots allowed to be created for a Snapshottable Directory. Contributed by Shashikant Banerjee 2018-02-06 14:46:44 -08:00
Anu Engineer 4304fcd5bd HDFS-12990. Change default NameNode RPC port back to 8020. Contributed by Xiao Chen. 2018-02-06 13:43:45 -08:00
Yongjun Zhang 4e9a59ce16 HDFS-13100. Handle IllegalArgumentException when GETSERVERDEFAULTS is not implemented in webhdfs. Contributed by Aaron T. Myers and Yongjun Zhang. 2018-02-02 22:58:44 -08:00
Wei-Chiu Chuang 2021f4bdce HDFS-11187. Optimize disk access for last partial chunk checksum of Finalized replica. Contributed by Wei-Chiu Chuang. 2018-02-02 17:18:42 -08:00
Hanisha Koneru 0ef639235b HDFS-13073. Cleanup code in InterQJournalProtocol.proto. Contributed by Bharat Viswanadham. 2018-02-02 16:28:03 -08:00