Commit Graph

5825 Commits

Author SHA1 Message Date
Uma Maheswara Rao G 01643020d2 HDFS-10555: Unable to loadFSEdits due to a failure in readCachePoolInfo. Contributed by Uma Maheswara Rao G 2016-06-22 22:06:13 -07:00
Uma Maheswara Rao G 17eae9ebb3 HDFS-10473: Allow only suitable storage policies to be set on striped files. Contributed by Uma Maheswara Rao G 2016-06-22 11:17:43 -07:00
Akira Ajisaka d433b16ce6 HDFS-7597. DelegationTokenIdentifier should cache the TokenIdentifier to UGI mapping. Contributed by Daryn Sharp, Bob Hansen, and Xiao Chen. 2016-06-22 11:00:16 +09:00
Brahma Reddy Battula f2ac132d6a HDFS-9530. ReservedSpace is not cleared for abandoned Blocks (Contributed by Brahma Reddy Battula) 2016-06-21 15:42:28 +05:30
Colin Patrick Mccabe 46f1602e89 HDFS-10448. CacheManager#addInternal tracks bytesNeeded incorrectly when dealing with replication factors other than 1 (Yiqun Lin via cmccabe) 2016-06-20 18:25:09 -07:00
Jitendra Pandey 7adc4d1769 HDFS-10538. Remove AsyncDistributedFileSystem. Contributed by Xiaobing Zhou and Jitendra Pandey. 2016-06-20 17:22:55 -07:00
Colin Patrick Mccabe 5f6b4157a4 HDFS-10328. Add per-cache-pool default replication num configuration (xupeng via cmccabe) 2016-06-20 10:42:50 -07:00
Arpit Agarwal 0319d73c3b HDFS-10437. ReconfigurationProtocol not covered by HDFSPolicyProvider. (Arpit Agarwal) 2016-06-18 16:16:54 -07:00
Kihwal Lee 280069510b HDFS-10493. Add links to datanode web UI in namenode datanodes page. Contributed by Weiwei Yang. 2016-06-17 11:05:44 -05:00
Akira Ajisaka 09e82acaf9 HADOOP-12943. Add -w -r options in dfs -test command. Contributed by Weiwei Yang. 2016-06-17 16:20:38 +09:00
Anu Engineer b5f772abda Merge branch 'trunk' into HDFS-7240 2016-06-16 11:29:40 -07:00
Arpit Agarwal e983eafb44 HDFS-10532. Typo in RollingUpgrade docs. (Contributed by Yiqun Lin) 2016-06-16 10:10:33 -07:00
Vinayakumar B cc6c265171 HDFS-10256. Use GenericTestUtils.getTestDir method in tests for temporary directories (Contributed by Vinayakumar B) 2016-06-16 16:47:06 +05:30
Colin Patrick Mccabe 2ca73445f5 HDFS-10525. Fix NPE in CacheReplicationMonitor#rescanCachedBlockMap (Xiao Chen via cmccabe) 2016-06-15 22:47:01 -07:00
Colin Patrick Mccabe 2449db507d HDFS-10505. OIV's ReverseXML processor should support ACLs (Surendra Singh Lilhore via cmccabe) 2016-06-15 22:35:19 -07:00
Ming Ma b48f27e794 HDFS-9922. Upgrade Domain placement policy status marks a good block in violation when there are decommissioned nodes. (Chris Trezzo via mingma) 2016-06-15 22:00:52 -07:00
Ming Ma 7d521a29ee HDFS-9016. Display upgrade domain information in fsck. (mingma) 2016-06-14 20:05:50 -07:00
Andrew Wang 709a814fe0 HDFS-10516. Fix bug when warming up EDEK cache of more than one encryption zone. Contributed by Xiao Chen. 2016-06-13 11:50:19 -07:00
Allen Wittenauer d44f4745b4 HDFS-7987. Allow files / directories to be moved (Ravi Prakash via aw) 2016-06-10 09:02:28 -07:00
Anu Engineer 23923086d1 Merge branch 'trunk' into HDFS-7240 2016-06-09 20:34:39 -07:00
Ravi Prakash ae047655f4 HDFS-10220. A large number of expired leases can make namenode unresponsive and cause failover (Nicolas Fraison via raviprak) 2016-06-08 13:44:22 -07:00
Andrew Wang 1ee9ea0026 Remove redundant TestMiniDFSCluster.testDualClusters. Contributed by Jiayi Zhou. 2016-06-08 12:58:56 -07:00
Jing Zhao be34e85e68 HDFS-10468. HDFS read ends up ignoring an interrupt. Contributed by Jing Zhao 2016-06-07 10:48:21 -07:00
Akira Ajisaka e620530301 HDFS-10485. Fix findbugs warning in FSEditLog.java. (aajisaka) 2016-06-07 17:52:55 +09:00
Zhe Zhang 6de9213df1 HDFS-10458. getFileEncryptionInfo should return quickly for non-encrypted cluster. 2016-06-06 15:52:39 -07:00
Tsz-Wo Nicholas Sze 35f255b03b Revert "Revert "HADOOP-13226 Support async call retry and failover.""
This reverts commit 5360da8bd9.
2016-06-06 16:31:43 +08:00
Tsz-Wo Nicholas Sze 7e7b1ae037 Revert "Revert "HDFS-10430. Reuse FileSystem#access in TestAsyncDFS. Contributed by Xiaobing Zhou.""
This reverts commit 8cf47d8589.
2016-06-06 16:31:38 +08:00
Tsz-Wo Nicholas Sze db41e6d285 Revert "Revert "HDFS-10431 Refactor and speedup TestAsyncDFSRename. Contributed by Xiaobing Zhou""
This reverts commit 5ee5912ebd.
2016-06-06 16:31:34 +08:00
Tsz-Wo Nicholas Sze b3d81f38da Revert "Revert "HDFS-10390. Implement asynchronous setAcl/getAclStatus for DistributedFileSystem. Contributed by Xiaobing Zhou""
This reverts commit b82c74b910.
2016-06-06 16:31:30 +08:00
Tsz-Wo Nicholas Sze cba9a01889 Revert "Revert "HDFS-10346. Implement asynchronous setPermission/setOwner for DistributedFileSystem. Contributed by Xiaobing Zhou""
This reverts commit f23d5dfc60.
2016-06-06 16:29:38 +08:00
Tsz-Wo Nicholas Sze aa20fa150d Revert "Revert "HADOOP-12957. Limit the number of outstanding async calls. Contributed by Xiaobing Zhou""
This reverts commit 4d36b221a2.
2016-06-06 16:28:47 +08:00
Tsz-Wo Nicholas Sze eded3d109e Revert "Revert "HDFS-10224. Implement asynchronous rename for DistributedFileSystem. Contributed by Xiaobing Zhou""
This reverts commit 106234d873.
2016-06-06 16:28:21 +08:00
Andrew Wang 106234d873 Revert "HDFS-10224. Implement asynchronous rename for DistributedFileSystem. Contributed by Xiaobing Zhou"
This reverts commit fc94810d3f.
2016-06-03 18:09:55 -07:00
Andrew Wang 4d36b221a2 Revert "HADOOP-12957. Limit the number of outstanding async calls. Contributed by Xiaobing Zhou"
This reverts commit 1b9f18623a.
2016-06-03 18:09:18 -07:00
Andrew Wang f23d5dfc60 Revert "HDFS-10346. Implement asynchronous setPermission/setOwner for DistributedFileSystem. Contributed by Xiaobing Zhou"
This reverts commit 7251bb922b.
2016-06-03 18:09:17 -07:00
Andrew Wang b82c74b910 Revert "HDFS-10390. Implement asynchronous setAcl/getAclStatus for DistributedFileSystem. Contributed by Xiaobing Zhou"
This reverts commit 02d4e478a3.
2016-06-03 18:09:14 -07:00
Andrew Wang 5ee5912ebd Revert "HDFS-10431 Refactor and speedup TestAsyncDFSRename. Contributed by Xiaobing Zhou"
This reverts commit f4b9bcd87c.
2016-06-03 18:09:13 -07:00
Andrew Wang 8cf47d8589 Revert "HDFS-10430. Reuse FileSystem#access in TestAsyncDFS. Contributed by Xiaobing Zhou."
This reverts commit 21890c4239.
2016-06-03 18:09:12 -07:00
Andrew Wang 5360da8bd9 Revert "HADOOP-13226 Support async call retry and failover."
This reverts commit 83f2f78c11.
2016-06-03 18:09:09 -07:00
Allen Wittenauer 99a771cd7a HDFS-7767. Use the noredirect flag in WebHDFS to allow web browsers to upload files via the NN UI (Ravi Prakash via aw) 2016-06-03 17:07:39 -07:00
Allen Wittenauer 15f018434c HDFS-9877. HDFS Namenode UI: Fix browsing directories that need to be encoded (Ravi Prakash via aw) 2016-06-03 17:06:29 -07:00
Arpit Agarwal 97e2449477 HDFS-10341. Add a metric to expose the timeout number of pending replication blocks. (Contributed by Akira Ajisaka) 2016-06-02 13:14:45 -07:00
Akira Ajisaka 1df6f5735c HDFS-10471. DFSAdmin#SetQuotaCommand's help msg is not correct. Contributed by Yiqun Lin. 2016-06-03 04:10:32 +09:00
Masatake Iwasaki aadb77e412 HDFS-10367. TestDFSShell.testMoveWithTargetPortEmpty fails with Address bind exception. Contributed by Brahma Reddy Battula. 2016-06-02 20:55:04 +09:00
Akira Ajisaka 69555fca06 HDFS-9476. TestDFSUpgradeFromImage#testUpgradeFromRel1BBWImage occasionally fail. Contributed by Masatake Iwasaki. 2016-06-02 18:52:47 +09:00
Kai Zheng d749cf65e1 HDFS-9833. Erasure coding: recomputing block checksum on the fly by reconstructing the missed/corrupt block data. Contributed by Rakesh R. 2016-06-02 12:56:21 +08:00
Colin Patrick Mccabe 8ceb06e239 HADOOP-13137. TraceAdmin should support Kerberized cluster (Wei-Chiu Chuang via cmccabe) 2016-05-31 17:54:34 -07:00
Colin Patrick Mccabe c7921c9bdd HDFS-9466. TestShortCircuitCache#testDataXceiverCleansUpSlotsOnFailure is flaky (Wei-Chiu Chuang via cmccabe) 2016-05-31 17:37:52 -07:00
Colin Patrick Mccabe 29d6cadc52 HDFS-10415. TestDistributedFileSystem#MyDistributedFileSystem attempts to set up statistics before initialize() is called (Mingliang Liu via cmccabe) 2016-05-31 16:54:52 -07:00
Tsz-Wo Nicholas Sze 83f2f78c11 HADOOP-13226 Support async call retry and failover. 2016-05-31 16:30:11 -07:00
Kai Zheng 93d8a7f2a2 Revert "HADOOP-12579. Deprecate and remove WriteableRPCEngine. Contributed by Kai Zheng"
This reverts commit a6c79f92d5.
2016-06-01 08:41:15 +08:00
Chris Nauroth 21890c4239 HDFS-10430. Reuse FileSystem#access in TestAsyncDFS. Contributed by Xiaobing Zhou. 2016-05-27 14:20:18 -07:00
Yongjun Zhang 5ea6fd85c7 HDFS-10276. HDFS should not expose path info that user has no permission to see. (Yuanbo Liu via Yongjun Zhang) 2016-05-27 10:02:02 -07:00
Kai Zheng 916140604f HADOOP-12911. Upgrade Hadoop MiniKDC with Kerby. Contributed by Jiajia Li 2016-05-28 14:23:39 +08:00
Zhe Zhang 8c84a2a93c HDFS-10236. Erasure Coding: Rename replication-based names in BlockManager to more generic [part-3]. Contributed by Rakesh R. 2016-05-26 16:50:55 -07:00
Karthik Kambatla 55c3e2de3d HDFS-10463. TestRollingFileSystemSinkWithHdfs needs some cleanup. (Daniel Templeton via kasha) 2016-05-26 14:24:31 -07:00
Tsz-Wo Nicholas Sze f4b9bcd87c HDFS-10431 Refactor and speedup TestAsyncDFSRename. Contributed by Xiaobing Zhou 2016-05-26 12:15:17 -07:00
Kai Zheng 77202fa103 HADOOP-13010. Refactor raw erasure coders. Contributed by Kai Zheng 2016-05-27 13:23:34 +08:00
Kai Zheng f69f5ab3b6 HDFS-10434. Fix intermittent test failure of TestDataNodeErasureCodingMetrics. Contributed by Rakesh R 2016-05-27 04:42:53 +08:00
Kai Zheng a6c79f92d5 HADOOP-12579. Deprecate and remove WriteableRPCEngine. Contributed by Kai Zheng 2016-05-27 04:29:42 +08:00
Vinayakumar B 2dab64da2f HDFS-10217. show 'blockScheduled' tooltip in datanodes table. 2016-05-25 12:34:52 +05:30
Tsz-Wo Nicholas Sze 02d4e478a3 HDFS-10390. Implement asynchronous setAcl/getAclStatus for DistributedFileSystem. Contributed by Xiaobing Zhou 2016-05-24 14:51:27 -07:00
Tsz-Wo Nicholas Sze 15ed080e36 HDFS-9365. Balaner does not work with the HDFS-6376 HA setup. 2016-05-24 12:49:48 -07:00
Karthik Kambatla 57c31a3fef HDFS-9782. RollingFileSystemSink should have configurable roll interval. (Daniel Templeton via kasha) 2016-05-24 10:37:00 -07:00
Allen Wittenauer 4b0f55b6ea HDFS-7766. Add a flag to WebHDFS op=CREATE to not respond with a 307 redirect (Ravi Prakash via aw) 2016-05-23 15:52:01 -07:00
Masatake Iwasaki 12eb5a7b11 HDFS-10439. Update setOwner doc in HdfsPermissionsGuide. Contributed by John Zhuge. 2016-05-22 16:53:30 +09:00
Arpit Agarwal 54f7975dfc HDFS-10420. Fix Ozone unit tests to use MiniOzoneCluster. Contributed by Arpit Agarwal. 2016-05-20 15:19:09 -07:00
Chris Nauroth 500e946729 HDFS-10438. When NameNode HA is configured to use the lifeline RPC server, it should log the address of that server. Contributed by Chris Nauroth. 2016-05-20 13:01:43 -07:00
Chris Nauroth bcde1562d2 HDFS-10424. DatanodeLifelineProtocol not able to use under security cluster. Contributed by Chris Nauroth. 2016-05-20 12:47:41 -07:00
Kihwal Lee 204de430bf HDFS-10417. Improve error message from checkBlockLocalPathAccess. Contributed by Tianyin Xu. 2016-05-19 15:52:32 -05:00
Arpit Agarwal 76279f5877 Merge branch 'trunk' into HDFS-7240 2016-05-19 12:44:16 -07:00
Anu Engineer 4770ae7e33 HDFS-10363. Ozone: Introduce new config keys for SCM service endpoints. Contributed by Arpit Agarwal. 2016-05-19 11:02:40 -07:00
Andrew Wang 010e6ac328 HDFS-2173. saveNamespace should not throw IOE when only one storage directory fails to write VERSION file. Contributed by Andras Bokor. 2016-05-18 14:13:41 -07:00
Lei Xu cf552aa87b HDFS-10360. DataNode may format directory and lose blocks if current/VERSION is missing. (Wei-Chiu Chuang via lei) 2016-05-18 09:38:37 -07:00
Arpit Agarwal f4d8fde822 HDFS-9926. MiniDFSCluster leaks dependency Mockito via DataNodeTestUtils. (Contributed by Josh Elser) 2016-05-18 09:20:57 -07:00
Xiaoyu Yao dd99f5fc79 HDFS-10383. Safely close resources in DFSTestUtil. Contributed by Mingliang Liu. 2016-05-17 16:12:00 -07:00
Junping Du f6ef876fe1 MAPREDUCE-6657. Job history server can fail on startup when NameNode is in start phase. Contributed by Haibo Chen. 2016-05-17 14:41:47 -07:00
Yongjun Zhang e24fe2641b HDFS-9732, Improve DelegationTokenIdentifier.toString() for better logging. Contributed by Yongjun Zhang. 2016-05-17 14:03:08 -07:00
Kihwal Lee 1356cbe994 Revert "HDFS-10417. Improve error message from checkBlockLocalPathAccess. Contributed by Tianyin Xu."
This reverts commit 0942954e8a.
2016-05-17 15:20:03 -05:00
Kihwal Lee 0942954e8a HDFS-10417. Improve error message from checkBlockLocalPathAccess. Contributed by Tianyin Xu. 2016-05-17 15:06:25 -05:00
Colin Patrick Mccabe 7cd5ae62f6 HDFS-10404. Fix formatting of CacheAdmin command usage help text (Yiqun Lin via cmccabe) 2016-05-17 11:10:48 -07:00
Kihwal Lee 4a5819dae2 HDFS-10303. DataStreamer#ResponseProcessor calculates packet ack latency incorrectly. Contributed by Surendra Singh Lilhore. 2016-05-17 08:53:31 -05:00
Akira Ajisaka 9fe5828f05 HDFS-10242. Cannot create space quota of zero. Contributed by Takashi Ohnishi. 2016-05-17 15:53:09 +09:00
Sangjin Lee 61f46be071 HDFS-10208. Addendum for HDFS-9579: to handle the case when client machine can't resolve network path (Ming Ma via sjlee) 2016-05-16 18:49:47 -07:00
Allen Wittenauer 730bc746f9 HADOOP-12930. Dynamic subcommands for hadoop shell scripts (aw)
This commit contains the following JIRA issues:

    HADOOP-12931. bin/hadoop work for dynamic subcommands
    HADOOP-12932. bin/yarn work for dynamic subcommands
    HADOOP-12933. bin/hdfs work for dynamic subcommands
    HADOOP-12934. bin/mapred work for dynamic subcommands
    HADOOP-12935. API documentation for dynamic subcommands
    HADOOP-12936. modify hadoop-tools to take advantage of dynamic subcommands
    HADOOP-13086. enable daemonization of dynamic commands
    HADOOP-13087. env var doc update for dynamic commands
    HADOOP-13088. fix shellprofiles in hadoop-tools to allow replacement
    HADOOP-13089. hadoop distcp adds client opts twice when dynamic
    HADOOP-13094. hadoop-common unit tests for dynamic commands
    HADOOP-13095. hadoop-hdfs unit tests for dynamic commands
    HADOOP-13107. clean up how rumen is executed
    HADOOP-13108. dynamic subcommands need a way to manipulate arguments
    HADOOP-13110. add a streaming subcommand to mapred
    HADOOP-13111. convert hadoop gridmix to be dynamic
    HADOOP-13115. dynamic subcommand docs should talk about exit vs. continue program flow
    HADOOP-13117. clarify daemonization and security vars for dynamic commands
    HADOOP-13120. add a --debug message when dynamic commands have been used
    HADOOP-13121. rename sub-project shellprofiles to match the rest of Hadoop
    HADOOP-13129. fix typo in dynamic subcommand docs
    HADOOP-13151. Underscores should be escaped in dynamic subcommands document
    HADOOP-13153. fix typo in debug statement for dynamic subcommands
2016-05-16 17:54:45 -07:00
Lei Xu 6a6e74acf5 HDFS-10410. RedundantEditLogInputStream.LOG is set to wrong class. (John Zhuge via lei) 2016-05-16 17:05:46 -07:00
Kai Zheng ad9441122f HDFS-8449. Add tasks count metrics to datanode for ECWorker. Contributed by Bo Li. 2016-05-15 23:39:09 -07:00
Andrew Wang 45788204ae HDFS-10333. Intermittent org.apache.hadoop.hdfs.TestFileAppend failure in trunk. Contributed by Yiqun Lin. 2016-05-15 22:15:05 -07:00
Andrew Wang 3c5c57af28 HADOOP-13142. Change project version from 3.0.0 to 3.0.0-alpha1. 2016-05-12 18:27:28 -07:00
Lei Xu a2774debf7 HDFS-9389. Add maintenance states to AdminStates. (Ming Ma via lei) 2016-05-12 15:42:54 -07:00
Andrew Wang ca5613af91 Revert "Update project version to 3.0.0-alpha1-SNAPSHOT."
This reverts commit 6b53802cba.
2016-05-12 15:32:45 -07:00
Andrew Wang 6b53802cba Update project version to 3.0.0-alpha1-SNAPSHOT. 2016-05-12 11:05:05 -07:00
Tsz-Wo Nicholas Sze 7251bb922b HDFS-10346. Implement asynchronous setPermission/setOwner for DistributedFileSystem. Contributed by Xiaobing Zhou 2016-05-11 17:53:40 -07:00
Colin Patrick Mccabe 687233f20d HADOOP-13065. Add a new interface for retrieving FS and FC Statistics (Mingliang Liu via cmccabe) 2016-05-11 13:45:39 -07:00
Zhe Zhang 307db61aac HDFS-10172. hdfs erasurecode command should remove the redundant -usage option. Contributed by Yuanbo Liu. 2016-05-10 15:20:17 -07:00
Colin Patrick Mccabe f0252ad252 HDFS-10377. CacheReplicationMonitor shutdown log message should use INFO level (Yiqun Lin via cmccabe) 2016-05-10 11:15:05 -07:00
Kihwal Lee b9e5a32fa1 HDFS-10372. Fix for failing TestFsDatasetImpl#testCleanShutdownOfVolume. Contributed by Rushabh Shah. 2016-05-09 15:50:09 -05:00
Akira Ajisaka 411fb4b2b7 HDFS-10337. OfflineEditsViewer stats option should print 0 instead of null for the count of operations. Contributed by Yiqun Lin. 2016-05-08 15:49:13 -07:00
Masatake Iwasaki 6957e45699 HDFS-10374. typo in HDFSHighAvailabilityWithQJM doc. Contributed by Takashi Ohnishi. 2016-05-07 11:26:42 +09:00
Masatake Iwasaki 2835f146b5 HDFS-2043. TestHFlush failing intermittently. Contributed by Lin Yiqun. 2016-05-06 15:36:47 +09:00
Xiaoyu Yao dacd1f50fe HDFS-10324. Trash directory in an encryption zone should be pre-created with correct permissions. Contributed by Wei-Chiu Chuang. 2016-05-05 18:08:47 -07:00
Arpit Agarwal 63a6a1d732 HDFS-10361. Support starting StorageContainerManager as a daemon. (Contributed by Arpit Agarwal) 2016-05-05 15:09:59 -07:00
Ravi Prakash d8faf47f32 HADOOP-13051. Test for special characters in path being respected during globPaths. Contributed by Harsh J. 2016-05-05 14:18:39 -07:00
Ming Ma 1268cf5fbe HDFS-10320. Rack failures may result in NN terminate. (Xiao Chen via mingma) 2016-05-04 17:02:26 -07:00
Arpit Agarwal 78bd1b2ab2 Merge trunk into HDFS-7240 2016-05-04 10:01:39 -07:00
Arpit Agarwal 6d77d6eab7 HDFS-9902. Support different values of dfs.datanode.du.reserved per storage type. (Contributed by Brahma Reddy Battula) 2016-05-03 16:52:43 -07:00
Xiaoyu Yao 45a753ccf7 HDFS-10344. DistributedFileSystem#getTrashRoots should skip encryption zone that does not have .Trash. Contributed by Xiaoyu Yao. 2016-05-02 19:30:47 -07:00
Anu Engineer 05d7a838ee Merge branch 'trunk' into HDFS-7240 2016-05-02 14:55:23 -07:00
Anu Engineer 183175e60f HDFS-10351. Ozone: Optimize key writes to chunks by providing a bulk write implementation in ChunkOutputStream. Contributed by Chris Nauroth. 2016-05-02 14:50:40 -07:00
Tsz-Wo Nicholas Sze 1b9f18623a HADOOP-12957. Limit the number of outstanding async calls. Contributed by Xiaobing Zhou 2016-05-02 11:16:30 -07:00
Ravi Prakash 2753185a01 HADOOP-12563. Updated utility (dtutil) to create/modify token files. Contributed by Matthew Paduano 2016-04-29 22:32:27 -07:00
Chris Nauroth 8264b61656 HDFS-10349. Ozone: StorageContainerManager fails to compile after merge of HDFS-10312 maxDataLength enforcement. Contributed by Chris Nauroth. 2016-04-29 20:44:38 -07:00
Kihwal Lee 7da540d03e HDFS-10347. Namenode report bad block method doesn't log the bad block or datanode. Contributed by Rushabh Shah. 2016-04-29 15:50:43 -05:00
Arpit Agarwal 3dcbbdc1d1 Merge trunk into HDFS-7240 2016-04-29 13:18:40 -07:00
Tsz-Wo Nicholas Sze 4da6f69ca1 HDFS-10335 Mover$Processor#chooseTarget() always chooses the first matching target storage group. Contributed by Mingliang Liu 2016-04-29 11:22:33 -07:00
Kihwal Lee af9b000535 HDFS-10260. TestFsDatasetImpl#testCleanShutdownOfVolume often fails. Contributed by Rushabh Shah. 2016-04-29 09:58:44 -05:00
Kihwal Lee 6243eabb48 HDFS-9958. BlockManager#createLocatedBlocks can throw NPE for corruptBlocks on failed storages. Contributed by Kuhu Shukla 2016-04-28 12:44:53 -05:00
Lei Xu 0a152103f1 HDFS-3702. Add an option for NOT writing the blocks locally if there is a datanode on the same box as the client. (Contributed by Lei (Eddy) Xu) 2016-04-27 14:22:51 -07:00
Kihwal Lee 919a1d824a HDFS-10330. Add Corrupt Blocks Information in Metasave output. Contributed by Kuhu Shukla. 2016-04-27 08:19:48 -05:00
Tsz-Wo Nicholas Sze fc94810d3f HDFS-10224. Implement asynchronous rename for DistributedFileSystem. Contributed by Xiaobing Zhou 2016-04-26 17:10:13 -07:00
Andrew Wang 6be22ddbf1 HDFS-10297. Increase default balance bandwidth and concurrent moves. Contributed by John Zhuge. 2016-04-26 13:04:18 -07:00
Kihwal Lee c6a2430b47 HDFS-10329. Bad initialisation of StringBuffer in RequestHedgingProxyProvider. Contributed by Lin Yiqun. 2016-04-26 11:45:29 -05:00
Zhe Zhang 5865fe2bf0 HDFS-9869. Erasure Coding: Rename replication-based names in BlockManager to more generic [part-2]. Contributed by Rakesh R. 2016-04-25 22:01:54 -07:00
Masatake Iwasaki 8eadd7145e HDFS-10325. TestDFSShell#testMoveWithTargetPortEmpty fails. Contributed by Takanobu Asanuma. 2016-04-26 07:11:13 +09:00
Tsz-Wo Nicholas Sze f308561f1d HDFS-8057 Move BlockReader implementation to the client implementation package. Contributed by Takanobu Asanuma 2016-04-25 12:01:48 -07:00
Kihwal Lee 10f0f7851a HDFS-10318. TestJMXGet hides the real error in case of test failure. Contributed by Andras Bokor. 2016-04-25 11:38:14 -05:00
Masatake Iwasaki 6fcde2e38d HDFS-9905. WebHdfsFileSystem#runWithRetry should display original stack trace on error. (Wei-Chiu Chuang via iwasakims) 2016-04-23 23:37:56 +09:00
Jing Zhao 63e5412f1a HDFS-9427. HDFS should not default to ephemeral ports. Contributed by Xiaobing Zhou. 2016-04-22 15:14:40 -07:00
Ravi Prakash d6402faded Revert "HADOOP-12563. Updated utility (dtutil) to create/modify token files. Contributed by Matthew Paduano"
This reverts commit 4838b735f0.
2016-04-22 10:17:20 -07:00
Kihwal Lee 5d4255a801 HDFS-9555. LazyPersistFileScrubber should still sleep if there are errors in the clear progress. Contributed by Phil Yang. 2016-04-22 11:08:44 -05:00
Tsz-Wo Nicholas Sze 14ab7a81e2 HDFS-10309 Balancer doesn't honor dfs.blocksize value defined with suffix k(kilo), m(mega), g(giga). Contributed by Amit Anand 2016-04-21 15:41:50 -07:00
Tsz-Wo Nicholas Sze bbce1d525e HDFS-10319. Balancer should not try to pair storages with different types. 2016-04-21 15:20:12 -07:00
Ravi Prakash 4838b735f0 HADOOP-12563. Updated utility (dtutil) to create/modify token files. Contributed by Matthew Paduano 2016-04-21 11:32:39 -07:00
Xiaoyu Yao b4be288c5d HDFS-10207. Support enable Hadoop IPC backoff without namenode restart. Contributed by Xiaobing Zhou. 2016-04-21 10:18:48 -07:00
Xiaoyu Yao 5bd7b592e5 HADOOP-12985. Support MetricsSource interface for DecayRpcScheduler Metrics. Contributed by Xiaoyu Yao. 2016-04-20 23:10:52 -07:00
Chris Nauroth 63ac2db59a HDFS-10312. Large block reports may fail to decode at NameNode due to 64 MB protobuf maximum length restriction. Contributed by Chris Nauroth. 2016-04-20 13:39:44 -07:00
Colin Patrick Mccabe ad36fa6f42 HDFS-10308. TestRetryCacheWithHA#testRetryCacheOnStandbyNN failing (Rakesh R via cmccabe) 2016-04-20 11:33:11 -07:00
Arpit Agarwal af9bdbe447 HDFS-10264. Logging improvements in FSImageFormatProtobuf.Saver. (Contributed by Xiaobing Zhou) 2016-04-19 11:26:30 -07:00
Walter Su 90d1af1416 HDFS-9744. TestDirectoryScanner#testThrottling occasionally time out after 300 seconds. Contributed by Lin Yiqun. 2016-04-19 18:54:11 +08:00
Walter Su 4b4df2cd48 HDFS-10284. o.a.h.hdfs.server.blockmanagement.TestBlockManagerSafeMode.testCheckSafeMode fails intermittently. Contributed by Mingliang Liu. 2016-04-19 18:07:46 +08:00
Steve Loughran 438efc3634 HDFS-10291 TestShortCircuitLocalRead failing (stevel)
(cherry picked from commit dd64769699)
2016-04-19 17:48:20 +08:00
Kai Zheng b5d4c7dc76 HADOOP-12924. Configure raw erasure coders for supported codecs. Contributed by Rui Li. 2016-04-20 15:47:01 +08:00
Jing Zhao be0bce1b71 HDFS-10306. SafeModeMonitor should not leave safe mode if name system is starting active service. Contributed by Mingliang Liu. 2016-04-18 18:05:49 -07:00
Anu Engineer c884170c93 Merge branch 'trunk' into HDFS-7240 2016-04-18 16:58:45 -07:00
Anu Engineer ce524c584b HDFS-10232. Ozone: Make config key naming consistent. Contributed by Anu Engineer. 2016-04-18 16:52:40 -07:00
Colin Patrick Mccabe cb3ca460ef HDFS-10265. OEV tool fails to read edit xml file if OP_UPDATE_BLOCKS has no BLOCK tag (Wan Chang via cmccabe) 2016-04-18 13:47:56 -07:00
Kihwal Lee d8b729e16f HDFS-10302. BlockPlacementPolicyDefault should use default replication considerload value. Contributed by Lin Yiqun. 2016-04-18 07:58:55 -05:00
Walter Su ab903029a9 HDFS-10275. TestDataNodeMetrics failing intermittently due to TotalWriteTime counted incorrectly. Contributed by Lin Yiqun. 2016-04-18 20:29:29 +08:00
Walter Su 67523ffcf4 HDFS-9412. getBlocks occupies FSLock and takes too long to complete. Contributed by He Tianyi. 2016-04-18 09:28:02 +08:00
Jing Zhao 55e19b7f0c HDFS-10293. StripedFileTestUtil#readAll flaky. Contributed by Mingliang Liu. 2016-04-15 10:53:40 -07:00
Jing Zhao 89a838769f HDFS-10283. o.a.h.hdfs.server.namenode.TestFSImageWithSnapshot#testSaveLoadImageWithAppending fails intermittently. Contributed by Mingliang Liu. 2016-04-15 10:49:21 -07:00
Kihwal Lee b9c9d03591 HDFS-10281. TestPendingCorruptDnMessages fails intermittently. Contributed by Mingliang Liu. 2016-04-14 15:24:39 -05:00
Xiaoyu Yao 809226752d HDFS-10286. Fix TestDFSAdmin#testNameNodeGetReconfigurableProperties. Contributed by Xiaobing Zhou. 2016-04-14 10:57:02 -07:00
Kihwal Lee c970f1d005 HDFS-10280. Document new dfsadmin command -evictWriters. Contributed by Wei-Chiu Chuang. 2016-04-14 12:45:47 -05:00
Kihwal Lee 0d1c1152f1 HDFS-10282. The VolumeScanner should warn about replica files which are misplaced. Contributed by Colin Patrick McCabe. 2016-04-14 07:58:24 -05:00
Anu Engineer ae6c0e839b Merge branch 'trunk' into HDFS-7240 2016-04-13 23:13:11 -07:00
Xiaoyu Yao 5566177c9a HDFS-10209. Support enable caller context in HDFS namenode audit log without restart namenode. Contributed by Xiaobing Zhou. 2016-04-13 16:51:13 -07:00
Xiaoyu Yao 4895c73dd4 Revert "HDFS-10209. Support enable caller context in HDFS namenode audit log without restart namenode"
This reverts commit 192112d5a2.
2016-04-13 16:45:18 -07:00
Andrew Wang 314aa21a89 HDFS-10279. Improve validation of the configured number of tolerated failed volumes. Contributed by Lin Yiqun. 2016-04-13 16:39:50 -07:00
Xiaobing Zhou 192112d5a2 HDFS-10209. Support enable caller context in HDFS namenode audit log without restart namenode 2016-04-13 15:34:41 -07:00
Kihwal Lee d2f3bbc290 HDFS-10270. TestJMXGet:testNameNode() fails. Contributed by Gergely Novák 2016-04-13 11:22:36 -05:00
Walter Su 903428bf94 HDFS-9772. TestBlockReplacement#testThrottler doesn't work as expected. Contributed by Lin Yiqun. 2016-04-13 17:49:45 +08:00
Anu Engineer eee7269748 HDFS-10278. Ozone: Add paging support to list Volumes. Contributed by Anu Engineer. 2016-04-12 18:08:48 -07:00
Anu Engineer 33b51da8c5 HDFS-10251. Ozone: Shutdown cleanly. Contributed by Anu Engineer 2016-04-12 18:00:24 -07:00
Colin Patrick Mccabe 35f0770555 HADOOP-12973. Make DU pluggable. (Elliott Clark via cmccabe) 2016-04-12 16:28:42 -07:00
Zhe Zhang 6ef42873a0 HDFS-9918. Erasure Coding: Sort located striped blocks based on decommissioned states. Contributed by Rakesh R. 2016-04-12 13:38:58 -07:00
Colin Patrick Mccabe 600d129bb8 HDFS-10273. Remove duplicate logSync() and log message in FSN#enterSafemode() (Vinayakumar B via cmccabe) 2016-04-12 10:52:39 -07:00
Akira Ajisaka 209303be3a HDFS-8356. Document missing properties in hdfs-default.xml. Contributed by Ray Chiang. 2016-04-12 15:26:50 +09:00
Vinayakumar B a9a607f8fc HDFS-10271. Extra bytes are getting released from reservedSpace for append (Contributed by Brahma Reddy Battula) 2016-04-12 11:44:34 +05:30
Akira Ajisaka 9c32f8785e HDFS-10266. Remove unused properties dfs.client.file-block-storage-locations.num-threads and dfs.client.file-block-storage-locations.timeout.millis. Contributed by Ray Chiang. 2016-04-08 15:32:13 +09:00
Anu Engineer 3f62ba558d Merge branch 'trunk' into HDFS-7240 2016-04-07 14:43:39 -07:00
Anu Engineer fedb22d9b6 HDFS-10268. Ozone: end-to-end integration for create/get volumes, buckets and keys. Contributed by Chris Nauroth. 2016-04-07 14:38:54 -07:00
Uma Maheswara Rao G 3c18a53cbd HDFS-9719. Refactoring ErasureCodingWorker into smaller reusable constructs. Contributed by Kai Zheng. 2016-04-06 22:50:24 -07:00
Tsz-Wo Nicholas Sze 654cd1d0c0 HDFS-10186. DirectoryScanner: Improve logs by adding full path of both actual and expected block directories. Contributed by Rakesh R 2016-04-07 12:38:42 +08:00
Colin Patrick Mccabe 4bd7cbc29d HDFS-10267. Extra "synchronized" on FsDatasetImpl#recoverAppend and FsDatasetImpl#recoverClose 2016-04-06 21:07:31 -07:00
Eric Payne aede8c10ec HDFS-9945. Datanode command for evicting writers. Contributed by Kihwal Lee 2016-04-06 20:20:14 +00:00
Colin Patrick Mccabe 188f65287d HDFS-6520. hdfs fsck passes invalid length value when creating BlockReader (Xiao Chen via cmccabe) 2016-04-06 11:28:34 -07:00
Jing Zhao 221b3a8722 HDFS-10192. Namenode safemode not coming out during failover. Contributed by Brahma Reddy Battula. 2016-04-06 10:42:59 -07:00
Kihwal Lee 9ba1e5af06 HDFS-10261. TestBookKeeperHACheckpoints doesn't handle ephemeral HTTP ports. Contributed by Eric Badger. 2016-04-05 16:26:18 -05:00
Ravi Prakash 0cd320a846 HDFS-10235. Last contact for Live Nodes should be relative time. Contributed by Brahma Reddy Battula. 2016-04-05 13:41:19 -07:00
Chris Nauroth b3044db407 HDFS-10250. Ozone: Add key Persistence. Contributed by Anu Engineer. 2016-04-05 12:59:45 -07:00
Kihwal Lee 917464505c HDFS-10239. Fsshell mv fails if port usage doesn't match in src and destination paths. Contributed by Kuhu Shukla. 2016-04-05 09:07:24 -05:00
Vinayakumar B 818d6b799e HDFS-9917. IBR accumulate more objects when SNN was down for sometime. (Contributed by Brahma Reddy Battula) 2016-04-05 09:49:39 +08:00
Colin Patrick Mccabe f6b1a81812 HDFS-8496. Calling stopWriter() with FSDatasetImpl lock held may block other threads (cmccabe) 2016-04-04 18:02:15 -07:00
Kihwal Lee a7d1fb0cd2 HDFS-10178. Permanent write failures can happen if pipeline recoveries occur for the first packet. Contributed by Kihwal Lee. 2016-04-04 16:40:00 -05:00
Masatake Iwasaki 154d2532cf HDFS-9599. TestDecommissioningStatus.testDecommissionStatus occasionally fails (Lin Yiqun via iwasakims) 2016-04-05 03:19:48 +09:00
Vinayakumar B 54b2e78fd2 HDFS-10253. Fix TestRefreshCallQueue failure (Contributed by Xiaoyu Yao) 2016-04-03 13:27:49 +05:30
Chris Nauroth 4ac97b1815 HDFS-10238. Ozone : Add chunk persistance. Contributed by Anu Engineer. 2016-04-01 10:52:38 -07:00
Allen Wittenauer 0a74610d1c HADOOP-11393. Revert HADOOP_PREFIX, go back to HADOOP_HOME (aw) 2016-03-31 07:51:05 -07:00
Akira Ajisaka 32c0c3ecdf HDFS-10221. Add .json to the rat exclusions. Contributed by Ming Ma. 2016-03-31 09:06:14 +09:00
Anu Engineer 55d4ee71e2 HDFS-8210. Ozone: Implement storage container manager. Contributed by Chris Nauroth. 2016-03-30 14:49:55 -07:00
Colin Patrick Mccabe 37e23ce45c HDFS-10223. peerFromSocketAndKey performs SASL exchange before setting connection timeouts (cmccabe) 2016-03-30 13:37:37 -07:00
Vinayakumar B 09d63d5a19 HDFS-5177. blocksScheduled count should be decremented for abandoned blocks (Contributed by Vinayakumar B) 2016-03-30 14:22:00 +08:00
Arpit Agarwal ddfe6774c2 HDFS-9439. Support reconfiguring fs.protected.directories without NN restart. (Contributed by Xiaobing Zhou) 2016-03-29 13:55:00 -07:00
Arpit Agarwal c9307e48b7 HDFS-10228. TestHDFSCLI fails. (Contributed by Akira AJISAKA) 2016-03-29 13:50:08 -07:00
Andrew Wang f2aec4eb82 HDFS-10197. TestFsDatasetCache failing intermittently due to timeout. Contributed by Lin Yiqun. 2016-03-29 11:54:42 -07:00
Vinayakumar B 1f004b3367 HDFS-9871. "Bytes Being Moved" -ve(-1 B) when cluster was already balanced. (Contributed by Brahma Reddy Battulla) 2016-03-29 11:25:41 +08:00
Anu Engineer 30473ecfb4 Merge branch 'trunk' into HDFS-7240 2016-03-28 10:34:52 -07:00
Uma Maheswara Rao G 3a4ff7776e HDFS-9694. Make existing DFSClient#getFileChecksum() work for striped blocks. Contributed by Kai Zheng 2016-03-26 19:58:09 -07:00
Chris Nauroth 643c5e5bdc HDFS-10195. Ozone: Add container persistence. Contributed by Anu Engineer. 2016-03-26 11:40:00 -07:00
Arpit Agarwal a337ceb74e Revert "HDFS-9694. Make existing DFSClient#getFileChecksum() work for striped blocks. Contributed by Kai Zheng"
This reverts commit e5ff0ea7ba.
2016-03-26 09:20:01 -07:00
Uma Maheswara Rao G e5ff0ea7ba HDFS-9694. Make existing DFSClient#getFileChecksum() work for striped blocks. Contributed by Kai Zheng 2016-03-26 00:52:50 -07:00
Lei Xu fde8ac5d85 Add missing files from HDFS-9005. (lei) 2016-03-25 17:11:35 -07:00
Lei Xu 4fcfea71bf HDFS-9005. Provide support for upgrade domain script. (Ming Ma via Lei Xu) 2016-03-25 17:09:12 -07:00
Chris Nauroth 2dc48b7f1e HDFS-10202. ozone : Add key commands to CLI. Contributed by Anu Engineer. 2016-03-25 09:50:58 -07:00
Chris Nauroth 58cdb715fb HDFS-10196. Ozone : Enable better error reporting for failed commands in ozone shell. Contributed by Anu Engineer. 2016-03-24 09:27:10 -07:00
Allen Wittenauer 738155063e HADOOP-12857. rework hadoop-tools (aw) 2016-03-23 13:46:38 -07:00
Andrew Wang 8f85e5d212 HDFS-10200. Docs for WebHDFS still describe GETDELEGATIONTOKENS operation. Contributed by Wellington Chevreuil. 2016-03-23 12:55:15 -07:00
Colin Patrick Mccabe a7d8f2b396 HDFS-10189. PacketResponder#toString should include the downstreams for PacketResponderType.HAS_DOWNSTREAM_IN_PIPELINE (Joe Pallas via cmccabe) 2016-03-22 14:56:02 -07:00
Colin Patrick Mccabe 680716f31e HDFS-9951. Use string constants for XML tags in OfflineImageReconstructor (Lin Yiqun via cmccabe) 2016-03-21 11:40:37 -07:00
Andrew Wang e3bb38d625 HDFS-9405. Warmup NameNode EDEK caches in background thread. Contributed by Xiao Chen. 2016-03-21 11:39:05 -07:00
Haohui Mai 8a3f0cb255 HDFS-7166. SbNN Web UI shows #Under replicated blocks and #pending deletion blocks. Contributed by Wei-Chiu Chuang. 2016-03-20 17:21:25 -07:00
Sangjin Lee cd8b6889a7 HDFS-9579. Provide bytes-read-by-network-distance metrics at FileSystem.Statistics level (Ming Ma via sjlee) 2016-03-19 14:02:04 -07:00
Chris Nauroth 3f708bf711 HDFS-10179. Ozone: Adding logging support. Contributed by Anu Engineer. 2016-03-19 13:59:00 -07:00
Chris Nauroth 2e517a64d8 HDFS-9960. OzoneHandler : Add localstorage support for keys. Contributed by Anu Engineer. 2016-03-19 13:36:18 -07:00
Chris Nauroth c73a32c21c HDFS-10180. Ozone: Refactor container Namespace. Contributed by Anu Engineer. 2016-03-18 13:46:56 -07:00
Anu Engineer 37e3a36a3f Merge branch 'trunk' into HDFS-7240 2016-03-18 11:18:48 -07:00
Akira Ajisaka 9b623fbaf7 HDFS-3677. dfs.namenode.edits.dir.required is missing from hdfs-default.xml. Contributed by Mark Yang. 2016-03-19 01:11:15 +09:00
Kihwal Lee 63c966a3fb HDFS-9874. Long living DataXceiver threads cause volume shutdown to block. Contributed by Rushabh Shah. 2016-03-18 10:24:59 -05:00
Colin Patrick Mccabe dc951e606f HDFS-9949. Add a test case to ensure that the DataNode does not regenerate its UUID when a storage directory is cleared (Harsh J via cmccabe) 2016-03-17 10:37:42 -07:00
Andrew Wang 02a250db9f HDFS-10173. Typo in DataXceiverServer. Contributed by Michael Han. 2016-03-16 18:49:57 -07:00
Zhe Zhang 32d043d9c5 HDFS-9857. Erasure Coding: Rename replication-based names in BlockManager to more generic [part-1]. Contributed by Rakesh R. 2016-03-16 16:53:58 -07:00
Chris Nauroth 4143f0362f HDFS-9961. Ozone: Add buckets commands to CLI. Contributed by Anu Engineer. 2016-03-15 21:27:53 -07:00
Kihwal Lee d457401784 HDFS-9904. testCheckpointCancellationDuringUpload occasionally fails. Contributed by Lin Yiqun. 2016-03-15 10:52:47 -05:00
Masatake Iwasaki 5de848cd5d HDFS-9928. Make HDFS commands guide up to date (Wei-Chiu Chuang via iwasakims) 2016-03-15 20:42:05 +09:00
Chris Nauroth 4683d68ee6 HDFS-9944. Ozone : Add container dispatcher. Contributed by Anu Engineer. 2016-03-14 16:16:35 -07:00
Ravi Prakash bd5556ba12 Download File from UI broken after pagination. Contributed by Brahma Reddy Battula 2016-03-14 14:30:13 -07:00
Chris Nauroth 657bc690c2 HDFS-9926. ozone : Add volume commands to CLI. Contributed by Anu Engineer. 2016-03-14 10:50:54 -07:00
Chris Nauroth 5644137ada HDFS-9941. Do not log StandbyException on NN, other minor logging fixes. Contributed by Arpit Agarwal. 2016-03-14 09:54:54 -07:00
Chris Nauroth 64add6756c HDFS-9925. Ozone: Add Ozone Client lib for bucket handling. Contributed by Anu Engineer.
Fix build break
2016-03-11 13:03:15 -08:00
Chris Nauroth e74f1d4728 HDFS-9916. OzoneHandler : Add Key handler. Contributed by Anu Engineer. 2016-03-11 12:57:10 -08:00
Chris Nauroth e882d6273c HDFS-9916. OzoneHandler : Add Key handler. Contributed by Anu Engineer. 2016-03-11 12:57:10 -08:00
Anu Engineer ff4ea053d3 HDFS-9920. Stop tracking CHANGES.txt in the HDFS-7240 feature branch. Contributed by Chris Nauroth. 2016-03-11 12:57:09 -08:00
Chris Nauroth 979dfe4c2e HDFS-9891. Ozone: Add container transport client. Contributed by Anu Engineer. 2016-03-11 12:57:09 -08:00
Chris Nauroth b31a5d67f1 HDFS-9873. Ozone: Add container transport server. Contributed by Anu Engineer. 2016-03-11 12:57:09 -08:00
Anu Engineer 2fff7d58da HDFS-9907. Exclude Ozone protobuf-generated classes from Findbugs analysis. Contributed by Chris Nauroth 2016-03-11 12:57:09 -08:00
Chris Nauroth d4402c5123 HDFS-9848. Ozone: Add Ozone Client lib for volume handling. Contributed by Anu Engineer. 2016-03-11 12:57:08 -08:00
Anu Engineer 45e360f54e HDFS-9853. Ozone: Add container definitions. Contributed by Anu Engineer. 2016-03-11 12:57:08 -08:00
cnauroth 40211dd4fe HDFS-9845. OzoneHandler : Support List and Info Volumes. Contributed by Anu Engineer. 2016-03-11 12:57:08 -08:00
cnauroth ed258dc633 HDFS-9834. OzoneHandler : Enable MiniDFSCluster based testing for Ozone. Contributed by Anu Engineer. 2016-03-11 12:57:08 -08:00
Anu Engineer 14b85da0ea HDFS-8757 : OzoneHandler : Add localStorageHandler support for Buckets. Contributed by Anu Engineer 2016-03-11 12:57:08 -08:00
Anu Engineer 312a01ea3c HDFS-8527. OzoneHandler: Integration of REST interface and container data pipeline back-end. Contributed by Chris Nauroth 2016-03-11 12:57:07 -08:00
Anu Engineer 114ef3000c HDFS-8695. OzoneHandler : Add Bucket REST Interface. (aengineer) 2016-03-11 12:57:07 -08:00
Anu Engineer d309930374 HDFS-8753. Ozone: Unify StorageContainerConfiguration with ozone-default.xml & ozone-site.xml. Contributed by kanaka kumar avvaru 2016-03-11 12:57:07 -08:00
Arpit Agarwal 06c5b2500a HDFS-8717. OzoneHandler : Add common bucket objects. (Contributed by Anu Engineer) 2016-03-11 12:57:07 -08:00
Arpit Agarwal acb949e6f9 HDFS-8680. OzoneHandler : Add Local StorageHandler support for volumes. (Contributed by Anu Engineer) 2016-03-11 12:57:07 -08:00
Arpit Agarwal 5d70ed415c HDFS-8654. OzoneHandler : Add ACL support. (Contributed by Anu Engineer) 2016-03-11 12:57:06 -08:00
Arpit Agarwal 476d22dfa1 HDFS-8644. OzoneHandler : Add volume handler. (Contributed by Anu Engineer) 2016-03-11 12:57:06 -08:00
Arpit Agarwal d9d9504102 HDFS-8634. OzoneHandler: Add userAuth Interface and Simple userAuth handler. (Contributed by Anu Engineer) 2016-03-11 12:57:06 -08:00
Arpit Agarwal 7452cc5d8b HDFS-8637. OzoneHandler : Add Error Table. (Contributed by Anu Engineer) 2016-03-11 12:57:06 -08:00
cnauroth f0b2b26c34 HDFS-8448. Create REST Interface for Volumes. Contributed by Anu Engineer. 2016-03-11 12:57:05 -08:00
Arpit Agarwal 15a3e75854 HDFS-8614. OzoneHandler : Add Quota Support. (Contributed by Anu Engineer) 2016-03-11 12:56:44 -08:00
Arpit Agarwal e2f494c2c4 HDFS-8456. Introduce STORAGE_CONTAINER_SERVICE as a new NodeType. (Contributed by Arpit Agarwal) 2016-03-11 12:56:29 -08:00
Arpit Agarwal e01c6ea688 HDFS-1477. Support reconfiguring dfs.heartbeat.interval and dfs.namenode.heartbeat.recheck-interval without NN restart. (Contributed by Xiaobing Zhou) 2016-03-10 19:03:55 -08:00
Colin Patrick Mccabe 79961ecea8 HDFS-9933. ReverseXML should be capitalized in oiv usage message (cmccabe) 2016-03-10 13:43:27 -08:00
Colin Patrick Mccabe bd49354c6d HDFS-9934. ReverseXML oiv processor should bail out if the XML file's layoutVersion doesn't match oiv's (cmccabe) 2016-03-10 13:41:06 -08:00
Colin Patrick Mccabe 500875dfcc HDFS-9927. Document the new OIV ReverseXML processor (Wei-Chiu Chuang via cmccabe) 2016-03-10 13:38:00 -08:00
Zhe Zhang 7600e3c48f HDFS-7866. Erasure coding: NameNode manages multiple erasure coding policies. Contributed by Rui Li. 2016-03-08 22:30:30 -08:00
Chris Nauroth 89b16d27e2 HADOOP-12905. Clean up CHANGES.txt RAT exclusions from pom.xml files. Contributed by Chris Nauroth. 2016-03-08 21:22:06 -08:00
Andrew Wang a14a6f08ee HDFS-9919. TestStandbyCheckpoints#testNonPrimarySBNUploadFSImage waitForCheckpoint incorrectly. Contributed by Lin Yiqun. 2016-03-08 11:54:50 -08:00
Jing Zhao 743a99f2db HDFS-8786. Erasure coding: use simple replication for internal blocks on decommissioning datanodes. Contributed by Rakesh R. 2016-03-08 10:24:57 -08:00
Arpit Agarwal c2140d05ef HDFS-9882. Add heartbeatsTotal in Datanode metrics. (Contributed by Hua Liu) 2016-03-07 21:10:24 -08:00
Arpit Agarwal 724d2299cd HDFS-9906. Remove spammy log spew when a datanode is restarted. (Contributed by Brahma Reddy Battula) 2016-03-07 12:19:53 -08:00
Masatake Iwasaki d718fc1ee5 HDFS-9865. TestBlockReplacement fails intermittently in trunk (Lin Yiqun via iwasakims) 2016-03-08 02:07:18 +09:00
Harsh J fd1c09be3e HDFS-9521. TransferFsImage.receiveFile should account and log separate times for image download and fsync to disk. Contributed by Wellington Chevreuil 2016-03-07 17:14:51 +05:30
Chris Nauroth 2759689d7d HDFS-9239. DataNode Lifeline Protocol: an alternative protocol for reporting DataNode liveness. Contributed by Chris Nauroth. 2016-03-04 15:29:50 -08:00
Yongjun Zhang 8e08861a14 HDFS-9889. Update balancer/mover document about HDFS-6133 feature. Contributed by Yongjun Zhang. 2016-03-04 13:25:29 -08:00
Zhe Zhang 3e8099a45a HDFS-9888. Allow reseting KerberosName in unit tests. Contributed by Xiao Chen. 2016-03-04 09:48:05 -08:00
Masatake Iwasaki cbd31328a6 HADOOP-12470. In-page TOC of documentation should be automatically generated by doxia macro (iwasakims) 2016-03-04 14:11:36 +09:00
Andrew Wang 1bc454615e HADOOP-11792. Remove all of the CHANGES.txt files. 2016-03-03 21:02:31 -08:00
Masatake Iwasaki 33a412e8a4 HDFS-9048. DistCp documentation is out-of-dated (Daisuke Kobayashi via iwasakims) 2016-03-03 18:57:23 +09:00
Masatake Iwasaki f70e317ccc HADOOP-12793. Write a new group mapping service guide (Wei-Chiu Chuang via iwasakims) 2016-03-03 17:14:32 +09:00
Arpit Agarwal 27941a1811 HDFS-9534. Add CLI command to clear storage policy from a path. (Contributed by Xiaobing Zhou) 2016-03-02 18:35:28 -08:00
Colin Patrick Mccabe 700b0e4019 HDFS-9835. OIV: add ReverseXML processor which reconstructs an fsimage from an XML file (cmccabe) 2016-03-02 17:56:11 -08:00
Zhe Zhang 67880ccae6 HDFS-9886. Configuration properties for hedged read is broken. Contributed by Akira AJISAKA. 2016-03-02 10:26:06 -08:00
Xiaoyu Yao 5abf051249 HDFS-9887. WebHdfs socket timeouts should be configurable. Contributed by Austin Donnelly and Chris Douglas. 2016-03-02 09:23:17 -08:00
Akira Ajisaka 27e0681f28 HDFS-9851. NameNode throws NPE when setPermission is called on a path that does not exist. Contributed by Brahma Reddy Battula. 2016-03-02 14:43:03 +09:00
Akira Ajisaka e2ddf82469 HDFS-9766. TestDataNodeMetrics#testDataNodeTimeSpend fails intermittently. Contributed by Xiao Chen. 2016-03-02 14:17:35 +09:00
Jing Zhao f2ba7da4f0 HDFS-9876. shouldProcessOverReplicated should not count number of pending replicas. Contributed by Jing Zhao. 2016-03-01 18:41:57 -08:00
Andrew Wang 4abb2fa687 HDFS-9881. DistributedFileSystem#getTrashRoot returns incorrect path for encryption zones. 2016-03-01 16:35:39 -08:00
Kihwal Lee e76b13c415 HDFS-9880. TestDatanodeRegistration fails occasionally. Contributed by Kihwal Lee. 2016-03-01 17:00:18 -06:00
Kihwal Lee 2c8496ebf3 HDFS-8791. block ID-based DN storage layout can be very slow for datanode on ext4. Contributed by Chris Trezzo. 2016-03-01 15:04:59 -06:00
Chris Nauroth 2137e8feeb HDFS-9870. Remove unused imports from DFSUtil. Contributed by Brahma Reddy Battula. 2016-03-01 11:15:13 -08:00
Uma Maheswara Rao G 307ec80aca HDFS-9733. Refactor DFSClient#getFileChecksum and DataXceiver#blockChecksum. Contributed by Kai Zheng 2016-02-29 21:52:20 -08:00
Jing Zhao 2151716832 HDFS-7964. Add support for async edit logging. Contributed by Daryn Sharp. 2016-02-29 15:34:43 -08:00
Akira Ajisaka 8bc023b3b1 HDFS-9864. Correct reference for RENEWDELEGATIONTOKEN and CANCELDELEGATIONTOKEN in webhdfs doc. Contributed by Brahma Reddy Battula. 2016-02-29 18:42:21 +09:00
Jing Zhao 321a80c759 HDFS-9867. Missing block exception should carry locatedBlocks information. Contributed by Mingliang Liu. 2016-02-28 15:00:27 -08:00
Jing Zhao 408f2c807b HDFS-9866. BlockManager#chooseExcessReplicasStriped may weaken rack fault tolerance. Contributed by Jing Zhao. 2016-02-28 14:54:49 -08:00
Tsz-Wo Nicholas Sze d1d4e16690 HDFS-9710. DN can be configured to send block receipt IBRs in batches. 2016-02-26 15:32:25 -08:00
Xiaoyu Yao eab52dfb35 HDFS-9831. Document webhdfs retry configuration keys introduced by HDFS-5219/HDFS-5122. Contributed by Xiaobing Zhou. 2016-02-26 14:14:12 -08:00
Karthik Kambatla c2460dad64 HDFS-9858. RollingFileSystemSink can throw an NPE on non-secure clusters. (Daniel Templeton via kasha) 2016-02-25 16:31:09 -08:00
Zhe Zhang 8808779db3 HDFS-9734. Refactoring of checksum failure report related codes. Contributed by Kai Zheng.
Change-Id: Ie69a77e3498a360959f8e213c51fb2b17c28b64a
2016-02-25 09:55:50 -08:00
Zhe Zhang ccff6035f5 HDFS-9804. Allow long-running Balancer to login with keytab. Contributed by Xiao Chen.
Change-Id: I54b82e0b11929082057b4d21bfcf285222c94cdb
2016-02-25 09:24:32 -08:00
Tsz-Wo Nicholas Sze 6979cbfc1f HDFS-9838. Refactor the excessReplicateMap to a class. 2016-02-24 19:42:47 -08:00
Chris Nauroth dbbfc58c33 HDFS-9843. Document distcp options required for copying between encrypted locations. Contributed by Xiaoyu Yao. 2016-02-24 15:16:05 -08:00
Jing Zhao 47b92f2b6f HDFS-9837. BlockManager#countNodes should be able to detect duplicated internal blocks. Contributed by Jing Zhao. 2016-02-24 15:13:56 -08:00
cnauroth d1dd248b75 HDFS-9854. Log cipher suite negotiation more verbosely. Contributed by Wei-Chiu Chuang. 2016-02-24 12:11:35 -08:00
Kihwal Lee d27d7fc72e HDFS-9395. Make HDFS audit logging consistant. Contributed by Kuhu Shukla. 2016-02-24 12:04:01 -06:00
Zhe Zhang def754ec06 HDFS-9816. Erasure Coding: allow to use multiple EC policies in striping related tests [Part 3]. Contributed by Rui Li.
Change-Id: I64b57bab4722cdc6e1e3148c3a3a401370249afe
2016-02-23 14:05:17 -08:00
Zhe Zhang 647a35e996 HDFS-9844. Correct path creation in getTrashRoot to handle root dir.
Change-Id: I5afe6c7176063892e3e632698c849bd9f4b92906
2016-02-23 13:29:39 -08:00