9c6a4383ca
HDFS-10681. DiskBalancer: query command should report Plan file path apart from PlanID. (Manoj Govindassamy via lei)
2016-08-09 15:59:22 -07:00
cc48251bfd
HDFS-10457. DataNode should not auto-format block pool directory if VERSION is missing. (Wei-Chiu Chuang via lei)
2016-08-09 15:51:19 -07:00
0f701f433d
HDFS-10738. Fix TestRefreshUserMappings.testRefreshSuperUserGroupsConfiguration test failure. Contributed by Rakesh R.
2016-08-09 14:54:11 -05:00
b10c936020
HDFS-10342. BlockManager#createLocatedBlocks should not check corrupt replicas if none are corrupt. Contributed by Kuhu Shukla.
2016-08-09 11:56:21 -05:00
8c0638471f
HADOOP-10682. Replace FsDatasetImpl object lock with a separate lock object. (Chen Liang)
2016-08-08 12:02:53 -07:00
4d3af47f27
HDFS-10693. metaSave should print blocks, not LightWeightHashSet. Contributed by Yuanbo Liu.
2016-08-07 14:29:26 -07:00
ef432579a7
HDFS-10715. NPE when applying AvailableSpaceBlockPlacementPolicy. Contributed by Guangbin Zhu.
2016-08-05 17:31:11 +09:00
18d9e6ec0b
HDFS-10588. False alarm in datanode log - ERROR - Disk Balancer is not enabled. Contributed by Weiwei Yang.
2016-08-04 19:40:33 -07:00
438a9f047e
HDFS-10673. Optimize FSPermissionChecker's internal path usage. Contributed by Daryn Sharp.
2016-08-04 16:14:13 -05:00
57369a678c
HDFS-10343. BlockManager#createLocatedBlocks may return blocks on failed storages. Contributed by Kuhu Shukla.
2016-08-04 14:55:21 -05:00
4a8e6dc02f
HDFS-10722. Fix race condition in TestEditLog#testBatchedSyncWithClosedLogs. Contributed by Daryn Sharp.
2016-08-04 11:53:44 -05:00
8c9b44eaff
In Balancer, the target task should be removed when its size < 0. Contributed by Yiqun Lin
2016-08-04 09:45:40 -07:00
6ae39199da
HDFS-10662. Optimize UTF8 string/byte conversions. Contributed by Daryn Sharp.
2016-08-04 09:07:34 -05:00
6f63566694
HDFS-10569. A bug causes OutOfIndex error in BlockListAsLongs. Contributed by Weiwei Yang.
2016-08-03 15:20:20 -05:00
f4ba5ff1d7
HDFS-10710. In BlockManager#rescanPostponedMisreplicatedBlocks(), postponed misreplicated block counts should be retrieved within the NN lock protection.Contributed by GAO Rui.
2016-08-03 12:42:05 -07:00
22ef5286bc
HDFS-10674. Optimize creating a full path from an inode. Contributed by Daryn Sharp.
2016-08-03 13:12:43 -05:00
58db263e93
HDFS-742. A down DataNode makes Balancer to hang on repeatingly asking NameNode its partial block list. Contributed by Mit Desai.
2016-08-03 12:14:59 -05:00
bebf10d245
HDFS-10656. Optimize conversion of byte arrays back to path string. Contributed by Daryn Sharp.
2016-08-03 11:53:41 -05:00
5e5b8793fb
HDFS-5805. TestCheckpoint.testCheckpoint fails intermittently on branch-2. Contributed by Eric Badger.
2016-08-02 15:37:36 -05:00
a5fb298e56
HDFS-10707. Replace org.apache.commons.io.Charsets with java.nio.charset.StandardCharsets. Contributed by Vincent Poon.
2016-08-02 17:07:59 +09:00
c4463f2ef2
Revert "HDFS-10301. Interleaving processing of storages from repeated block reports causes false zombie storage detection, removes valid blocks. Contributed by Vinitha Gankidi."
...
This reverts commit 85a20508bd
2016-08-01 22:34:40 -07:00
9f473cf903
HDFS-10655. Fix path related byte array conversion bugs. (daryn)
2016-08-01 10:14:28 -05:00
8d32bd884d
HDFS-10703. HA NameNode Web UI should show last checkpoint time. (John Zhuge via Yongjun Zhang)
2016-07-29 23:20:14 -07:00
204a2055b1
HDFS-10691. FileDistribution fails in hdfs oiv command due to ArrayIndexOutOfBoundsException. Contributed by Yiqun Lin.
2016-07-29 15:39:48 +09:00
d9aae22fdf
HDFS-9276. Failed to Update HDFS Delegation Token for long running application in HA mode. Contributed by Liangliang Gu and John Zhuge
2016-07-28 16:29:40 -07:00
ce3d68e9c3
HDFS-10676. Add namenode metric to measure time spent in generating EDEKs. Contributed by Hanisha Koneru.
2016-07-28 16:07:45 -07:00
a3d0cba810
HDFS-10689. Hdfs dfs chmod should reset sticky bit permission when the bit is omitted in the octal mode. (Manoj Govindassamy via Lei Xu)
2016-07-28 13:52:14 -07:00
67406460f0
HDFS-4176. EditLogTailer should call rollEdits with a timeout. (Lei Xu)
2016-07-28 13:32:00 -07:00
328c855a57
HDFS-10650. DFSClient#mkdirs and DFSClient#primitiveMkdir should use default directory permission. Contributed by John Zhuge.
2016-07-28 13:15:02 -07:00
414fbfab41
HDFS-10696. TestHDFSCLI fails. Contributed by Kai Sasaki.
2016-07-28 16:58:23 +09:00
098ec2b11f
HDFS-10519. Add a configuration option to enable in-progress edit log tailing. Contributed by Jiayi Zhou.
2016-07-27 17:55:41 -07:00
eb7ff0c992
HDFS-10667. Report more accurate info about data corruption location. (Yuanbo Liu via Yongjun Zhang)
2016-07-27 13:58:04 -07:00
54fe17a607
HADOOP-9427. Use JUnit assumptions to skip platform-specific tests. Contributed by Gergely Novák.
2016-07-27 19:41:09 +09:00
55d5993a8e
HDFS-10668. Fix intermittently failing UT TestDataNodeMXBean#testDataNodeMXBeanBlockCount. Contributed by Mingliang Liu.
2016-07-27 10:26:42 +05:30
d84ab8a578
HDFS-10598. DiskBalancer does not execute multi-steps plan. Contributed by Lei (Eddy) Xu.
2016-07-26 16:01:50 -07:00
d2cf8b54c5
HDFS-10642. TestLazyPersistReplicaRecovery#testDnRestartWithSavedReplicas fails intermittently. (Contributed by Mingliang Liu)
2016-07-26 12:27:46 -07:00
25f0a9b3ab
HDFS-9937. Update dfsadmin command line help and HdfsQuotaAdminGuide. Contributed by Kai Sasaki.
2016-07-26 08:01:42 -07:00
2aa18e1925
Revert "HDFS-10668. Fix intermittently failing UT TestDataNodeMXBean#testDataNodeMXBeanBlockCount. Contributed by Mingliang Liu."
...
This reverts commit 7cac7655fd
2016-07-26 14:30:02 +01:00
7cac7655fd
HDFS-10668. Fix intermittently failing UT TestDataNodeMXBean#testDataNodeMXBeanBlockCount. Contributed by Mingliang Liu.
2016-07-26 10:54:24 +05:30
85a20508bd
HDFS-10301. Interleaving processing of storages from repeated block reports causes false zombie storage detection, removes valid blocks. Contributed by Vinitha Gankidi.
2016-07-25 18:50:59 -07:00
59466b8c18
HDFS-10671. Fix typo in HdfsRollingUpgrade.md. Contributed by Yiqun Lin.
2016-07-26 10:48:21 +09:00
0cde9e12a7
HDFS-10688. BPServiceActor may run into a tight loop for sending block report when hitting IOException. Contributed by Chen Liang.
2016-07-25 18:41:13 -07:00
b79ba4fe96
HDFS-10651. Clean up some configuration related codes about legacy block reader. Contributed by Youwei Wang
2016-07-23 17:45:33 +08:00
c6e3a0020f
HDFS-10660. Expose storage policy apis via HDFSAdmin interface. (Contributed by Rakesh R)
2016-07-22 12:33:50 -07:00
77ac04efe4
HDFS-10565: Erasure Coding: Document about the current allowed storage policies for EC Striped mode files
2016-07-22 11:08:20 -07:00
132deb4cac
HDFS-10225. DataNode hot swap drives should disallow storage type changes. Contributed by Lei (Eddy) Xu.
2016-07-21 16:41:02 -07:00
fcde6940e0
HDFS-10287. MiniDFSCluster should implement AutoCloseable. Contributed by Andras Bokor.
2016-07-21 11:26:08 -07:00
bd3dcf46e2
HDFS-10653. Optimize conversion from path string to components. Contributed by Daryn Sharp.
2016-07-21 11:14:39 -07:00
38128baff4
HDFS-10425. Clean up NNStorage and TestSaveNamespace. Contributed by Andras Bokor.
2016-07-20 10:44:11 -07:00
f7dabe3add
HDFS-10620. StringBuilder created and appended even if logging is disabled. Contributed by Staffan Friberg.
2016-07-19 15:13:01 -07:00
fc570b55b9
HDFS-10603. Fix flaky tests in org.apache.hadoop.hdfs.server.namenode.snapshot.TestOpenFilesWithSnapshot. Contributed by Yiqun Lin.
2016-07-19 13:49:24 -07:00
5b4a708704
HDFS-10639. Fix typos in HDFSDiskbalancer.md. Contributed by Yiqun Lin.
2016-07-15 21:41:57 -07:00
da456ffd62
Preparing for 3.0.0-alpha2 development
2016-07-15 19:04:17 -07:00
c48e9d608c
HDFS-10628. Log HDFS Balancer exit message to its own log. Contributed by Jiayi Zhou.
2016-07-15 11:42:44 -07:00
5537c6b234
HADOOP-13351. TestDFSClientSocketSize buffer size tests are flaky. Contributed by Aaron Fabbri and Mingliang Liu.
2016-07-14 14:40:58 -07:00
382dff7475
HDFS-10600. PlanCommand#getThrsholdPercentage should not use throughput value. (Yiqun Lin via lei)
2016-07-14 10:40:34 -07:00
2bbc3ea1b5
HDFS-10617. PendingReconstructionBlocks.size() should be synchronized. Contributed by Eric Badger.
2016-07-13 21:59:35 -05:00
438b7c5935
HDFS-10590: Fix TestReconstructStripedBlocks.testCountLiveReplicas test failures. Contributed by Rakesh R
2016-07-13 00:07:11 -07:00
087290e6b1
HDFS-10544. Balancer doesn't work with IPFailoverProxyProvider.
2016-07-12 23:18:37 -07:00
c447efebdb
HDFS-10579. HDFS web interfaces lack configs for X-FRAME-OPTIONS protection. Contributed by Anu Engineer.
2016-07-11 14:55:33 -07:00
da6f1b88dd
HDFS-10512. VolumeScanner may terminate due to NPE in DataNode.reportBadBlocks. Contributed by Wei-Chiu Chuang and Yiqun Lin.
2016-07-08 19:40:44 -07:00
932aed64d7
HDFS-10336. TestBalancer failing intermittently because of not reseting UserGroupInformation completely. Contributed by Yiqun Lin.
2016-07-08 14:39:11 -07:00
6e597600f7
HADOOP-13283. Support reset operation for new global storage statistics and per FS storage stats. Contributed by Mingliang Liu.
2016-07-07 14:58:19 -07:00
ab092c56c2
HDFS-10592:Fix intermittent test failure of TestNameNodeResourceChecker#testCheckThatNameNodeResourceMonitorIsRunning. Contributed by Rakesh R
2016-07-07 13:52:35 -07:00
b8f93cd275
HDFS-10488. Update WebHDFS documentation regarding CREATE and MKDIR default permissions. Contributed by Wellington Chevreuil.
2016-07-07 10:36:55 -07:00
a3f93beaa1
HDFS-10582. Change deprecated configuration fs.checkpoint.dir to dfs.namenode.checkpoint.dir in HDFS Commands Doc. Contributed by Pan Yuxuan.
2016-07-06 17:51:42 -07:00
8b4b5259d5
HDFS-10589. Javadoc for HAState#HAState and HAState#setStateInternal contains non-existent params. Contributed by shenyinjie.
2016-07-04 07:15:04 -07:00
2e835d986e
HDFS-10572. Fix TestOfflineEditsViewer#testGenerated. Contributed by Surendra Singh Lilhore.
2016-07-03 21:11:56 -07:00
8b281bce85
HDFS-10548. Remove the long deprecated BlockReaderRemote. Contributed by Kai Zheng
2016-07-03 11:56:23 +08:00
e4a2545620
HDFS-9805. Add server-side configuration for enabling TCP_NODELAY for DataTransferProtocol and default it to true (Gary Helmling via cmccabe)
2016-06-29 12:41:42 -07:00
c0829f4493
HDFS-6434. Default permission for creating file should be 644 for WebHdfs/HttpFS. Contributed by Wellington Chevreuil.
2016-06-28 13:55:26 -07:00
23c3ff85a9
HADOOP-13209. replace slaves with workers (John Smith via aw)
2016-06-28 05:53:03 -07:00
2a0082c51d
HDFS-10440. Improve DataNode web UI (Contributed by Weiwei Yang)
2016-06-28 16:49:39 +05:30
73615a789d
HDFS-10536. Standby NN can not trigger log roll after EditLogTailer thread failed 3 times in EditLogTailer.triggerActiveLogRoll method (Contributed by XingFeng Shen
2016-06-26 15:45:32 +05:30
bf74dbf80d
HDFS-7959. WebHdfs logging is missing on Datanode (Kihwal Lee via sjlee)
2016-06-24 14:44:15 -07:00
22be604fa3
Revert "HDFS-10534. NameNode WebUI should display DataNode usage rate with a certain percentile. Contributed by Kai Sasaki."
...
This reverts commit 0424056a77
2016-06-24 09:36:03 -07:00
0424056a77
HDFS-10534. NameNode WebUI should display DataNode usage rate with a certain percentile. Contributed by Kai Sasaki.
2016-06-24 08:58:29 -07:00
b2584bee45
HDFS-10571. TestDiskBalancerCommand#testPlanNode failed with IllegalArgumentException. Contributed by Xiaobing Zhou.
2016-06-23 18:27:02 -07:00
8a6e354122
HDFS-10552. DiskBalancer "-query" results in NPE if no plan for the node. Contributed by Anu Engineer.
2016-06-23 18:27:02 -07:00
e8de28181a
HDFS-10551. o.a.h.h.s.diskbalancer.command.Command does not actually verify options as expected. Contributed by Anu Engineer.
2016-06-23 18:27:02 -07:00
66fa34c839
HDFS-10557. Fix handling of the -fs Generic option. (Arpit Agarwal)
2016-06-23 18:27:01 -07:00
7b23ad1ef7
HDFS-10550. DiskBalancer: fix issue of order dependency in iteration in ReportCommand test. Contributed by Xiaobing Zhou.
2016-06-23 18:27:01 -07:00
c6ed54808d
HDFS-10547. DiskBalancer: fix whitespace issue in doc files. Contributed by Anu Engineer.
2016-06-23 18:27:01 -07:00
0774412e41
HDFS-10545. DiskBalancer: PlanCommand should use -fs instead of -uri to be consistent with other hdfs commands. Contributed by Anu Engineer.
2016-06-23 18:27:01 -07:00
5b8e1c26d7
HDFS-10541. Diskbalancer: When no actions in plan, error message says "Plan was generated more than 24 hours ago". Contributed by Anu Engineer.
2016-06-23 18:27:00 -07:00
cb68e5b3bd
HDFS-10540. Diskbalancer: The CLI error message for disk balancer is not enabled is not clear. Contributed by Anu Engineer.
2016-06-23 18:27:00 -07:00
3225c24e0e
HDFS-10520. DiskBalancer: Fix Checkstyle issues in test code. Contributed by Anu Engineer.
2016-06-23 18:27:00 -07:00
7e2be5c4a0
HDFS-10518. DiskBalancer: Pretty-print json in Query command. Contributed by Anu Engineer.
2016-06-23 18:21:08 -07:00
af11ab34d0
HDFS-10517. DiskBalancer: Support help command. Contributed by Anu Engineer.
2016-06-23 18:21:08 -07:00
b502102bb1
HDFS-9461. DiskBalancer: Add Report Command. Contributed by Xiaobing Zhou.
2016-06-23 18:21:08 -07:00
121142cf95
HDFS-10501. DiskBalancer: Use the default datanode port if port is not provided. Contributed by Anu Engineer.
2016-06-23 18:21:08 -07:00
78a1032b71
HDFS-10500. Diskbalancer: Print out information when a plan is not generated. Contributed by Anu Engineer.
2016-06-23 18:21:08 -07:00
d2ff793ae4
HDFS-10496. DiskBalancer: ExecuteCommand checks planFile in a wrong way. Contributed by Lei (Eddy) Xu.
2016-06-23 18:21:08 -07:00
64ccb232cc
HDFS-10478. DiskBalancer: resolve volume path names. Contributed by Anu Engineer.
2016-06-23 18:21:08 -07:00
47dcb0f952
HDFS-10476. DiskBalancer: Plan command output directory should be a sub-directory. Contributed by Anu Engineer.
2016-06-23 18:21:08 -07:00
06a9799d84
HDFS-9547. DiskBalancer: Add user documentation. Contributed by Anu Engineer.
2016-06-23 18:21:08 -07:00
43eee50966
HDFS-10403. DiskBalancer: Add cancel command. Contributed by Anu Engineer.
2016-06-23 18:21:08 -07:00
9e5fcb5e40
HDFS-10402. DiskBalancer: Add QueryStatus command. (Contributed by Anu Engineer)
2016-06-23 18:21:08 -07:00
5df2d2b8fd
HDFS-10399. DiskBalancer: Add JMX for DiskBalancer. Contributed by Anu Engineer.
2016-06-23 18:21:08 -07:00
1b39b283c7
HDFS-9546: DiskBalancer: Add Execute command. Contributed by Anu Engineer.
2016-06-23 18:21:08 -07:00
75882ec0b0
HDFS-9545: DiskBalancer: Add Plan Command. Contributed by Anu Engineer.
2016-06-23 18:21:08 -07:00
1594b472bb
HDFS-9543. DiskBalancer: Add Data mover. Contributed by Anu Engineer.
2016-06-23 18:20:24 -07:00
7820737cfa
HDFS-9735. DiskBalancer : Refactor moveBlockAcrossStorage to be used by disk balancer. Contributed by Anu Engineer.
2016-06-23 18:20:24 -07:00
050677077b
HDFS-9720. DiskBalancer : Add configuration parameters. Contributed by Anu Engineer.
2016-06-23 18:18:48 -07:00
6c606bf5c8
HDFS-9709. DiskBalancer : Add tests for disk balancer using a Mock Mover class. Contributed by Anu Engineer.
2016-06-23 18:18:48 -07:00
9be9703716
Fix a build break in HDFS-1312
2016-06-23 18:18:48 -07:00
ec601673a8
HDFS-10170. DiskBalancer: Force rebase diskbalancer branch. Contributed by Anu Engineer
2016-06-23 18:18:48 -07:00
75a711a2d5
HDFS-9703. DiskBalancer: getBandwidth implementation. (Contributed by Anu Engineer)
2016-06-23 18:18:48 -07:00
918722bdd2
HDFS-9702. DiskBalancer: getVolumeMap implementation. (Contributed by Anu Engineer)
2016-06-23 18:18:48 -07:00
4b93ddae07
HDFS-8821. Stop tracking CHANGES.txt in the HDFS-1312 feature branch. Contributed by Xiaobing Zhou
2016-06-23 18:18:48 -07:00
747227e9de
HDFS-9817. Use SLF4J in new classes. Contributed by Anu Engineer
2016-06-23 18:18:48 -07:00
3df0781aa7
HDFS-9856. Suppress Jenkins warning for sample JSON file. Contributed by Xiaobing Zhou
2016-06-23 18:18:48 -07:00
9847640603
HDFS-9683. DiskBalancer: Add cancelPlan implementation. (Contributed by Anu Engineer)
2016-06-23 18:18:48 -07:00
e646c2eb50
HDFS-9681. DiskBalancer: Add QueryPlan implementation. (Contributed by Anu Engineer)
2016-06-23 18:18:48 -07:00
2b1b2faf76
HDFS-9671. DiskBalancer: SubmitPlan implementation. (Contributed by Anu Engineer)
2016-06-23 18:18:48 -07:00
66f0bb646d
HDFS-9647. DiskBalancer: Add getRuntimeSettings. (Contributed by Anu Engineer)
2016-06-23 18:18:48 -07:00
96fe685b7a
HDFS-9645. DiskBalancer: Add Query RPC. (Contributed by Anu Engineer)
2016-06-23 18:18:48 -07:00
0501d430e2
HDFS-9595. DiskBalancer: Add cancelPlan RPC. (Contributed by Anu Engineer)
2016-06-23 18:18:48 -07:00
7100c0da35
HDFS-9588. DiskBalancer: Add submitDiskbalancer RPC. (Anu Engineer via Arpit Agarwal)
2016-06-23 18:18:48 -07:00
5724a10316
HDFS-9469. DiskBalancer: Add Planner. (Contributed by Anu Engineer)
2016-06-23 18:18:48 -07:00
e325c6ade9
HDFS-9611. DiskBalancer : Replace htrace json imports with jackson. (Contributed by Anu Engineer)
2016-06-23 18:18:48 -07:00
599eca07b4
HDFS-9526. Fix jackson annotation imports. Contributed by Xiaobing Zhou
2016-06-23 18:18:48 -07:00
30c6ebd699
HDFS-9449. DiskBalancer: Add connectors. Contributed by Anu Engineer
2016-06-23 18:18:48 -07:00
91a5c48143
HDFS-9420. Add DataModels for DiskBalancer. Contributed by Anu Engineer
2016-06-23 18:18:48 -07:00
dca298d79e
HDFS-10469. Add number of active xceivers to datanode metrics. Contributed by Hanisha Koneru.
2016-06-23 14:13:39 -07:00
e6cb07520f
HDFS-10460. Recompute block checksum for a particular range less than file size on the fly by reconstructing missed block. Contributed by Rakesh R
2016-06-24 17:39:32 +08:00
01643020d2
HDFS-10555: Unable to loadFSEdits due to a failure in readCachePoolInfo. Contributed by Uma Maheswara Rao G
2016-06-22 22:06:13 -07:00
17eae9ebb3
HDFS-10473: Allow only suitable storage policies to be set on striped files. Contributed by Uma Maheswara Rao G
2016-06-22 11:17:43 -07:00
d433b16ce6
HDFS-7597. DelegationTokenIdentifier should cache the TokenIdentifier to UGI mapping. Contributed by Daryn Sharp, Bob Hansen, and Xiao Chen.
2016-06-22 11:00:16 +09:00
f2ac132d6a
HDFS-9530. ReservedSpace is not cleared for abandoned Blocks (Contributed by Brahma Reddy Battula)
2016-06-21 15:42:28 +05:30
46f1602e89
HDFS-10448. CacheManager#addInternal tracks bytesNeeded incorrectly when dealing with replication factors other than 1 (Yiqun Lin via cmccabe)
2016-06-20 18:25:09 -07:00
7adc4d1769
HDFS-10538. Remove AsyncDistributedFileSystem. Contributed by Xiaobing Zhou and Jitendra Pandey.
2016-06-20 17:22:55 -07:00
5f6b4157a4
HDFS-10328. Add per-cache-pool default replication num configuration (xupeng via cmccabe)
2016-06-20 10:42:50 -07:00
0319d73c3b
HDFS-10437. ReconfigurationProtocol not covered by HDFSPolicyProvider. (Arpit Agarwal)
2016-06-18 16:16:54 -07:00
280069510b
HDFS-10493. Add links to datanode web UI in namenode datanodes page. Contributed by Weiwei Yang.
2016-06-17 11:05:44 -05:00
09e82acaf9
HADOOP-12943. Add -w -r options in dfs -test command. Contributed by Weiwei Yang.
2016-06-17 16:20:38 +09:00
b5f772abda
Merge branch 'trunk' into HDFS-7240
2016-06-16 11:29:40 -07:00
e983eafb44
HDFS-10532. Typo in RollingUpgrade docs. (Contributed by Yiqun Lin)
2016-06-16 10:10:33 -07:00
cc6c265171
HDFS-10256. Use GenericTestUtils.getTestDir method in tests for temporary directories (Contributed by Vinayakumar B)
2016-06-16 16:47:06 +05:30
2ca73445f5
HDFS-10525. Fix NPE in CacheReplicationMonitor#rescanCachedBlockMap (Xiao Chen via cmccabe)
2016-06-15 22:47:01 -07:00
2449db507d
HDFS-10505. OIV's ReverseXML processor should support ACLs (Surendra Singh Lilhore via cmccabe)
2016-06-15 22:35:19 -07:00
b48f27e794
HDFS-9922. Upgrade Domain placement policy status marks a good block in violation when there are decommissioned nodes. (Chris Trezzo via mingma)
2016-06-15 22:00:52 -07:00
7d521a29ee
HDFS-9016. Display upgrade domain information in fsck. (mingma)
2016-06-14 20:05:50 -07:00
709a814fe0
HDFS-10516. Fix bug when warming up EDEK cache of more than one encryption zone. Contributed by Xiao Chen.
2016-06-13 11:50:19 -07:00
d44f4745b4
HDFS-7987. Allow files / directories to be moved (Ravi Prakash via aw)
2016-06-10 09:02:28 -07:00
23923086d1
Merge branch 'trunk' into HDFS-7240
2016-06-09 20:34:39 -07:00
ae047655f4
HDFS-10220. A large number of expired leases can make namenode unresponsive and cause failover (Nicolas Fraison via raviprak)
2016-06-08 13:44:22 -07:00
1ee9ea0026
Remove redundant TestMiniDFSCluster.testDualClusters. Contributed by Jiayi Zhou.
2016-06-08 12:58:56 -07:00
be34e85e68
HDFS-10468. HDFS read ends up ignoring an interrupt. Contributed by Jing Zhao
2016-06-07 10:48:21 -07:00
e620530301
HDFS-10485. Fix findbugs warning in FSEditLog.java. (aajisaka)
2016-06-07 17:52:55 +09:00
6de9213df1
HDFS-10458. getFileEncryptionInfo should return quickly for non-encrypted cluster.
2016-06-06 15:52:39 -07:00
35f255b03b
Revert "Revert "HADOOP-13226 Support async call retry and failover.""
...
This reverts commit 5360da8bd9
2016-06-06 16:31:43 +08:00
7e7b1ae037
Revert "Revert "HDFS-10430. Reuse FileSystem#access in TestAsyncDFS. Contributed by Xiaobing Zhou.""
...
This reverts commit 8cf47d8589
2016-06-06 16:31:38 +08:00
db41e6d285
Revert "Revert "HDFS-10431 Refactor and speedup TestAsyncDFSRename. Contributed by Xiaobing Zhou""
...
This reverts commit 5ee5912ebd
2016-06-06 16:31:34 +08:00
b3d81f38da
Revert "Revert "HDFS-10390. Implement asynchronous setAcl/getAclStatus for DistributedFileSystem. Contributed by Xiaobing Zhou""
...
This reverts commit b82c74b910
2016-06-06 16:31:30 +08:00
cba9a01889
Revert "Revert "HDFS-10346. Implement asynchronous setPermission/setOwner for DistributedFileSystem. Contributed by Xiaobing Zhou""
...
This reverts commit f23d5dfc60
2016-06-06 16:29:38 +08:00
aa20fa150d
Revert "Revert "HADOOP-12957. Limit the number of outstanding async calls. Contributed by Xiaobing Zhou""
...
This reverts commit 4d36b221a2
2016-06-06 16:28:47 +08:00
eded3d109e
Revert "Revert "HDFS-10224. Implement asynchronous rename for DistributedFileSystem. Contributed by Xiaobing Zhou""
...
This reverts commit 106234d873
2016-06-06 16:28:21 +08:00
106234d873
Revert "HDFS-10224. Implement asynchronous rename for DistributedFileSystem. Contributed by Xiaobing Zhou"
...
This reverts commit fc94810d3f
2016-06-03 18:09:55 -07:00
4d36b221a2
Revert "HADOOP-12957. Limit the number of outstanding async calls. Contributed by Xiaobing Zhou"
...
This reverts commit 1b9f18623a
2016-06-03 18:09:18 -07:00
f23d5dfc60
Revert "HDFS-10346. Implement asynchronous setPermission/setOwner for DistributedFileSystem. Contributed by Xiaobing Zhou"
...
This reverts commit 7251bb922b
2016-06-03 18:09:17 -07:00
b82c74b910
Revert "HDFS-10390. Implement asynchronous setAcl/getAclStatus for DistributedFileSystem. Contributed by Xiaobing Zhou"
...
This reverts commit 02d4e478a3
2016-06-03 18:09:14 -07:00
5ee5912ebd
Revert "HDFS-10431 Refactor and speedup TestAsyncDFSRename. Contributed by Xiaobing Zhou"
...
This reverts commit f4b9bcd87c
2016-06-03 18:09:13 -07:00
8cf47d8589
Revert "HDFS-10430. Reuse FileSystem#access in TestAsyncDFS. Contributed by Xiaobing Zhou."
...
This reverts commit 21890c4239
2016-06-03 18:09:12 -07:00
5360da8bd9
Revert "HADOOP-13226 Support async call retry and failover."
...
This reverts commit 83f2f78c11
2016-06-03 18:09:09 -07:00
99a771cd7a
HDFS-7767. Use the noredirect flag in WebHDFS to allow web browsers to upload files via the NN UI (Ravi Prakash via aw)
2016-06-03 17:07:39 -07:00
15f018434c
HDFS-9877. HDFS Namenode UI: Fix browsing directories that need to be encoded (Ravi Prakash via aw)
2016-06-03 17:06:29 -07:00
97e2449477
HDFS-10341. Add a metric to expose the timeout number of pending replication blocks. (Contributed by Akira Ajisaka)
2016-06-02 13:14:45 -07:00
1df6f5735c
HDFS-10471. DFSAdmin#SetQuotaCommand's help msg is not correct. Contributed by Yiqun Lin.
2016-06-03 04:10:32 +09:00
aadb77e412
HDFS-10367. TestDFSShell.testMoveWithTargetPortEmpty fails with Address bind exception. Contributed by Brahma Reddy Battula.
2016-06-02 20:55:04 +09:00
69555fca06
HDFS-9476. TestDFSUpgradeFromImage#testUpgradeFromRel1BBWImage occasionally fail. Contributed by Masatake Iwasaki.
2016-06-02 18:52:47 +09:00
d749cf65e1
HDFS-9833. Erasure coding: recomputing block checksum on the fly by reconstructing the missed/corrupt block data. Contributed by Rakesh R.
2016-06-02 12:56:21 +08:00
8ceb06e239
HADOOP-13137. TraceAdmin should support Kerberized cluster (Wei-Chiu Chuang via cmccabe)
2016-05-31 17:54:34 -07:00
c7921c9bdd
HDFS-9466. TestShortCircuitCache#testDataXceiverCleansUpSlotsOnFailure is flaky (Wei-Chiu Chuang via cmccabe)
2016-05-31 17:37:52 -07:00
29d6cadc52
HDFS-10415. TestDistributedFileSystem#MyDistributedFileSystem attempts to set up statistics before initialize() is called (Mingliang Liu via cmccabe)
2016-05-31 16:54:52 -07:00
83f2f78c11
HADOOP-13226 Support async call retry and failover.
2016-05-31 16:30:11 -07:00
93d8a7f2a2
Revert "HADOOP-12579. Deprecate and remove WriteableRPCEngine. Contributed by Kai Zheng"
...
This reverts commit a6c79f92d5
2016-06-01 08:41:15 +08:00
21890c4239
HDFS-10430. Reuse FileSystem#access in TestAsyncDFS. Contributed by Xiaobing Zhou.
2016-05-27 14:20:18 -07:00
5ea6fd85c7
HDFS-10276. HDFS should not expose path info that user has no permission to see. (Yuanbo Liu via Yongjun Zhang)
2016-05-27 10:02:02 -07:00
916140604f
HADOOP-12911. Upgrade Hadoop MiniKDC with Kerby. Contributed by Jiajia Li
2016-05-28 14:23:39 +08:00
8c84a2a93c
HDFS-10236. Erasure Coding: Rename replication-based names in BlockManager to more generic [part-3]. Contributed by Rakesh R.
2016-05-26 16:50:55 -07:00
55c3e2de3d
HDFS-10463. TestRollingFileSystemSinkWithHdfs needs some cleanup. (Daniel Templeton via kasha)
2016-05-26 14:24:31 -07:00
f4b9bcd87c
HDFS-10431 Refactor and speedup TestAsyncDFSRename. Contributed by Xiaobing Zhou
2016-05-26 12:15:17 -07:00
77202fa103
HADOOP-13010. Refactor raw erasure coders. Contributed by Kai Zheng
2016-05-27 13:23:34 +08:00
f69f5ab3b6
HDFS-10434. Fix intermittent test failure of TestDataNodeErasureCodingMetrics. Contributed by Rakesh R
2016-05-27 04:42:53 +08:00
a6c79f92d5
HADOOP-12579. Deprecate and remove WriteableRPCEngine. Contributed by Kai Zheng
2016-05-27 04:29:42 +08:00
2dab64da2f
HDFS-10217. show 'blockScheduled' tooltip in datanodes table.
2016-05-25 12:34:52 +05:30
02d4e478a3
HDFS-10390. Implement asynchronous setAcl/getAclStatus for DistributedFileSystem. Contributed by Xiaobing Zhou
2016-05-24 14:51:27 -07:00
15ed080e36
HDFS-9365. Balaner does not work with the HDFS-6376 HA setup.
2016-05-24 12:49:48 -07:00
57c31a3fef
HDFS-9782. RollingFileSystemSink should have configurable roll interval. (Daniel Templeton via kasha)
2016-05-24 10:37:00 -07:00
4b0f55b6ea
HDFS-7766. Add a flag to WebHDFS op=CREATE to not respond with a 307 redirect (Ravi Prakash via aw)
2016-05-23 15:52:01 -07:00
12eb5a7b11
HDFS-10439. Update setOwner doc in HdfsPermissionsGuide. Contributed by John Zhuge.
2016-05-22 16:53:30 +09:00
54f7975dfc
HDFS-10420. Fix Ozone unit tests to use MiniOzoneCluster. Contributed by Arpit Agarwal.
2016-05-20 15:19:09 -07:00
500e946729
HDFS-10438. When NameNode HA is configured to use the lifeline RPC server, it should log the address of that server. Contributed by Chris Nauroth.
2016-05-20 13:01:43 -07:00
bcde1562d2
HDFS-10424. DatanodeLifelineProtocol not able to use under security cluster. Contributed by Chris Nauroth.
2016-05-20 12:47:41 -07:00
204de430bf
HDFS-10417. Improve error message from checkBlockLocalPathAccess. Contributed by Tianyin Xu.
2016-05-19 15:52:32 -05:00
76279f5877
Merge branch 'trunk' into HDFS-7240
2016-05-19 12:44:16 -07:00
4770ae7e33
HDFS-10363. Ozone: Introduce new config keys for SCM service endpoints. Contributed by Arpit Agarwal.
2016-05-19 11:02:40 -07:00
010e6ac328
HDFS-2173. saveNamespace should not throw IOE when only one storage directory fails to write VERSION file. Contributed by Andras Bokor.
2016-05-18 14:13:41 -07:00
cf552aa87b
HDFS-10360. DataNode may format directory and lose blocks if current/VERSION is missing. (Wei-Chiu Chuang via lei)
2016-05-18 09:38:37 -07:00
f4d8fde822
HDFS-9926. MiniDFSCluster leaks dependency Mockito via DataNodeTestUtils. (Contributed by Josh Elser)
2016-05-18 09:20:57 -07:00
dd99f5fc79
HDFS-10383. Safely close resources in DFSTestUtil. Contributed by Mingliang Liu.
2016-05-17 16:12:00 -07:00
f6ef876fe1
MAPREDUCE-6657. Job history server can fail on startup when NameNode is in start phase. Contributed by Haibo Chen.
2016-05-17 14:41:47 -07:00
e24fe2641b
HDFS-9732, Improve DelegationTokenIdentifier.toString() for better logging. Contributed by Yongjun Zhang.
2016-05-17 14:03:08 -07:00
1356cbe994
Revert "HDFS-10417. Improve error message from checkBlockLocalPathAccess. Contributed by Tianyin Xu."
...
This reverts commit 0942954e8a
2016-05-17 15:20:03 -05:00
0942954e8a
HDFS-10417. Improve error message from checkBlockLocalPathAccess. Contributed by Tianyin Xu.
2016-05-17 15:06:25 -05:00
7cd5ae62f6
HDFS-10404. Fix formatting of CacheAdmin command usage help text (Yiqun Lin via cmccabe)
2016-05-17 11:10:48 -07:00
4a5819dae2
HDFS-10303. DataStreamer#ResponseProcessor calculates packet ack latency incorrectly. Contributed by Surendra Singh Lilhore.
2016-05-17 08:53:31 -05:00
9fe5828f05
HDFS-10242. Cannot create space quota of zero. Contributed by Takashi Ohnishi.
2016-05-17 15:53:09 +09:00
61f46be071
HDFS-10208. Addendum for HDFS-9579: to handle the case when client machine can't resolve network path (Ming Ma via sjlee)
2016-05-16 18:49:47 -07:00
730bc746f9
HADOOP-12930. Dynamic subcommands for hadoop shell scripts (aw)
...
This commit contains the following JIRA issues:
HADOOP-12931. bin/hadoop work for dynamic subcommands
HADOOP-12932. bin/yarn work for dynamic subcommands
HADOOP-12933. bin/hdfs work for dynamic subcommands
HADOOP-12934. bin/mapred work for dynamic subcommands
HADOOP-12935. API documentation for dynamic subcommands
HADOOP-12936. modify hadoop-tools to take advantage of dynamic subcommands
HADOOP-13086. enable daemonization of dynamic commands
HADOOP-13087. env var doc update for dynamic commands
HADOOP-13088. fix shellprofiles in hadoop-tools to allow replacement
HADOOP-13089. hadoop distcp adds client opts twice when dynamic
HADOOP-13094. hadoop-common unit tests for dynamic commands
HADOOP-13095. hadoop-hdfs unit tests for dynamic commands
HADOOP-13107. clean up how rumen is executed
HADOOP-13108. dynamic subcommands need a way to manipulate arguments
HADOOP-13110. add a streaming subcommand to mapred
HADOOP-13111. convert hadoop gridmix to be dynamic
HADOOP-13115. dynamic subcommand docs should talk about exit vs. continue program flow
HADOOP-13117. clarify daemonization and security vars for dynamic commands
HADOOP-13120. add a --debug message when dynamic commands have been used
HADOOP-13121. rename sub-project shellprofiles to match the rest of Hadoop
HADOOP-13129. fix typo in dynamic subcommand docs
HADOOP-13151. Underscores should be escaped in dynamic subcommands document
HADOOP-13153. fix typo in debug statement for dynamic subcommands
2016-05-16 17:54:45 -07:00
6a6e74acf5
HDFS-10410. RedundantEditLogInputStream.LOG is set to wrong class. (John Zhuge via lei)
2016-05-16 17:05:46 -07:00
ad9441122f
HDFS-8449. Add tasks count metrics to datanode for ECWorker. Contributed by Bo Li.
2016-05-15 23:39:09 -07:00
45788204ae
HDFS-10333. Intermittent org.apache.hadoop.hdfs.TestFileAppend failure in trunk. Contributed by Yiqun Lin.
2016-05-15 22:15:05 -07:00
3c5c57af28
HADOOP-13142. Change project version from 3.0.0 to 3.0.0-alpha1.
2016-05-12 18:27:28 -07:00
a2774debf7
HDFS-9389. Add maintenance states to AdminStates. (Ming Ma via lei)
2016-05-12 15:42:54 -07:00
ca5613af91
Revert "Update project version to 3.0.0-alpha1-SNAPSHOT."
...
This reverts commit 6b53802cba
2016-05-12 15:32:45 -07:00
6b53802cba
Update project version to 3.0.0-alpha1-SNAPSHOT.
2016-05-12 11:05:05 -07:00
7251bb922b
HDFS-10346. Implement asynchronous setPermission/setOwner for DistributedFileSystem. Contributed by Xiaobing Zhou
2016-05-11 17:53:40 -07:00
687233f20d
HADOOP-13065. Add a new interface for retrieving FS and FC Statistics (Mingliang Liu via cmccabe)
2016-05-11 13:45:39 -07:00
307db61aac
HDFS-10172. hdfs erasurecode command should remove the redundant -usage option. Contributed by Yuanbo Liu.
2016-05-10 15:20:17 -07:00
f0252ad252
HDFS-10377. CacheReplicationMonitor shutdown log message should use INFO level (Yiqun Lin via cmccabe)
2016-05-10 11:15:05 -07:00
b9e5a32fa1
HDFS-10372. Fix for failing TestFsDatasetImpl#testCleanShutdownOfVolume. Contributed by Rushabh Shah.
2016-05-09 15:50:09 -05:00
411fb4b2b7
HDFS-10337. OfflineEditsViewer stats option should print 0 instead of null for the count of operations. Contributed by Yiqun Lin.
2016-05-08 15:49:13 -07:00
6957e45699
HDFS-10374. typo in HDFSHighAvailabilityWithQJM doc. Contributed by Takashi Ohnishi.
2016-05-07 11:26:42 +09:00
2835f146b5
HDFS-2043. TestHFlush failing intermittently. Contributed by Lin Yiqun.
2016-05-06 15:36:47 +09:00
dacd1f50fe
HDFS-10324. Trash directory in an encryption zone should be pre-created with correct permissions. Contributed by Wei-Chiu Chuang.
2016-05-05 18:08:47 -07:00
63a6a1d732
HDFS-10361. Support starting StorageContainerManager as a daemon. (Contributed by Arpit Agarwal)
2016-05-05 15:09:59 -07:00
d8faf47f32
HADOOP-13051. Test for special characters in path being respected during globPaths. Contributed by Harsh J.
2016-05-05 14:18:39 -07:00
1268cf5fbe
HDFS-10320. Rack failures may result in NN terminate. (Xiao Chen via mingma)
2016-05-04 17:02:26 -07:00
78bd1b2ab2
Merge trunk into HDFS-7240
2016-05-04 10:01:39 -07:00
6d77d6eab7
HDFS-9902. Support different values of dfs.datanode.du.reserved per storage type. (Contributed by Brahma Reddy Battula)
2016-05-03 16:52:43 -07:00
45a753ccf7
HDFS-10344. DistributedFileSystem#getTrashRoots should skip encryption zone that does not have .Trash. Contributed by Xiaoyu Yao.
2016-05-02 19:30:47 -07:00
05d7a838ee
Merge branch 'trunk' into HDFS-7240
2016-05-02 14:55:23 -07:00
183175e60f
HDFS-10351. Ozone: Optimize key writes to chunks by providing a bulk write implementation in ChunkOutputStream. Contributed by Chris Nauroth.
2016-05-02 14:50:40 -07:00
1b9f18623a
HADOOP-12957. Limit the number of outstanding async calls. Contributed by Xiaobing Zhou
2016-05-02 11:16:30 -07:00
2753185a01
HADOOP-12563. Updated utility (dtutil) to create/modify token files. Contributed by Matthew Paduano
2016-04-29 22:32:27 -07:00
8264b61656
HDFS-10349. Ozone: StorageContainerManager fails to compile after merge of HDFS-10312 maxDataLength enforcement. Contributed by Chris Nauroth.
2016-04-29 20:44:38 -07:00
7da540d03e
HDFS-10347. Namenode report bad block method doesn't log the bad block or datanode. Contributed by Rushabh Shah.
2016-04-29 15:50:43 -05:00
3dcbbdc1d1
Merge trunk into HDFS-7240
2016-04-29 13:18:40 -07:00
4da6f69ca1
HDFS-10335 Mover$Processor#chooseTarget() always chooses the first matching target storage group. Contributed by Mingliang Liu
2016-04-29 11:22:33 -07:00
af9b000535
HDFS-10260. TestFsDatasetImpl#testCleanShutdownOfVolume often fails. Contributed by Rushabh Shah.
2016-04-29 09:58:44 -05:00
6243eabb48
HDFS-9958. BlockManager#createLocatedBlocks can throw NPE for corruptBlocks on failed storages. Contributed by Kuhu Shukla
2016-04-28 12:44:53 -05:00
0a152103f1
HDFS-3702. Add an option for NOT writing the blocks locally if there is a datanode on the same box as the client. (Contributed by Lei (Eddy) Xu)
2016-04-27 14:22:51 -07:00
919a1d824a
HDFS-10330. Add Corrupt Blocks Information in Metasave output. Contributed by Kuhu Shukla.
2016-04-27 08:19:48 -05:00
fc94810d3f
HDFS-10224. Implement asynchronous rename for DistributedFileSystem. Contributed by Xiaobing Zhou
2016-04-26 17:10:13 -07:00
6be22ddbf1
HDFS-10297. Increase default balance bandwidth and concurrent moves. Contributed by John Zhuge.
2016-04-26 13:04:18 -07:00
c6a2430b47
HDFS-10329. Bad initialisation of StringBuffer in RequestHedgingProxyProvider. Contributed by Lin Yiqun.
2016-04-26 11:45:29 -05:00
5865fe2bf0
HDFS-9869. Erasure Coding: Rename replication-based names in BlockManager to more generic [part-2]. Contributed by Rakesh R.
2016-04-25 22:01:54 -07:00
8eadd7145e
HDFS-10325. TestDFSShell#testMoveWithTargetPortEmpty fails. Contributed by Takanobu Asanuma.
2016-04-26 07:11:13 +09:00
f308561f1d
HDFS-8057 Move BlockReader implementation to the client implementation package. Contributed by Takanobu Asanuma
2016-04-25 12:01:48 -07:00
10f0f7851a
HDFS-10318. TestJMXGet hides the real error in case of test failure. Contributed by Andras Bokor.
2016-04-25 11:38:14 -05:00
6fcde2e38d
HDFS-9905. WebHdfsFileSystem#runWithRetry should display original stack trace on error. (Wei-Chiu Chuang via iwasakims)
2016-04-23 23:37:56 +09:00
63e5412f1a
HDFS-9427. HDFS should not default to ephemeral ports. Contributed by Xiaobing Zhou.
2016-04-22 15:14:40 -07:00
d6402faded
Revert "HADOOP-12563. Updated utility (dtutil) to create/modify token files. Contributed by Matthew Paduano"
...
This reverts commit 4838b735f0
2016-04-22 10:17:20 -07:00
5d4255a801
HDFS-9555. LazyPersistFileScrubber should still sleep if there are errors in the clear progress. Contributed by Phil Yang.
2016-04-22 11:08:44 -05:00
14ab7a81e2
HDFS-10309 Balancer doesn't honor dfs.blocksize value defined with suffix k(kilo), m(mega), g(giga). Contributed by Amit Anand
2016-04-21 15:41:50 -07:00
bbce1d525e
HDFS-10319. Balancer should not try to pair storages with different types.
2016-04-21 15:20:12 -07:00
4838b735f0
HADOOP-12563. Updated utility (dtutil) to create/modify token files. Contributed by Matthew Paduano
2016-04-21 11:32:39 -07:00
b4be288c5d
HDFS-10207. Support enable Hadoop IPC backoff without namenode restart. Contributed by Xiaobing Zhou.
2016-04-21 10:18:48 -07:00
5bd7b592e5
HADOOP-12985. Support MetricsSource interface for DecayRpcScheduler Metrics. Contributed by Xiaoyu Yao.
2016-04-20 23:10:52 -07:00
63ac2db59a
HDFS-10312. Large block reports may fail to decode at NameNode due to 64 MB protobuf maximum length restriction. Contributed by Chris Nauroth.
2016-04-20 13:39:44 -07:00
ad36fa6f42
HDFS-10308. TestRetryCacheWithHA#testRetryCacheOnStandbyNN failing (Rakesh R via cmccabe)
2016-04-20 11:33:11 -07:00
af9bdbe447
HDFS-10264. Logging improvements in FSImageFormatProtobuf.Saver. (Contributed by Xiaobing Zhou)
2016-04-19 11:26:30 -07:00
90d1af1416
HDFS-9744. TestDirectoryScanner#testThrottling occasionally time out after 300 seconds. Contributed by Lin Yiqun.
2016-04-19 18:54:11 +08:00
4b4df2cd48
HDFS-10284. o.a.h.hdfs.server.blockmanagement.TestBlockManagerSafeMode.testCheckSafeMode fails intermittently. Contributed by Mingliang Liu.
2016-04-19 18:07:46 +08:00
438efc3634
HDFS-10291 TestShortCircuitLocalRead failing (stevel)
...
(cherry picked from commit dd64769699
2016-04-19 17:48:20 +08:00
b5d4c7dc76
HADOOP-12924. Configure raw erasure coders for supported codecs. Contributed by Rui Li.
2016-04-20 15:47:01 +08:00
be0bce1b71
HDFS-10306. SafeModeMonitor should not leave safe mode if name system is starting active service. Contributed by Mingliang Liu.
2016-04-18 18:05:49 -07:00
c884170c93
Merge branch 'trunk' into HDFS-7240
2016-04-18 16:58:45 -07:00
ce524c584b
HDFS-10232. Ozone: Make config key naming consistent. Contributed by Anu Engineer.
2016-04-18 16:52:40 -07:00
cb3ca460ef
HDFS-10265. OEV tool fails to read edit xml file if OP_UPDATE_BLOCKS has no BLOCK tag (Wan Chang via cmccabe)
2016-04-18 13:47:56 -07:00
d8b729e16f
HDFS-10302. BlockPlacementPolicyDefault should use default replication considerload value. Contributed by Lin Yiqun.
2016-04-18 07:58:55 -05:00
ab903029a9
HDFS-10275. TestDataNodeMetrics failing intermittently due to TotalWriteTime counted incorrectly. Contributed by Lin Yiqun.
2016-04-18 20:29:29 +08:00
67523ffcf4
HDFS-9412. getBlocks occupies FSLock and takes too long to complete. Contributed by He Tianyi.
2016-04-18 09:28:02 +08:00
55e19b7f0c
HDFS-10293. StripedFileTestUtil#readAll flaky. Contributed by Mingliang Liu.
2016-04-15 10:53:40 -07:00
89a838769f
HDFS-10283. o.a.h.hdfs.server.namenode.TestFSImageWithSnapshot#testSaveLoadImageWithAppending fails intermittently. Contributed by Mingliang Liu.
2016-04-15 10:49:21 -07:00
b9c9d03591
HDFS-10281. TestPendingCorruptDnMessages fails intermittently. Contributed by Mingliang Liu.
2016-04-14 15:24:39 -05:00
809226752d
HDFS-10286. Fix TestDFSAdmin#testNameNodeGetReconfigurableProperties. Contributed by Xiaobing Zhou.
2016-04-14 10:57:02 -07:00
c970f1d005
HDFS-10280. Document new dfsadmin command -evictWriters. Contributed by Wei-Chiu Chuang.
2016-04-14 12:45:47 -05:00
0d1c1152f1
HDFS-10282. The VolumeScanner should warn about replica files which are misplaced. Contributed by Colin Patrick McCabe.
2016-04-14 07:58:24 -05:00
ae6c0e839b
Merge branch 'trunk' into HDFS-7240
2016-04-13 23:13:11 -07:00
5566177c9a
HDFS-10209. Support enable caller context in HDFS namenode audit log without restart namenode. Contributed by Xiaobing Zhou.
2016-04-13 16:51:13 -07:00
4895c73dd4
Revert "HDFS-10209. Support enable caller context in HDFS namenode audit log without restart namenode"
...
This reverts commit 192112d5a2
2016-04-13 16:45:18 -07:00
314aa21a89
HDFS-10279. Improve validation of the configured number of tolerated failed volumes. Contributed by Lin Yiqun.
2016-04-13 16:39:50 -07:00
192112d5a2
HDFS-10209. Support enable caller context in HDFS namenode audit log without restart namenode
2016-04-13 15:34:41 -07:00
d2f3bbc290
HDFS-10270. TestJMXGet:testNameNode() fails. Contributed by Gergely Novák
2016-04-13 11:22:36 -05:00
903428bf94
HDFS-9772. TestBlockReplacement#testThrottler doesn't work as expected. Contributed by Lin Yiqun.
2016-04-13 17:49:45 +08:00
eee7269748
HDFS-10278. Ozone: Add paging support to list Volumes. Contributed by Anu Engineer.
2016-04-12 18:08:48 -07:00
33b51da8c5
HDFS-10251. Ozone: Shutdown cleanly. Contributed by Anu Engineer
2016-04-12 18:00:24 -07:00
35f0770555
HADOOP-12973. Make DU pluggable. (Elliott Clark via cmccabe)
2016-04-12 16:28:42 -07:00
6ef42873a0
HDFS-9918. Erasure Coding: Sort located striped blocks based on decommissioned states. Contributed by Rakesh R.
2016-04-12 13:38:58 -07:00
600d129bb8
HDFS-10273. Remove duplicate logSync() and log message in FSN#enterSafemode() (Vinayakumar B via cmccabe)
2016-04-12 10:52:39 -07:00
209303be3a
HDFS-8356. Document missing properties in hdfs-default.xml. Contributed by Ray Chiang.
2016-04-12 15:26:50 +09:00
a9a607f8fc
HDFS-10271. Extra bytes are getting released from reservedSpace for append (Contributed by Brahma Reddy Battula)
2016-04-12 11:44:34 +05:30
9c32f8785e
HDFS-10266. Remove unused properties dfs.client.file-block-storage-locations.num-threads and dfs.client.file-block-storage-locations.timeout.millis. Contributed by Ray Chiang.
2016-04-08 15:32:13 +09:00
3f62ba558d
Merge branch 'trunk' into HDFS-7240
2016-04-07 14:43:39 -07:00
fedb22d9b6
HDFS-10268. Ozone: end-to-end integration for create/get volumes, buckets and keys. Contributed by Chris Nauroth.
2016-04-07 14:38:54 -07:00
3c18a53cbd
HDFS-9719. Refactoring ErasureCodingWorker into smaller reusable constructs. Contributed by Kai Zheng.
2016-04-06 22:50:24 -07:00
654cd1d0c0
HDFS-10186. DirectoryScanner: Improve logs by adding full path of both actual and expected block directories. Contributed by Rakesh R
2016-04-07 12:38:42 +08:00
4bd7cbc29d
HDFS-10267. Extra "synchronized" on FsDatasetImpl#recoverAppend and FsDatasetImpl#recoverClose
2016-04-06 21:07:31 -07:00
aede8c10ec
HDFS-9945. Datanode command for evicting writers. Contributed by Kihwal Lee
2016-04-06 20:20:14 +00:00
188f65287d
HDFS-6520. hdfs fsck passes invalid length value when creating BlockReader (Xiao Chen via cmccabe)
2016-04-06 11:28:34 -07:00
221b3a8722
HDFS-10192. Namenode safemode not coming out during failover. Contributed by Brahma Reddy Battula.
2016-04-06 10:42:59 -07:00
9ba1e5af06
HDFS-10261. TestBookKeeperHACheckpoints doesn't handle ephemeral HTTP ports. Contributed by Eric Badger.
2016-04-05 16:26:18 -05:00
0cd320a846
HDFS-10235. Last contact for Live Nodes should be relative time. Contributed by Brahma Reddy Battula.
2016-04-05 13:41:19 -07:00
b3044db407
HDFS-10250. Ozone: Add key Persistence. Contributed by Anu Engineer.
2016-04-05 12:59:45 -07:00
917464505c
HDFS-10239. Fsshell mv fails if port usage doesn't match in src and destination paths. Contributed by Kuhu Shukla.
2016-04-05 09:07:24 -05:00
818d6b799e
HDFS-9917. IBR accumulate more objects when SNN was down for sometime. (Contributed by Brahma Reddy Battula)
2016-04-05 09:49:39 +08:00
f6b1a81812
HDFS-8496. Calling stopWriter() with FSDatasetImpl lock held may block other threads (cmccabe)
2016-04-04 18:02:15 -07:00
a7d1fb0cd2
HDFS-10178. Permanent write failures can happen if pipeline recoveries occur for the first packet. Contributed by Kihwal Lee.
2016-04-04 16:40:00 -05:00
154d2532cf
HDFS-9599. TestDecommissioningStatus.testDecommissionStatus occasionally fails (Lin Yiqun via iwasakims)
2016-04-05 03:19:48 +09:00
54b2e78fd2
HDFS-10253. Fix TestRefreshCallQueue failure (Contributed by Xiaoyu Yao)
2016-04-03 13:27:49 +05:30
4ac97b1815
HDFS-10238. Ozone : Add chunk persistance. Contributed by Anu Engineer.
2016-04-01 10:52:38 -07:00
0a74610d1c
HADOOP-11393. Revert HADOOP_PREFIX, go back to HADOOP_HOME (aw)
2016-03-31 07:51:05 -07:00
32c0c3ecdf
HDFS-10221. Add .json to the rat exclusions. Contributed by Ming Ma.
2016-03-31 09:06:14 +09:00
55d4ee71e2
HDFS-8210. Ozone: Implement storage container manager. Contributed by Chris Nauroth.
2016-03-30 14:49:55 -07:00
37e23ce45c
HDFS-10223. peerFromSocketAndKey performs SASL exchange before setting connection timeouts (cmccabe)
2016-03-30 13:37:37 -07:00
09d63d5a19
HDFS-5177. blocksScheduled count should be decremented for abandoned blocks (Contributed by Vinayakumar B)
2016-03-30 14:22:00 +08:00
ddfe6774c2
HDFS-9439. Support reconfiguring fs.protected.directories without NN restart. (Contributed by Xiaobing Zhou)
2016-03-29 13:55:00 -07:00
c9307e48b7
HDFS-10228. TestHDFSCLI fails. (Contributed by Akira AJISAKA)
2016-03-29 13:50:08 -07:00
f2aec4eb82
HDFS-10197. TestFsDatasetCache failing intermittently due to timeout. Contributed by Lin Yiqun.
2016-03-29 11:54:42 -07:00
1f004b3367
HDFS-9871. "Bytes Being Moved" -ve(-1 B) when cluster was already balanced. (Contributed by Brahma Reddy Battulla)
2016-03-29 11:25:41 +08:00
30473ecfb4
Merge branch 'trunk' into HDFS-7240
2016-03-28 10:34:52 -07:00
3a4ff7776e
HDFS-9694. Make existing DFSClient#getFileChecksum() work for striped blocks. Contributed by Kai Zheng
2016-03-26 19:58:09 -07:00
643c5e5bdc
HDFS-10195. Ozone: Add container persistence. Contributed by Anu Engineer.
2016-03-26 11:40:00 -07:00
a337ceb74e
Revert "HDFS-9694. Make existing DFSClient#getFileChecksum() work for striped blocks. Contributed by Kai Zheng"
...
This reverts commit e5ff0ea7ba
2016-03-26 09:20:01 -07:00
e5ff0ea7ba
HDFS-9694. Make existing DFSClient#getFileChecksum() work for striped blocks. Contributed by Kai Zheng
2016-03-26 00:52:50 -07:00
fde8ac5d85
Add missing files from HDFS-9005. (lei)
2016-03-25 17:11:35 -07:00
4fcfea71bf
HDFS-9005. Provide support for upgrade domain script. (Ming Ma via Lei Xu)
2016-03-25 17:09:12 -07:00
2dc48b7f1e
HDFS-10202. ozone : Add key commands to CLI. Contributed by Anu Engineer.
2016-03-25 09:50:58 -07:00
58cdb715fb
HDFS-10196. Ozone : Enable better error reporting for failed commands in ozone shell. Contributed by Anu Engineer.
2016-03-24 09:27:10 -07:00
738155063e
HADOOP-12857. rework hadoop-tools (aw)
2016-03-23 13:46:38 -07:00
8f85e5d212
HDFS-10200. Docs for WebHDFS still describe GETDELEGATIONTOKENS operation. Contributed by Wellington Chevreuil.
2016-03-23 12:55:15 -07:00
a7d8f2b396
HDFS-10189. PacketResponder#toString should include the downstreams for PacketResponderType.HAS_DOWNSTREAM_IN_PIPELINE (Joe Pallas via cmccabe)
2016-03-22 14:56:02 -07:00
680716f31e
HDFS-9951. Use string constants for XML tags in OfflineImageReconstructor (Lin Yiqun via cmccabe)
2016-03-21 11:40:37 -07:00
e3bb38d625
HDFS-9405. Warmup NameNode EDEK caches in background thread. Contributed by Xiao Chen.
2016-03-21 11:39:05 -07:00
8a3f0cb255
HDFS-7166. SbNN Web UI shows #Under replicated blocks and #pending deletion blocks. Contributed by Wei-Chiu Chuang.
2016-03-20 17:21:25 -07:00
cd8b6889a7
HDFS-9579. Provide bytes-read-by-network-distance metrics at FileSystem.Statistics level (Ming Ma via sjlee)
2016-03-19 14:02:04 -07:00
3f708bf711
HDFS-10179. Ozone: Adding logging support. Contributed by Anu Engineer.
2016-03-19 13:59:00 -07:00
2e517a64d8
HDFS-9960. OzoneHandler : Add localstorage support for keys. Contributed by Anu Engineer.
2016-03-19 13:36:18 -07:00
c73a32c21c
HDFS-10180. Ozone: Refactor container Namespace. Contributed by Anu Engineer.
2016-03-18 13:46:56 -07:00
37e3a36a3f
Merge branch 'trunk' into HDFS-7240
2016-03-18 11:18:48 -07:00
9b623fbaf7
HDFS-3677. dfs.namenode.edits.dir.required is missing from hdfs-default.xml. Contributed by Mark Yang.
2016-03-19 01:11:15 +09:00
63c966a3fb
HDFS-9874. Long living DataXceiver threads cause volume shutdown to block. Contributed by Rushabh Shah.
2016-03-18 10:24:59 -05:00
dc951e606f
HDFS-9949. Add a test case to ensure that the DataNode does not regenerate its UUID when a storage directory is cleared (Harsh J via cmccabe)
2016-03-17 10:37:42 -07:00
02a250db9f
HDFS-10173. Typo in DataXceiverServer. Contributed by Michael Han.
2016-03-16 18:49:57 -07:00
32d043d9c5
HDFS-9857. Erasure Coding: Rename replication-based names in BlockManager to more generic [part-1]. Contributed by Rakesh R.
2016-03-16 16:53:58 -07:00
4143f0362f
HDFS-9961. Ozone: Add buckets commands to CLI. Contributed by Anu Engineer.
2016-03-15 21:27:53 -07:00
d457401784
HDFS-9904. testCheckpointCancellationDuringUpload occasionally fails. Contributed by Lin Yiqun.
2016-03-15 10:52:47 -05:00
5de848cd5d
HDFS-9928. Make HDFS commands guide up to date (Wei-Chiu Chuang via iwasakims)
2016-03-15 20:42:05 +09:00
4683d68ee6
HDFS-9944. Ozone : Add container dispatcher. Contributed by Anu Engineer.
2016-03-14 16:16:35 -07:00
bd5556ba12
Download File from UI broken after pagination. Contributed by Brahma Reddy Battula
2016-03-14 14:30:13 -07:00
657bc690c2
HDFS-9926. ozone : Add volume commands to CLI. Contributed by Anu Engineer.
2016-03-14 10:50:54 -07:00
5644137ada
HDFS-9941. Do not log StandbyException on NN, other minor logging fixes. Contributed by Arpit Agarwal.
2016-03-14 09:54:54 -07:00
64add6756c
HDFS-9925. Ozone: Add Ozone Client lib for bucket handling. Contributed by Anu Engineer.
...
Fix build break
2016-03-11 13:03:15 -08:00
e74f1d4728
HDFS-9916. OzoneHandler : Add Key handler. Contributed by Anu Engineer.
2016-03-11 12:57:10 -08:00
e882d6273c
HDFS-9916. OzoneHandler : Add Key handler. Contributed by Anu Engineer.
2016-03-11 12:57:10 -08:00
ff4ea053d3
HDFS-9920. Stop tracking CHANGES.txt in the HDFS-7240 feature branch. Contributed by Chris Nauroth.
2016-03-11 12:57:09 -08:00
979dfe4c2e
HDFS-9891. Ozone: Add container transport client. Contributed by Anu Engineer.
2016-03-11 12:57:09 -08:00
b31a5d67f1
HDFS-9873. Ozone: Add container transport server. Contributed by Anu Engineer.
2016-03-11 12:57:09 -08:00
2fff7d58da
HDFS-9907. Exclude Ozone protobuf-generated classes from Findbugs analysis. Contributed by Chris Nauroth
2016-03-11 12:57:09 -08:00
d4402c5123
HDFS-9848. Ozone: Add Ozone Client lib for volume handling. Contributed by Anu Engineer.
2016-03-11 12:57:08 -08:00
45e360f54e
HDFS-9853. Ozone: Add container definitions. Contributed by Anu Engineer.
2016-03-11 12:57:08 -08:00
40211dd4fe
HDFS-9845. OzoneHandler : Support List and Info Volumes. Contributed by Anu Engineer.
2016-03-11 12:57:08 -08:00
ed258dc633
HDFS-9834. OzoneHandler : Enable MiniDFSCluster based testing for Ozone. Contributed by Anu Engineer.
2016-03-11 12:57:08 -08:00
14b85da0ea
HDFS-8757 : OzoneHandler : Add localStorageHandler support for Buckets. Contributed by Anu Engineer
2016-03-11 12:57:08 -08:00
312a01ea3c
HDFS-8527. OzoneHandler: Integration of REST interface and container data pipeline back-end. Contributed by Chris Nauroth
2016-03-11 12:57:07 -08:00
114ef3000c
HDFS-8695. OzoneHandler : Add Bucket REST Interface. (aengineer)
2016-03-11 12:57:07 -08:00
d309930374
HDFS-8753. Ozone: Unify StorageContainerConfiguration with ozone-default.xml & ozone-site.xml. Contributed by kanaka kumar avvaru
2016-03-11 12:57:07 -08:00
06c5b2500a
HDFS-8717. OzoneHandler : Add common bucket objects. (Contributed by Anu Engineer)
2016-03-11 12:57:07 -08:00
acb949e6f9
HDFS-8680. OzoneHandler : Add Local StorageHandler support for volumes. (Contributed by Anu Engineer)
2016-03-11 12:57:07 -08:00
5d70ed415c
HDFS-8654. OzoneHandler : Add ACL support. (Contributed by Anu Engineer)
2016-03-11 12:57:06 -08:00
476d22dfa1
HDFS-8644. OzoneHandler : Add volume handler. (Contributed by Anu Engineer)
2016-03-11 12:57:06 -08:00
d9d9504102
HDFS-8634. OzoneHandler: Add userAuth Interface and Simple userAuth handler. (Contributed by Anu Engineer)
2016-03-11 12:57:06 -08:00
7452cc5d8b
HDFS-8637. OzoneHandler : Add Error Table. (Contributed by Anu Engineer)
2016-03-11 12:57:06 -08:00
f0b2b26c34
HDFS-8448. Create REST Interface for Volumes. Contributed by Anu Engineer.
2016-03-11 12:57:05 -08:00
15a3e75854
HDFS-8614. OzoneHandler : Add Quota Support. (Contributed by Anu Engineer)
2016-03-11 12:56:44 -08:00
e2f494c2c4
HDFS-8456. Introduce STORAGE_CONTAINER_SERVICE as a new NodeType. (Contributed by Arpit Agarwal)
2016-03-11 12:56:29 -08:00
e01c6ea688
HDFS-1477. Support reconfiguring dfs.heartbeat.interval and dfs.namenode.heartbeat.recheck-interval without NN restart. (Contributed by Xiaobing Zhou)
2016-03-10 19:03:55 -08:00
79961ecea8
HDFS-9933. ReverseXML should be capitalized in oiv usage message (cmccabe)
2016-03-10 13:43:27 -08:00
bd49354c6d
HDFS-9934. ReverseXML oiv processor should bail out if the XML file's layoutVersion doesn't match oiv's (cmccabe)
2016-03-10 13:41:06 -08:00
500875dfcc
HDFS-9927. Document the new OIV ReverseXML processor (Wei-Chiu Chuang via cmccabe)
2016-03-10 13:38:00 -08:00
7600e3c48f
HDFS-7866. Erasure coding: NameNode manages multiple erasure coding policies. Contributed by Rui Li.
2016-03-08 22:30:30 -08:00
89b16d27e2
HADOOP-12905. Clean up CHANGES.txt RAT exclusions from pom.xml files. Contributed by Chris Nauroth.
2016-03-08 21:22:06 -08:00
a14a6f08ee
HDFS-9919. TestStandbyCheckpoints#testNonPrimarySBNUploadFSImage waitForCheckpoint incorrectly. Contributed by Lin Yiqun.
2016-03-08 11:54:50 -08:00
743a99f2db
HDFS-8786. Erasure coding: use simple replication for internal blocks on decommissioning datanodes. Contributed by Rakesh R.
2016-03-08 10:24:57 -08:00
c2140d05ef
HDFS-9882. Add heartbeatsTotal in Datanode metrics. (Contributed by Hua Liu)
2016-03-07 21:10:24 -08:00
724d2299cd
HDFS-9906. Remove spammy log spew when a datanode is restarted. (Contributed by Brahma Reddy Battula)
2016-03-07 12:19:53 -08:00
d718fc1ee5
HDFS-9865. TestBlockReplacement fails intermittently in trunk (Lin Yiqun via iwasakims)
2016-03-08 02:07:18 +09:00
fd1c09be3e
HDFS-9521. TransferFsImage.receiveFile should account and log separate times for image download and fsync to disk. Contributed by Wellington Chevreuil
2016-03-07 17:14:51 +05:30
2759689d7d
HDFS-9239. DataNode Lifeline Protocol: an alternative protocol for reporting DataNode liveness. Contributed by Chris Nauroth.
2016-03-04 15:29:50 -08:00
8e08861a14
HDFS-9889. Update balancer/mover document about HDFS-6133 feature. Contributed by Yongjun Zhang.
2016-03-04 13:25:29 -08:00
3e8099a45a
HDFS-9888. Allow reseting KerberosName in unit tests. Contributed by Xiao Chen.
2016-03-04 09:48:05 -08:00
cbd31328a6
HADOOP-12470. In-page TOC of documentation should be automatically generated by doxia macro (iwasakims)
2016-03-04 14:11:36 +09:00
1bc454615e
HADOOP-11792. Remove all of the CHANGES.txt files.
2016-03-03 21:02:31 -08:00
33a412e8a4
HDFS-9048. DistCp documentation is out-of-dated (Daisuke Kobayashi via iwasakims)
2016-03-03 18:57:23 +09:00
f70e317ccc
HADOOP-12793. Write a new group mapping service guide (Wei-Chiu Chuang via iwasakims)
2016-03-03 17:14:32 +09:00
27941a1811
HDFS-9534. Add CLI command to clear storage policy from a path. (Contributed by Xiaobing Zhou)
2016-03-02 18:35:28 -08:00
700b0e4019
HDFS-9835. OIV: add ReverseXML processor which reconstructs an fsimage from an XML file (cmccabe)
2016-03-02 17:56:11 -08:00
67880ccae6
HDFS-9886. Configuration properties for hedged read is broken. Contributed by Akira AJISAKA.
2016-03-02 10:26:06 -08:00
5abf051249
HDFS-9887. WebHdfs socket timeouts should be configurable. Contributed by Austin Donnelly and Chris Douglas.
2016-03-02 09:23:17 -08:00
27e0681f28
HDFS-9851. NameNode throws NPE when setPermission is called on a path that does not exist. Contributed by Brahma Reddy Battula.
2016-03-02 14:43:03 +09:00
e2ddf82469
HDFS-9766. TestDataNodeMetrics#testDataNodeTimeSpend fails intermittently. Contributed by Xiao Chen.
2016-03-02 14:17:35 +09:00
f2ba7da4f0
HDFS-9876. shouldProcessOverReplicated should not count number of pending replicas. Contributed by Jing Zhao.
2016-03-01 18:41:57 -08:00
4abb2fa687
HDFS-9881. DistributedFileSystem#getTrashRoot returns incorrect path for encryption zones.
2016-03-01 16:35:39 -08:00
e76b13c415
HDFS-9880. TestDatanodeRegistration fails occasionally. Contributed by Kihwal Lee.
2016-03-01 17:00:18 -06:00
2c8496ebf3
HDFS-8791. block ID-based DN storage layout can be very slow for datanode on ext4. Contributed by Chris Trezzo.
2016-03-01 15:04:59 -06:00
2137e8feeb
HDFS-9870. Remove unused imports from DFSUtil. Contributed by Brahma Reddy Battula.
2016-03-01 11:15:13 -08:00
307ec80aca
HDFS-9733. Refactor DFSClient#getFileChecksum and DataXceiver#blockChecksum. Contributed by Kai Zheng
2016-02-29 21:52:20 -08:00
2151716832
HDFS-7964. Add support for async edit logging. Contributed by Daryn Sharp.
2016-02-29 15:34:43 -08:00
8bc023b3b1
HDFS-9864. Correct reference for RENEWDELEGATIONTOKEN and CANCELDELEGATIONTOKEN in webhdfs doc. Contributed by Brahma Reddy Battula.
2016-02-29 18:42:21 +09:00
321a80c759
HDFS-9867. Missing block exception should carry locatedBlocks information. Contributed by Mingliang Liu.
2016-02-28 15:00:27 -08:00
408f2c807b
HDFS-9866. BlockManager#chooseExcessReplicasStriped may weaken rack fault tolerance. Contributed by Jing Zhao.
2016-02-28 14:54:49 -08:00
d1d4e16690
HDFS-9710. DN can be configured to send block receipt IBRs in batches.
2016-02-26 15:32:25 -08:00
eab52dfb35
HDFS-9831. Document webhdfs retry configuration keys introduced by HDFS-5219/HDFS-5122. Contributed by Xiaobing Zhou.
2016-02-26 14:14:12 -08:00
c2460dad64
HDFS-9858. RollingFileSystemSink can throw an NPE on non-secure clusters. (Daniel Templeton via kasha)
2016-02-25 16:31:09 -08:00
8808779db3
HDFS-9734. Refactoring of checksum failure report related codes. Contributed by Kai Zheng.
...
Change-Id: Ie69a77e3498a360959f8e213c51fb2b17c28b64a
2016-02-25 09:55:50 -08:00
ccff6035f5
HDFS-9804. Allow long-running Balancer to login with keytab. Contributed by Xiao Chen.
...
Change-Id: I54b82e0b11929082057b4d21bfcf285222c94cdb
2016-02-25 09:24:32 -08:00
6979cbfc1f
HDFS-9838. Refactor the excessReplicateMap to a class.
2016-02-24 19:42:47 -08:00
dbbfc58c33
HDFS-9843. Document distcp options required for copying between encrypted locations. Contributed by Xiaoyu Yao.
2016-02-24 15:16:05 -08:00
47b92f2b6f
HDFS-9837. BlockManager#countNodes should be able to detect duplicated internal blocks. Contributed by Jing Zhao.
2016-02-24 15:13:56 -08:00
d1dd248b75
HDFS-9854. Log cipher suite negotiation more verbosely. Contributed by Wei-Chiu Chuang.
2016-02-24 12:11:35 -08:00
d27d7fc72e
HDFS-9395. Make HDFS audit logging consistant. Contributed by Kuhu Shukla.
2016-02-24 12:04:01 -06:00
def754ec06
HDFS-9816. Erasure Coding: allow to use multiple EC policies in striping related tests [Part 3]. Contributed by Rui Li.
...
Change-Id: I64b57bab4722cdc6e1e3148c3a3a401370249afe
2016-02-23 14:05:17 -08:00
647a35e996
HDFS-9844. Correct path creation in getTrashRoot to handle root dir.
...
Change-Id: I5afe6c7176063892e3e632698c849bd9f4b92906
2016-02-23 13:29:39 -08:00
211c78c090
HDFS-9549. TestCacheDirectives#testExceedsCapacity is flaky (Xiao Chen via cmccabe)
2016-02-23 12:01:20 -08:00
48c61cd6aa
HDFS-9084. Pagination, sorting and filtering of files/directories in the HDFS Web UI. (Contributed by Ravi Prakash)
2016-02-23 19:30:58 +09:00
66289a3bf4
HDFS-8578. On upgrade, Datanode should process all storage/data dirs in parallel. Contributed by vinayakumarb and szetszwo
2016-02-22 15:01:15 -08:00
a2fdfff02d
HADOOP-12668. Support excluding weak Ciphers in HttpServer2 through ssl-server.conf. Contributed by Vijay Singh.
...
Change-Id: Ie46a5427d29188935427f67e55203c19fcd83335
2016-02-22 14:13:54 -08:00
a63301a864
HDFS-9842. dfs.datanode.balance.bandwidthPerSec should accept friendly size units. (Contributed by Lin Yiqun)
2016-02-22 11:34:09 -08:00
342c9572bf
HDFS-9425. Expose number of blocks per volume as a metric (Contributed by Brahma Reddy Battula)
2016-02-22 09:29:23 +05:30
f313516731
HDFS-7452. skip StandbyException log for getCorruptFiles() (Contributed by Bramha Reddy Battula)
2016-02-22 09:21:46 +05:30
d5abd293a8
HDFS-9839. Reduce verbosity of processReport logging. (Contributed by Arpit Agarwal)
...
This closes #78
2016-02-20 23:19:09 -08:00
e54cc29312
HDFS-9818. Correctly handle EC reconstruction work caused by not enough racks. Contributed by Jing Zhao.
2016-02-19 19:02:23 -08:00
6546d9e7ff
HDFS-9829. Erasure Coding: Improve few exception handling logic of ErasureCodingWorker. Contributed by Rakesh R.
2016-02-19 10:40:28 -08:00
ba1c9d484a
HDFS-9764. DistCp doesn't print value for several arguments including -numListstatusThreads. (Wei-Chiu Chuang via Yongjun Zhang)
2016-02-19 10:17:37 -08:00
748b6c07fe
Move HDFS-8923 to Release 2.8.0 in CHANGES.txt.
2016-02-18 18:43:06 -08:00
46f7790236
HDFS-8923. Add -source flag to balancer usage message. Contributed by Chris Trezzo
2016-02-18 18:18:12 -08:00
c7ac25e52c
HDFS-9830. Remove references to hftp in ViewFs documentation in trunk. Contributed by Wei-Chiu Chuang.
2016-02-19 05:02:57 +09:00
bbfaf3c271
HADOOP-10865. Add a Crc32 chunked verification benchmark for both directly and non-directly buffer cases.
2016-02-18 11:47:33 -08:00
ba6d5ed955
HDFS-4946. Allow preferLocalNode in BlockPlacementPolicyDefault to be configurable. Contributed by James Kinley and Nathan Roberts.
2016-02-18 13:21:51 -06:00
5d1889a66d
HDFS-9711. Integrate CSRF prevention filter in WebHDFS. Contributed by Chris Nauroth.
2016-02-18 10:07:28 -08:00
e78d8e66f7
HDFS-6832. Fix the usage of 'hdfs namenode' command. Contributed by Manjunath Ballur.
2016-02-19 01:35:06 +09:00
0fb14aaced
HDFS-9799. Reimplement getCurrentTrashDir to remove incompatibility. (zhz)
...
Change-Id: I7834bcebffed38cb384db5395ddb8b6dd9e79a0b
2016-02-17 13:30:50 -08:00
3a23dc683c
HDFS-9608. Disk IO imbalance in HDFS with heterogeneous storages. Contributed by Wei Zhou.
2016-02-17 11:29:58 -08:00
77f7ca3e94
HDFS-9815. Move o.a.h.fs.Hdfs to hadoop-hdfs-client. Contributed by Vinayakumar B.
2016-02-17 10:56:11 -08:00
2536ece7b6
HDFS-9787. SNNs stop uploading FSImage to ANN once isPrimaryCheckPointer changed to false. (Contributed by Guocui Mi)
2016-02-17 10:41:24 +05:30
77ba5add0d
HDFS-9456. BlockPlacementPolicyWithNodeGroup should override verifyBlockPlacement(). Contributed by Xiaobing Zhou.
2016-02-16 18:55:55 -08:00
8ed07bd3e6
HDFS-9765. TestBlockScanner#testVolumeIteratorWithCaching fails intermittently. (aajisaka)
2016-02-15 19:08:03 +09:00
b0738ae673
HDFS-9773. Remove dead code related to SimulatedFSDataset in tests. Contributed by Brahma Reddy Battula.
2016-02-15 15:35:06 +09:00
ac5da11399
HDFS-9691. TestBlockManagerSafeMode#testCheckSafeMode fails intermittently. Contributed by Mingliang Liu.
2016-02-15 14:00:09 +09:00
ec12ce8f48
Set the release date for 2.6.4.
2016-02-13 01:42:50 -08:00
1de1641f17
HDFS-9801. ReconfigurableBase should update the cached configuration. (Arpit Agarwal)
2016-02-12 12:41:04 -08:00
9fdfb546fb
HDFS-9797. Log Standby exceptions thrown by RequestHedgingProxyProvider at DEBUG Level (Inigo Goiri via asuresh)
2016-02-12 11:18:10 -08:00
972782d956
HDFS-9754. Avoid unnecessary getBlockCollection calls in BlockManager. Contributed by Jing Zhao.
2016-02-12 11:07:52 -08:00
f3c91a41a5
HDFS-9794. Streamer threads may leak if failure happens when closing the striped outputstream. Contributed by Jing Zhao.
2016-02-12 10:59:31 -08:00
b21bbe9ed1
HDFS-9644. Update encryption documentation to reflect nested EZs. (zhz)
...
Change-Id: I84ae96f4711a16ded46d501c51ca322bfca5151d
2016-02-12 10:44:15 -08:00
372d1302c6
HDFS-9700. DFSClient and DFSOutputStream should set TCP_NODELAY on sockets for DataTransferProtocol (Gary Helmling via iwasakims)
2016-02-13 03:31:15 +09:00
e6a7044b85
HDFS-9768. Reuse ObjectMapper instance in HDFS to improve the performance. Contributed by Lin Yiqun.
2016-02-13 01:57:24 +09:00
9b959f3ee7
HDFS-9790. HDFS Balancer should exit with a proper message if upgrade is not finalized (Contributed by Xiaobing Zhou)
2016-02-11 20:40:03 -08:00
33ce7f6c07
HDFS-9780. RollingFileSystemSink doesn't work on secure clusters. (Daniel Templeton via kasha)
2016-02-11 20:37:14 -08:00
c7fcec24b8
HDFS-9795. OIV Delimited should show which files are ACL-enabled (lei)
2016-02-11 20:33:51 -08:00
0aa8c82894
HDFS-9755. Erasure Coding: allow to use multiple EC policies in striping related tests [Part 2]. Contributed by Rui Li.
...
Change-Id: I2100bc27ad484f83c9cb2d2e5bb232f4f74fd286
2016-02-11 10:14:09 -08:00
19adb2bc64
HDFS-9789. Correctly update DataNode's scheduled block size when writing small EC file. Contributed by Jing Zhao.
2016-02-10 21:24:00 -08:00
aeb13ef2ab
HDFS-9788. Incompatible tag renumbering in HeartbeatResponseProto.
2016-02-10 15:26:08 -08:00
bc425a623f
HDFS-9637. Tests for RollingFileSystemSink. (Daniel Templeton via kasha)
2016-02-10 10:08:05 -08:00
802a7edfae
HDFS-9686. Remove useless boxing/unboxing code. Contributed by Kousuke Saruta.
2016-02-10 23:49:14 +09:00
5e565ce7a7
Revert "HDFS-9686. Remove useless boxing/unboxing code. Contributed by Kousuke Saruta."
...
This reverts commit fe124da5ff
2016-02-10 23:43:33 +09:00
a7fce9ab41
HDFS-9779 . TestReplicationPolicyWithNodeGroup NODE variable picks wrong rack value. Contributed by Kuhu Shukla.
2016-02-09 15:14:30 -08:00
a0fb2eff9b
HDFS-9775. Erasure Coding : Rename BlockRecoveryWork to BlockReconstructionWork. Contributed by Rakesh R.
...
Change-Id: I6dfc8efd94fa2bbb4eec0e4730a5a4f92c8a5519
2016-02-09 14:43:59 -08:00
401ae4ecdb
HDFS-9760. WebHDFS AuthFilter cannot be configured with custom AltKerberos auth handler (Ryan Sasson via aw)
2016-02-09 14:15:21 -08:00
60d2011b7c
HDFS-9784. Example usage is not correct in Transparent Encryption document. Contributed by Ohnishi Takashi.
2016-02-10 03:30:26 +09:00
acac72911e
Move HDFS-9347 from 2.8.0 to 2.6.5 in CHANGES.txt.
2016-02-09 10:48:10 +08:00
dbe49c1bd6
HDFS-9244. Support nested encryption zones.
...
Change-Id: I43a13035a8b27956e90967ee82058efb647c3415
2016-02-08 16:30:51 -08:00
bffaa38a91
HDFS-9777. Fix typos in DFSAdmin command line and documentation.(Wei-Chiu Chuang via umamahesh)
2016-02-08 13:47:45 -08:00
193d27de0a
HDFS-9752. Permanent write failures may happen to slow writers during datanode rolling upgrades. Contributed by Walter Su.
2016-02-08 12:16:29 -06:00
aea31eee78
HDFS-9713. DataXceiver#copyBlock should return if block is pinned. Contributed by Uma Maheswara Rao G.
2016-02-07 20:50:47 -08:00
fe124da5ff
HDFS-9686. Remove useless boxing/unboxing code. Contributed by Kousuke Saruta.
2016-02-06 19:31:01 +09:00
c6497949e8
HDFS-9761. Rebalancer sleeps too long between iterations. Contributed by Mingliang Liu.
2016-02-05 15:07:43 -08:00
4e5e1c0f99
HDFS-9726. Refactor IBR code to a new class.
2016-02-05 23:17:59 +08:00
1bcfab8e7f
HDFS-9724. Degraded performance in WebHDFS listing as it does not reuse ObjectMapper. Contributed by Akira Ajisaka.
2016-02-04 11:34:26 -08:00
496f33de0c
HDFS-9730. Storage ID update does not happen when there is a layout change. Contributed by Tsz Wo Nicholas Sze.
2016-02-04 13:19:54 -06:00
a6728a013e
HDFS-9629. Update the footer of Web UI to show year 2016 (Contributed by Xiao Chen and Vinayakumar B)
2016-02-04 13:37:51 +05:30
81ef1a1f55
HDFS-9503. Use generic option -fs for NNThroughputBenchmark instead of -namenode. Contributed by Mingliang Liu.
2016-02-03 14:59:46 -08:00
a0f5e83f28
HDFS-9658. Erasure Coding: allow to use multiple EC policies in striping related tests. Contributed by Rui Li.
...
Change-Id: I5b02f5bde4d343b7529c6a7fe5df73bd99c6cb24
2016-02-03 14:41:07 -08:00
48b76c8301
Move HDFS-9601 to branch-2.8.0 in CHANGES.txt. (shv)
2016-02-03 14:34:23 -08:00
7badf15604
HDFS-9748. Avoid duplication in pendingReplications when addExpectedReplicasToPending is called twice. Contributed by Walter Su.
2016-02-03 13:30:09 -08:00
eb2fb943fd
HDFS-9740. Use a reasonable limit in DFSTestUtil.waitForMetric() (Contributed by Chang Li)
2016-02-03 11:14:29 +05:30
d6b1acb940
HDFS-9739. DatanodeStorage.isValidStorageId() is broken (Contributed by Mingliang Liu)
2016-02-03 10:33:33 +05:30
04375756a5
HDFS-9715. Check storage ID uniqueness on datanode startup (Contributed by Lei (Eddy) Xu)
2016-02-03 07:35:01 +05:30
414cf07650
Adding release 2.6.5 to CHANGES.txt
2016-02-02 18:06:10 -08:00
6d1213860f
HDFS-9403. Erasure coding: some EC tests are missing timeout. Contributed by Gao Rui.
...
Change-Id: I13c4bc0e566c4f8af5371d26f8e18a749ed41d8b
2016-02-02 14:03:45 -08:00
4ae543fdcd
HDFS-9731. Erasure Coding: Rename BlockECRecoveryCommand to BlockECReconstructionCommand. Contributed by Rakesh R.
...
Change-Id: I405365a8395770e494b92bfe9651f4f0366d8f28
2016-02-02 12:32:08 -08:00
913676dc35
CHANGES.txt: Move HDFS-9260 to trunk
2016-02-02 12:22:26 -08:00
dd9ebf6eed
HDFS-9260. Improve the performance and GC friendliness of NameNode startup and full block reports (Staffan Friberg via cmccabe)
2016-02-02 11:23:00 -08:00
2da03b48eb
HDFS-9669. TcpPeerServer should respect ipc.server.listen.queue.size (Elliot Clark via cmccabe)
2016-02-02 10:59:10 -08:00
9d494f0c0e
HDFS-9721. Allow Delimited PB OIV tool to run upon fsimage that contains INodeReference. (Xiao Chen via lei)
2016-02-02 10:42:01 -08:00
4d7055e0c8
HDFS-9718. HAUtil#getConfForOtherNodes should unset independent generic keys before initialize (Contributed by DENG FEI)
2016-02-02 12:51:35 +05:30
34ab50ea92
HDFS-9406. FSImage may get corrupted after deleting snapshot. (Contributed by Jing Zhao, Stanislav Antic, Vinayakumar B, Yongjun Zhang)
2016-02-01 13:56:55 -08:00
e30ce01ddc
HDFS-9494. Parallel optimization of DFSStripedOutputStream#flushAllInternals. Contributed by Gao Rui.
2016-02-01 13:02:58 -08:00
e50aa53eed
HDFS-9701. DN may deadlock when hot-swapping under load. (Xiao Chen via lei)
2016-02-01 12:56:53 -08:00
b11008d54d
HDFS-9210. Fix some misuse of %n in VolumeScanner#printStats. Contributed by Xiaoyu Yao.
2016-02-01 11:55:27 -08:00
af2dccbca5
HDFS-9708. FSNamesystem.initAuditLoggers() doesn't trim classnames (Mingliang Liu via stevel)
2016-02-01 16:01:50 +00:00
8f2622b6a0
HDFS-9659. EditLogTailerThread to Active Namenode RPC should timeout (Contributed by surendra singh lilhore)
2016-02-01 14:10:55 +05:30
e418bd1fb0
HDFS-9566. Remove expensive 'BlocksMap#getStorages(Block b, final DatanodeStorage.State state)' method (Contributed by Daryn Sharp)
2016-02-01 13:24:05 +05:30
eddd823cd6
HDFS-9638. Improve DistCp Help and documentation. (Wei-Chiu Chuang via Yongjun Zhang)
2016-01-29 12:11:55 -08:00
8ee060311c
HDFS-9706. Log more details in debug logs in BlockReceiver's constructor. (Xiao Chen via Yongjun Zhang)
2016-01-28 23:04:03 -08:00
f67149ab08
HDFS-7764. DirectoryScanner shouldn't abort the scan if one directory had an error (Rakesh R via cmccabe)
2016-01-28 19:54:50 -08:00
662e17b46a
HDFS-9654. Code refactoring for HDFS-8578.
2016-01-28 10:58:03 +08:00
ec25c7f9c7
HDFS-9677. Rename generationStampV1/generationStampV2 to legacyGenerationStamp/generationStamp. Contributed by Mingliang Liu.
2016-01-27 16:34:40 -08:00
3a9571308e
Revert "HDFS-9677. Rename generationStampV1/generationStampV2 to legacyGenerationStamp/generationStamp. Contributed by Mingliang Liu."
...
This reverts commit 8a91109d16
2016-01-27 16:31:19 -08:00
8a91109d16
HDFS-9677. Rename generationStampV1/generationStampV2 to legacyGenerationStamp/generationStamp. Contributed by Mingliang Liu.
2016-01-27 15:48:47 -08:00
cf8af7bb45
HDFS-9541. Add hdfsStreamBuilder API to libhdfs to support defaultBlockSizes greater than 2 GB. Contributed by Colin Patrick McCabe.
...
Change-Id: Ifce1b9be534dc8f7e9d2634cd60e423921b9810f
2016-01-26 11:24:57 -08:00
45c763ad61
HDFS-9690. ClientProtocol.addBlock is not idempotent after HDFS-8071.
2016-01-26 11:20:13 +08:00
bd909ed9f2
HDFS-8999. Allow a file to be closed with COMMITTED but not yet COMPLETE blocks.
2016-01-26 10:32:51 +08:00
e8650fea1f
HDFS-9672. o.a.h.hdfs.TestLeaseRecovery2 fails intermittently. Contributed by Mingliang Liu.
2016-01-25 16:08:46 -08:00
ec4d2d9f40
Release process for 2.7.2: Set the release date for 2.7.2
2016-01-25 15:45:57 -08:00
d62b4a4de7
HDFS-9094. Add command line option to ask NameNode reload configuration. (Contributed by Xiaobing Zhou)
2016-01-25 12:17:05 -08:00
10a2bc0dff
HDFS-9653. Added blocks pending deletion report to dfsadmin.
...
(Weiwei Yang via eyang)
2016-01-24 14:19:49 -08:00
d22c4239a4
HDFS-9525. hadoop utilities need to support provided delegation tokens (HeeSoo Kim via aw)
2016-01-22 12:15:22 -08:00
95363bcc7d
HDFS-9646. ErasureCodingWorker may fail when recovering data blocks with length less than the first internal block. Contributed by Jing Zhao.
2016-01-22 09:46:02 -08:00
2fd19b9674
HDFS-8898. Create API and command-line argument to get quota and quota usage without detailed content summary. Contributed by Ming Ma.
2016-01-22 09:10:06 -06:00
6831634682
HDFS-9682. Fix a typo "aplication" in HttpFS document. Contributed by Weiwei yang.
2016-01-22 20:12:18 +09:00
ae9c61ff0a
HDFS-9618. Fix mismatch between log level and guard in BlockManager#computeRecoveryWorkForBlocks (iwasakims)
2016-01-22 14:11:48 +09:00
b2ffcc2915
HDFS-9601. NNThroughputBenchmark.BlockReportStats should handle NotReplicatedYetException on adding block (iwasakims)
2016-01-22 12:28:38 +09:00
b4a05c1fd5
HDFS-9674. The HTrace span for OpWriteBlock should record the maxWriteToDisk time. Contributed by Colin McCabe.
...
Change-Id: I9bf3f3bcd57f5880189ad7c160f3dd66f97d904b
2016-01-21 13:25:42 -08:00
c304890c8c
HDFS-9542. Move BlockIdManager from FSNamesystem to BlockManager. Contributed by Jing Zhao.
2016-01-21 11:13:17 -08:00
3616c7b855
HDFS-9634. webhdfs client side exceptions don't provide enough details. Contributed by Eric Payne.
2016-01-21 09:32:57 -06:00
b7372b7166
HDFS-9625. set replication for empty file failed when set storage policy (Contributed by DENG FEI)
2016-01-21 19:17:05 +05:30
2ec438e8f7
HDFS-9655. NN should start JVM pause monitor before loading fsimage. (John Zhuge via Lei (Eddy) Xu)
2016-01-20 14:26:11 -08:00
7905788db9
HDFS-9576: HTrace: collect position/length information on read operations (zhz via cmccabe)
2016-01-20 11:26:44 -08:00
1425578690
HDFS-9661. Deadlock in DN.FsDatasetImpl between moveBlockAcrossStorage and createRbw (Contributed by ade)
2016-01-20 21:04:21 +05:30
57d0a94305
HDFS-6054. MiniQJMHACluster should not use static port to avoid binding failure in unit test. (Yongjun Zhang)
2016-01-19 22:54:47 -08:00
92c5f565fd
HDFS-9623. Update example configuration of block state change log in log4j.properties. Contributed by Masatake Iwasaki.
2016-01-19 13:31:26 +09:00
995f06f268
In CHANGES.txt, move HDFS-9294 to Release 2.6.4.
2016-01-16 23:44:14 +08:00
c07f7fa8ff
HDFS-9624. DataNode start slowly due to the initial DU command operations. (Lin Yiqun via wang)
2016-01-15 11:28:46 -08:00
a9c69ebeb7
HDFS-9612. DistCp worker threads are not terminated after jobs are done. (Wei-Chiu Chuang via Yongjun Zhang)
2016-01-15 10:03:09 -08:00
e97cd4ade5
HDFS-9415. Document dfs.cluster.administrators and dfs.permissions.superusergroup. (Contributed by Xiaobing Zhou)
2016-01-14 14:17:52 -08:00
817cc1f02a
HDFS-9648. TestStartup.testImageChecksum is broken by HDFS-9569's message change. (Wei-Chiu Chuang via Yongjun Zhang)
2016-01-14 12:36:36 -08:00
e50dd19a9c
Add missing CHANGES.txt entry for HDFS-8767.
2016-01-14 06:05:39 -08:00
cb73c753da
HADOOP-5323. Trash documentation should describe its directory structure and configurations. (Weiwei Yang via ozawa)
...
Moved entry from HDFS CHANGES.txt to that of common.
2016-01-13 14:55:06 -08:00
25051c3bd0
HDFS-9569. Log the name of the fsimage being loaded for better supportability. (Yongjun Zhang)
2016-01-12 09:22:22 -08:00
17158647f8
move HDFS-9621 from trunk to 2.9.0 in CHANGES.txt.
2016-01-11 22:51:08 -08:00
103d3cfc4e
Correct commit message for HDFS-9584
2016-01-11 18:59:43 -08:00
c2e2e13455
HDFS-8584. NPE in distcp when ssl configuration file does not exist in class path. Contributed by Surendra Singh Lilhore.
2016-01-11 17:08:26 -08:00
de37f37543
HDFS-9639. Inconsistent Logging in BootstrapStandby. (Contributed by Xiaobing Zhou)
2016-01-11 15:08:00 -08:00
9f4bf3bdf9
HDFS-9621. getListing wrongly associates Erasure Coding policy to pre-existing replicated files under an EC directory. Contributed by Jing Zhao.
2016-01-11 11:31:59 -08:00
71e5982e39
Update CHANGES.txt: move HDFS-9626 and HDFS-9630 to the section of release 2.8
...
Change-Id: Ief7915e794d6862ca2c9d84f4188cb560d7dba95
2016-01-11 10:00:22 -08:00
95f32015ad
HDFS-9630. DistCp minor refactoring and clean up. Contributed by Kai Zheng.
...
Change-Id: I363c4ffcac32116ddcdc0a22fac3db92f14a0db0
2016-01-11 09:46:56 -08:00
fd8065a763
HDFS-9493. Test o.a.h.hdfs.server.namenode.TestMetaSave fails in trunk. (Tony Wu via lei)
2016-01-08 15:00:30 -08:00
0af2022e6d
HDFS-9626. TestBlockReplacement#testBlockReplacement fails occasionally. Contributed by Xiao Chen.
...
Change-Id: Ia766a5bfb89f8cf8a48b473bb27c30d5818ebfc0
2016-01-08 13:14:36 -08:00
38c4c14472
HDFS-9574. Reduce client failures during datanode restart. Contributed by Kihwal Lee.
2016-01-08 11:13:58 -06:00
6702e7d66a
HDFS-9619. SimulatedFSDataset sometimes can not find blockpool for the correct namenode (Contributed by Wei-Chiu Chuang)
2016-01-07 14:20:18 +05:30
34cd7cd765
HDFS-9600. do not check replication if the block is under construction (Contributed by Phil Yang)
2016-01-07 11:27:42 +05:30
c213ee0859
HDFS-9047. Retire libwebhdfs. Contributed by Haohui Mai.
2016-01-06 16:16:31 -08:00
67c9780609
HDFS-9498. Move code that tracks blocks with future generation stamps to BlockManagerSafeMode. (Contributed by Mingliang Liu)
2016-01-06 10:30:59 -08:00
b9936689c9
HDFS-9615. Fix variable name typo in DFSConfigKeys. (Contributed by Ray Chiang)
2016-01-06 09:40:31 -08:00
dec8fedb65
HDFS-9605. Add links to failed volumes to explorer.html in HDFS Web UI. Contributed by Archana T.
2016-01-05 13:55:55 -08:00
cea0972fa1
HDFS-7779. Support changing ownership, group and replication in HDFS Web UI. Contributed by Ravi Prakash.
2016-01-05 13:44:16 -08:00
778146eaae
HADOOP-12658. Clear javadoc and check style issues around DomainSocket. Contributed by Kai Zheng
2016-01-04 14:32:09 -08:00
db99e30f67
Set release date for 2.6.3
2016-01-04 16:12:12 +09:00
64ae85fd2e
HADOOP-11252. RPC client does not time out by default. Contributed by Wilfred Spiegelenburg and Masatake Iwasaki.
2016-01-04 14:31:22 +09:00
84a8147791
HDFS-9376. TestSeveralNameNodes fails occasionally. Contributed by Masatake Iwasaki.
2015-12-29 14:37:03 -08:00
99cf2ecee9
HDFS-7553. fix the TestDFSUpgradeWithHA due to BindException. Contributed by Xiao Chen.
2015-12-29 10:56:59 -08:00
8cfd672397
HDFS-9597. BaseReplicationPolicyTest should update data node stats after adding a data node. Contributed by Wei-Chiu Chuang.
2015-12-25 08:55:39 -08:00
df83230948
HDFS-9034. StorageTypeStats Metric should not count failed storage. Contributed by Surendra Singh Lilhore.
2015-12-22 15:28:17 -08:00
867048c3e4
HDFS-7163. WebHdfsFileSystem should retry reads according to the configured retry policy. Contributed by Eric Payne.
2015-12-22 14:08:23 -06:00
5c0ff69618
HDFS-9458. TestBackupNode always binds to port 50070, which can cause bind failures. Contributed by Xiao Chen.
2015-12-22 10:29:35 -08:00
bb540ba85a
HDFS-9589. Block files which have been hardlinked should be duplicated before the DataNode appends to the them (cmccabe)
2015-12-22 09:36:50 -08:00
70d6f20126
HDFS-9575. Use byte array for internal block indices in a striped block. Contributed by jing9
2015-12-22 14:47:57 +08:00
0087734cc1
HDFS-9580. TestComputeInvalidateWork#testDatanodeReRegistration failed due to unexpected number of invalidate blocks. Contributed by Wei-Chiu Chuang.
...
Change-Id: I9411dfb1dd4605cbcc515ca3361218d35d7c5fe3
2015-12-21 22:38:30 -08:00
2cb5afffc4
Move HDFS-8914 from 2.8.0 to 2.7.3 in CHANGES.txt.
2015-12-21 21:52:04 +09:00
fa544020f6
HDFS-9505. HDFS Architecture documentation needs to be refreshed. Contributed by Masatake Iwasaki.
2015-12-21 21:23:03 +09:00
52ad9125b8
HDFS-9582. TestLeaseRecoveryStriped file missing Apache License header and not well formatted. (umamahesh)
2015-12-20 13:10:57 -08:00
0f82b5d878
YARN-4480. Clean up some inappropriate imports. (Kai Zheng via umamahesh)
2015-12-19 23:10:13 -08:00
932956458d
HADOOP-12570. HDFS Secure Mode Documentation updates. Contributed by Arpit Agarwal.
2015-12-18 16:24:53 -08:00
ef3f3f6bb1
HDFS-9347. Invariant assumption in TestQuorumJournalManager.shutdown() is wrong. Contributed by Wei-Chiu Chuang.
...
Change-Id: Idde8522e11c77f82b376e0c90a9bf33d163d5cb9
2015-12-18 16:04:47 -08:00
61ab0440f7
HDFS-9173. Erasure Coding: Lease recovery for striped file. Contributed by Walter Su and Jing Zhao.
...
Change-Id: I51703a61c9d8454f883028f3f6acb5729fde1b15
2015-12-18 15:57:48 -08:00
e63388fdf2
HDFS-9350. Avoid creating temprorary strings in Block.toString() and getBlockName() (Staffan Friberg via cmccabe)
2015-12-18 09:40:39 -08:00
058cfddebb
HDFS-8477. describe dfs.ha.zkfc.port in hdfs-default.xml. Contributed by Kanaka Kumar Avvaru.
2015-12-18 09:14:14 -08:00
bfadf11b36
HDFS-9393. After choosing favored nodes, choosing nodes for remaining replicas should go through BlockPlacementPolicy (Contributed by J.Andreina)
2015-12-18 11:38:12 +05:30
6da9deec20
HDFS-9571. Fix ASF Licence warnings in Jenkins reports. Contributed by Brahma Reddy Battula.
2015-12-17 16:26:01 -08:00
5cb1e0118b
HDFS-9533. seen_txid in the shared edits directory is modified during bootstrapping. Contributed by Kihwal Lee.
2015-12-17 17:11:16 -06:00
03bab8dea1
HDFS-9572. Prevent DataNode log spam if a client connects on the data transfer port but sends no data. Contributed by Chris Nauroth
2015-12-17 14:04:45 -08:00
2f623fb8cc
HDFS-9515. NPE when MiniDFSCluster#shutdown is invoked on uninitialized reference. (Contributed by Wei-Chiu Chuang)
2015-12-17 13:57:08 -08:00
db37f02dc7
Revert "HDFS-9569. Log the name of the fsimage being loaded for better supportability. Contributed by Yongjun Zhang."
...
This reverts commit eb6939cea0
2015-12-17 13:50:23 -08:00
5104077e1f
HDFS-9373. Erasure coding: friendly log information for write operations with some failed streamers. Contributed by Li Bo.
...
Change-Id: Ie8ab4ae00e9ee0eb03c32a54bea26a3524308038
2015-12-17 13:05:04 -08:00
d85f72978e
HDFS-9570. Update CHANGES.txt to list under 2.8.0.
2015-12-17 11:37:19 -08:00
724e71f63b
HDFS-9552. Document types of permission checks performed for HDFS operations. Contributed by Chris Nauroth.
2015-12-17 10:43:48 -08:00
72a3f649e4
HDFS-9565. TestDistributedFileSystem.testLocatedFileStatusStorageIdsTypes is flaky due to race condition. (Contributed by Wei-Chiu Chuang)
2015-12-17 10:36:07 -08:00
8d278d8d2e
HDFS-9570. Minor typos, grammar, and case sensitivity cleanup in HdfsPermissionsGuide.md's (Travis Campbell via aw)
2015-12-17 08:31:44 -08:00
eb6939cea0
HDFS-9569. Log the name of the fsimage being loaded for better supportability. Contributed by Yongjun Zhang.
2015-12-17 10:29:41 -06:00
d90625e038
Update CHANGES.txt to move HDFS-9516 to 2.7.3 section.
2015-12-16 23:11:12 -08:00
f741476146
HDFS-9198. Coalesce IBR processing in the NN. (Daryn Sharp via umamahesh)
2015-12-16 18:16:39 -08:00
3c0adac88c
HDFS-9300. TestDirectoryScanner.testThrottle() is still a little flakey. Contributed by Daniel Templeton.
2015-12-16 16:21:06 -08:00
c470c8953d
HDFS-9557. Reduce object allocation in PB conversion. Contributed by Daryn Sharp.
2015-12-16 11:10:40 -08:00
49949a4bb0
HDFS-8894. Set SO_KEEPALIVE on DN server sockets. Contributed by Kanaka Kumar Avvaru.
2015-12-15 14:38:35 -08:00
8602692338
HDFS-9371. Code cleanup for DatanodeManager. Contributed by Jing Zhao.
2015-12-15 10:47:53 -08:00
96d307e1e3
HDFS-9516. Truncate file fails with data dirs on multiple disks. Contributed by Plamen Jeliazkov.
2015-12-15 00:32:10 -08:00
de522d2cd4
Revert "Revert "HDFS-8860. Remove unused Replica copyOnWrite code (Lei (Eddy) Xu via Colin P. McCabe)""
...
This reverts commit 7f393a6f61
2015-12-14 11:25:09 -08:00
e534569814
HDFS-9535. Newly completed blocks in IBR should not be considered under-replicated too quickly. Contributed by Mingliang Liu.
2015-12-14 11:05:25 -08:00
f229772f99
HDFS-9281. Change TestDeleteBlockPool to not explicitly use File to check block pool existence. (lei)
2015-12-14 11:02:07 -08:00
bf5295b118
HDFS-9514. TestDistributedFileSystem.testDFSClientPeerWriteTimeout failing; exception being swallowed. (Wei-Chiu Chuang via Yongjun Zhang)
2015-12-11 19:52:38 -08:00
2a4c7d4fac
HDFS-9519. Some coding improvement in SecondaryNameNode#main. (Xiao Chen via Yongjun Zhang)
2015-12-11 18:44:01 -08:00
f5a911452f
HDFS-9532. Detailed exception info is lost in reportTo methods of ErrorReportAction and ReportBadBlockAction. (Yongjun Zhang)
2015-12-11 18:15:24 -08:00
796a676d18
HDFS-9528. Cleanup namenode audit/log/exception messages. (szetszwo via umamahesh)
2015-12-11 17:57:35 -08:00
576b569b6c
Revert "HDFS-9525. hadoop utilities need to support provided delegation tokens (HeeSoo Kim via aw)"
...
This reverts commit 832b3cbde1
2015-12-11 10:59:42 -08:00
a48301791e
HDFS-9445. Datanode may deadlock while handling a bad volume. Contributed by Walter Su.
2015-12-11 08:44:47 -06:00
e363417e7b
HDFS-9472. concat() API does not give proper exception messages on ./reserved relative path (Rakesh R via umamahesh)
2015-12-10 23:55:29 -08:00
7f393a6f61
Revert "HDFS-8860. Remove unused Replica copyOnWrite code (Lei (Eddy) Xu via Colin P. McCabe)"
...
This reverts commit a153b9601a
2015-12-10 10:57:33 -10:00
132478e805
HDFS-9527. The return type of FSNamesystem.getBlockCollection should be changed to INodeFile.
2015-12-09 17:55:28 -08:00
832b3cbde1
HDFS-9525. hadoop utilities need to support provided delegation tokens (HeeSoo Kim via aw)
2015-12-08 12:56:38 -08:00
9676774e23
HDFS-9273. Moving to 2.6.3 CHANGES section to reflect the backport.
2015-12-08 11:32:42 -08:00
303f80e656
HDFS-9414. Refactor reconfiguration of ClientDatanodeProtocol for reusability. Contributed by Xiaobing Zhou.
2015-12-08 10:49:32 -08:00
7fa9ea85d4
Move HDFS-9129 from trunk to branch-2.9.0
2015-12-07 13:47:40 -08:00
65f395226b
HADOOP-12321. Make JvmPauseMonitor an AbstractService. (Sunil G via Stevel) [includes HDFS-8947 MAPREDUCE-6462 and YARN-4072]
2015-12-06 17:43:35 +00:00
86c95cb31a
HDFS-9414. Refactor reconfiguration of ClientDatanodeProtocol for reusability. (Contributed by Xiaobing Zhou)
2015-12-04 20:24:08 -08:00
4265a85f6d
HDFS-9491. Tests should get the number of pending async deletes via FsDatasetTestUtils. (Tony Wu via lei)
2015-12-04 18:06:16 -08:00
bc6d8d9814
HDFS-9214. Add missing license header
2015-12-04 15:33:09 -08:00
9d817fa1b1
HDFS-9214. Support reconfiguring dfs.datanode.balance.max.concurrent.moves without DN restart. (Contributed by Xiaobing Zhou)
2015-12-04 14:46:46 -08:00
59dbe8b3e9
HDFS-9474. TestPipelinesFailover should not fail when printing debug message. (John Zhuge via Yongjun Zhang)
2015-12-04 13:45:01 -08:00
e02bbeb886
HDFS-9267. TestDiskError should get stored replicas through FsDatasetTestUtils. (Lei (Eddy) Xu via Colin P. McCabe)
2015-12-04 12:51:19 -08:00
cbc7b6bf97
HDFS-8831. Trash Support for deletion in HDFS encryption zone. Contributed by Xiaoyu Yao.
2015-12-04 10:39:45 -08:00
0ac8fb4b33
HDFS-9490. MiniDFSCluster should change block generation stamp via FsDatasetTestUtils. (Tony Wu via lei)
2015-12-04 10:24:55 -08:00
3fa33b5c2c
HDFS-9430 Remove waitForLoadingFSImage since checkNNStartup has ensured image loaded and namenode started. (Brahma Reddy Battula via mingma)
2015-12-04 09:47:57 -08:00
924a33d02d
HDFS-9484. NNThroughputBenchmark$BlockReportStats should not send empty block reports. Contributed by Mingliang Liu.
2015-12-03 15:03:34 -08:00
e71aa717d4
HDFS-9436. Make NNThroughputBenchmark$BlockReportStats run with 10 datanodes by default. Contributed by Mingliang.
2015-12-03 15:03:33 -08:00
e8bd1ba74b
HDFS-9294. DFSClient deadlock when close file and failed to renew lease. Contributed by Brahma Reddy Battula
2015-12-02 17:39:28 -08:00
53e3bf7e70
HDFS-9429. Tests in TestDFSAdminWithHA intermittently fail with EOFException (Xiao Chen via Colin P. McCabe)
2015-12-01 23:21:21 -08:00
3c4a34e90c
Move HDFS-9129 to trunk in CHANGES.txt
2015-12-01 16:15:08 -08:00
a49cc74b4c
HDFS-9129. Move the safemode block count into BlockManager. Contributed by Mingliang Liu.
2015-12-01 16:09:19 -08:00
58f6f54eea
HDFS-6533. TestBPOfferService#testBasicFunctionalitytest fails intermittently. (Contributed by Wei-Chiu Chuang)
2015-12-01 13:32:32 -08:00
830eb252aa
HDFS-9485. Make BlockManager#removeFromExcessReplicateMap accept BlockInfo instead of Block. Contributed by Mingliang Liu.
2015-12-01 13:05:22 -08:00
1cc7e61431
HDFS-9269. Update the documentation and wrapper for fuse-dfs. Contributed by Wei-Chiu Chuang.
...
Change-Id: Ia9ec512de2464bf94725cc7c15c378c59d0f04c4
2015-12-01 10:24:49 -08:00
028894281b
Creating 2.6.4 entries in CHANGES.txt files.
2015-12-01 08:16:39 -08:00
1c05393b51
HDFS-9336. deleteSnapshot throws NPE when snapshotname is null. Contributed by Brahma Reddy Battula.
2015-12-01 11:29:09 +08:00
9b8e50b424
HDFS-9470. Encryption zone on root not loaded from fsimage after NN restart. Xiao Chen via wang.
2015-11-30 14:32:51 -08:00
9f256d1d71
HDFS-9426. Rollingupgrade finalization is not backward compatible (Contributed by Kihwal Lee)
...
(cherry picked from commit c62d42cd8b
2015-11-26 09:39:47 +05:30
d57fd181c7
Adding release 2.8.0 to CHANGES.txt
2015-11-25 17:33:26 -08:00
e556c35b05
HDFS-9467. Fix data race accessing writeLockHeldTimeStamp in FSNamesystem. Contributed by Mingliang Liu.
2015-11-25 14:22:12 -08:00
fc799ab16c
HDFS-9407. TestFileTruncate should not use fixed NN port. Contributed by Brahma Reddy Battula.
2015-11-25 13:52:09 -08:00
e3d673901b
HDFS-8512. WebHDFS : GETFILESTATUS should return LocatedBlock with storage type info. Contributed by Xiaoyu Yao.
2015-11-25 13:41:06 -08:00
b21dffb1fe
HDFS-9451. Clean up depreated umasks and related unit tests. Contributed by Wei-Chiu Chuang.
2015-11-25 12:47:24 -08:00
95d5227c75
HDFS-9459. hadoop-hdfs-native-client fails test build on Windows after transition to ctest. Contributed by Chris Nauroth.
2015-11-25 10:32:48 -08:00
84d01ad7f4
HDFS-6694. Addendum. Update CHANGES.txt for cherry-picking to 2.8.
2015-11-25 08:41:39 -08:00
8176ea7dc6
HDFS-9438. TestPipelinesFailover assumes Linux ifconfig. (John Zhuge via Yongjun Zhang)
2015-11-25 07:40:16 -08:00
b4c6b511e7
HADOOP-12415. Add io.netty dependency to hadoop-nfs and to hadoop-hdfs, needed to build Bigtop successfuly, see BIGTOP-2049
...
Signed-off-by: Konstantin Boudnik <cos@boudnik.org>
2015-11-24 18:36:34 -08:00
78ec38b2ed
HDFS-8807. dfs.datanode.data.dir does not handle spaces between storageType and URI correctly. Contributed by Anu Engineer
2015-11-24 16:01:55 -08:00
977e0b3c4c
HDFS-8335. FSNamesystem should construct FSPermissionChecker only if permission is enabled. Contributed by Gabor Liptak.
2015-11-24 13:14:49 -08:00
Lei Xu
Kihwal Lee
Arpit Agarwal
Konstantin V Shvachko
Akira Ajisaka
Wei-Chiu Chuang
Tsz-Wo Nicholas Sze
Jing Zhao
Daryn Sharp
Yongjun Zhang
Xiao Chen
Xiaoyu Yao
Andrew Wang
Brahma Reddy Battula
Steve Loughran
Vinitha Reddy Gankidi
Masatake Iwasaki
Kai Zheng
Uma Maheswara Rao G
Zhe Zhang
Jitendra Pandey
Colin Patrick Mccabe
Allen Wittenauer
Vinayakumar B
Sangjin Lee
Anu Engineer
Ming Ma
Ravi Prakash
Chris Nauroth
Karthik Kambatla
Karthik Kambatla
Junping Du
Ravi Prakash
Walter Su
Xiaobing Zhou
Eric Payne
Haohui Mai
Zhe Zhang
Anu Engineer
Harsh J
Tsuyoshi Ozawa
Arun Suresh
Haohui Mai
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
Eric Yang
Uma Mahesh
Benoy Antony
Plamen Jeliazkov
Tom Zeng