Commit Graph

5471 Commits

Author SHA1 Message Date
Colin Patrick Mccabe 79961ecea8 HDFS-9933. ReverseXML should be capitalized in oiv usage message (cmccabe) 2016-03-10 13:43:27 -08:00
Colin Patrick Mccabe bd49354c6d HDFS-9934. ReverseXML oiv processor should bail out if the XML file's layoutVersion doesn't match oiv's (cmccabe) 2016-03-10 13:41:06 -08:00
Colin Patrick Mccabe 500875dfcc HDFS-9927. Document the new OIV ReverseXML processor (Wei-Chiu Chuang via cmccabe) 2016-03-10 13:38:00 -08:00
Zhe Zhang 7600e3c48f HDFS-7866. Erasure coding: NameNode manages multiple erasure coding policies. Contributed by Rui Li. 2016-03-08 22:30:30 -08:00
Chris Nauroth 89b16d27e2 HADOOP-12905. Clean up CHANGES.txt RAT exclusions from pom.xml files. Contributed by Chris Nauroth. 2016-03-08 21:22:06 -08:00
Andrew Wang a14a6f08ee HDFS-9919. TestStandbyCheckpoints#testNonPrimarySBNUploadFSImage waitForCheckpoint incorrectly. Contributed by Lin Yiqun. 2016-03-08 11:54:50 -08:00
Jing Zhao 743a99f2db HDFS-8786. Erasure coding: use simple replication for internal blocks on decommissioning datanodes. Contributed by Rakesh R. 2016-03-08 10:24:57 -08:00
Arpit Agarwal c2140d05ef HDFS-9882. Add heartbeatsTotal in Datanode metrics. (Contributed by Hua Liu) 2016-03-07 21:10:24 -08:00
Arpit Agarwal 724d2299cd HDFS-9906. Remove spammy log spew when a datanode is restarted. (Contributed by Brahma Reddy Battula) 2016-03-07 12:19:53 -08:00
Masatake Iwasaki d718fc1ee5 HDFS-9865. TestBlockReplacement fails intermittently in trunk (Lin Yiqun via iwasakims) 2016-03-08 02:07:18 +09:00
Harsh J fd1c09be3e HDFS-9521. TransferFsImage.receiveFile should account and log separate times for image download and fsync to disk. Contributed by Wellington Chevreuil 2016-03-07 17:14:51 +05:30
Chris Nauroth 2759689d7d HDFS-9239. DataNode Lifeline Protocol: an alternative protocol for reporting DataNode liveness. Contributed by Chris Nauroth. 2016-03-04 15:29:50 -08:00
Yongjun Zhang 8e08861a14 HDFS-9889. Update balancer/mover document about HDFS-6133 feature. Contributed by Yongjun Zhang. 2016-03-04 13:25:29 -08:00
Zhe Zhang 3e8099a45a HDFS-9888. Allow reseting KerberosName in unit tests. Contributed by Xiao Chen. 2016-03-04 09:48:05 -08:00
Masatake Iwasaki cbd31328a6 HADOOP-12470. In-page TOC of documentation should be automatically generated by doxia macro (iwasakims) 2016-03-04 14:11:36 +09:00
Andrew Wang 1bc454615e HADOOP-11792. Remove all of the CHANGES.txt files. 2016-03-03 21:02:31 -08:00
Masatake Iwasaki 33a412e8a4 HDFS-9048. DistCp documentation is out-of-dated (Daisuke Kobayashi via iwasakims) 2016-03-03 18:57:23 +09:00
Masatake Iwasaki f70e317ccc HADOOP-12793. Write a new group mapping service guide (Wei-Chiu Chuang via iwasakims) 2016-03-03 17:14:32 +09:00
Arpit Agarwal 27941a1811 HDFS-9534. Add CLI command to clear storage policy from a path. (Contributed by Xiaobing Zhou) 2016-03-02 18:35:28 -08:00
Colin Patrick Mccabe 700b0e4019 HDFS-9835. OIV: add ReverseXML processor which reconstructs an fsimage from an XML file (cmccabe) 2016-03-02 17:56:11 -08:00
Zhe Zhang 67880ccae6 HDFS-9886. Configuration properties for hedged read is broken. Contributed by Akira AJISAKA. 2016-03-02 10:26:06 -08:00
Xiaoyu Yao 5abf051249 HDFS-9887. WebHdfs socket timeouts should be configurable. Contributed by Austin Donnelly and Chris Douglas. 2016-03-02 09:23:17 -08:00
Akira Ajisaka 27e0681f28 HDFS-9851. NameNode throws NPE when setPermission is called on a path that does not exist. Contributed by Brahma Reddy Battula. 2016-03-02 14:43:03 +09:00
Akira Ajisaka e2ddf82469 HDFS-9766. TestDataNodeMetrics#testDataNodeTimeSpend fails intermittently. Contributed by Xiao Chen. 2016-03-02 14:17:35 +09:00
Jing Zhao f2ba7da4f0 HDFS-9876. shouldProcessOverReplicated should not count number of pending replicas. Contributed by Jing Zhao. 2016-03-01 18:41:57 -08:00
Andrew Wang 4abb2fa687 HDFS-9881. DistributedFileSystem#getTrashRoot returns incorrect path for encryption zones. 2016-03-01 16:35:39 -08:00
Kihwal Lee e76b13c415 HDFS-9880. TestDatanodeRegistration fails occasionally. Contributed by Kihwal Lee. 2016-03-01 17:00:18 -06:00
Kihwal Lee 2c8496ebf3 HDFS-8791. block ID-based DN storage layout can be very slow for datanode on ext4. Contributed by Chris Trezzo. 2016-03-01 15:04:59 -06:00
Chris Nauroth 2137e8feeb HDFS-9870. Remove unused imports from DFSUtil. Contributed by Brahma Reddy Battula. 2016-03-01 11:15:13 -08:00
Uma Maheswara Rao G 307ec80aca HDFS-9733. Refactor DFSClient#getFileChecksum and DataXceiver#blockChecksum. Contributed by Kai Zheng 2016-02-29 21:52:20 -08:00
Jing Zhao 2151716832 HDFS-7964. Add support for async edit logging. Contributed by Daryn Sharp. 2016-02-29 15:34:43 -08:00
Akira Ajisaka 8bc023b3b1 HDFS-9864. Correct reference for RENEWDELEGATIONTOKEN and CANCELDELEGATIONTOKEN in webhdfs doc. Contributed by Brahma Reddy Battula. 2016-02-29 18:42:21 +09:00
Jing Zhao 321a80c759 HDFS-9867. Missing block exception should carry locatedBlocks information. Contributed by Mingliang Liu. 2016-02-28 15:00:27 -08:00
Jing Zhao 408f2c807b HDFS-9866. BlockManager#chooseExcessReplicasStriped may weaken rack fault tolerance. Contributed by Jing Zhao. 2016-02-28 14:54:49 -08:00
Tsz-Wo Nicholas Sze d1d4e16690 HDFS-9710. DN can be configured to send block receipt IBRs in batches. 2016-02-26 15:32:25 -08:00
Xiaoyu Yao eab52dfb35 HDFS-9831. Document webhdfs retry configuration keys introduced by HDFS-5219/HDFS-5122. Contributed by Xiaobing Zhou. 2016-02-26 14:14:12 -08:00
Karthik Kambatla c2460dad64 HDFS-9858. RollingFileSystemSink can throw an NPE on non-secure clusters. (Daniel Templeton via kasha) 2016-02-25 16:31:09 -08:00
Zhe Zhang 8808779db3 HDFS-9734. Refactoring of checksum failure report related codes. Contributed by Kai Zheng.
Change-Id: Ie69a77e3498a360959f8e213c51fb2b17c28b64a
2016-02-25 09:55:50 -08:00
Zhe Zhang ccff6035f5 HDFS-9804. Allow long-running Balancer to login with keytab. Contributed by Xiao Chen.
Change-Id: I54b82e0b11929082057b4d21bfcf285222c94cdb
2016-02-25 09:24:32 -08:00
Tsz-Wo Nicholas Sze 6979cbfc1f HDFS-9838. Refactor the excessReplicateMap to a class. 2016-02-24 19:42:47 -08:00
Chris Nauroth dbbfc58c33 HDFS-9843. Document distcp options required for copying between encrypted locations. Contributed by Xiaoyu Yao. 2016-02-24 15:16:05 -08:00
Jing Zhao 47b92f2b6f HDFS-9837. BlockManager#countNodes should be able to detect duplicated internal blocks. Contributed by Jing Zhao. 2016-02-24 15:13:56 -08:00
cnauroth d1dd248b75 HDFS-9854. Log cipher suite negotiation more verbosely. Contributed by Wei-Chiu Chuang. 2016-02-24 12:11:35 -08:00
Kihwal Lee d27d7fc72e HDFS-9395. Make HDFS audit logging consistant. Contributed by Kuhu Shukla. 2016-02-24 12:04:01 -06:00
Zhe Zhang def754ec06 HDFS-9816. Erasure Coding: allow to use multiple EC policies in striping related tests [Part 3]. Contributed by Rui Li.
Change-Id: I64b57bab4722cdc6e1e3148c3a3a401370249afe
2016-02-23 14:05:17 -08:00
Zhe Zhang 647a35e996 HDFS-9844. Correct path creation in getTrashRoot to handle root dir.
Change-Id: I5afe6c7176063892e3e632698c849bd9f4b92906
2016-02-23 13:29:39 -08:00
Colin Patrick Mccabe 211c78c090 HDFS-9549. TestCacheDirectives#testExceedsCapacity is flaky (Xiao Chen via cmccabe) 2016-02-23 12:01:20 -08:00
Tsuyoshi Ozawa 48c61cd6aa HDFS-9084. Pagination, sorting and filtering of files/directories in the HDFS Web UI. (Contributed by Ravi Prakash) 2016-02-23 19:30:58 +09:00
Tsz-Wo Nicholas Sze 66289a3bf4 HDFS-8578. On upgrade, Datanode should process all storage/data dirs in parallel. Contributed by vinayakumarb and szetszwo 2016-02-22 15:01:15 -08:00
Zhe Zhang a2fdfff02d HADOOP-12668. Support excluding weak Ciphers in HttpServer2 through ssl-server.conf. Contributed by Vijay Singh.
Change-Id: Ie46a5427d29188935427f67e55203c19fcd83335
2016-02-22 14:13:54 -08:00
Arpit Agarwal a63301a864 HDFS-9842. dfs.datanode.balance.bandwidthPerSec should accept friendly size units. (Contributed by Lin Yiqun) 2016-02-22 11:34:09 -08:00
Vinayakumar B 342c9572bf HDFS-9425. Expose number of blocks per volume as a metric (Contributed by Brahma Reddy Battula) 2016-02-22 09:29:23 +05:30
Vinayakumar B f313516731 HDFS-7452. skip StandbyException log for getCorruptFiles() (Contributed by Bramha Reddy Battula) 2016-02-22 09:21:46 +05:30
Arpit Agarwal d5abd293a8 HDFS-9839. Reduce verbosity of processReport logging. (Contributed by Arpit Agarwal)
This closes #78
2016-02-20 23:19:09 -08:00
Jing Zhao e54cc29312 HDFS-9818. Correctly handle EC reconstruction work caused by not enough racks. Contributed by Jing Zhao. 2016-02-19 19:02:23 -08:00
Jing Zhao 6546d9e7ff HDFS-9829. Erasure Coding: Improve few exception handling logic of ErasureCodingWorker. Contributed by Rakesh R. 2016-02-19 10:40:28 -08:00
Yongjun Zhang ba1c9d484a HDFS-9764. DistCp doesn't print value for several arguments including -numListstatusThreads. (Wei-Chiu Chuang via Yongjun Zhang) 2016-02-19 10:17:37 -08:00
Tsz-Wo Nicholas Sze 748b6c07fe Move HDFS-8923 to Release 2.8.0 in CHANGES.txt. 2016-02-18 18:43:06 -08:00
Tsz-Wo Nicholas Sze 46f7790236 HDFS-8923. Add -source flag to balancer usage message. Contributed by Chris Trezzo 2016-02-18 18:18:12 -08:00
Akira Ajisaka c7ac25e52c HDFS-9830. Remove references to hftp in ViewFs documentation in trunk. Contributed by Wei-Chiu Chuang. 2016-02-19 05:02:57 +09:00
Tsz-Wo Nicholas Sze bbfaf3c271 HADOOP-10865. Add a Crc32 chunked verification benchmark for both directly and non-directly buffer cases. 2016-02-18 11:47:33 -08:00
Kihwal Lee ba6d5ed955 HDFS-4946. Allow preferLocalNode in BlockPlacementPolicyDefault to be configurable. Contributed by James Kinley and Nathan Roberts. 2016-02-18 13:21:51 -06:00
cnauroth 5d1889a66d HDFS-9711. Integrate CSRF prevention filter in WebHDFS. Contributed by Chris Nauroth. 2016-02-18 10:07:28 -08:00
Akira Ajisaka e78d8e66f7 HDFS-6832. Fix the usage of 'hdfs namenode' command. Contributed by Manjunath Ballur. 2016-02-19 01:35:06 +09:00
Zhe Zhang 0fb14aaced HDFS-9799. Reimplement getCurrentTrashDir to remove incompatibility. (zhz)
Change-Id: I7834bcebffed38cb384db5395ddb8b6dd9e79a0b
2016-02-17 13:30:50 -08:00
Andrew Wang 3a23dc683c HDFS-9608. Disk IO imbalance in HDFS with heterogeneous storages. Contributed by Wei Zhou. 2016-02-17 11:29:58 -08:00
Haohui Mai 77f7ca3e94 HDFS-9815. Move o.a.h.fs.Hdfs to hadoop-hdfs-client. Contributed by Vinayakumar B. 2016-02-17 10:56:11 -08:00
Vinayakumar B 2536ece7b6 HDFS-9787. SNNs stop uploading FSImage to ANN once isPrimaryCheckPointer changed to false. (Contributed by Guocui Mi) 2016-02-17 10:41:24 +05:30
Junping Du 77ba5add0d HDFS-9456. BlockPlacementPolicyWithNodeGroup should override verifyBlockPlacement(). Contributed by Xiaobing Zhou. 2016-02-16 18:55:55 -08:00
Akira Ajisaka 8ed07bd3e6 HDFS-9765. TestBlockScanner#testVolumeIteratorWithCaching fails intermittently. (aajisaka) 2016-02-15 19:08:03 +09:00
Akira Ajisaka b0738ae673 HDFS-9773. Remove dead code related to SimulatedFSDataset in tests. Contributed by Brahma Reddy Battula. 2016-02-15 15:35:06 +09:00
Akira Ajisaka ac5da11399 HDFS-9691. TestBlockManagerSafeMode#testCheckSafeMode fails intermittently. Contributed by Mingliang Liu. 2016-02-15 14:00:09 +09:00
Junping Du ec12ce8f48 Set the release date for 2.6.4. 2016-02-13 01:42:50 -08:00
Arpit Agarwal 1de1641f17 HDFS-9801. ReconfigurableBase should update the cached configuration. (Arpit Agarwal) 2016-02-12 12:41:04 -08:00
Arun Suresh 9fdfb546fb HDFS-9797. Log Standby exceptions thrown by RequestHedgingProxyProvider at DEBUG Level (Inigo Goiri via asuresh) 2016-02-12 11:18:10 -08:00
Jing Zhao 972782d956 HDFS-9754. Avoid unnecessary getBlockCollection calls in BlockManager. Contributed by Jing Zhao. 2016-02-12 11:07:52 -08:00
Jing Zhao f3c91a41a5 HDFS-9794. Streamer threads may leak if failure happens when closing the striped outputstream. Contributed by Jing Zhao. 2016-02-12 10:59:31 -08:00
Zhe Zhang b21bbe9ed1 HDFS-9644. Update encryption documentation to reflect nested EZs. (zhz)
Change-Id: I84ae96f4711a16ded46d501c51ca322bfca5151d
2016-02-12 10:44:15 -08:00
Masatake Iwasaki 372d1302c6 HDFS-9700. DFSClient and DFSOutputStream should set TCP_NODELAY on sockets for DataTransferProtocol (Gary Helmling via iwasakims) 2016-02-13 03:31:15 +09:00
Akira Ajisaka e6a7044b85 HDFS-9768. Reuse ObjectMapper instance in HDFS to improve the performance. Contributed by Lin Yiqun. 2016-02-13 01:57:24 +09:00
Arpit Agarwal 9b959f3ee7 HDFS-9790. HDFS Balancer should exit with a proper message if upgrade is not finalized (Contributed by Xiaobing Zhou) 2016-02-11 20:40:03 -08:00
Karthik Kambatla 33ce7f6c07 HDFS-9780. RollingFileSystemSink doesn't work on secure clusters. (Daniel Templeton via kasha) 2016-02-11 20:37:14 -08:00
Lei Xu c7fcec24b8 HDFS-9795. OIV Delimited should show which files are ACL-enabled (lei) 2016-02-11 20:33:51 -08:00
Zhe Zhang 0aa8c82894 HDFS-9755. Erasure Coding: allow to use multiple EC policies in striping related tests [Part 2]. Contributed by Rui Li.
Change-Id: I2100bc27ad484f83c9cb2d2e5bb232f4f74fd286
2016-02-11 10:14:09 -08:00
Jing Zhao 19adb2bc64 HDFS-9789. Correctly update DataNode's scheduled block size when writing small EC file. Contributed by Jing Zhao. 2016-02-10 21:24:00 -08:00
Andrew Wang aeb13ef2ab HDFS-9788. Incompatible tag renumbering in HeartbeatResponseProto. 2016-02-10 15:26:08 -08:00
Karthik Kambatla bc425a623f HDFS-9637. Tests for RollingFileSystemSink. (Daniel Templeton via kasha) 2016-02-10 10:08:05 -08:00
Akira Ajisaka 802a7edfae HDFS-9686. Remove useless boxing/unboxing code. Contributed by Kousuke Saruta. 2016-02-10 23:49:14 +09:00
Akira Ajisaka 5e565ce7a7 Revert "HDFS-9686. Remove useless boxing/unboxing code. Contributed by Kousuke Saruta."
This reverts commit fe124da5ff.
2016-02-10 23:43:33 +09:00
Uma Maheswara Rao G a7fce9ab41 HDFS-9779 . TestReplicationPolicyWithNodeGroup NODE variable picks wrong rack value. Contributed by Kuhu Shukla. 2016-02-09 15:14:30 -08:00
Zhe Zhang a0fb2eff9b HDFS-9775. Erasure Coding : Rename BlockRecoveryWork to BlockReconstructionWork. Contributed by Rakesh R.
Change-Id: I6dfc8efd94fa2bbb4eec0e4730a5a4f92c8a5519
2016-02-09 14:43:59 -08:00
Allen Wittenauer 401ae4ecdb HDFS-9760. WebHDFS AuthFilter cannot be configured with custom AltKerberos auth handler (Ryan Sasson via aw) 2016-02-09 14:15:21 -08:00
Akira Ajisaka 60d2011b7c HDFS-9784. Example usage is not correct in Transparent Encryption document. Contributed by Ohnishi Takashi. 2016-02-10 03:30:26 +09:00
Walter Su acac72911e Move HDFS-9347 from 2.8.0 to 2.6.5 in CHANGES.txt. 2016-02-09 10:48:10 +08:00
zhezhang dbe49c1bd6 HDFS-9244. Support nested encryption zones.
Change-Id: I43a13035a8b27956e90967ee82058efb647c3415
2016-02-08 16:30:51 -08:00
Uma Maheswara Rao G bffaa38a91 HDFS-9777. Fix typos in DFSAdmin command line and documentation.(Wei-Chiu Chuang via umamahesh) 2016-02-08 13:47:45 -08:00
Kihwal Lee 193d27de0a HDFS-9752. Permanent write failures may happen to slow writers during datanode rolling upgrades. Contributed by Walter Su. 2016-02-08 12:16:29 -06:00
Uma Maheswara Rao G aea31eee78 HDFS-9713. DataXceiver#copyBlock should return if block is pinned. Contributed by Uma Maheswara Rao G. 2016-02-07 20:50:47 -08:00
Akira Ajisaka fe124da5ff HDFS-9686. Remove useless boxing/unboxing code. Contributed by Kousuke Saruta. 2016-02-06 19:31:01 +09:00
cnauroth c6497949e8 HDFS-9761. Rebalancer sleeps too long between iterations. Contributed by Mingliang Liu. 2016-02-05 15:07:43 -08:00
Tsz-Wo Nicholas Sze 4e5e1c0f99 HDFS-9726. Refactor IBR code to a new class. 2016-02-05 23:17:59 +08:00
Haohui Mai 1bcfab8e7f HDFS-9724. Degraded performance in WebHDFS listing as it does not reuse ObjectMapper. Contributed by Akira Ajisaka. 2016-02-04 11:34:26 -08:00
Kihwal Lee 496f33de0c HDFS-9730. Storage ID update does not happen when there is a layout change. Contributed by Tsz Wo Nicholas Sze. 2016-02-04 13:19:54 -06:00
Vinayakumar B a6728a013e HDFS-9629. Update the footer of Web UI to show year 2016 (Contributed by Xiao Chen and Vinayakumar B) 2016-02-04 13:37:51 +05:30
Konstantin V Shvachko 81ef1a1f55 HDFS-9503. Use generic option -fs for NNThroughputBenchmark instead of -namenode. Contributed by Mingliang Liu. 2016-02-03 14:59:46 -08:00
zhezhang a0f5e83f28 HDFS-9658. Erasure Coding: allow to use multiple EC policies in striping related tests. Contributed by Rui Li.
Change-Id: I5b02f5bde4d343b7529c6a7fe5df73bd99c6cb24
2016-02-03 14:41:07 -08:00
Konstantin V Shvachko 48b76c8301 Move HDFS-9601 to branch-2.8.0 in CHANGES.txt. (shv) 2016-02-03 14:34:23 -08:00
Jing Zhao 7badf15604 HDFS-9748. Avoid duplication in pendingReplications when addExpectedReplicasToPending is called twice. Contributed by Walter Su. 2016-02-03 13:30:09 -08:00
Vinayakumar B eb2fb943fd HDFS-9740. Use a reasonable limit in DFSTestUtil.waitForMetric() (Contributed by Chang Li) 2016-02-03 11:14:29 +05:30
Vinayakumar B d6b1acb940 HDFS-9739. DatanodeStorage.isValidStorageId() is broken (Contributed by Mingliang Liu) 2016-02-03 10:33:33 +05:30
Vinayakumar B 04375756a5 HDFS-9715. Check storage ID uniqueness on datanode startup (Contributed by Lei (Eddy) Xu) 2016-02-03 07:35:01 +05:30
Junping Du 414cf07650 Adding release 2.6.5 to CHANGES.txt 2016-02-02 18:06:10 -08:00
zhezhang 6d1213860f HDFS-9403. Erasure coding: some EC tests are missing timeout. Contributed by Gao Rui.
Change-Id: I13c4bc0e566c4f8af5371d26f8e18a749ed41d8b
2016-02-02 14:03:45 -08:00
zhezhang 4ae543fdcd HDFS-9731. Erasure Coding: Rename BlockECRecoveryCommand to BlockECReconstructionCommand. Contributed by Rakesh R.
Change-Id: I405365a8395770e494b92bfe9651f4f0366d8f28
2016-02-02 12:32:08 -08:00
Colin Patrick Mccabe 913676dc35 CHANGES.txt: Move HDFS-9260 to trunk 2016-02-02 12:22:26 -08:00
Colin Patrick Mccabe dd9ebf6eed HDFS-9260. Improve the performance and GC friendliness of NameNode startup and full block reports (Staffan Friberg via cmccabe) 2016-02-02 11:23:00 -08:00
Colin Patrick Mccabe 2da03b48eb HDFS-9669. TcpPeerServer should respect ipc.server.listen.queue.size (Elliot Clark via cmccabe) 2016-02-02 10:59:10 -08:00
Lei Xu 9d494f0c0e HDFS-9721. Allow Delimited PB OIV tool to run upon fsimage that contains INodeReference. (Xiao Chen via lei) 2016-02-02 10:42:01 -08:00
Vinayakumar B 4d7055e0c8 HDFS-9718. HAUtil#getConfForOtherNodes should unset independent generic keys before initialize (Contributed by DENG FEI) 2016-02-02 12:51:35 +05:30
Yongjun Zhang 34ab50ea92 HDFS-9406. FSImage may get corrupted after deleting snapshot. (Contributed by Jing Zhao, Stanislav Antic, Vinayakumar B, Yongjun Zhang) 2016-02-01 13:56:55 -08:00
Jing Zhao e30ce01ddc HDFS-9494. Parallel optimization of DFSStripedOutputStream#flushAllInternals. Contributed by Gao Rui. 2016-02-01 13:02:58 -08:00
Lei Xu e50aa53eed HDFS-9701. DN may deadlock when hot-swapping under load. (Xiao Chen via lei) 2016-02-01 12:56:53 -08:00
Xiaoyu Yao b11008d54d HDFS-9210. Fix some misuse of %n in VolumeScanner#printStats. Contributed by Xiaoyu Yao. 2016-02-01 11:55:27 -08:00
Steve Loughran af2dccbca5 HDFS-9708. FSNamesystem.initAuditLoggers() doesn't trim classnames (Mingliang Liu via stevel) 2016-02-01 16:01:50 +00:00
Vinayakumar B 8f2622b6a0 HDFS-9659. EditLogTailerThread to Active Namenode RPC should timeout (Contributed by surendra singh lilhore) 2016-02-01 14:10:55 +05:30
Vinayakumar B e418bd1fb0 HDFS-9566. Remove expensive 'BlocksMap#getStorages(Block b, final DatanodeStorage.State state)' method (Contributed by Daryn Sharp) 2016-02-01 13:24:05 +05:30
Yongjun Zhang eddd823cd6 HDFS-9638. Improve DistCp Help and documentation. (Wei-Chiu Chuang via Yongjun Zhang) 2016-01-29 12:11:55 -08:00
Yongjun Zhang 8ee060311c HDFS-9706. Log more details in debug logs in BlockReceiver's constructor. (Xiao Chen via Yongjun Zhang) 2016-01-28 23:04:03 -08:00
Colin Patrick Mccabe f67149ab08 HDFS-7764. DirectoryScanner shouldn't abort the scan if one directory had an error (Rakesh R via cmccabe) 2016-01-28 19:54:50 -08:00
Tsz-Wo Nicholas Sze 662e17b46a HDFS-9654. Code refactoring for HDFS-8578. 2016-01-28 10:58:03 +08:00
Jing Zhao ec25c7f9c7 HDFS-9677. Rename generationStampV1/generationStampV2 to legacyGenerationStamp/generationStamp. Contributed by Mingliang Liu. 2016-01-27 16:34:40 -08:00
Jing Zhao 3a9571308e Revert "HDFS-9677. Rename generationStampV1/generationStampV2 to legacyGenerationStamp/generationStamp. Contributed by Mingliang Liu."
This reverts commit 8a91109d16.
2016-01-27 16:31:19 -08:00
Jing Zhao 8a91109d16 HDFS-9677. Rename generationStampV1/generationStampV2 to legacyGenerationStamp/generationStamp. Contributed by Mingliang Liu. 2016-01-27 15:48:47 -08:00
Zhe Zhang cf8af7bb45 HDFS-9541. Add hdfsStreamBuilder API to libhdfs to support defaultBlockSizes greater than 2 GB. Contributed by Colin Patrick McCabe.
Change-Id: Ifce1b9be534dc8f7e9d2634cd60e423921b9810f
2016-01-26 11:24:57 -08:00
Tsz-Wo Nicholas Sze 45c763ad61 HDFS-9690. ClientProtocol.addBlock is not idempotent after HDFS-8071. 2016-01-26 11:20:13 +08:00
Tsz-Wo Nicholas Sze bd909ed9f2 HDFS-8999. Allow a file to be closed with COMMITTED but not yet COMPLETE blocks. 2016-01-26 10:32:51 +08:00
Jitendra Pandey e8650fea1f HDFS-9672. o.a.h.hdfs.TestLeaseRecovery2 fails intermittently. Contributed by Mingliang Liu. 2016-01-25 16:08:46 -08:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.) ec4d2d9f40 Release process for 2.7.2: Set the release date for 2.7.2 2016-01-25 15:45:57 -08:00
Arpit Agarwal d62b4a4de7 HDFS-9094. Add command line option to ask NameNode reload configuration. (Contributed by Xiaobing Zhou) 2016-01-25 12:17:05 -08:00
Eric Yang 10a2bc0dff HDFS-9653. Added blocks pending deletion report to dfsadmin.
(Weiwei Yang via eyang)
2016-01-24 14:19:49 -08:00
Allen Wittenauer d22c4239a4 HDFS-9525. hadoop utilities need to support provided delegation tokens (HeeSoo Kim via aw) 2016-01-22 12:15:22 -08:00
Jing Zhao 95363bcc7d HDFS-9646. ErasureCodingWorker may fail when recovering data blocks with length less than the first internal block. Contributed by Jing Zhao. 2016-01-22 09:46:02 -08:00
Kihwal Lee 2fd19b9674 HDFS-8898. Create API and command-line argument to get quota and quota usage without detailed content summary. Contributed by Ming Ma. 2016-01-22 09:10:06 -06:00
Akira Ajisaka 6831634682 HDFS-9682. Fix a typo "aplication" in HttpFS document. Contributed by Weiwei yang. 2016-01-22 20:12:18 +09:00
Masatake Iwasaki ae9c61ff0a HDFS-9618. Fix mismatch between log level and guard in BlockManager#computeRecoveryWorkForBlocks (iwasakims) 2016-01-22 14:11:48 +09:00
Masatake Iwasaki b2ffcc2915 HDFS-9601. NNThroughputBenchmark.BlockReportStats should handle NotReplicatedYetException on adding block (iwasakims) 2016-01-22 12:28:38 +09:00
Zhe Zhang b4a05c1fd5 HDFS-9674. The HTrace span for OpWriteBlock should record the maxWriteToDisk time. Contributed by Colin McCabe.
Change-Id: I9bf3f3bcd57f5880189ad7c160f3dd66f97d904b
2016-01-21 13:25:42 -08:00
Jing Zhao c304890c8c HDFS-9542. Move BlockIdManager from FSNamesystem to BlockManager. Contributed by Jing Zhao. 2016-01-21 11:13:17 -08:00
Kihwal Lee 3616c7b855 HDFS-9634. webhdfs client side exceptions don't provide enough details. Contributed by Eric Payne. 2016-01-21 09:32:57 -06:00
Vinayakumar B b7372b7166 HDFS-9625. set replication for empty file failed when set storage policy (Contributed by DENG FEI) 2016-01-21 19:17:05 +05:30
Lei Xu 2ec438e8f7 HDFS-9655. NN should start JVM pause monitor before loading fsimage. (John Zhuge via Lei (Eddy) Xu) 2016-01-20 14:26:11 -08:00
Colin Patrick Mccabe 7905788db9 HDFS-9576: HTrace: collect position/length information on read operations (zhz via cmccabe) 2016-01-20 11:26:44 -08:00
Vinayakumar B 1425578690 HDFS-9661. Deadlock in DN.FsDatasetImpl between moveBlockAcrossStorage and createRbw (Contributed by ade) 2016-01-20 21:04:21 +05:30
Yongjun Zhang 57d0a94305 HDFS-6054. MiniQJMHACluster should not use static port to avoid binding failure in unit test. (Yongjun Zhang) 2016-01-19 22:54:47 -08:00
Akira Ajisaka 92c5f565fd HDFS-9623. Update example configuration of block state change log in log4j.properties. Contributed by Masatake Iwasaki. 2016-01-19 13:31:26 +09:00
Tsz-Wo Nicholas Sze 995f06f268 In CHANGES.txt, move HDFS-9294 to Release 2.6.4. 2016-01-16 23:44:14 +08:00
Andrew Wang c07f7fa8ff HDFS-9624. DataNode start slowly due to the initial DU command operations. (Lin Yiqun via wang) 2016-01-15 11:28:46 -08:00
Yongjun Zhang a9c69ebeb7 HDFS-9612. DistCp worker threads are not terminated after jobs are done. (Wei-Chiu Chuang via Yongjun Zhang) 2016-01-15 10:03:09 -08:00
Arpit Agarwal e97cd4ade5 HDFS-9415. Document dfs.cluster.administrators and dfs.permissions.superusergroup. (Contributed by Xiaobing Zhou) 2016-01-14 14:17:52 -08:00
Yongjun Zhang 817cc1f02a HDFS-9648. TestStartup.testImageChecksum is broken by HDFS-9569's message change. (Wei-Chiu Chuang via Yongjun Zhang) 2016-01-14 12:36:36 -08:00
Junping Du e50dd19a9c Add missing CHANGES.txt entry for HDFS-8767. 2016-01-14 06:05:39 -08:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.) cb73c753da HADOOP-5323. Trash documentation should describe its directory structure and configurations. (Weiwei Yang via ozawa)
Moved entry from HDFS CHANGES.txt to that of common.
2016-01-13 14:55:06 -08:00
Yongjun Zhang 25051c3bd0 HDFS-9569. Log the name of the fsimage being loaded for better supportability. (Yongjun Zhang) 2016-01-12 09:22:22 -08:00
Jing Zhao 17158647f8 move HDFS-9621 from trunk to 2.9.0 in CHANGES.txt. 2016-01-11 22:51:08 -08:00
Xiaoyu Yao 103d3cfc4e Correct commit message for HDFS-9584 2016-01-11 18:59:43 -08:00
Xiaoyu Yao c2e2e13455 HDFS-8584. NPE in distcp when ssl configuration file does not exist in class path. Contributed by Surendra Singh Lilhore. 2016-01-11 17:08:26 -08:00
Arpit Agarwal de37f37543 HDFS-9639. Inconsistent Logging in BootstrapStandby. (Contributed by Xiaobing Zhou) 2016-01-11 15:08:00 -08:00
Jing Zhao 9f4bf3bdf9 HDFS-9621. getListing wrongly associates Erasure Coding policy to pre-existing replicated files under an EC directory. Contributed by Jing Zhao. 2016-01-11 11:31:59 -08:00
Zhe Zhang 71e5982e39 Update CHANGES.txt: move HDFS-9626 and HDFS-9630 to the section of release 2.8
Change-Id: Ief7915e794d6862ca2c9d84f4188cb560d7dba95
2016-01-11 10:00:22 -08:00
Zhe Zhang 95f32015ad HDFS-9630. DistCp minor refactoring and clean up. Contributed by Kai Zheng.
Change-Id: I363c4ffcac32116ddcdc0a22fac3db92f14a0db0
2016-01-11 09:46:56 -08:00
Lei Xu fd8065a763 HDFS-9493. Test o.a.h.hdfs.server.namenode.TestMetaSave fails in trunk. (Tony Wu via lei) 2016-01-08 15:00:30 -08:00
Zhe Zhang 0af2022e6d HDFS-9626. TestBlockReplacement#testBlockReplacement fails occasionally. Contributed by Xiao Chen.
Change-Id: Ia766a5bfb89f8cf8a48b473bb27c30d5818ebfc0
2016-01-08 13:14:36 -08:00
Kihwal Lee 38c4c14472 HDFS-9574. Reduce client failures during datanode restart. Contributed by Kihwal Lee. 2016-01-08 11:13:58 -06:00
Vinayakumar B 6702e7d66a HDFS-9619. SimulatedFSDataset sometimes can not find blockpool for the correct namenode (Contributed by Wei-Chiu Chuang) 2016-01-07 14:20:18 +05:30
Vinayakumar B 34cd7cd765 HDFS-9600. do not check replication if the block is under construction (Contributed by Phil Yang) 2016-01-07 11:27:42 +05:30
Haohui Mai c213ee0859 HDFS-9047. Retire libwebhdfs. Contributed by Haohui Mai. 2016-01-06 16:16:31 -08:00
Arpit Agarwal 67c9780609 HDFS-9498. Move code that tracks blocks with future generation stamps to BlockManagerSafeMode. (Contributed by Mingliang Liu) 2016-01-06 10:30:59 -08:00
Arpit Agarwal b9936689c9 HDFS-9615. Fix variable name typo in DFSConfigKeys. (Contributed by Ray Chiang) 2016-01-06 09:40:31 -08:00
Haohui Mai dec8fedb65 HDFS-9605. Add links to failed volumes to explorer.html in HDFS Web UI. Contributed by Archana T. 2016-01-05 13:55:55 -08:00
Haohui Mai cea0972fa1 HDFS-7779. Support changing ownership, group and replication in HDFS Web UI. Contributed by Ravi Prakash. 2016-01-05 13:44:16 -08:00
Uma Mahesh 778146eaae HADOOP-12658. Clear javadoc and check style issues around DomainSocket. Contributed by Kai Zheng 2016-01-04 14:32:09 -08:00
Akira Ajisaka db99e30f67 Set release date for 2.6.3 2016-01-04 16:12:12 +09:00
Akira Ajisaka 64ae85fd2e HADOOP-11252. RPC client does not time out by default. Contributed by Wilfred Spiegelenburg and Masatake Iwasaki. 2016-01-04 14:31:22 +09:00
cnauroth 84a8147791 HDFS-9376. TestSeveralNameNodes fails occasionally. Contributed by Masatake Iwasaki. 2015-12-29 14:37:03 -08:00
cnauroth 99cf2ecee9 HDFS-7553. fix the TestDFSUpgradeWithHA due to BindException. Contributed by Xiao Chen. 2015-12-29 10:56:59 -08:00
Benoy Antony 8cfd672397 HDFS-9597. BaseReplicationPolicyTest should update data node stats after adding a data node. Contributed by Wei-Chiu Chuang. 2015-12-25 08:55:39 -08:00
Benoy Antony df83230948 HDFS-9034. StorageTypeStats Metric should not count failed storage. Contributed by Surendra Singh Lilhore. 2015-12-22 15:28:17 -08:00
Kihwal Lee 867048c3e4 HDFS-7163. WebHdfsFileSystem should retry reads according to the configured retry policy. Contributed by Eric Payne. 2015-12-22 14:08:23 -06:00
cnauroth 5c0ff69618 HDFS-9458. TestBackupNode always binds to port 50070, which can cause bind failures. Contributed by Xiao Chen. 2015-12-22 10:29:35 -08:00
Colin Patrick Mccabe bb540ba85a HDFS-9589. Block files which have been hardlinked should be duplicated before the DataNode appends to the them (cmccabe) 2015-12-22 09:36:50 -08:00
Tsz-Wo Nicholas Sze 70d6f20126 HDFS-9575. Use byte array for internal block indices in a striped block. Contributed by jing9 2015-12-22 14:47:57 +08:00
Zhe Zhang 0087734cc1 HDFS-9580. TestComputeInvalidateWork#testDatanodeReRegistration failed due to unexpected number of invalidate blocks. Contributed by Wei-Chiu Chuang.
Change-Id: I9411dfb1dd4605cbcc515ca3361218d35d7c5fe3
2015-12-21 22:38:30 -08:00
Akira Ajisaka 2cb5afffc4 Move HDFS-8914 from 2.8.0 to 2.7.3 in CHANGES.txt. 2015-12-21 21:52:04 +09:00
Akira Ajisaka fa544020f6 HDFS-9505. HDFS Architecture documentation needs to be refreshed. Contributed by Masatake Iwasaki. 2015-12-21 21:23:03 +09:00
Uma Mahesh 52ad9125b8 HDFS-9582. TestLeaseRecoveryStriped file missing Apache License header and not well formatted. (umamahesh) 2015-12-20 13:10:57 -08:00
Uma Mahesh 0f82b5d878 YARN-4480. Clean up some inappropriate imports. (Kai Zheng via umamahesh) 2015-12-19 23:10:13 -08:00
cnauroth 932956458d HADOOP-12570. HDFS Secure Mode Documentation updates. Contributed by Arpit Agarwal. 2015-12-18 16:24:53 -08:00
Zhe Zhang ef3f3f6bb1 HDFS-9347. Invariant assumption in TestQuorumJournalManager.shutdown() is wrong. Contributed by Wei-Chiu Chuang.
Change-Id: Idde8522e11c77f82b376e0c90a9bf33d163d5cb9
2015-12-18 16:04:47 -08:00
Zhe Zhang 61ab0440f7 HDFS-9173. Erasure Coding: Lease recovery for striped file. Contributed by Walter Su and Jing Zhao.
Change-Id: I51703a61c9d8454f883028f3f6acb5729fde1b15
2015-12-18 15:57:48 -08:00
Colin Patrick Mccabe e63388fdf2 HDFS-9350. Avoid creating temprorary strings in Block.toString() and getBlockName() (Staffan Friberg via cmccabe) 2015-12-18 09:40:39 -08:00