Commit Graph

5295 Commits

Author SHA1 Message Date
Kihwal Lee e76b13c415 HDFS-9880. TestDatanodeRegistration fails occasionally. Contributed by Kihwal Lee. 2016-03-01 17:00:18 -06:00
Kihwal Lee 2c8496ebf3 HDFS-8791. block ID-based DN storage layout can be very slow for datanode on ext4. Contributed by Chris Trezzo. 2016-03-01 15:04:59 -06:00
Chris Nauroth 2137e8feeb HDFS-9870. Remove unused imports from DFSUtil. Contributed by Brahma Reddy Battula. 2016-03-01 11:15:13 -08:00
Uma Maheswara Rao G 307ec80aca HDFS-9733. Refactor DFSClient#getFileChecksum and DataXceiver#blockChecksum. Contributed by Kai Zheng 2016-02-29 21:52:20 -08:00
Jing Zhao 2151716832 HDFS-7964. Add support for async edit logging. Contributed by Daryn Sharp. 2016-02-29 15:34:43 -08:00
Akira Ajisaka 8bc023b3b1 HDFS-9864. Correct reference for RENEWDELEGATIONTOKEN and CANCELDELEGATIONTOKEN in webhdfs doc. Contributed by Brahma Reddy Battula. 2016-02-29 18:42:21 +09:00
Jing Zhao 321a80c759 HDFS-9867. Missing block exception should carry locatedBlocks information. Contributed by Mingliang Liu. 2016-02-28 15:00:27 -08:00
Jing Zhao 408f2c807b HDFS-9866. BlockManager#chooseExcessReplicasStriped may weaken rack fault tolerance. Contributed by Jing Zhao. 2016-02-28 14:54:49 -08:00
Tsz-Wo Nicholas Sze d1d4e16690 HDFS-9710. DN can be configured to send block receipt IBRs in batches. 2016-02-26 15:32:25 -08:00
Xiaoyu Yao eab52dfb35 HDFS-9831. Document webhdfs retry configuration keys introduced by HDFS-5219/HDFS-5122. Contributed by Xiaobing Zhou. 2016-02-26 14:14:12 -08:00
Karthik Kambatla c2460dad64 HDFS-9858. RollingFileSystemSink can throw an NPE on non-secure clusters. (Daniel Templeton via kasha) 2016-02-25 16:31:09 -08:00
Zhe Zhang 8808779db3 HDFS-9734. Refactoring of checksum failure report related codes. Contributed by Kai Zheng.
Change-Id: Ie69a77e3498a360959f8e213c51fb2b17c28b64a
2016-02-25 09:55:50 -08:00
Zhe Zhang ccff6035f5 HDFS-9804. Allow long-running Balancer to login with keytab. Contributed by Xiao Chen.
Change-Id: I54b82e0b11929082057b4d21bfcf285222c94cdb
2016-02-25 09:24:32 -08:00
Tsz-Wo Nicholas Sze 6979cbfc1f HDFS-9838. Refactor the excessReplicateMap to a class. 2016-02-24 19:42:47 -08:00
Chris Nauroth dbbfc58c33 HDFS-9843. Document distcp options required for copying between encrypted locations. Contributed by Xiaoyu Yao. 2016-02-24 15:16:05 -08:00
Jing Zhao 47b92f2b6f HDFS-9837. BlockManager#countNodes should be able to detect duplicated internal blocks. Contributed by Jing Zhao. 2016-02-24 15:13:56 -08:00
cnauroth d1dd248b75 HDFS-9854. Log cipher suite negotiation more verbosely. Contributed by Wei-Chiu Chuang. 2016-02-24 12:11:35 -08:00
Kihwal Lee d27d7fc72e HDFS-9395. Make HDFS audit logging consistant. Contributed by Kuhu Shukla. 2016-02-24 12:04:01 -06:00
Zhe Zhang def754ec06 HDFS-9816. Erasure Coding: allow to use multiple EC policies in striping related tests [Part 3]. Contributed by Rui Li.
Change-Id: I64b57bab4722cdc6e1e3148c3a3a401370249afe
2016-02-23 14:05:17 -08:00
Zhe Zhang 647a35e996 HDFS-9844. Correct path creation in getTrashRoot to handle root dir.
Change-Id: I5afe6c7176063892e3e632698c849bd9f4b92906
2016-02-23 13:29:39 -08:00
Colin Patrick Mccabe 211c78c090 HDFS-9549. TestCacheDirectives#testExceedsCapacity is flaky (Xiao Chen via cmccabe) 2016-02-23 12:01:20 -08:00
Tsuyoshi Ozawa 48c61cd6aa HDFS-9084. Pagination, sorting and filtering of files/directories in the HDFS Web UI. (Contributed by Ravi Prakash) 2016-02-23 19:30:58 +09:00
Tsz-Wo Nicholas Sze 66289a3bf4 HDFS-8578. On upgrade, Datanode should process all storage/data dirs in parallel. Contributed by vinayakumarb and szetszwo 2016-02-22 15:01:15 -08:00
Zhe Zhang a2fdfff02d HADOOP-12668. Support excluding weak Ciphers in HttpServer2 through ssl-server.conf. Contributed by Vijay Singh.
Change-Id: Ie46a5427d29188935427f67e55203c19fcd83335
2016-02-22 14:13:54 -08:00
Arpit Agarwal a63301a864 HDFS-9842. dfs.datanode.balance.bandwidthPerSec should accept friendly size units. (Contributed by Lin Yiqun) 2016-02-22 11:34:09 -08:00
Vinayakumar B 342c9572bf HDFS-9425. Expose number of blocks per volume as a metric (Contributed by Brahma Reddy Battula) 2016-02-22 09:29:23 +05:30
Vinayakumar B f313516731 HDFS-7452. skip StandbyException log for getCorruptFiles() (Contributed by Bramha Reddy Battula) 2016-02-22 09:21:46 +05:30
Arpit Agarwal d5abd293a8 HDFS-9839. Reduce verbosity of processReport logging. (Contributed by Arpit Agarwal)
This closes #78
2016-02-20 23:19:09 -08:00
Jing Zhao e54cc29312 HDFS-9818. Correctly handle EC reconstruction work caused by not enough racks. Contributed by Jing Zhao. 2016-02-19 19:02:23 -08:00
Jing Zhao 6546d9e7ff HDFS-9829. Erasure Coding: Improve few exception handling logic of ErasureCodingWorker. Contributed by Rakesh R. 2016-02-19 10:40:28 -08:00
Yongjun Zhang ba1c9d484a HDFS-9764. DistCp doesn't print value for several arguments including -numListstatusThreads. (Wei-Chiu Chuang via Yongjun Zhang) 2016-02-19 10:17:37 -08:00
Tsz-Wo Nicholas Sze 748b6c07fe Move HDFS-8923 to Release 2.8.0 in CHANGES.txt. 2016-02-18 18:43:06 -08:00
Tsz-Wo Nicholas Sze 46f7790236 HDFS-8923. Add -source flag to balancer usage message. Contributed by Chris Trezzo 2016-02-18 18:18:12 -08:00
Akira Ajisaka c7ac25e52c HDFS-9830. Remove references to hftp in ViewFs documentation in trunk. Contributed by Wei-Chiu Chuang. 2016-02-19 05:02:57 +09:00
Tsz-Wo Nicholas Sze bbfaf3c271 HADOOP-10865. Add a Crc32 chunked verification benchmark for both directly and non-directly buffer cases. 2016-02-18 11:47:33 -08:00
Kihwal Lee ba6d5ed955 HDFS-4946. Allow preferLocalNode in BlockPlacementPolicyDefault to be configurable. Contributed by James Kinley and Nathan Roberts. 2016-02-18 13:21:51 -06:00
cnauroth 5d1889a66d HDFS-9711. Integrate CSRF prevention filter in WebHDFS. Contributed by Chris Nauroth. 2016-02-18 10:07:28 -08:00
Akira Ajisaka e78d8e66f7 HDFS-6832. Fix the usage of 'hdfs namenode' command. Contributed by Manjunath Ballur. 2016-02-19 01:35:06 +09:00
Zhe Zhang 0fb14aaced HDFS-9799. Reimplement getCurrentTrashDir to remove incompatibility. (zhz)
Change-Id: I7834bcebffed38cb384db5395ddb8b6dd9e79a0b
2016-02-17 13:30:50 -08:00
Andrew Wang 3a23dc683c HDFS-9608. Disk IO imbalance in HDFS with heterogeneous storages. Contributed by Wei Zhou. 2016-02-17 11:29:58 -08:00
Haohui Mai 77f7ca3e94 HDFS-9815. Move o.a.h.fs.Hdfs to hadoop-hdfs-client. Contributed by Vinayakumar B. 2016-02-17 10:56:11 -08:00
Vinayakumar B 2536ece7b6 HDFS-9787. SNNs stop uploading FSImage to ANN once isPrimaryCheckPointer changed to false. (Contributed by Guocui Mi) 2016-02-17 10:41:24 +05:30
Junping Du 77ba5add0d HDFS-9456. BlockPlacementPolicyWithNodeGroup should override verifyBlockPlacement(). Contributed by Xiaobing Zhou. 2016-02-16 18:55:55 -08:00
Akira Ajisaka 8ed07bd3e6 HDFS-9765. TestBlockScanner#testVolumeIteratorWithCaching fails intermittently. (aajisaka) 2016-02-15 19:08:03 +09:00
Akira Ajisaka b0738ae673 HDFS-9773. Remove dead code related to SimulatedFSDataset in tests. Contributed by Brahma Reddy Battula. 2016-02-15 15:35:06 +09:00
Akira Ajisaka ac5da11399 HDFS-9691. TestBlockManagerSafeMode#testCheckSafeMode fails intermittently. Contributed by Mingliang Liu. 2016-02-15 14:00:09 +09:00
Junping Du ec12ce8f48 Set the release date for 2.6.4. 2016-02-13 01:42:50 -08:00
Arpit Agarwal 1de1641f17 HDFS-9801. ReconfigurableBase should update the cached configuration. (Arpit Agarwal) 2016-02-12 12:41:04 -08:00
Arun Suresh 9fdfb546fb HDFS-9797. Log Standby exceptions thrown by RequestHedgingProxyProvider at DEBUG Level (Inigo Goiri via asuresh) 2016-02-12 11:18:10 -08:00
Jing Zhao 972782d956 HDFS-9754. Avoid unnecessary getBlockCollection calls in BlockManager. Contributed by Jing Zhao. 2016-02-12 11:07:52 -08:00