Commit Graph

512 Commits

Author SHA1 Message Date
Xiaoyu Yao 84e11c7c01 Merge branch 'HDFS-7240' of https://git-wip-us.apache.org/repos/asf/hadoop into HDFS-7240 2017-07-19 14:47:05 -07:00
Anu Engineer 8d37ef30e1 HDFS-11493. Ozone: SCM: Add the ability to handle container reports. Contributed by Anu Engineer. 2017-07-14 11:18:36 -07:00
Xiaoyu Yao b36d08633a Merge branch 'HDFS-7240' of https://git-wip-us.apache.org/repos/asf/hadoop into HDFS-7240 2017-07-07 13:17:11 -07:00
Xiaoyu Yao 99474212cc Merge branch 'trunk' of https://git-wip-us.apache.org/repos/asf/hadoop into HDFS-7240 2017-07-07 13:16:18 -07:00
Weiwei Yang 5fd38a6dc1 HDFS-11679. Ozone: SCM CLI: Implement list container command. Contributed by Yuanbo Liu. 2017-07-07 15:54:21 +08:00
Mingliang Liu 6436768baf HDFS-12089. Fix ambiguous NN retry log message in WebHDFS. Contributed by Eric Badger 2017-07-05 11:10:57 -07:00
Anu Engineer 2708e6260d HDFS-11773. Ozone: KSM : add listVolumes. Contributed by Weiwei Yang. 2017-06-30 23:44:15 -07:00
Andrew Wang af2773f609 Updating version for 3.0.0-beta1 development 2017-06-29 17:57:40 -07:00
Chen Liang ba647764f3 HDFS-12050. Ozone: StorageHandler: Implementation of close for releasing resources during shutdown. Contributed by Nandakumar. 2017-06-29 14:43:30 -07:00
Andrew Wang 441378e7e4 Revert "HDFS-11696. Fix warnings from Spotbugs in hadoop-hdfs. Contributed by Yiqun Lin."
This reverts commit 89a8edc014.

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/tools/DFSAdmin.java
2017-06-29 13:54:16 -07:00
Wei-Chiu Chuang 16c8dbde57 HDFS-11881. NameNode consumes a lot of memory for snapshot diff report generation. Contributed by Manoj Govindassamy. 2017-06-29 06:38:41 -07:00
Wei-Chiu Chuang f99b6d19de HDFS-11870. Add CLI cmd to enable/disable an erasure code policy. Contributed by lufei. 2017-06-28 10:54:25 -07:00
Ravi Prakash a9d3412b4c HDFS-11993. Add log info when connect to datanode socket address failed. Contributed by chencan 2017-06-26 13:24:27 -07:00
Anu Engineer 31eafb15bc HDFS-12007. Ozone: Enable HttpServer2 for SCM and KSM. Contributed by Elek, Marton. 2017-06-24 00:44:32 -07:00
Arpit Agarwal 6d116ffad2 HDFS-11789. Maintain Short-Circuit Read Statistics. Contributed by Hanisha Koneru. 2017-06-22 13:35:56 -07:00
Vinayakumar B 8dbd53ef9f HDFS-11067. DFS#listStatusIterator(..) should throw FileNotFoundException if the directory deleted before fetching next batch of entries. Contributed by Vinayakumar B. 2017-06-22 17:37:08 +05:30
Anu Engineer c77d7f9047 HDFS-11970. Ozone: TestXceiverClientManager.testFreeByEviction fails occasionally. Contributed by Mukul Kumar Singh. 2017-06-21 18:01:58 -07:00
Kai Zheng 5db3f98468 HDFS-11606. Add CLI cmd to remove an erasure code policy. Contributed by Tim Yao 2017-06-21 14:01:55 +08:00
Kai Zheng a010b330e7 HDFS-11933. Arguments check for ErasureCodingPolicy->composePolicyName. Contributed by Lu Fei 2017-06-21 13:46:18 +08:00
Lei Xu 45ff4d38e6 HDFS-11647. Add -E option in hdfs "count" command to show erasure policy summarization. Contributed by luhuichun. 2017-06-20 11:55:09 -07:00
Anu Engineer 185e3ad744 HDFS-11585. Ozone: Support force update a container. Contributed by Yuanbo Liu. 2017-06-20 11:13:12 -07:00
Xiaoyu Yao 0f671caf8d HDFS-11782. Ozone: KSM: Add listKey. Contributed by Yiqun Lin. 2017-06-19 15:55:58 -07:00
Lei Xu 6460df21a0 HADOOP-14395. Provide Builder pattern for DistributedFileSystem.append. Contributed by Lei (Eddy) Xu. 2017-06-16 17:24:00 -07:00
Xiao Chen 4ebc23ba7b HADOOP-14524. Make CryptoCodec Closeable so it can be cleaned up proactively. 2017-06-16 09:49:33 -07:00
Andrew Wang fb68980959 HDFS-10480. Add an admin command to list currently open files. Contributed by Manoj Govindassamy. 2017-06-15 14:46:55 -07:00
Lei Xu 5e7cfdca7b HADOOP-14394. Provide Builder pattern for DistributedFileSystem.create. (lei) 2017-06-15 10:59:24 -07:00
Lei Xu 999c8fcbef HDFS-10999. Introduce separate stats for Replicated and Erasure Coded Blocks apart from the current Aggregated stats. (Manoj Govindassamy via lei) 2017-06-14 10:44:19 -07:00
Anu Engineer 0a05da9a89 HDFS-11845. Ozone: Output error when DN handshakes with SCM. Contributed by Weiwei Yang 2017-06-09 10:44:07 -07:00
Anu Engineer 423c4bde74 HDFS-11185. Ozone: remove disabled tests. Contributed by Anu Engineer. 2017-06-09 10:25:25 -07:00
Vinayakumar B f2f1ada640 HDFS-11708. Positional read will fail if replicas moved to different DNs after stream is opened. Contributed by Vinayakumar B. 2017-06-08 10:44:52 -07:00
Yiqun Lin 60a7f57b61 HDFS-11359. DFSAdmin report command supports displaying maintenance state datanodes. Contributed by Yiqun Lin. 2017-06-08 10:44:50 -07:00
Andrew Wang 0a09e1f29d HDFS-11383. Intern strings in BlockLocation and ExtendedBlock. Contributed by Misha Dmitriev. 2017-06-08 10:44:50 -07:00
Andrew Wang b876bbd936 Update maven version for 3.0.0-alpha4 development 2017-06-08 10:44:47 -07:00
Kihwal Lee 46bad64684 HDFS-11856. Ability to re-add Upgrading Nodes to pipeline for future pipeline updates. Contributed by Vinayakumar B. 2017-06-08 10:44:46 -07:00
Kai Zheng 6d09cf72e7 HDFS-11793. Allow to enable user defined erasure coding policy. Contributed by Sammi Chen 2017-06-08 10:44:44 -07:00
Rakesh Radhakrishnan 0e93e5c482 HDFS-11794. Add ec sub command -listCodec to show currently supported ec codecs. Contributed by SammiChen. 2017-06-08 10:44:44 -07:00
Sunil G 8ec366b0f8 YARN-6584. Correct license headers in hadoop-common, hdfs, yarn and mapreduce. Contributed by Yeliang Cang. 2017-06-08 10:44:43 -07:00
Akira Ajisaka 1c6ec991b5 HDFS-11696. Fix warnings from Spotbugs in hadoop-hdfs. Contributed by Yiqun Lin. 2017-06-08 10:44:40 -07:00
Weiwei Yang 23d7d613df HDFS-11779. Ozone: KSM: add listBuckets. Contributed by Weiwei Yang. 2017-06-08 17:38:48 +08:00
Xiaoyu Yao da8bc385a7 HDFS-11880. Ozone: KSM: Remove protobuf formats from KSM wrappers. Contributed by Nandakumar Vadivelu. 2017-06-07 14:49:44 -07:00
Xiaoyu Yao 18706f433f HDFS-11777. Ozone: KSM: add deleteBucket. Contributed by Nandakumar Vadivelu. 2017-06-07 09:45:34 -07:00
Vinayakumar B 70fc6746b3 HDFS-11708. Positional read will fail if replicas moved to different DNs after stream is opened. Contributed by Vinayakumar B. 2017-06-07 10:55:53 +05:30
Weiwei Yang 245c6fed97 HDFS-11887. Shared XceiverClient should be closed if there is no open clients to avoid resource leak. Contributed by Mukul Kumar Singh. 2017-06-06 21:20:20 +08:00
Weiwei Yang d50c8de46c HDFS-11781. Ozone: KSM: Add deleteKey. Contributed by Yuanbo Liu. 2017-06-05 21:04:25 +08:00
Anu Engineer c7dd72e2fe HDFS-11771. Ozone: KSM: Add checkVolumeAccess. Contributed by Mukul Kumar Singh. 2017-06-02 17:04:10 -07:00
Yiqun Lin 8d9084eb62 HDFS-11359. DFSAdmin report command supports displaying maintenance state datanodes. Contributed by Yiqun Lin. 2017-06-02 12:48:30 +08:00
Andrew Wang 7101477e47 HDFS-11383. Intern strings in BlockLocation and ExtendedBlock. Contributed by Misha Dmitriev. 2017-06-01 15:20:18 -07:00
Anu Engineer 988b25419c HDFS-11894. Ozone: Cleanup imports. Contributed by Weiwei Yang. 2017-06-01 13:07:20 -07:00
Xiaoyu Yao 9cb63fdba0 HDFS-11774. Ozone: KSM: add deleteVolume. Contributed by Mukul Kumar Singh. 2017-05-31 14:21:17 -07:00
Xiaoyu Yao 3983e94f0d HDFS-11776. Ozone: KSM: add SetBucketProperty. Contributed by Nandakumar Vadivelu. 2017-05-31 08:37:09 -07:00