523 Commits

Author SHA1 Message Date
Xiaoyu Yao
43d38114e6 HDFS-12259. Ozone: OzoneClient: Refactor move ozone client from hadoop-hdfs to hadoop-hdfs-client. Contributed by Nandakumar. 2017-08-08 13:36:05 -07:00
Xiaoyu Yao
5ffb2508ef HDFS-12267. Ozone: XceiverClientManager should not close the connection if client holds the reference. Contributed by Nandakumar. 2017-08-05 16:09:56 -07:00
Anu Engineer
9fe0d61816 HDFS-12231. Ozone: KSM: Add creation time field in volume info. Contributed by Yiqun Lin. 2017-08-04 19:50:48 -07:00
Xiaoyu Yao
15101eef75 HDFS-12246. Ozone: potential thread leaks. Contributed by Weiwei Yang. 2017-08-04 11:11:11 -07:00
Anu Engineer
92945d01b2 HDFS-11580. Ozone: Support asynchronus client API for SCM and containers. Contributed by Anu Engineer. 2017-08-01 12:32:11 -07:00
Chen Liang
42ab44d34e HDFS-11920. Ozone : add key partition. Contributed by Chen Liang. 2017-07-31 16:01:39 -07:00
Anu Engineer
1f5353d7b6 HDFS-12195. Ozone: DeleteKey-1: KSM replies delete key request asynchronously. Contributed by Yuanbo Liu. 2017-07-31 10:23:11 -07:00
Weiwei Yang
c651868c4a HDFS-12145. Ozone: OzoneFileSystem: Ozone & KSM should support / delimited key names. Contributed by Mukul Kumar Singh.
(cherry picked from commit fe0a957e92d506330ba005abba18f665eb5ac1cc)
2017-07-26 22:36:23 -07:00
Yiqun Lin
f6ed186330 HDFS-12170. Ozone: OzoneFileSystem: KSM should maintain key creation time and modification time. Contributed by Mukul Kumar Singh. 2017-07-27 11:43:01 +08:00
Anu Engineer
c2d08e6013 HDFS-12115. Ozone: SCM: Add queryNode RPC Call. Contributed by Anu Engineer. 2017-07-25 13:28:33 -07:00
Weiwei Yang
b92587c35d HDFS-12127. Ozone: Ozone shell: Add more testing for key shell commands. Contributed by Yiqun Lin. 2017-07-21 20:43:57 +08:00
Xiaoyu Yao
84e11c7c01 Merge branch 'HDFS-7240' of https://git-wip-us.apache.org/repos/asf/hadoop into HDFS-7240 2017-07-19 14:47:05 -07:00
Anu Engineer
8d37ef30e1 HDFS-11493. Ozone: SCM: Add the ability to handle container reports. Contributed by Anu Engineer. 2017-07-14 11:18:36 -07:00
Xiaoyu Yao
b36d08633a Merge branch 'HDFS-7240' of https://git-wip-us.apache.org/repos/asf/hadoop into HDFS-7240 2017-07-07 13:17:11 -07:00
Xiaoyu Yao
99474212cc Merge branch 'trunk' of https://git-wip-us.apache.org/repos/asf/hadoop into HDFS-7240 2017-07-07 13:16:18 -07:00
Weiwei Yang
5fd38a6dc1 HDFS-11679. Ozone: SCM CLI: Implement list container command. Contributed by Yuanbo Liu. 2017-07-07 15:54:21 +08:00
Mingliang Liu
6436768baf HDFS-12089. Fix ambiguous NN retry log message in WebHDFS. Contributed by Eric Badger 2017-07-05 11:10:57 -07:00
Anu Engineer
2708e6260d HDFS-11773. Ozone: KSM : add listVolumes. Contributed by Weiwei Yang. 2017-06-30 23:44:15 -07:00
Andrew Wang
af2773f609 Updating version for 3.0.0-beta1 development 2017-06-29 17:57:40 -07:00
Chen Liang
ba647764f3 HDFS-12050. Ozone: StorageHandler: Implementation of close for releasing resources during shutdown. Contributed by Nandakumar. 2017-06-29 14:43:30 -07:00
Andrew Wang
441378e7e4 Revert "HDFS-11696. Fix warnings from Spotbugs in hadoop-hdfs. Contributed by Yiqun Lin."
This reverts commit 89a8edc0149e3f31a5ade9a0927c4b6332cf6b1a.

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/tools/DFSAdmin.java
2017-06-29 13:54:16 -07:00
Wei-Chiu Chuang
16c8dbde57 HDFS-11881. NameNode consumes a lot of memory for snapshot diff report generation. Contributed by Manoj Govindassamy. 2017-06-29 06:38:41 -07:00
Wei-Chiu Chuang
f99b6d19de HDFS-11870. Add CLI cmd to enable/disable an erasure code policy. Contributed by lufei. 2017-06-28 10:54:25 -07:00
Ravi Prakash
a9d3412b4c HDFS-11993. Add log info when connect to datanode socket address failed. Contributed by chencan 2017-06-26 13:24:27 -07:00
Anu Engineer
31eafb15bc HDFS-12007. Ozone: Enable HttpServer2 for SCM and KSM. Contributed by Elek, Marton. 2017-06-24 00:44:32 -07:00
Arpit Agarwal
6d116ffad2 HDFS-11789. Maintain Short-Circuit Read Statistics. Contributed by Hanisha Koneru. 2017-06-22 13:35:56 -07:00
Vinayakumar B
8dbd53ef9f HDFS-11067. DFS#listStatusIterator(..) should throw FileNotFoundException if the directory deleted before fetching next batch of entries. Contributed by Vinayakumar B. 2017-06-22 17:37:08 +05:30
Anu Engineer
c77d7f9047 HDFS-11970. Ozone: TestXceiverClientManager.testFreeByEviction fails occasionally. Contributed by Mukul Kumar Singh. 2017-06-21 18:01:58 -07:00
Kai Zheng
5db3f98468 HDFS-11606. Add CLI cmd to remove an erasure code policy. Contributed by Tim Yao 2017-06-21 14:01:55 +08:00
Kai Zheng
a010b330e7 HDFS-11933. Arguments check for ErasureCodingPolicy->composePolicyName. Contributed by Lu Fei 2017-06-21 13:46:18 +08:00
Lei Xu
45ff4d38e6 HDFS-11647. Add -E option in hdfs "count" command to show erasure policy summarization. Contributed by luhuichun. 2017-06-20 11:55:09 -07:00
Anu Engineer
185e3ad744 HDFS-11585. Ozone: Support force update a container. Contributed by Yuanbo Liu. 2017-06-20 11:13:12 -07:00
Xiaoyu Yao
0f671caf8d HDFS-11782. Ozone: KSM: Add listKey. Contributed by Yiqun Lin. 2017-06-19 15:55:58 -07:00
Lei Xu
6460df21a0 HADOOP-14395. Provide Builder pattern for DistributedFileSystem.append. Contributed by Lei (Eddy) Xu. 2017-06-16 17:24:00 -07:00
Xiao Chen
4ebc23ba7b HADOOP-14524. Make CryptoCodec Closeable so it can be cleaned up proactively. 2017-06-16 09:49:33 -07:00
Andrew Wang
fb68980959 HDFS-10480. Add an admin command to list currently open files. Contributed by Manoj Govindassamy. 2017-06-15 14:46:55 -07:00
Lei Xu
5e7cfdca7b HADOOP-14394. Provide Builder pattern for DistributedFileSystem.create. (lei) 2017-06-15 10:59:24 -07:00
Lei Xu
999c8fcbef HDFS-10999. Introduce separate stats for Replicated and Erasure Coded Blocks apart from the current Aggregated stats. (Manoj Govindassamy via lei) 2017-06-14 10:44:19 -07:00
Anu Engineer
0a05da9a89 HDFS-11845. Ozone: Output error when DN handshakes with SCM. Contributed by Weiwei Yang 2017-06-09 10:44:07 -07:00
Anu Engineer
423c4bde74 HDFS-11185. Ozone: remove disabled tests. Contributed by Anu Engineer. 2017-06-09 10:25:25 -07:00
Vinayakumar B
f2f1ada640 HDFS-11708. Positional read will fail if replicas moved to different DNs after stream is opened. Contributed by Vinayakumar B. 2017-06-08 10:44:52 -07:00
Yiqun Lin
60a7f57b61 HDFS-11359. DFSAdmin report command supports displaying maintenance state datanodes. Contributed by Yiqun Lin. 2017-06-08 10:44:50 -07:00
Andrew Wang
0a09e1f29d HDFS-11383. Intern strings in BlockLocation and ExtendedBlock. Contributed by Misha Dmitriev. 2017-06-08 10:44:50 -07:00
Andrew Wang
b876bbd936 Update maven version for 3.0.0-alpha4 development 2017-06-08 10:44:47 -07:00
Kihwal Lee
46bad64684 HDFS-11856. Ability to re-add Upgrading Nodes to pipeline for future pipeline updates. Contributed by Vinayakumar B. 2017-06-08 10:44:46 -07:00
Kai Zheng
6d09cf72e7 HDFS-11793. Allow to enable user defined erasure coding policy. Contributed by Sammi Chen 2017-06-08 10:44:44 -07:00
Rakesh Radhakrishnan
0e93e5c482 HDFS-11794. Add ec sub command -listCodec to show currently supported ec codecs. Contributed by SammiChen. 2017-06-08 10:44:44 -07:00
Sunil G
8ec366b0f8 YARN-6584. Correct license headers in hadoop-common, hdfs, yarn and mapreduce. Contributed by Yeliang Cang. 2017-06-08 10:44:43 -07:00
Akira Ajisaka
1c6ec991b5 HDFS-11696. Fix warnings from Spotbugs in hadoop-hdfs. Contributed by Yiqun Lin. 2017-06-08 10:44:40 -07:00
Weiwei Yang
23d7d613df HDFS-11779. Ozone: KSM: add listBuckets. Contributed by Weiwei Yang. 2017-06-08 17:38:48 +08:00