Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
17,013 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

549 Commits

Author SHA1 Message Date
Weiwei Yang 0f60507521 HDFS-12354. Ozone: Shuffle container list for datanode BlockDeletingService. Contributed by Yiqun Lin. 2017-08-29 16:46:17 +08:00
Chen Liang f0d6a3eaa0 HDFS-12365. Ozone: ListVolume displays incorrect createdOn time when the volume was created by OzoneRpcClient. Contributed by Weiwei Yang. 2017-08-28 10:28:20 -07:00
Anu Engineer 896414e305 HDFS-12341. Ozone: maven dist compilation fails with "Duplicate classes found" error. Contributed by Mukul Kumar Singh. 2017-08-24 21:03:39 -07:00
Weiwei Yang 91ffbaa8b9 HDFS-12283. Ozone: DeleteKey-5: Implement SCM DeletedBlockLog. Contributed by Yuanbo Liu. 2017-08-24 13:46:03 +08:00
Xiaoyu Yao 8333602a99 HDFS-11888. Ozone: SCM: use state machine for open containers allocated for key/blocks. Contributed by Xiaoyu Yao. 2017-08-23 12:37:09 -07:00
Weiwei Yang b1bbd9a030 HDFS-12327. Ozone: support setting timeout in background service. Contributed by Yiqun Lin. 2017-08-23 13:30:02 +08:00
Anu Engineer d0bd0f6233 Merge branch 'trunk' into HDFS-7240 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/dev-support/findbugsExcludeFile.xml
	hadoop-hdfs-project/hadoop-hdfs/pom.xml
	hadoop-hdfs-project/hadoop-hdfs/src/main/bin/hdfs
	hadoop-project/pom.xml
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/test/java/org/apache/hadoop/yarn/client/api/impl/TestAMRMClient.java
 2017-08-21 18:57:15 -07:00
John Zhuge b6bfb2fcb2 HDFS-11738. Hedged pread takes more time when block moved from initial locations. Contributed by Vinayakumar B. 2017-08-21 13:45:30 -07:00
Anu Engineer a245c60bb0 HDFS-12159. Ozone: SCM: Add create replication pipeline RPC. Contributed by Anu Engineer. 2017-08-17 19:38:26 -07:00
Xiaoyu Yao 6c1e9ab2a4 HDFS-12313. Ozone: SCM: move container/pipeline StateMachine to the right package. Contributed by Xiaoyu Yao. 2017-08-17 11:27:54 -07:00
Andrew Wang 96b3a6b972 HDFS-11082. Provide replicated EC policy to replicate files. Contributed by SammiChen. 2017-08-16 22:17:06 -07:00
Akira Ajisaka 08aaa4b36f
HDFS-12269. Better to return a Map rather than HashMap in getErasureCodingCodecs. Contributed by Huafeng Wang. 2017-08-17 13:20:27 +09:00
Anu Engineer 8151f26a1f HDFS-12238. Ozone: Add valid trace ID check in sendCommandAsync. Contributed by Ajay Kumar. 2017-08-16 14:24:58 -07:00
Chen Liang 63edc5b1e5 HDFS-12290. Block Storage: Change dfs.cblock.jscsi.server.address default bind address to 0.0.0.0. Contributed by Mukul Kumar Singh. 2017-08-15 15:37:17 -07:00
Yiqun Lin 2e43c28e01 HDFS-11696. Fix warnings from Spotbugs in hadoop-hdfs. Contributed by Yiqun Lin. 2017-08-15 16:48:49 +08:00
Weiwei Yang e53567ba5d HDFS-12230. Ozone: KSM: Add creation time field in bucket info. Contributed by Yiqun Lin. 2017-08-15 14:17:33 +08:00
Chris Douglas 645a8f2a4d HADOOP-14726. Mark FileStatus::isDir as final 2017-08-14 21:57:20 -07:00
John Zhuge 8b242f09a6 HDFS-11303. Hedged read might hang infinitely if read data from all DN failed . Contributed by Chen Zhang, Wei-chiu Chuang, and John Zhuge. 2017-08-11 19:42:07 -07:00
Anu Engineer 531d9ced98 HDFS-12281. Ozone: Ozone-default.xml has 3 properties that do not match the default Config value. Contributed by Ajay Yadav. 2017-08-11 10:12:48 -07:00
Weiwei Yang 482c094622 HDFS-12196. Ozone: DeleteKey-2: Implement block deleting service to delete stale blocks at background. Contributed by Weiwei Yang. 2017-08-11 18:45:55 +08:00
Kai Zheng a53b8b6fdc HDFS-11975. Provide a system-default EC policy. Contributed by Huichun Lu 2017-08-09 10:12:58 +08:00
Haohui Mai 71b8dda4f6 HDFS-10326. Disable setting tcp socket send/receive buffers for write pipelines. Contributed by Daryn Sharp. 2017-08-08 14:58:16 -07:00
Xiaoyu Yao 43d38114e6 HDFS-12259. Ozone: OzoneClient: Refactor move ozone client from hadoop-hdfs to hadoop-hdfs-client. Contributed by Nandakumar. 2017-08-08 13:36:05 -07:00
Xiaoyu Yao 5ffb2508ef HDFS-12267. Ozone: XceiverClientManager should not close the connection if client holds the reference. Contributed by Nandakumar. 2017-08-05 16:09:56 -07:00
Anu Engineer 9fe0d61816 HDFS-12231. Ozone: KSM: Add creation time field in volume info. Contributed by Yiqun Lin. 2017-08-04 19:50:48 -07:00
Xiaoyu Yao 15101eef75 HDFS-12246. Ozone: potential thread leaks. Contributed by Weiwei Yang. 2017-08-04 11:11:11 -07:00
Chris Douglas 12e44e7bda HDFS-6984. Serialize FileStatus via protobuf. 2017-08-02 12:12:48 -07:00
Anu Engineer 92945d01b2 HDFS-11580. Ozone: Support asynchronus client API for SCM and containers. Contributed by Anu Engineer. 2017-08-01 12:32:11 -07:00
Lei Xu 9586b0e24f HADOOP-14397. Pull up the builder pattern to FileSystem and add AbstractContractCreateTest for it. (Lei (Eddy) Xu) 2017-07-31 20:12:40 -07:00
Chen Liang 42ab44d34e HDFS-11920. Ozone : add key partition. Contributed by Chen Liang. 2017-07-31 16:01:39 -07:00
Anu Engineer 1f5353d7b6 HDFS-12195. Ozone: DeleteKey-1: KSM replies delete key request asynchronously. Contributed by Yuanbo Liu. 2017-07-31 10:23:11 -07:00
Lei Xu 77791e4c36 HDFS-12044. Mismatch between BlockManager.maxReplicationStreams and ErasureCodingWorker.stripedReconstructionPool pool size causes slow and bursty recovery. (Contributed by Lei (Eddy) Xu) 2017-07-28 10:50:49 -07:00
Wei-Chiu Chuang 369f731264 HDFS-12062. removeErasureCodingPolicy needs super user permission. Contributed by Wei-Chiu Chuang. 2017-07-28 00:51:03 -07:00
Weiwei Yang c651868c4a HDFS-12145. Ozone: OzoneFileSystem: Ozone & KSM should support / delimited key names. Contributed by Mukul Kumar Singh. 
(cherry picked from commit fe0a957e92d506330ba005abba18f665eb5ac1cc)
 2017-07-26 22:36:23 -07:00
Yiqun Lin f6ed186330 HDFS-12170. Ozone: OzoneFileSystem: KSM should maintain key creation time and modification time. Contributed by Mukul Kumar Singh. 2017-07-27 11:43:01 +08:00
Anu Engineer c2d08e6013 HDFS-12115. Ozone: SCM: Add queryNode RPC Call. Contributed by Anu Engineer. 2017-07-25 13:28:33 -07:00
Weiwei Yang b92587c35d HDFS-12127. Ozone: Ozone shell: Add more testing for key shell commands. Contributed by Yiqun Lin. 2017-07-21 20:43:57 +08:00
Xiaoyu Yao 84e11c7c01 Merge branch 'HDFS-7240' of https://git-wip-us.apache.org/repos/asf/hadoop into HDFS-7240 2017-07-19 14:47:05 -07:00
Anu Engineer 8d37ef30e1 HDFS-11493. Ozone: SCM: Add the ability to handle container reports. Contributed by Anu Engineer. 2017-07-14 11:18:36 -07:00
Xiaoyu Yao b36d08633a Merge branch 'HDFS-7240' of https://git-wip-us.apache.org/repos/asf/hadoop into HDFS-7240 2017-07-07 13:17:11 -07:00
Xiaoyu Yao 99474212cc Merge branch 'trunk' of https://git-wip-us.apache.org/repos/asf/hadoop into HDFS-7240 2017-07-07 13:16:18 -07:00
Weiwei Yang 5fd38a6dc1 HDFS-11679. Ozone: SCM CLI: Implement list container command. Contributed by Yuanbo Liu. 2017-07-07 15:54:21 +08:00
Mingliang Liu 6436768baf HDFS-12089. Fix ambiguous NN retry log message in WebHDFS. Contributed by Eric Badger 2017-07-05 11:10:57 -07:00
Anu Engineer 2708e6260d HDFS-11773. Ozone: KSM : add listVolumes. Contributed by Weiwei Yang. 2017-06-30 23:44:15 -07:00
Andrew Wang af2773f609 Updating version for 3.0.0-beta1 development 2017-06-29 17:57:40 -07:00
Chen Liang ba647764f3 HDFS-12050. Ozone: StorageHandler: Implementation of close for releasing resources during shutdown. Contributed by Nandakumar. 2017-06-29 14:43:30 -07:00
Andrew Wang 441378e7e4 Revert "HDFS-11696. Fix warnings from Spotbugs in hadoop-hdfs. Contributed by Yiqun Lin." 
This reverts commit 89a8edc014.

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/tools/DFSAdmin.java
 2017-06-29 13:54:16 -07:00
Wei-Chiu Chuang 16c8dbde57 HDFS-11881. NameNode consumes a lot of memory for snapshot diff report generation. Contributed by Manoj Govindassamy. 2017-06-29 06:38:41 -07:00
Wei-Chiu Chuang f99b6d19de HDFS-11870. Add CLI cmd to enable/disable an erasure code policy. Contributed by lufei. 2017-06-28 10:54:25 -07:00
Ravi Prakash a9d3412b4c HDFS-11993. Add log info when connect to datanode socket address failed. Contributed by chencan 2017-06-26 13:24:27 -07:00