6730 Commits

Author SHA1 Message Date
Xiaoyu Yao
43d38114e6 HDFS-12259. Ozone: OzoneClient: Refactor move ozone client from hadoop-hdfs to hadoop-hdfs-client. Contributed by Nandakumar. 2017-08-08 13:36:05 -07:00
Kai Zheng
0b67436068 HDFS-12306. Add audit log for some erasure coding operations. Contributed by Huafeng Wang 2017-08-07 19:30:10 +08:00
Xiaoyu Yao
b153dbb9b0 HDFS-12266. Ozone : add debug cli to hdfs script. Contributed by Chen Liang. 2017-08-06 08:08:37 -07:00
Xiaoyu Yao
538d2957b8 HDFS-12262. Ozone: KSM: Reduce default handler thread count from 200. Contributed by Ajay Yadav. 2017-08-05 16:02:29 -07:00
Anu Engineer
9fe0d61816 HDFS-12231. Ozone: KSM: Add creation time field in volume info. Contributed by Yiqun Lin. 2017-08-04 19:50:48 -07:00
Arpit Agarwal
bbc6d254c8 HDFS-12224. Add tests to TestJournalNodeSync for sync after JN downtime. Contributed by Hanisha Koneru. 2017-08-04 12:51:33 -07:00
Xiaoyu Yao
5fd34ba195 HDFS-12163. Ozone: Reduce MiniOzoneCluster handler thread count. Contributed by Weiwei Yang. 2017-08-04 11:33:10 -07:00
Lei Xu
fe3341786a HDFS-12251. Add document for StreamCapabilities. (Lei (Eddy) Xu) 2017-08-04 11:21:58 -07:00
Xiaoyu Yao
15101eef75 HDFS-12246. Ozone: potential thread leaks. Contributed by Weiwei Yang. 2017-08-04 11:11:11 -07:00
Anu Engineer
af6dfdf7ee HDFS-11935. Ozone: TestStorageContainerManager#testRpcPermission fails when ipv6 address used. Contributed by Yiqun Lin. 2017-08-04 10:32:32 -07:00
Anu Engineer
72e3016224 HDFS-12178. Ozone: OzoneClient: Handling SCM container creationFlag at client side. Contributed by Nandakumar. 2017-08-04 10:17:45 -07:00
Andrew Wang
f4c6b00a9f HDFS-12131. Add some of the FSNamesystem JMX values as metrics. Contributed by Erik Krogen. 2017-08-03 15:44:51 -07:00
Xiaoyu Yao
507447c816 HDFS-12247. Ozone: KeySpaceManager should unregister KSMMetrics upon stop. Contributed by Yiqun Lin. 2017-08-03 12:45:46 -07:00
Manoj Govindassamy
79df1e750e HDFS-9388. Decommission related code to support Maintenance State for datanodes. 2017-08-02 14:22:46 -07:00
Chris Douglas
12e44e7bda HDFS-6984. Serialize FileStatus via protobuf. 2017-08-02 12:12:48 -07:00
Sean Mackrory
1a1bf6b7d0 HADOOP-13595. Rework hadoop_usage to be broken up by clients/daemons/etc. Contributed by Allen Wittenauer. 2017-08-02 12:25:05 -06:00
Haohui Mai
6814324c33 HDFS-12107. FsDatasetImpl#removeVolumes floods the logs when removing the volume. Contributed by Kelvin Chu. 2017-08-01 18:34:07 -07:00
Manoj Govindassamy
52d7bafcf4 HDFS-12217. HDFS snapshots doesn't capture all open files when one of the open files is deleted. 2017-08-01 16:28:20 -07:00
Sean Mackrory
7774759830 HDFS-12151. Hadoop 2 clients cannot writeBlock to Hadoop 3 DataNodes. 2017-08-01 14:34:25 -06:00
Anu Engineer
92945d01b2 HDFS-11580. Ozone: Support asynchronus client API for SCM and containers. Contributed by Anu Engineer. 2017-08-01 12:32:11 -07:00
Akira Ajisaka
b38a1eea8e
HADOOP-14245. Use Mockito.when instead of Mockito.stub. Contributed by Andras Bokor. 2017-08-01 15:15:43 +09:00
Weiwei Yang
1fd2790344 HDFS-11984. Ozone: Ensures listKey lists all required key fields. Contributed by Yiqun Lin. 2017-08-01 13:47:44 +08:00
Weiwei Yang
ea568123fa HDFS-12154. Incorrect javadoc description in StorageLocationChecker#check. Contributed by Nandakumar. 2017-07-31 17:02:44 -07:00
Anu Engineer
c49297b5b2 HDFS-12034. Ozone: Web interface for KSM. Contributed by Elek, Marton. 2017-07-31 16:05:21 -07:00
Chen Liang
42ab44d34e HDFS-11920. Ozone : add key partition. Contributed by Chen Liang. 2017-07-31 16:01:39 -07:00
Arpit Agarwal
3e23415a92 HDFS-12082. BlockInvalidateLimit value is incorrectly set after namenode heartbeat interval reconfigured. Contributed by Weiwei Yang. 2017-07-31 11:33:55 -07:00
Anu Engineer
1f5353d7b6 HDFS-12195. Ozone: DeleteKey-1: KSM replies delete key request asynchronously. Contributed by Yuanbo Liu. 2017-07-31 10:23:11 -07:00
Weiwei Yang
6fb800fbe0 HDFS-12179. Ozone: Corona: Adding corona as part of hdfs command. Contributed by Nandakumar. 2017-07-29 08:23:05 +08:00
Anu Engineer
e269865a2b HDFS-12183. Ozone: KSM : Use proper defaults for block client address. Contributed by Lokesh Jain. 2017-07-28 15:40:59 -07:00
Andrew Wang
480c8db40c HDFS-12206. Rename the split EC / replicated block metrics. 2017-07-28 11:24:44 -07:00
Lei Xu
77791e4c36 HDFS-12044. Mismatch between BlockManager.maxReplicationStreams and ErasureCodingWorker.stripedReconstructionPool pool size causes slow and bursty recovery. (Contributed by Lei (Eddy) Xu) 2017-07-28 10:50:49 -07:00
Wei-Chiu Chuang
369f731264 HDFS-12062. removeErasureCodingPolicy needs super user permission. Contributed by Wei-Chiu Chuang. 2017-07-28 00:51:03 -07:00
Yongjun Zhang
c6330f22a5 HDFS-12190. Enable 'hdfs dfs -stat' to display access time. Contributed by Yongjun Zhang. 2017-07-27 16:48:24 -07:00
Anu Engineer
52640fb884 Merge branch 'trunk' into HDFS-7240 2017-07-27 16:44:36 -07:00
Jitendra Pandey
e3c7300225 HDFS-2319. Add test cases for FSshell -stat. Contributed by XieXianshan and Bharat Viswanadham. 2017-07-27 13:23:15 -07:00
Brahma Reddy Battula
c4a85c694f HDFS-11896. Non-dfsUsed will be doubled on dead node re-registration. Contributed by Brahma Reddy Battula. 2017-07-27 12:02:57 -07:00
Chen Liang
5e47076032 HDFS-12059. Ozone: OzoneClient: OzoneClientImpl Add setBucketProperty and delete calls. Contributed by Nandakumar. 2017-07-27 10:39:33 -07:00
Anu Engineer
5b3cac7657 HDFS-12180. Ozone: Corona: Add stats and progress bar to corona. Contributed by Nandakumar. 2017-07-26 22:48:06 -07:00
Weiwei Yang
c651868c4a HDFS-12145. Ozone: OzoneFileSystem: Ozone & KSM should support / delimited key names. Contributed by Mukul Kumar Singh.
(cherry picked from commit fe0a957e92d506330ba005abba18f665eb5ac1cc)
2017-07-26 22:36:23 -07:00
Yiqun Lin
f6ed186330 HDFS-12170. Ozone: OzoneFileSystem: KSM should maintain key creation time and modification time. Contributed by Mukul Kumar Singh. 2017-07-27 11:43:01 +08:00
Weiwei Yang
04b39066db HDFS-12192. Ozone: Fix the remaining failure tests for Windows caused by incorrect path generated. Contributed by Yiqun Lin. 2017-07-26 17:51:05 +08:00
Weiwei Yang
5d0f545143 HDFS-12155. Ozone : add RocksDB support to DEBUG CLI. Contributed by Chen Liang. 2017-07-26 12:59:25 +08:00
Anu Engineer
c2d08e6013 HDFS-12115. Ozone: SCM: Add queryNode RPC Call. Contributed by Anu Engineer. 2017-07-25 13:28:33 -07:00
Kihwal Lee
a68b5b31cf HDFS-12171. Reduce IIP object allocations for inode lookup. Contributed by Daryn Sharp. 2017-07-25 11:03:49 -05:00
Brahma Reddy Battula
6d983cca52 HADOOP-14455. ViewFileSystem#rename should support be supported within same nameservice with different mountpoints. Contributed by Brahma Reddy Battula. 2017-07-25 23:51:53 +08:00
Kihwal Lee
1a79dcfc45 HDFS-12143. Improve performance of getting and removing inode features. Contributed by Daryn Sharp. 2017-07-25 10:28:57 -05:00
Weiwei Yang
f35def4cc8 HDFS-12187. Ozone : add support to DEBUG CLI for ksm.db. Contributed by Chen Liang. 2017-07-25 09:43:19 +08:00
Akira Ajisaka
770cc46228
HDFS-12176. dfsadmin shows DFS Used%: NaN% if the cluster has zero block. Contributed by Weiwei Yang. 2017-07-24 16:24:23 +09:00
Weiwei Yang
c539095200 HDFS-12167. Ozone: Intermittent failure TestContainerPersistence#testListKey. Contributed by Surendra Singh Lilhore. 2017-07-22 22:02:35 +08:00
Anu Engineer
63e211ff75 HDFS-12185. Ozone: Fix Leaking in TestXceiverClientManager. Contributed by Xiaoyu Yao. 2017-07-21 21:06:37 -07:00