Commit Graph

16785 Commits

Author SHA1 Message Date
Anu Engineer 293c425b25 HDFS-12305. Ozone: SCM: Add StateMachine for pipeline/container. Contributed by Xiaoyu Yao. 2017-08-16 14:36:34 -07:00
Anu Engineer 8151f26a1f HDFS-12238. Ozone: Add valid trace ID check in sendCommandAsync. Contributed by Ajay Kumar. 2017-08-16 14:24:58 -07:00
Chen Liang 63edc5b1e5 HDFS-12290. Block Storage: Change dfs.cblock.jscsi.server.address default bind address to 0.0.0.0. Contributed by Mukul Kumar Singh. 2017-08-15 15:37:17 -07:00
Chen Liang bfc49a4b2d HDFS-12255. Block Storage: Cblock should generated unique trace ID for the ops. Contributed by Mukul Kumar Singh. 2017-08-15 10:57:11 -07:00
Weiwei Yang f7ae9f6e41 HDFS-12298. Ozone: Block deletion service floods the log when deleting large number of block files. Contributed by Yiqun Lin. 2017-08-15 17:12:59 +08:00
Weiwei Yang e53567ba5d HDFS-12230. Ozone: KSM: Add creation time field in bucket info. Contributed by Yiqun Lin. 2017-08-15 14:17:33 +08:00
Anu Engineer 57dfe49363 HDFS-12005. Ozone: Web interface for SCM. Contributed by Elek, Marton. 2017-08-14 16:28:26 -07:00
Anu Engineer 531d9ced98 HDFS-12281. Ozone: Ozone-default.xml has 3 properties that do not match the default Config value. Contributed by Ajay Yadav. 2017-08-11 10:12:48 -07:00
Anu Engineer bd23dbfbf7 HDFS-12028. Reapply: Ozone: CLI: remove noisy slf4j binding output from hdfs oz command. Contributed by Chen Liang.
While committing HDFS-12115, I accidently removed this patch. Reapplying the same patch again.
2017-08-11 09:10:34 -07:00
Anu Engineer 4fac755bc7 HDFS-12286. Ozone: Extend MBeans utility to add any key value pairs to the registered MXBeans. Contributed by Elek, Marton. 2017-08-11 08:32:23 -07:00
Weiwei Yang 482c094622 HDFS-12196. Ozone: DeleteKey-2: Implement block deleting service to delete stale blocks at background. Contributed by Weiwei Yang. 2017-08-11 18:45:55 +08:00
Weiwei Yang 0e32bf1797 HDFS-12274. Ozone: Corona: move corona from test to tools package. Contributed by Nandakumar. 2017-08-10 17:25:14 +08:00
Chen Liang c25d95963d Revert "HDFS-11836. Ozone : add sql debug CLI to hdfs script. Contributed by Chen Liang." due to duplicate of HDFS-12266
This reverts commit ac2d219007.
2017-08-09 09:59:16 -07:00
Xiaoyu Yao 43d38114e6 HDFS-12259. Ozone: OzoneClient: Refactor move ozone client from hadoop-hdfs to hadoop-hdfs-client. Contributed by Nandakumar. 2017-08-08 13:36:05 -07:00
Xiaoyu Yao b153dbb9b0 HDFS-12266. Ozone : add debug cli to hdfs script. Contributed by Chen Liang. 2017-08-06 08:08:37 -07:00
Xiaoyu Yao 5ffb2508ef HDFS-12267. Ozone: XceiverClientManager should not close the connection if client holds the reference. Contributed by Nandakumar. 2017-08-05 16:09:56 -07:00
Xiaoyu Yao 538d2957b8 HDFS-12262. Ozone: KSM: Reduce default handler thread count from 200. Contributed by Ajay Yadav. 2017-08-05 16:02:29 -07:00
Anu Engineer 9fe0d61816 HDFS-12231. Ozone: KSM: Add creation time field in volume info. Contributed by Yiqun Lin. 2017-08-04 19:50:48 -07:00
Xiaoyu Yao 5fd34ba195 HDFS-12163. Ozone: Reduce MiniOzoneCluster handler thread count. Contributed by Weiwei Yang. 2017-08-04 11:33:10 -07:00
Xiaoyu Yao 15101eef75 HDFS-12246. Ozone: potential thread leaks. Contributed by Weiwei Yang. 2017-08-04 11:11:11 -07:00
Anu Engineer af6dfdf7ee HDFS-11935. Ozone: TestStorageContainerManager#testRpcPermission fails when ipv6 address used. Contributed by Yiqun Lin. 2017-08-04 10:32:32 -07:00
Anu Engineer 72e3016224 HDFS-12178. Ozone: OzoneClient: Handling SCM container creationFlag at client side. Contributed by Nandakumar. 2017-08-04 10:17:45 -07:00
Xiaoyu Yao 507447c816 HDFS-12247. Ozone: KeySpaceManager should unregister KSMMetrics upon stop. Contributed by Yiqun Lin. 2017-08-03 12:45:46 -07:00
Anu Engineer 92945d01b2 HDFS-11580. Ozone: Support asynchronus client API for SCM and containers. Contributed by Anu Engineer. 2017-08-01 12:32:11 -07:00
Weiwei Yang 1fd2790344 HDFS-11984. Ozone: Ensures listKey lists all required key fields. Contributed by Yiqun Lin. 2017-08-01 13:47:44 +08:00
Anu Engineer c49297b5b2 HDFS-12034. Ozone: Web interface for KSM. Contributed by Elek, Marton. 2017-07-31 16:05:21 -07:00
Chen Liang 42ab44d34e HDFS-11920. Ozone : add key partition. Contributed by Chen Liang. 2017-07-31 16:01:39 -07:00
Anu Engineer 1f5353d7b6 HDFS-12195. Ozone: DeleteKey-1: KSM replies delete key request asynchronously. Contributed by Yuanbo Liu. 2017-07-31 10:23:11 -07:00
Weiwei Yang 6fb800fbe0 HDFS-12179. Ozone: Corona: Adding corona as part of hdfs command. Contributed by Nandakumar. 2017-07-29 08:23:05 +08:00
Anu Engineer e269865a2b HDFS-12183. Ozone: KSM : Use proper defaults for block client address. Contributed by Lokesh Jain. 2017-07-28 15:40:59 -07:00
Anu Engineer 52640fb884 Merge branch 'trunk' into HDFS-7240 2017-07-27 16:44:36 -07:00
Jitendra Pandey e3c7300225 HDFS-2319. Add test cases for FSshell -stat. Contributed by XieXianshan and Bharat Viswanadham. 2017-07-27 13:23:15 -07:00
Allen Wittenauer 5f4808ce73
HADOOP-14692. Upgrade Apache Rat
Signed-off-by: Anu Engineer <aegineer@apache.org>
2017-07-27 13:04:50 -07:00
Brahma Reddy Battula c4a85c694f HDFS-11896. Non-dfsUsed will be doubled on dead node re-registration. Contributed by Brahma Reddy Battula. 2017-07-27 12:02:57 -07:00
Varun Saxena 11ece0bda1 Addendum for YARN-5548. Use MockRMMemoryStateStore to reduce test failures (Bibin A Chundatt via Varun Saxena) 2017-07-28 00:10:45 +05:30
Varun Saxena f66fd11e51 YARN-5548. Use MockRMMemoryStateStore to reduce test failures (Bibin A Chundatt via Varun Saxena) 2017-07-27 23:14:50 +05:30
Chen Liang 5e47076032 HDFS-12059. Ozone: OzoneClient: OzoneClientImpl Add setBucketProperty and delete calls. Contributed by Nandakumar. 2017-07-27 10:39:33 -07:00
Anu Engineer 5b3cac7657 HDFS-12180. Ozone: Corona: Add stats and progress bar to corona. Contributed by Nandakumar. 2017-07-26 22:48:06 -07:00
Weiwei Yang c651868c4a HDFS-12145. Ozone: OzoneFileSystem: Ozone & KSM should support / delimited key names. Contributed by Mukul Kumar Singh.
(cherry picked from commit fe0a957e92d506330ba005abba18f665eb5ac1cc)
2017-07-26 22:36:23 -07:00
Yiqun Lin f6ed186330 HDFS-12170. Ozone: OzoneFileSystem: KSM should maintain key creation time and modification time. Contributed by Mukul Kumar Singh. 2017-07-27 11:43:01 +08:00
Kihwal Lee 27a1a5fde9 HADOOP-14578. Bind IPC connections to kerberos UPN host for proxy users. Contributed by Daryn Sharp. 2017-07-26 13:12:39 -05:00
Weiwei Yang 04b39066db HDFS-12192. Ozone: Fix the remaining failure tests for Windows caused by incorrect path generated. Contributed by Yiqun Lin. 2017-07-26 17:51:05 +08:00
Weiwei Yang 5d0f545143 HDFS-12155. Ozone : add RocksDB support to DEBUG CLI. Contributed by Chen Liang. 2017-07-26 12:59:25 +08:00
Jitendra Pandey a92bf39e23 HADOOP-14680. Azure: IndexOutOfBoundsException in BlockBlobInputStream. Contributed by Thomas Marquardt. 2017-07-25 16:26:48 -07:00
Anu Engineer c2d08e6013 HDFS-12115. Ozone: SCM: Add queryNode RPC Call. Contributed by Anu Engineer. 2017-07-25 13:28:33 -07:00
Daniel Templeton f81a4efb8c YARN-6307. Refactor FairShareComparator#compare (Contributed by Yufei Gu via Daniel Templeton) 2017-07-25 13:00:31 -07:00
Jian He ac9489f7fc YARN-6804. Allow custom hostname for docker containers in native services. Contributed by Billie Rinaldi 2017-07-25 09:57:14 -07:00
Kihwal Lee a68b5b31cf HDFS-12171. Reduce IIP object allocations for inode lookup. Contributed by Daryn Sharp. 2017-07-25 11:03:49 -05:00
Brahma Reddy Battula 6d983cca52 HADOOP-14455. ViewFileSystem#rename should support be supported within same nameservice with different mountpoints. Contributed by Brahma Reddy Battula. 2017-07-25 23:51:53 +08:00
Kihwal Lee 1a79dcfc45 HDFS-12143. Improve performance of getting and removing inode features. Contributed by Daryn Sharp. 2017-07-25 10:28:57 -05:00