6858 Commits

Author	SHA1	Message	Date
Weiwei Yang	91ffbaa8b9	HDFS-12283. Ozone: DeleteKey-5: Implement SCM DeletedBlockLog. Contributed by Yuanbo Liu.	2017-08-24 13:46:03 +08:00
Xiaoyu Yao	9c789e883d	HDFS-12324. Ozone: TestQueryNode#testStaleNodesCount is failing. Contributed by Xiaoyu Yao.	2017-08-23 13:51:17 -07:00
Xiaoyu Yao	8333602a99	HDFS-11888. Ozone: SCM: use state machine for open containers allocated for key/blocks. Contributed by Xiaoyu Yao.	2017-08-23 12:37:09 -07:00
Anu Engineer	076bd5d64a	HDFS-12337. Ozone: Concurrent RocksDB open calls fail because of "No locks available". Contributed by Mukul Kumar Singh.	2017-08-23 10:21:31 -07:00
Weiwei Yang	b1bbd9a030	HDFS-12327. Ozone: support setting timeout in background service. Contributed by Yiqun Lin.	2017-08-23 13:30:02 +08:00
Anu Engineer	d0bd0f6233	Merge branch 'trunk' into HDFS-7240 ... Conflicts: hadoop-hdfs-project/hadoop-hdfs/dev-support/findbugsExcludeFile.xml hadoop-hdfs-project/hadoop-hdfs/pom.xml hadoop-hdfs-project/hadoop-hdfs/src/main/bin/hdfs hadoop-project/pom.xml hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/test/java/org/apache/hadoop/yarn/client/api/impl/TestAMRMClient.java	2017-08-21 18:57:15 -07:00
John Zhuge	b6bfb2fcb2	HDFS-11738. Hedged pread takes more time when block moved from initial locations. Contributed by Vinayakumar B.	2017-08-21 13:45:30 -07:00
Manoj Govindassamy	913760cb4f	HDFS-11988. Verify HDFS Snapshots with open files captured are consistent across truncates and appends to current version file.	2017-08-21 11:08:38 -07:00
Anu Engineer	7d132596da	HDFS-12216. Ozone: TestKeys is failing consistently. Contributed by Mukul Kumar Singh.	2017-08-19 00:55:43 -07:00
Anu Engineer	a245c60bb0	HDFS-12159. Ozone: SCM: Add create replication pipeline RPC. Contributed by Anu Engineer.	2017-08-17 19:38:26 -07:00
Manoj Govindassamy	4230872dd6	HDFS-12316. Verify HDFS snapshot deletion doesn't crash the ongoing file writes.	2017-08-17 16:23:48 -07:00
Andrew Wang	b298948897	HDFS-12072. Provide fairness between EC and non-EC recovery tasks. Contributed by Eddy Xu.	2017-08-17 15:26:11 -07:00
Xiaoyu Yao	6c1e9ab2a4	HDFS-12313. Ozone: SCM: move container/pipeline StateMachine to the right package. Contributed by Xiaoyu Yao.	2017-08-17 11:27:54 -07:00
Andrew Wang	dd7916d3cd	HDFS-12250. Reduce usage of FsPermissionExtension in unit tests. Contributed by Chris Douglas.	2017-08-17 09:35:36 -07:00
Andrew Wang	96b3a6b972	HDFS-11082. Provide replicated EC policy to replicate files. Contributed by SammiChen.	2017-08-16 22:17:06 -07:00
Akira Ajisaka	08aaa4b36f	HDFS-12269. Better to return a Map rather than HashMap in getErasureCodingCodecs. Contributed by Huafeng Wang.	2017-08-17 13:20:27 +09:00
Anu Engineer	8151f26a1f	HDFS-12238. Ozone: Add valid trace ID check in sendCommandAsync. Contributed by Ajay Kumar.	2017-08-16 14:24:58 -07:00
Ravi Prakash	f34646d652	HDFS-12301. NN File Browser UI: Navigate to a path when enter is pressed	2017-08-15 15:44:59 -07:00
Chen Liang	63edc5b1e5	HDFS-12290. Block Storage: Change dfs.cblock.jscsi.server.address default bind address to 0.0.0.0. Contributed by Mukul Kumar Singh.	2017-08-15 15:37:17 -07:00
Chen Liang	bfc49a4b2d	HDFS-12255. Block Storage: Cblock should generated unique trace ID for the ops. Contributed by Mukul Kumar Singh.	2017-08-15 10:57:11 -07:00
Wei-Chiu Chuang	e3ae3e2644	HDFS-12066. When Namenode is in safemode,may not allowed to remove an user's erasure coding policy. Contributed by lufei.	2017-08-15 07:41:43 -07:00
Wei-Chiu Chuang	1040bae6fc	HDFS-12054. FSNamesystem#addErasureCodingPolicies should call checkNameNodeSafeMode() to ensure Namenode is not in safemode. Contributed by lufei.	2017-08-15 07:38:43 -07:00
Weiwei Yang	f7ae9f6e41	HDFS-12298. Ozone: Block deletion service floods the log when deleting large number of block files. Contributed by Yiqun Lin.	2017-08-15 17:12:59 +08:00
Yiqun Lin	2e43c28e01	HDFS-11696. Fix warnings from Spotbugs in hadoop-hdfs. Contributed by Yiqun Lin.	2017-08-15 16:48:49 +08:00
Weiwei Yang	e53567ba5d	HDFS-12230. Ozone: KSM: Add creation time field in bucket info. Contributed by Yiqun Lin.	2017-08-15 14:17:33 +08:00
Chris Douglas	645a8f2a4d	HADOOP-14726. Mark FileStatus::isDir as final	2017-08-14 21:57:20 -07:00
Anu Engineer	57dfe49363	HDFS-12005. Ozone: Web interface for SCM. Contributed by Elek, Marton.	2017-08-14 16:28:26 -07:00
Anu Engineer	d72124a442	HDFS-12162. Update listStatus document to describe the behavior when the argument is a file. Contributed by Ajay Kumar.	2017-08-14 11:32:49 -07:00
Lei Xu	ce797a1706	HDFS-12221. Replace xcerces in XmlEditsVisitor. (Ajay Kumar via lei)	2017-08-14 10:27:47 -07:00
John Zhuge	8b242f09a6	HDFS-11303. Hedged read might hang infinitely if read data from all DN failed . Contributed by Chen Zhang, Wei-chiu Chuang, and John Zhuge.	2017-08-11 19:42:07 -07:00
Anu Engineer	531d9ced98	HDFS-12281. Ozone: Ozone-default.xml has 3 properties that do not match the default Config value. Contributed by Ajay Yadav.	2017-08-11 10:12:48 -07:00
Anu Engineer	bd23dbfbf7	HDFS-12028. Reapply: Ozone: CLI: remove noisy slf4j binding output from hdfs oz command. Contributed by Chen Liang. ... While committing HDFS-12115, I accidently removed this patch. Reapplying the same patch again.	2017-08-11 09:10:34 -07:00
Weiwei Yang	482c094622	HDFS-12196. Ozone: DeleteKey-2: Implement block deleting service to delete stale blocks at background. Contributed by Weiwei Yang.	2017-08-11 18:45:55 +08:00
Yiqun Lin	f13ca94954	HDFS-12287. Remove a no-longer applicable TODO comment in DatanodeManager. Contributed by Chen Liang.	2017-08-11 14:13:45 +08:00
John Zhuge	312e57b954	HDFS-11957. Enable POSIX ACL inheritance by default. Contributed by John Zhuge.	2017-08-10 10:30:47 -07:00
Weiwei Yang	0e32bf1797	HDFS-12274. Ozone: Corona: move corona from test to tools package. Contributed by Nandakumar.	2017-08-10 17:25:14 +08:00
Kihwal Lee	b5c02f95b5	HDFS-12278. LeaseManager operations are inefficient in 2.8. Contributed by Rushabh S Shah.	2017-08-09 16:46:05 -05:00
Chen Liang	c25d95963d	Revert "HDFS-11836. Ozone : add sql debug CLI to hdfs script. Contributed by Chen Liang." due to duplicate of HDFS-12266 ... This reverts commit ac2d219007.	2017-08-09 09:59:16 -07:00
Kihwal Lee	69afa26f19	HDFS-12157. Do fsyncDirectory(..) outside of FSDataset lock. Contributed by inayakumar B.	2017-08-09 09:03:51 -05:00
Wei-Chiu Chuang	8a4bff02c1	HDFS-12117. HttpFS does not seem to support SNAPSHOT related methods for WebHDFS REST Interface. Contributed by Wellington Chevreuil.	2017-08-08 23:58:53 -07:00
Wei-Chiu Chuang	9a3c2379ef	HDFS-12182. BlockManager.metaSave does not distinguish between "under replicated" and "missing" blocks. Contributed by Wellington Chevreuil.	2017-08-08 23:44:18 -07:00
Kai Zheng	a53b8b6fdc	HDFS-11975. Provide a system-default EC policy. Contributed by Huichun Lu	2017-08-09 10:12:58 +08:00
Haohui Mai	1db4788b7d	HADOOP-14598. Blacklist Http/HttpsFileSystem in FsUrlStreamHandlerFactory. Contributed by Steve Loughran.	2017-08-08 16:33:18 -07:00
Haohui Mai	71b8dda4f6	HDFS-10326. Disable setting tcp socket send/receive buffers for write pipelines. Contributed by Daryn Sharp.	2017-08-08 14:58:16 -07:00
Xiaoyu Yao	43d38114e6	HDFS-12259. Ozone: OzoneClient: Refactor move ozone client from hadoop-hdfs to hadoop-hdfs-client. Contributed by Nandakumar.	2017-08-08 13:36:05 -07:00
Kai Zheng	0b67436068	HDFS-12306. Add audit log for some erasure coding operations. Contributed by Huafeng Wang	2017-08-07 19:30:10 +08:00
Xiaoyu Yao	b153dbb9b0	HDFS-12266. Ozone : add debug cli to hdfs script. Contributed by Chen Liang.	2017-08-06 08:08:37 -07:00
Xiaoyu Yao	5ffb2508ef	HDFS-12267. Ozone: XceiverClientManager should not close the connection if client holds the reference. Contributed by Nandakumar.	2017-08-05 16:09:56 -07:00
Xiaoyu Yao	538d2957b8	HDFS-12262. Ozone: KSM: Reduce default handler thread count from 200. Contributed by Ajay Yadav.	2017-08-05 16:02:29 -07:00
Anu Engineer	9fe0d61816	HDFS-12231. Ozone: KSM: Add creation time field in volume info. Contributed by Yiqun Lin.	2017-08-04 19:50:48 -07:00