Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
17,014 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

17014 Commits

Author SHA1 Message Date
Anu Engineer ea05b4245b HDFS-12333. Ozone: Extend Datanode web interface with SCM information. Contributed by Elek, Marton. 2017-08-29 14:05:28 -07:00
Anu Engineer 6215afcd8c HDFS-12366. Ozone: Refactor KSM metadata class names to avoid confusion. Contributed by Weiwei Yang. 2017-08-29 13:57:51 -07:00
Weiwei Yang 0f60507521 HDFS-12354. Ozone: Shuffle container list for datanode BlockDeletingService. Contributed by Yiqun Lin. 2017-08-29 16:46:17 +08:00
Anu Engineer b06f4f63e3 HDFS-12361. Ozone: SCM failed to start when a container metadata is empty. Contributed by Weiwei Yang. 2017-08-28 13:20:45 -07:00
Chen Liang f0d6a3eaa0 HDFS-12365. Ozone: ListVolume displays incorrect createdOn time when the volume was created by OzoneRpcClient. Contributed by Weiwei Yang. 2017-08-28 10:28:20 -07:00
Weiwei Yang 76a156ebce HDFS-12282. Ozone: DeleteKey-4: Block delete via HB between SCM and DN. Contributed by Weiwei Yang. 2017-08-28 10:04:46 +08:00
Anu Engineer 1586f20fc5 HDFS-12275. Ozone: Corona: Support for random validation of writes. Contributed by Nandakumar. 2017-08-25 10:09:48 -07:00
Anu Engineer 896414e305 HDFS-12341. Ozone: maven dist compilation fails with "Duplicate classes found" error. Contributed by Mukul Kumar Singh. 2017-08-24 21:03:39 -07:00
Anu Engineer 6564e10d98 HDFS-12280. Ozone: TestOzoneContainer#testCreateOzoneContainer fails. Contributed by Lokesh Jain. 2017-08-24 10:29:38 -07:00
Weiwei Yang 91ffbaa8b9 HDFS-12283. Ozone: DeleteKey-5: Implement SCM DeletedBlockLog. Contributed by Yuanbo Liu. 2017-08-24 13:46:03 +08:00
Xiaoyu Yao 9c789e883d HDFS-12324. Ozone: TestQueryNode#testStaleNodesCount is failing. Contributed by Xiaoyu Yao. 2017-08-23 13:51:17 -07:00
Xiaoyu Yao 8333602a99 HDFS-11888. Ozone: SCM: use state machine for open containers allocated for key/blocks. Contributed by Xiaoyu Yao. 2017-08-23 12:37:09 -07:00
Anu Engineer 076bd5d64a HDFS-12337. Ozone: Concurrent RocksDB open calls fail because of "No locks available". Contributed by Mukul Kumar Singh. 2017-08-23 10:21:31 -07:00
Weiwei Yang b1bbd9a030 HDFS-12327. Ozone: support setting timeout in background service. Contributed by Yiqun Lin. 2017-08-23 13:30:02 +08:00
Anu Engineer d0bd0f6233 Merge branch 'trunk' into HDFS-7240 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/dev-support/findbugsExcludeFile.xml
	hadoop-hdfs-project/hadoop-hdfs/pom.xml
	hadoop-hdfs-project/hadoop-hdfs/src/main/bin/hdfs
	hadoop-project/pom.xml
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/test/java/org/apache/hadoop/yarn/client/api/impl/TestAMRMClient.java
 2017-08-21 18:57:15 -07:00
John Zhuge b6bfb2fcb2 HDFS-11738. Hedged pread takes more time when block moved from initial locations. Contributed by Vinayakumar B. 2017-08-21 13:45:30 -07:00
Arpit Agarwal 736ceab2f5 HDFS-12325. SFTPFileSystem operations should restore cwd. Contributed by Chen Liang. 2017-08-21 11:48:51 -07:00
Manoj Govindassamy 913760cb4f HDFS-11988. Verify HDFS Snapshots with open files captured are consistent across truncates and appends to current version file. 2017-08-21 11:08:38 -07:00
Kai Zheng 267e19a09f HADOOP-14194. Aliyun OSS should not use empty endpoint as default. Contributed by Genmao Yu 2017-08-21 13:36:28 +08:00
Arun Suresh 7a82d7bcea YARN-6979. [Addendum patch] Fixed classname and added javadocs. (Kartheek Muthyala via asuresh) 2017-08-20 10:24:05 -07:00
Arun Suresh 8410d862d3 YARN-6979. Add flag to notify all types of container updates to NM via NodeHeartbeatResponse. (Kartheek Muthyala via asuresh) 2017-08-20 07:54:09 -07:00
Anu Engineer 7d132596da HDFS-12216. Ozone: TestKeys is failing consistently. Contributed by Mukul Kumar Singh. 2017-08-19 00:55:43 -07:00
Wangda Tan 436c2638f9 YARN-6852. Native code changes to support isolate GPU devices by using CGroups. (wangda) 
Change-Id: I4869cc4d8ad539539ccba4bea5a178cacdb741ab
 2017-08-18 18:26:36 -07:00
Yufei Gu 8991f0baec YARN-6969. Clean up unused code in class FairSchedulerQueueInfo. (Larry Lo via Yufei Gu) 2017-08-18 14:38:44 -07:00
Arpit Agarwal 2d105a2068 Revert "HADOOP-14732. ProtobufRpcEngine should use Time.monotonicNow to measure durations. Contributed by Hanisha Koneru." 
This reverts commit 8bef4eca28.
 2017-08-18 10:15:52 -07:00
bibinchundatt e05fa3451d YARN-7007. NPE in RM while using YarnClient.getApplications(). Contributed by Lingfeng Su. 2017-08-18 20:28:50 +05:30
Steve Loughran c6b4e656b7
HADOOP-14769. WASB: delete recursive should not fail if a file is deleted. 
Contributed by Thomas Marquardt
 2017-08-18 14:13:40 +01:00
Anu Engineer a245c60bb0 HDFS-12159. Ozone: SCM: Add create replication pipeline RPC. Contributed by Anu Engineer. 2017-08-17 19:38:26 -07:00
Lei Xu 99e558b13b HADOOP-14398. Modify documents for the FileSystem Builder API. (Lei (Eddy) Xu) 2017-08-17 18:06:23 -07:00
Manoj Govindassamy 4230872dd6 HDFS-12316. Verify HDFS snapshot deletion doesn't crash the ongoing file writes. 2017-08-17 16:23:48 -07:00
Andrew Wang b298948897 HDFS-12072. Provide fairness between EC and non-EC recovery tasks. Contributed by Eddy Xu. 2017-08-17 15:26:11 -07:00
Jason Lowe ab1a8ae85f YARN-6988. container-executor fails for docker when command length > 4096 B. Contributed by Eric Badger 2017-08-17 15:50:14 -05:00
Xiaoyu Yao 6c1e9ab2a4 HDFS-12313. Ozone: SCM: move container/pipeline StateMachine to the right package. Contributed by Xiaoyu Yao. 2017-08-17 11:27:54 -07:00
Andrew Wang dd7916d3cd HDFS-12250. Reduce usage of FsPermissionExtension in unit tests. Contributed by Chris Douglas. 2017-08-17 09:35:36 -07:00
Sunil G f9a0e23381 YARN-3254. HealthReport should include disk full information. Contributed by Suma Shivaprasad. 2017-08-17 15:07:15 +05:30
Alexandr Krasheninnikov 1f04cb45f7 HADOOP-14560. Make HttpServer2 backlog size configurable. Contributed by Alexander Krasheninnikov. 
This closes #242.
 2017-08-17 01:05:19 -07:00
Andrew Wang 96b3a6b972 HDFS-11082. Provide replicated EC policy to replicate files. Contributed by SammiChen. 2017-08-16 22:17:06 -07:00
Akira Ajisaka 08aaa4b36f
HDFS-12269. Better to return a Map rather than HashMap in getErasureCodingCodecs. Contributed by Huafeng Wang. 2017-08-17 13:20:27 +09:00
Robert Kanter ab051bd42e MAPREDUCE-6936. Remove unnecessary dependency of hadoop-yarn-server-common from hadoop-mapreduce-client-common (haibochen via rkanter) 2017-08-16 16:14:04 -07:00
Anu Engineer 293c425b25 HDFS-12305. Ozone: SCM: Add StateMachine for pipeline/container. Contributed by Xiaoyu Yao. 2017-08-16 14:36:34 -07:00
Jason Lowe 0acc5e0036 MAPREDUCE-6940. Copy-paste error in the TaskAttemptUnsuccessfulCompletionEvent constructor. Contributed by Oleg Danilov 2017-08-16 16:34:06 -05:00
Anu Engineer 8151f26a1f HDFS-12238. Ozone: Add valid trace ID check in sendCommandAsync. Contributed by Ajay Kumar. 2017-08-16 14:24:58 -07:00
Subru Krishnan de462da04e YARN-6900. ZooKeeper based implementation of the FederationStateStore. (Íñigo Goiri via Subru). 2017-08-16 11:43:24 -07:00
Jason Lowe 14553061be YARN-7020. TestAMRMProxy#testAMRMProxyTokenRenewal is flakey. Contributed by Robert Kanter 2017-08-16 13:04:36 -05:00
Akira Ajisaka 588c190afd
YARN-6965. Duplicate instantiation in FairSchedulerQueueInfo. Contributed by Masahiro Tanaka. 2017-08-16 14:06:22 +09:00
Subru Krishnan 75dd866bfb HADOOP-14773. Extend ZKCuratorManager API for more reusability. (Íñigo Goiri via Subru). 2017-08-15 16:53:59 -07:00
Ravi Prakash f34646d652 HDFS-12301. NN File Browser UI: Navigate to a path when enter is pressed 2017-08-15 15:44:59 -07:00
Chen Liang 63edc5b1e5 HDFS-12290. Block Storage: Change dfs.cblock.jscsi.server.address default bind address to 0.0.0.0. Contributed by Mukul Kumar Singh. 2017-08-15 15:37:17 -07:00
Nathan Roberts d265459024 YARN-7014. Fix off-by-one error causing heap corruption (Jason Lowe via nroberts) 2017-08-15 15:52:48 -05:00
Chen Liang bfc49a4b2d HDFS-12255. Block Storage: Cblock should generated unique trace ID for the ops. Contributed by Mukul Kumar Singh. 2017-08-15 10:57:11 -07:00