Commit Graph

6409 Commits

Author SHA1 Message Date
Chen Liang 50dd3a5cfa HDFS-11627. Block Storage: Cblock cache should register with flusher to upload blocks to containers. Contributed by Mukul Kumar Singh. 2017-04-26 10:36:56 -07:00
Chen Liang eae8c2a469 HDFS-11667. Block Storage:Handling flushing of incomplete block id buffers during shutdown. Contributed by Mukul Kumar Singh. 2017-04-20 13:50:29 -07:00
Xiaoyu Yao a2c6f594ba HDFS-11668. Ozone: misc improvements for SCM CLI. Contributed by Weiwei Yang. 2017-04-20 11:32:13 -07:00
Yiqun Lin 9154d77ca8 HDFS-11666. Ozone: Fix compile error due to inconsistent package name. Contributed by Yiqun Lin. 2017-04-20 14:22:59 +08:00
Xiaoyu Yao 8ec13a397f HDFS-11504. Ozone: SCM: Add Block APIs. Contributed by Xiaoyu Yao. 2017-04-19 22:34:49 -07:00
Weiwei Yang 0bf416ac40 HDFS-11649. Ozone: SCM: CLI: Add shell code placeholder classes. Contributed by Chen Liang. 2017-04-19 11:43:14 +08:00
Anu Engineer d889437c27 HDFS-11658. Ozone: SCM daemon is unable to be started via CLI. Contributed by Weiwei Yang. 2017-04-17 19:09:11 -07:00
Anu Engineer 368424b465 HDFS-11581. Ozone: Support force delete a container. Contributed by Yuanbo Liu. 2017-04-17 17:58:54 -07:00
Anu Engineer 350220bfb3 HDFS-11631. Block Storage : allow cblock server to be started from hdfs commandline. Contributed by Chen Liang. 2017-04-17 15:54:39 -07:00
Anu Engineer 49c92ea73d HDFS-11657. Ozone: Add unit test for storage container metrics. Contributed by Yiqun Lin. 2017-04-17 12:44:29 -07:00
Anu Engineer 1a418ef2c0 HDFS-11582. Block Storage : add SCSI target access daemon. Contributed by Chen Liang. 2017-04-13 13:25:53 -07:00
Anu Engineer 3231ead84b Merge branch 'trunk' into HDFS-7240 2017-04-12 16:36:41 -07:00
Anu Engineer 6556445792 HDFS-11569. Ozone: Implement listKey function for KeyManager. Contributed by Weiwei Yang. 2017-04-12 15:36:56 -07:00
Andrew Wang a7312715a6 HDFS-10996. Ability to specify per-file EC policy at create time. Contributed by SammiChen. 2017-04-12 12:27:34 -07:00
Andrew Wang 966b1b5b44 HDFS-11565. Use compact identifiers for built-in ECPolicies in HdfsFileStatus. 2017-04-12 12:24:32 -07:00
Chen Liang cedacf12c9 HDFS-11642. Block Storage: fix TestCBlockCLI and TestCBlockServerPersistence cleanup. Contributed by Xiaoyu Yao. 2017-04-12 12:09:10 -07:00
Anu Engineer abce613356 HDFS-11645. DataXceiver thread should log the actual error when getting InvalidMagicNumberException. Contributed by Chen Liang. 2017-04-12 11:40:58 -07:00
Kihwal Lee d4c01dde49 HDFS-11648. Lazy construct the IIP pathname. Contributed by Daryn Sharp. 2017-04-12 13:29:24 -05:00
Chen Liang f4dec00896 HDFS-11635. Block Storage: Add metrics for Container Flushes. Contributed by Mukul Kumar Singh. 2017-04-12 10:38:30 -07:00
Chris Nauroth 23b1a7bdf1 HDFS-11163. Mover should move the file blocks to default storage once policy is unset. Contributed by Surendra Singh Lilhore. 2017-04-11 22:03:09 -07:00
Hanisha Koneru 62e4573efb HDFS-11630. TestThrottledAsyncCheckerTimeout fails intermittently in Jenkins builds. Contributed by Hanisha Koneru. 2017-04-11 21:36:24 -07:00
Mingliang Liu 3a91376707 HDFS-11558. BPServiceActor thread name is too long. Contributed by Xiaobing Zhou 2017-04-11 15:29:38 -07:00
Xiaoyu Yao a2ff806d2e HDFS-11062. Ozone:SCM: Remove null command. Contributed by Yuanbo Liu. 2017-04-11 13:33:40 -07:00
Wei-Chiu Chuang f050afb578 HADOOP-13665. Erasure Coding codec should support fallback coder. Contributed by Kai Sasaki. 2017-04-11 07:32:13 -07:00
Yiqun Lin 2fd568fdd4 HDFS-11637. Fix javac warning caused by the deprecated key used in TestDFSClientRetries#testFailuresArePerOperation. Contributed by Yiqun Lin. 2017-04-11 19:40:09 +08:00
Chris Douglas a5e57df3c5 HADOOP-14225. Remove xmlenc dependency 2017-04-10 11:48:40 -07:00
Andrew Wang e8bdad7385 HDFS-11623. Move system erasure coding policies into hadoop-hdfs-client. 2017-04-07 16:46:28 -07:00
Andrew Wang 203edc026c HDFS-11633. FSImage failover disables all erasure coding policies. Contributed by Wei-Chiu Chuang. 2017-04-07 15:46:11 -07:00
Chen Liang 349a19b2ad HDFS-11618. Block Storage: Add Support for Direct I/O. Contributed by Mukul Kumar Singh. 2017-04-07 10:01:19 -07:00
Allen Wittenauer 96cbb4fce2 HADOOP-14202. fix jsvc/secure user var inconsistencies
Signed-off-by: John Zhuge <jzhuge@apache.org>
2017-04-07 08:59:21 -07:00
Xiaoyu Yao 0eacd4c13b HDFS-11608. HDFS write crashed with block size greater than 2 GB. Contributed by Xiaobing Zhou. 2017-04-06 16:11:55 -07:00
Xiaoyu Yao a49fac5302 HDFS-11362. StorageDirectory should initialize a non-null default StorageDirType. Contribute by Hanisha Koneru. 2017-04-06 14:33:16 -07:00
Arpit Agarwal 8c57aeb5b4 HDFS-11131. TestThrottledAsyncChecker#testCancellation is flaky. 2017-04-05 17:54:30 -07:00
Andrew Wang 539ef5aa2e HFDS-11596. hadoop-hdfs-client jar is in the wrong directory in release tarball. Contributed by Yuanbo Liu. 2017-04-05 16:04:09 -07:00
Xiaobing Zhou 3db8d68d63 HDFS-11628. Clarify the behavior of HDFS Mover in documentation. Contributed by Xiaobing Zhou. 2017-04-05 15:33:08 -07:00
Anu Engineer 7ce1090558 HDFS-11006. Ozone: support setting chunk size in streaming API. Contributed by Yiqun Lin. 2017-04-05 11:07:28 -07:00
Anu Engineer bc2c5d2d61 HDFS-11625. Ozone: Fix UT failures that caused by hard coded datanode data dirs. Contributed by Weiwei Yang. 2017-04-05 10:11:44 -07:00
Andrew Wang 9e0e430f18 HDFS-11538. Move ClientProtocol HA proxies into hadoop-hdfs-client. Contributed by Huafeng Wang. 2017-04-04 23:05:24 -07:00
Akira Ajisaka 8cb7325527
HDFS-9651. Add missing robots.txt files. 2017-04-05 12:47:45 +09:00
Akira Ajisaka 09e6caec3d
HDFS-9651. All web UIs should include a robots.txt file. Contributed by Lars Francke. 2017-04-05 12:45:28 +09:00
Andrew Wang 18432130a7 HADOOP-14104. Client should always ask namenode for kms provider path. Contributed by Rushabh S Shah. 2017-04-04 13:38:25 -07:00
Anu Engineer adc651044c Merge branch 'trunk' into HDFS-7240 2017-04-04 12:50:22 -07:00
Anu Engineer 38dddad74e HDFS-11620. Ozone: Allocate container for MiniOzone cluster fails because of insufficient space error. Contributed by Mukul Kumar Singh. 2017-04-04 10:09:40 -07:00
Anu Engineer 3bc2e1d992 HDFS-11619. Ozone: Unit tests running failed in Windows. Contributed by Yiqun Lin. 2017-04-04 09:57:56 -07:00
Chris Douglas 6eba79232f HADOOP-14271. Correct spelling of 'occurred' and variants. Contributed by Yeliang Cang 2017-04-03 20:13:14 -07:00
Anu Engineer ec4d25fc53 HDFS-11566. Ozone: Document missing metrics for container operations. Contributed by Yiqun Lin. 2017-04-03 15:01:23 -07:00
Anu Engineer 68eab679e3 HDFS-11564. Ozone: SCM: Add Comparable Metric Support. Contributed by Anu Engineer. 2017-04-03 13:33:11 -07:00
Anu Engineer 558b478ff2 HDFS-11519. Ozone: Implement XceiverServerSpi and XceiverClientSpi using Ratis. Contributed by Tsz Wo Nicholas Sze. 2017-04-03 12:40:06 -07:00
Wei-Chiu Chuang bbd68478d5 HDFS-11598. Improve -setrep for Erasure Coded files. Contributed by Yiqun Lin. 2017-04-03 07:57:28 -07:00
Wei-Chiu Chuang bc7aff7cec HDFS-11515. -du throws ConcurrentModificationException. Contributed by Istvan Fajth, Wei-Chiu Chuang. 2017-04-03 07:35:09 -07:00