Commit Graph

421 Commits

Author SHA1 Message Date
Xiaoyu Yao 8ec13a397f HDFS-11504. Ozone: SCM: Add Block APIs. Contributed by Xiaoyu Yao. 2017-04-19 22:34:49 -07:00
Anu Engineer 368424b465 HDFS-11581. Ozone: Support force delete a container. Contributed by Yuanbo Liu. 2017-04-17 17:58:54 -07:00
Anu Engineer 1a418ef2c0 HDFS-11582. Block Storage : add SCSI target access daemon. Contributed by Chen Liang. 2017-04-13 13:25:53 -07:00
Anu Engineer 3231ead84b Merge branch 'trunk' into HDFS-7240 2017-04-12 16:36:41 -07:00
Andrew Wang a7312715a6 HDFS-10996. Ability to specify per-file EC policy at create time. Contributed by SammiChen. 2017-04-12 12:27:34 -07:00
Andrew Wang 966b1b5b44 HDFS-11565. Use compact identifiers for built-in ECPolicies in HdfsFileStatus. 2017-04-12 12:24:32 -07:00
Chris Nauroth 23b1a7bdf1 HDFS-11163. Mover should move the file blocks to default storage once policy is unset. Contributed by Surendra Singh Lilhore. 2017-04-11 22:03:09 -07:00
Andrew Wang e8bdad7385 HDFS-11623. Move system erasure coding policies into hadoop-hdfs-client. 2017-04-07 16:46:28 -07:00
Xiaoyu Yao 0eacd4c13b HDFS-11608. HDFS write crashed with block size greater than 2 GB. Contributed by Xiaobing Zhou. 2017-04-06 16:11:55 -07:00
Anu Engineer 7ce1090558 HDFS-11006. Ozone: support setting chunk size in streaming API. Contributed by Yiqun Lin. 2017-04-05 11:07:28 -07:00
Andrew Wang 9e0e430f18 HDFS-11538. Move ClientProtocol HA proxies into hadoop-hdfs-client. Contributed by Huafeng Wang. 2017-04-04 23:05:24 -07:00
Andrew Wang 18432130a7 HADOOP-14104. Client should always ask namenode for kms provider path. Contributed by Rushabh S Shah. 2017-04-04 13:38:25 -07:00
Anu Engineer adc651044c Merge branch 'trunk' into HDFS-7240 2017-04-04 12:50:22 -07:00
Chris Douglas 6eba79232f HADOOP-14271. Correct spelling of 'occurred' and variants. Contributed by Yeliang Cang 2017-04-03 20:13:14 -07:00
Anu Engineer 558b478ff2 HDFS-11519. Ozone: Implement XceiverServerSpi and XceiverClientSpi using Ratis. Contributed by Tsz Wo Nicholas Sze. 2017-04-03 12:40:06 -07:00
Arpit Agarwal 5485d93bda HDFS-11603. Improve slow mirror/disk warnings in BlockReceiver. 2017-03-31 12:10:27 -07:00
Hanisha Koneru 28cdc5a8dc HDFS-11551. Handle SlowDiskReport from DataNode at the NameNode. Contributed by Hanisha Koneru. 2017-03-30 22:41:26 -07:00
Anu Engineer fbfdf69904 HDFS-11594. Ozone: close container should call compactDB. Contributed by Anu Engineer. 2017-03-30 16:53:28 -07:00
Rakesh Radhakrishnan 84d787b9d5 HDFS-11541. Call RawErasureEncoder and RawErasureDecoder release() methods. Contributed by SammiChen. 2017-03-29 11:41:48 +05:30
Anu Engineer ed14373a9f HDFS-11550. Ozone: Add a check to prevent removing a container that has keys in it. Contributed by Weiwei Yang. 2017-03-27 08:38:57 -07:00
Tsuyoshi Ozawa 84ddedc0b2 HADOOP-10101. Update guava dependency to the latest version. (ozawa) 2017-03-25 10:06:52 +09:00
Andrew Wang 332a997e10 HDFS-11170. Add builder-based create API to FileSystem. Contributed by SammiChen and Wei Zhou. 2017-03-24 12:56:46 -07:00
Andrew Wang 52b00600df HADOOP-13715. Add isErasureCoded() API to FileStatus class. Contributed by Manoj Govindassamy. 2017-03-24 11:44:46 -07:00
Anu Engineer e867baa220 HDFS-11361. Block Storage: add cache interface. Contributed by Chen Liang. 2017-03-23 14:33:23 -07:00
Zhe Zhang 59d69257a8 HADOOP-9631. ViewFs should use underlying FileSystem's server side defaults. Contributed by Lohit Vijayarenu and Erik Krogen. 2017-03-22 22:22:22 -07:00
Arpit Agarwal e7c8da614c HDFS-11545. Propagate DataNode's slow disks info to the NameNode via Heartbeats. Contributed by Hanisha Koneru. 2017-03-20 21:54:58 -07:00
Chris Douglas b104f3a282 HDFS-6648. Order of namenodes in ConfiguredFailoverProxyProvider is undefined. Contributed by Inigo Goiri 2017-03-20 17:15:13 -07:00
Anu Engineer 603f2c18ec HDFS-11444. Ozone: Fix datanode ID handling in MiniOzoneCluster. Contributed by Weiwei Yang. 2017-03-20 13:18:26 -07:00
Xiaobing Zhou 7536815039 HDFS-10394. move declaration of okhttp version from hdfs-client to hadoop-project POM. Contributed by Xiaobing Zhou. 2017-03-16 18:13:43 -07:00
Xiaoyu Yao 65487b579e HDFS-11491. Ozone: SCM: Add close container RPC. Contributed by Anu Engineer. 2017-03-14 21:28:44 -07:00
Xiaoyu Yao 72f4e3f347 HDFS-11487. Ozone: Exclude container protobuf files from findbugs check(amends previous fix). Contributed by Yuanbo Liu. 2017-03-14 21:18:44 -07:00
Andrew Wang cc1292e73a HDFS-9705. Refine the behaviour of getFileChecksum when length = 0. Contributed by Kai Zheng and SammiChen. 2017-03-14 16:41:10 -07:00
Anu Engineer 39058dd601 HDFS-11469. Ozone: SCM: Container allocation based on node report. Contributed by Xiaoyu Yao. 2017-03-14 11:54:26 -07:00
Xiaoyu Yao 8eca9824cf HDFS-11071. Ozone: SCM: Move SCM config keys to ScmConfig. Contributed by Weiwei Yang. 2017-03-10 16:24:24 -08:00
Tsz-Wo Nicholas Sze fbc8099b63 HDFS-11513. Ozone: Separate XceiverServer and XceiverClient into interfaces and implementations. 2017-03-09 11:03:20 -08:00
Andrew Wang 6b6c61ee74 HDFS-11152. Start erasure coding policy ID number from 1 instead of 0 to void potential unexpected errors. Contributed by SammiChen. 2017-03-08 15:34:04 -08:00
Arpit Agarwal 79b8d7ed38 HDFS-10838. Last full block report received time for each DN should be easily discoverable. Contributed by Surendra Singh Lilhore. 2017-03-08 15:33:59 -08:00
Yiqun Lin b13878cf50 HDFS-8741. Proper error msg to be printed when invalid operation type is given to WebHDFS operations. Contributed by Surendra Singh Lilhore. 2017-03-08 15:33:58 -08:00
Anu Engineer 4074123636 HDFS-11196. Ozone: Improve logging and error handling in the container layer. Contributed by Anu Engineer. 2017-03-08 09:36:20 -08:00
Andrew Wang 5addacb1e3 HDFS-11152. Start erasure coding policy ID number from 1 instead of 0 to void potential unexpected errors. Contributed by SammiChen. 2017-03-08 08:47:38 -08:00
Anu Engineer f0f4c3e7e3 HDFS-11424. Block Storage: add container representation to meta data. Contributed Chen Liang. 2017-03-07 13:26:22 -08:00
Arpit Agarwal b5adc5c301 HDFS-10838. Last full block report received time for each DN should be easily discoverable. Contributed by Surendra Singh Lilhore. 2017-03-06 16:39:53 -08:00
Anu Engineer 72f0bed3dd HDFS-11487. Ozone: Exclude container protobuf files from findbugs check. Contributed by Yuanbo Liu. 2017-03-06 14:17:41 -08:00
Yiqun Lin 3536ce031c HDFS-8741. Proper error msg to be printed when invalid operation type is given to WebHDFS operations. Contributed by Surendra Singh Lilhore. 2017-03-06 19:04:03 +08:00
Anu Engineer 0951726233 Merge branch 'trunk' into HDFS-7240 2017-03-03 14:03:35 -08:00
Anu Engineer 09ad229db9 HDFS-11425. Ozone: add client-facing container APIs and container references. Contributed by Chen Liang. 2017-03-02 11:00:25 -08:00
Rakesh Radhakrishnan 82ef9accaf HDFS-11428. Change setErasureCodingPolicy to take a required string EC policy name. Contributed by Andrew Wang. 2017-03-01 16:06:02 +05:30
Anu Engineer 00684d62ca HDFS-11036. Ozone: reuse Xceiver connection. Contributed by Chen Liang. 2017-02-28 12:15:26 -08:00
Arpit Agarwal ad16978e65 HDFS-11414. Ozone : move StorageContainerLocation protocol to hdfs-client. Contributed by Chen Liang. 2017-02-28 10:28:05 -08:00
Andrew Wang 55c07bbed2 HDFS-11382. Persist Erasure Coding Policy ID in a new optional field in INodeFile in FSImage. Contributed by Manoj Govindassamy. 2017-02-27 17:07:45 -08:00