Commit Graph

6191 Commits

Author SHA1 Message Date
Xiaoyu Yao 65487b579e HDFS-11491. Ozone: SCM: Add close container RPC. Contributed by Anu Engineer. 2017-03-14 21:28:44 -07:00
Anu Engineer 39058dd601 HDFS-11469. Ozone: SCM: Container allocation based on node report. Contributed by Xiaoyu Yao. 2017-03-14 11:54:26 -07:00
Xiaoyu Yao 8eca9824cf HDFS-11071. Ozone: SCM: Move SCM config keys to ScmConfig. Contributed by Weiwei Yang. 2017-03-10 16:24:24 -08:00
Tsz-Wo Nicholas Sze fbc8099b63 HDFS-11513. Ozone: Separate XceiverServer and XceiverClient into interfaces and implementations. 2017-03-09 11:03:20 -08:00
Anu Engineer 5e95bdeef2 HDFS-10928. Ozone:SCM: Support MXBean for SCM and NodeManager. Contributed by Weiwei Yang. 2017-03-08 18:52:57 -08:00
Anu Engineer cc63937e31 merge trunk to HDFS-7240 2017-03-08 15:34:04 -08:00
Andrew Wang 6b6c61ee74 HDFS-11152. Start erasure coding policy ID number from 1 instead of 0 to void potential unexpected errors. Contributed by SammiChen. 2017-03-08 15:34:04 -08:00
Arpit Agarwal 647de3c41e HDFS-11477. Simplify file IO profiling configuration. Contributed by Hanisha Koneru. 2017-03-08 15:34:01 -08:00
Arpit Agarwal 79b8d7ed38 HDFS-10838. Last full block report received time for each DN should be easily discoverable. Contributed by Surendra Singh Lilhore. 2017-03-08 15:33:59 -08:00
Andrew Wang 52a53fe71f HDFS-11498. Make RestCsrfPreventionHandler and WebHdfsHandler compatible with Netty 4.0. 2017-03-08 15:33:59 -08:00
Yiqun Lin b13878cf50 HDFS-8741. Proper error msg to be printed when invalid operation type is given to WebHDFS operations. Contributed by Surendra Singh Lilhore. 2017-03-08 15:33:58 -08:00
Mingliang Liu 370f4da168 HDFS-11494. Log message when DN is not selected for block replication. Contributed by Yiqun Lin 2017-03-08 15:33:56 -08:00
Jing Zhao 09cfa79dbd HDFS-11476. Fix NPE in FsDatasetImpl#checkAndUpdate. Contributed by Xiaobing Zhou. 2017-03-08 15:33:55 -08:00
Andrew Wang 4a09ed01a8 HDFS-8112. Relax permission checking for EC related operations. 2017-03-08 15:33:55 -08:00
Anu Engineer 4074123636 HDFS-11196. Ozone: Improve logging and error handling in the container layer. Contributed by Anu Engineer. 2017-03-08 09:36:20 -08:00
Anu Engineer dac2b9e7d9 HDFS-11509. Ozone: Fix TestEndpoint test regression. Contributed by Anu Engineer. 2017-03-07 22:38:11 -08:00
Anu Engineer f0f4c3e7e3 HDFS-11424. Block Storage: add container representation to meta data. Contributed Chen Liang. 2017-03-07 13:26:22 -08:00
Anu Engineer e37c5ed47d HDFS-11451. Ozone: Add protobuf definitions for container reports. Contributed by Anu Engineer. 2017-03-07 10:28:21 -08:00
Anu Engineer a13c9782a3 HDFS-11158. Ozone: TestDatanodeStateMachine is failing intermittently. Contributed by Weiwei Yang. 2017-03-07 10:02:16 -08:00
Anu Engineer 5d0a206a63 HDFS-11497. Ozone: Fix Container test regression. Contributed by Anu Engineer. 2017-03-06 21:20:30 -08:00
Anu Engineer 0951726233 Merge branch 'trunk' into HDFS-7240 2017-03-03 14:03:35 -08:00
Anu Engineer 3ab6bc5329 HDFS-11137. Ozone: SCM: Add negative tests cases for datanodeStatemachine. Contributed by Weiwei Yang. 2017-03-03 10:29:05 -08:00
Rakesh Radhakrishnan 3749152b66 HDFS-11416. Refactor out system default erasure coding policy. Contributed by Andrew Wang. 2017-03-03 09:28:03 +05:30
Andrew Wang 8f4817f2c5 Revert "HDFS-11477. Simplify file IO profiling configuration. Contributed by Hanisha Koneru."
This reverts commit e61491d476.
2017-03-02 16:20:48 -08:00
Arpit Agarwal e61491d476 HDFS-11477. Simplify file IO profiling configuration. Contributed by Hanisha Koneru. 2017-03-02 15:38:25 -08:00
Anu Engineer e79f9da8de HDFS-11484. Ozone: Fix flaky TestNodeManager#testScmNodeReportUpdate. Contributed by Xiaoyu Yao. 2017-03-02 15:10:47 -08:00
Arpit Agarwal b3ec531f40 HDFS-11461. DataNode Disk Outlier Detection. Contributed by Hanisha Koneru. 2017-03-02 12:45:48 -08:00
Anu Engineer 02c35065f7 HDFS-11480. Ozone: TestEndpoint task failure. Contributed by Xiaoyu Yao. 2017-03-02 11:18:41 -08:00
Anu Engineer 09ad229db9 HDFS-11425. Ozone: add client-facing container APIs and container references. Contributed by Chen Liang. 2017-03-02 11:00:25 -08:00
Arpit Agarwal eeca8b0c4e HDFS-11419. HDFS specific network topology classes with storage type info included. Contributed by Chen Liang. 2017-03-02 09:21:27 -08:00
Ming Ma 4e14eaded2 Merge branch 'trunk' of https://git-wip-us.apache.org/repos/asf/hadoop into trunk 2017-03-01 20:24:49 -08:00
Ming Ma 25c84d279b HDFS-11412. Maintenance minimum replication config value allowable range should be [0, DefaultReplication]. (Manoj Govindassamy via mingma) 2017-03-01 20:23:52 -08:00
Yiqun Lin 555d0c3995 HDFS-11478. Update EC commands in HDFSCommands.md. Contributed by Yiqun Lin. 2017-03-02 12:10:24 +08:00
Anu Engineer 7aa0a44cf1 HDFS-11447. Ozone: SCM: Send node report to SCM with heartbeat.Contributed by Xiaoyu Yao. 2017-03-01 11:47:22 -08:00
Anu Engineer 3eae84c1be HDFS-11474. Ozone: TestContainerMapping needs to cleanup levelDB files.Contributed by Xiaoyu Yao. 2017-03-01 11:30:32 -08:00
Anu Engineer 4cd34e2a18 HDFS-11473. Ozone : exclude cblock protobuf files from findbugs check. Contributed by Xiaoyu Yao. 2017-03-01 09:40:18 -08:00
Rakesh Radhakrishnan 82ef9accaf HDFS-11428. Change setErasureCodingPolicy to take a required string EC policy name. Contributed by Andrew Wang. 2017-03-01 16:06:02 +05:30
Brahma Reddy Battula dcd03df9f9 HDFS-11432. Federation : Support fully qualified path for Quota/Snapshot/cacheadmin/cryptoadmin commands. Contributed by Brahma Reddy Battula. 2017-03-01 10:45:56 +05:30
Arpit Agarwal ad16978e65 HDFS-11414. Ozone : move StorageContainerLocation protocol to hdfs-client. Contributed by Chen Liang. 2017-02-28 10:28:05 -08:00
Zhe Zhang d269b488a7 HDFS-11466. Change dfs.namenode.write-lock-reporting-threshold-ms default from 1000ms to 5000ms. Contributed by Andrew Wang. 2017-02-28 09:00:49 -08:00
Andrew Wang 55c07bbed2 HDFS-11382. Persist Erasure Coding Policy ID in a new optional field in INodeFile in FSImage. Contributed by Manoj Govindassamy. 2017-02-27 17:07:45 -08:00
Anu Engineer d63ec0ca81 HDFS-11184. Ozone: SCM: Make SCM use container protocol. Contributed by Anu Engineer. 2017-02-27 12:25:03 -08:00
Anu Engineer ae783b1991 HDFS-11463. Ozone: Add metrics for container operations and export over JMX. Contributed by Mukul Kumar Singh. 2017-02-27 09:44:48 -08:00
Wei-Chiu Chuang 05391c1845 HDFS-10506. OIV's ReverseXML processor cannot reconstruct some snapshot details. Contributed by Akira Ajisaka. 2017-02-25 14:38:50 -08:00
Arpit Agarwal 120bef7de8 HDFS-11462. Fix occasional BindException in TestNameNodeMetricsLogger. 2017-02-24 19:53:39 -08:00
Yiqun Lin 4a58870a04 HDFS-11433. Document missing usages of OfflineEditsViewer processors. Contributed by Yiqun Lin. 2017-02-25 10:00:05 +08:00
Xiao Chen e24ed47d9a HDFS-11421. Make WebHDFS' ACLs RegEx configurable. Contributed by Harsh J. 2017-02-24 16:49:46 -08:00
Arpit Agarwal d2b3ba9b8f HDFS-11295. Check storage remaining instead of node remaining in BlockPlacementPolicyDefault.chooseReplicaToDelete(). Contributed by Marton Elek. 2017-02-24 15:44:11 -08:00
Andrew Wang c1a52b04d0 HDFS-11427. Rename rs-default to rs. 2017-02-24 10:58:45 -08:00
Andrew Wang 132f758e3d HDFS-11426. Refactor EC CLI to be similar to storage policies CLI. 2017-02-23 16:00:11 -08:00