6508 Commits

Author SHA1 Message Date
Xiaoyu Yao
72f4e3f347 HDFS-11487. Ozone: Exclude container protobuf files from findbugs check(amends previous fix). Contributed by Yuanbo Liu. 2017-03-14 21:18:44 -07:00
Andrew Wang
cc1292e73a HDFS-9705. Refine the behaviour of getFileChecksum when length = 0. Contributed by Kai Zheng and SammiChen. 2017-03-14 16:41:10 -07:00
Anu Engineer
39058dd601 HDFS-11469. Ozone: SCM: Container allocation based on node report. Contributed by Xiaoyu Yao. 2017-03-14 11:54:26 -07:00
Andrew Wang
7515e75103 HDFS-11505. Do not enable any erasure coding policies by default. Contributed by Manoj Govindassamy. 2017-03-14 11:47:25 -07:00
Yiqun Lin
023b941e3b HDFS-11526. Fix confusing block recovery message. Contributed by Yiqun Lin. 2017-03-14 17:49:48 +08:00
Chen Liang
9832ae0ed8 HDFS-11482. Add storage type demand to into DFSNetworkTopology#chooseRandom. Contributed by Chen Liang. 2017-03-13 17:30:10 -07:00
Jing Zhao
55796a0946 HDFS-11395. RequestHedgingProxyProvider#RequestHedgingInvocationHandler hides the Exception thrown from NameNode. Contributed by Nandakumar. 2017-03-13 14:24:51 -07:00
Yiqun Lin
79924266f8 HDFS-11512. Increase timeout on TestShortCircuitLocalRead#testSkipWithVerifyChecksum. Contributed by Eric Badger. 2017-03-13 18:22:30 +08:00
Xiaoyu Yao
8eca9824cf HDFS-11071. Ozone: SCM: Move SCM config keys to ScmConfig. Contributed by Weiwei Yang. 2017-03-10 16:24:24 -08:00
Lei Xu
6d356b6b4d HDFS-11340. DataNode reconfigure for disks doesn't remove the failed volumes. (Manoj Govindassamy via lei) 2017-03-10 14:37:13 -08:00
Andrew Wang
819808a016 HDFS-11506. Move ErasureCodingPolicyManager#getSystemDefaultPolicy to test code. Contributed by Manoj Govindassamy. 2017-03-09 17:29:11 -08:00
Tsz-Wo Nicholas Sze
fbc8099b63 HDFS-11513. Ozone: Separate XceiverServer and XceiverClient into interfaces and implementations. 2017-03-09 11:03:20 -08:00
Masatake Iwasaki
385d2cb777 HDFS-11499. Decommissioning stuck because of failing recovery. Contributed by Lukas Majercak and Manoj Govindassamy. 2017-03-09 21:13:50 +09:00
Anu Engineer
5e95bdeef2 HDFS-10928. Ozone:SCM: Support MXBean for SCM and NodeManager. Contributed by Weiwei Yang. 2017-03-08 18:52:57 -08:00
Andrew Wang
33a38a5341 HDFS-11314. Enforce set of enabled EC policies on the NameNode. 2017-03-08 16:41:44 -08:00
Andrew Wang
5ca6ef0c26 HDFS-10983. OIV tool should make an EC file explicit. Contributed by Manoj Govindassamy. 2017-03-08 15:36:19 -08:00
Anu Engineer
cc63937e31 merge trunk to HDFS-7240 2017-03-08 15:34:04 -08:00
Andrew Wang
6b6c61ee74 HDFS-11152. Start erasure coding policy ID number from 1 instead of 0 to void potential unexpected errors. Contributed by SammiChen. 2017-03-08 15:34:04 -08:00
Arpit Agarwal
647de3c41e HDFS-11477. Simplify file IO profiling configuration. Contributed by Hanisha Koneru. 2017-03-08 15:34:01 -08:00
Arpit Agarwal
79b8d7ed38 HDFS-10838. Last full block report received time for each DN should be easily discoverable. Contributed by Surendra Singh Lilhore. 2017-03-08 15:33:59 -08:00
Andrew Wang
52a53fe71f HDFS-11498. Make RestCsrfPreventionHandler and WebHdfsHandler compatible with Netty 4.0. 2017-03-08 15:33:59 -08:00
Yiqun Lin
b13878cf50 HDFS-8741. Proper error msg to be printed when invalid operation type is given to WebHDFS operations. Contributed by Surendra Singh Lilhore. 2017-03-08 15:33:58 -08:00
Mingliang Liu
370f4da168 HDFS-11494. Log message when DN is not selected for block replication. Contributed by Yiqun Lin 2017-03-08 15:33:56 -08:00
Jing Zhao
09cfa79dbd HDFS-11476. Fix NPE in FsDatasetImpl#checkAndUpdate. Contributed by Xiaobing Zhou. 2017-03-08 15:33:55 -08:00
Andrew Wang
4a09ed01a8 HDFS-8112. Relax permission checking for EC related operations. 2017-03-08 15:33:55 -08:00
Anu Engineer
4074123636 HDFS-11196. Ozone: Improve logging and error handling in the container layer. Contributed by Anu Engineer. 2017-03-08 09:36:20 -08:00
Andrew Wang
5addacb1e3 HDFS-11152. Start erasure coding policy ID number from 1 instead of 0 to void potential unexpected errors. Contributed by SammiChen. 2017-03-08 08:47:38 -08:00
Anu Engineer
dac2b9e7d9 HDFS-11509. Ozone: Fix TestEndpoint test regression. Contributed by Anu Engineer. 2017-03-07 22:38:11 -08:00
Anu Engineer
f0f4c3e7e3 HDFS-11424. Block Storage: add container representation to meta data. Contributed Chen Liang. 2017-03-07 13:26:22 -08:00
Anu Engineer
e37c5ed47d HDFS-11451. Ozone: Add protobuf definitions for container reports. Contributed by Anu Engineer. 2017-03-07 10:28:21 -08:00
Arpit Agarwal
959940b0ab HDFS-11477. Simplify file IO profiling configuration. Contributed by Hanisha Koneru. 2017-03-07 10:12:35 -08:00
Anu Engineer
a13c9782a3 HDFS-11158. Ozone: TestDatanodeStateMachine is failing intermittently. Contributed by Weiwei Yang. 2017-03-07 10:02:16 -08:00
Anu Engineer
5d0a206a63 HDFS-11497. Ozone: Fix Container test regression. Contributed by Anu Engineer. 2017-03-06 21:20:30 -08:00
Arpit Agarwal
b5adc5c301 HDFS-10838. Last full block report received time for each DN should be easily discoverable. Contributed by Surendra Singh Lilhore. 2017-03-06 16:39:53 -08:00
Andrew Wang
5e74196ede HDFS-11498. Make RestCsrfPreventionHandler and WebHdfsHandler compatible with Netty 4.0. 2017-03-06 15:04:13 -08:00
Anu Engineer
72f0bed3dd HDFS-11487. Ozone: Exclude container protobuf files from findbugs check. Contributed by Yuanbo Liu. 2017-03-06 14:17:41 -08:00
Yiqun Lin
3536ce031c HDFS-8741. Proper error msg to be printed when invalid operation type is given to WebHDFS operations. Contributed by Surendra Singh Lilhore. 2017-03-06 19:04:03 +08:00
Mingliang Liu
0f336bab9c HDFS-11494. Log message when DN is not selected for block replication. Contributed by Yiqun Lin 2017-03-03 18:47:13 -08:00
Anu Engineer
0951726233 Merge branch 'trunk' into HDFS-7240 2017-03-03 14:03:35 -08:00
Jing Zhao
ac5ae0065a HDFS-11476. Fix NPE in FsDatasetImpl#checkAndUpdate. Contributed by Xiaobing Zhou. 2017-03-03 13:31:20 -08:00
Andrew Wang
3085a60430 HDFS-8112. Relax permission checking for EC related operations. 2017-03-03 13:00:22 -08:00
Anu Engineer
3ab6bc5329 HDFS-11137. Ozone: SCM: Add negative tests cases for datanodeStatemachine. Contributed by Weiwei Yang. 2017-03-03 10:29:05 -08:00
Rakesh Radhakrishnan
3749152b66 HDFS-11416. Refactor out system default erasure coding policy. Contributed by Andrew Wang. 2017-03-03 09:28:03 +05:30
Andrew Wang
8f4817f2c5 Revert "HDFS-11477. Simplify file IO profiling configuration. Contributed by Hanisha Koneru."
This reverts commit e61491d4769536ce8b77b416005ce531278ce729.
2017-03-02 16:20:48 -08:00
Arpit Agarwal
e61491d476 HDFS-11477. Simplify file IO profiling configuration. Contributed by Hanisha Koneru. 2017-03-02 15:38:25 -08:00
Anu Engineer
e79f9da8de HDFS-11484. Ozone: Fix flaky TestNodeManager#testScmNodeReportUpdate. Contributed by Xiaoyu Yao. 2017-03-02 15:10:47 -08:00
Arpit Agarwal
b3ec531f40 HDFS-11461. DataNode Disk Outlier Detection. Contributed by Hanisha Koneru. 2017-03-02 12:45:48 -08:00
Anu Engineer
02c35065f7 HDFS-11480. Ozone: TestEndpoint task failure. Contributed by Xiaoyu Yao. 2017-03-02 11:18:41 -08:00
Anu Engineer
09ad229db9 HDFS-11425. Ozone: add client-facing container APIs and container references. Contributed by Chen Liang. 2017-03-02 11:00:25 -08:00
Arpit Agarwal
eeca8b0c4e HDFS-11419. HDFS specific network topology classes with storage type info included. Contributed by Chen Liang. 2017-03-02 09:21:27 -08:00