Chen Liang
|
d00c07c675
|
HDFS-11591. Block Storage: fix TestCBlockServer test cleanup. Contributed by Xiaoyu Yao
|
2017-03-31 14:41:05 -07:00 |
Hanisha Koneru
|
73835c73e2
|
HDFS-11560. Expose slow disks via NameNode JMX. Contributed by Hanisha Koneru.
|
2017-03-31 13:50:29 -07:00 |
Arpit Agarwal
|
5485d93bda
|
HDFS-11603. Improve slow mirror/disk warnings in BlockReceiver.
|
2017-03-31 12:10:27 -07:00 |
|
Hanisha Koneru
|
28cdc5a8dc
|
HDFS-11551. Handle SlowDiskReport from DataNode at the NameNode. Contributed by Hanisha Koneru.
|
2017-03-30 22:41:26 -07:00 |
Yongjun Zhang
|
bf3fb585aa
|
HADOOP-11794. Enable distcp to copy blocks in parallel. Contributed by Yongjun Zhang, Wei-Chiu Chuang, Xiao Chen, Rosie Li.
|
2017-03-30 17:38:56 -07:00 |
|
Yongjun Zhang
|
144f1cf765
|
Revert "HADOOP-11794. Enable distcp to copy blocks in parallel. Contributed by Yongjun Zhang, Wei-Chiu Chuang, Xiao Chen."
This reverts commit 064c8b25ec.
|
2017-03-30 17:38:18 -07:00 |
|
Yongjun Zhang
|
064c8b25ec
|
HADOOP-11794. Enable distcp to copy blocks in parallel. Contributed by Yongjun Zhang, Wei-Chiu Chuang, Xiao Chen.
|
2017-03-30 17:01:15 -07:00 |
Anu Engineer
|
fbfdf69904
|
HDFS-11594. Ozone: close container should call compactDB. Contributed by Anu Engineer.
|
2017-03-30 16:53:28 -07:00 |
Mingliang Liu
|
e5f0622a6f
|
HDFS-11592. Closing a file has a wasteful preconditions in NameNode. Contributed by Eric Badger
|
2017-03-30 15:44:21 -07:00 |
Wei-Chiu Chuang
|
8c591b8d19
|
HDFS-10974. Document replication factor for EC files. Contributed by Yiqun Lin.
|
2017-03-30 11:16:05 -07:00 |
Chris Douglas
|
7297e82cb4
|
HADOOP-14250. Correct spelling of 'separate' and variants. Contributed by Doris Gu
|
2017-03-30 10:17:11 -07:00 |
Andrew Wang
|
4966a6e26e
|
HADOOP-14223. Extend FileStatus#toString() to include details like Erasure Coding and Encryption. Contributed by Manoj Govindassamy.
|
2017-03-29 14:37:21 -07:00 |
Xiaoyu Yao
|
1590b9f7ea
|
HDFS-11567. Ozone: SCM: Support update container. Contributed by Weiwei Yang.
|
2017-03-29 12:19:31 -07:00 |
Daniel Templeton
|
15e3873dc3
|
HDFS-11571. Typo in DataStorage exception message (Contributed by Anna Budai via Daniel Templeton)
|
2017-03-29 10:56:36 -07:00 |
Rakesh Radhakrishnan
|
84d787b9d5
|
HDFS-11541. Call RawErasureEncoder and RawErasureDecoder release() methods. Contributed by SammiChen.
|
2017-03-29 11:41:48 +05:30 |
|
Xiaoyu Yao
|
8617fda2c6
|
HDFS-11537. Block Storage : add cache layer. Contributed by Chen Liang.
|
2017-03-28 19:21:37 -07:00 |
Yiqun Lin
|
6b09336438
|
HDFS-11577. Combine the old and the new chooseRandom for better performance. Contributed by Chen Liang.
|
2017-03-28 23:02:07 +08:00 |
|
Anu Engineer
|
8f4d8c43f8
|
HDFS-11548. Ozone: SCM: Add node pool management API. Contributed by Xiaoyu Yao
|
2017-03-27 17:59:49 -07:00 |
Masatake Iwasaki
|
64ea62c1cc
|
HDFS-11486. Client close() should not fail fast if the last block is being decommissioned. Contributed by Wei-Chiu Chuang and Yiqun Lin.
|
2017-03-28 09:13:44 +09:00 |
|
Anu Engineer
|
33dfb72fa3
|
HDFS-11355. Block Storage : Merge configuration into ozone configuration classes. Contributed by Chen Liang.
|
2017-03-27 15:26:13 -07:00 |
|
Anu Engineer
|
ed14373a9f
|
HDFS-11550. Ozone: Add a check to prevent removing a container that has keys in it. Contributed by Weiwei Yang.
|
2017-03-27 08:38:57 -07:00 |
|
Wei-Chiu Chuang
|
46d37a65cf
|
HDFS-10506. Addendum patch to include missing changes. Contributed by Akira Ajisaka.
|
2017-03-27 05:23:45 -07:00 |
|
Yiqun Lin
|
96e2ab8144
|
HDFS-11555. Fix typos in class OfflineImageReconstructor. Contributed by Yiqun Lin.
|
2017-03-27 19:23:37 +08:00 |
Junping Du
|
d174c06b01
|
Add HDFS jdiff for 2.8.0 release.
|
2017-03-25 14:05:20 -07:00 |
Tsuyoshi Ozawa
|
84ddedc0b2
|
HADOOP-10101. Update guava dependency to the latest version. (ozawa)
|
2017-03-25 10:06:52 +09:00 |
|
Hanisha Koneru
|
1f66524432
|
HDFS-11570. Unit test for NameNodeStatusMXBean. Contributed by Hanisha Koneru.
|
2017-03-24 14:44:25 -07:00 |
Xiaobing Zhou
|
1168ece596
|
HDFS-11534. Add counters for number of blocks in pending IBR. Contributed by Xiaobing Zhou.
|
2017-03-24 14:33:44 -07:00 |
|
Andrew Wang
|
332a997e10
|
HDFS-11170. Add builder-based create API to FileSystem. Contributed by SammiChen and Wei Zhou.
|
2017-03-24 12:56:46 -07:00 |
|
Andrew Wang
|
52b00600df
|
HADOOP-13715. Add isErasureCoded() API to FileStatus class. Contributed by Manoj Govindassamy.
|
2017-03-24 11:44:46 -07:00 |
Ravi Prakash
|
d4f73e7e27
|
HDFS-11574. Spelling mistakes in the Java source. Contributed by Hu Xiaodong.
|
2017-03-24 09:38:17 -07:00 |
|
Anu Engineer
|
e867baa220
|
HDFS-11361. Block Storage: add cache interface. Contributed by Chen Liang.
|
2017-03-23 14:33:23 -07:00 |
Zhe Zhang
|
59d69257a8
|
HADOOP-9631. ViewFs should use underlying FileSystem's server side defaults. Contributed by Lohit Vijayarenu and Erik Krogen.
|
2017-03-22 22:22:22 -07:00 |
John Zhuge
|
ed2d03f2a5
|
HDFS-11561. HttpFS doc errors. Contributed by Yuanbo Liu.
|
2017-03-22 22:15:24 -07:00 |
|
Anu Engineer
|
302948531f
|
HDFS-11559. Ozone: MiniOzoneCluster prints too many log messages by default. Contributed by Tsz Wo Nicholas Sze.
|
2017-03-21 22:08:02 -07:00 |
|
Anu Engineer
|
36b20e9fbf
|
HDFS-11496. Ozone: Merge with trunk needed a ignore duplicate entry in pom file due to shading. Contributed by Tsz Wo Nicholas Sze.
|
2017-03-21 15:23:56 -07:00 |
|
Anu Engineer
|
a9f92c4666
|
HDFS-11162. Block Storage: add command line tool. Contributed by Chen Liang.
|
2017-03-21 15:06:18 -07:00 |
|
Anu Engineer
|
6b5dee9c38
|
HDFS-11492. Ozone: Add the ability to handle sendContainerReport Command. Contributed by Anu Engineer.
|
2017-03-21 10:43:27 -07:00 |
|
Yiqun Lin
|
3b908f71c5
|
HDFS-11358. DiskBalancer: Report command supports reading nodes from host file. Contributed by Yiqun Lin.
|
2017-03-21 17:44:17 +08:00 |
|
Arpit Agarwal
|
e7c8da614c
|
HDFS-11545. Propagate DataNode's slow disks info to the NameNode via Heartbeats. Contributed by Hanisha Koneru.
|
2017-03-20 21:54:58 -07:00 |
|
Chris Douglas
|
b104f3a282
|
HDFS-6648. Order of namenodes in ConfiguredFailoverProxyProvider is undefined. Contributed by Inigo Goiri
|
2017-03-20 17:15:13 -07:00 |
|
Anu Engineer
|
603f2c18ec
|
HDFS-11444. Ozone: Fix datanode ID handling in MiniOzoneCluster. Contributed by Weiwei Yang.
|
2017-03-20 13:18:26 -07:00 |
|
Arpit Agarwal
|
ffa160ddb8
|
HDFS-11547. Add logs for slow BlockReceiver while writing data to disk. Contributed by Xiaobing Zhou.
|
2017-03-17 19:02:24 -07:00 |
|
Hanisha Koneru
|
7f8e928400
|
HDFS-11517. Expose slow disks via DataNode JMX. Contributed by Hanisha Koneru
|
2017-03-17 15:42:25 -07:00 |
|
Andrew Wang
|
92ea6d74ec
|
HDFS-11516. Admin command line should print message to stderr in failure case. Contributed by Kai Sasaki.
|
2017-03-17 11:26:02 -07:00 |
|
Xiaobing Zhou
|
7536815039
|
HDFS-10394. move declaration of okhttp version from hdfs-client to hadoop-project POM. Contributed by Xiaobing Zhou.
|
2017-03-16 18:13:43 -07:00 |
|
Andrew Wang
|
4812518b23
|
HDFS-10530. BlockManager reconstruction work scheduling should correctly adhere to EC block placement policy. Contributed by Manoj Govindassamy and Rui Gao.
|
2017-03-16 15:07:38 -07:00 |
Kihwal Lee
|
ba62b50eba
|
HDFS-10601. Improve log message to include hostname when the NameNode is in safemode. Contributed by Kuhu Shukla.
|
2017-03-16 10:54:59 -05:00 |
|
Hanisha Koneru
|
d69a82c89c
|
HDFS-11511. Support Timeout when checking single disk. Contributed by Hanisha Koneru.
|
2017-03-15 18:01:45 -07:00 |
Chen Liang
|
615ac09499
|
HDFS-11419. DFSTopologyNodeImpl#chooseRandom optimizations. Contributed by Chen Liang.
|
2017-03-15 12:28:22 -07:00 |
|
Yiqun Lin
|
4416a07c9c
|
HDFS-11420. Edit file should not be processed by the same type processor in OfflineEditsViewer. Contributed by Yiqun Lin.
|
2017-03-15 18:05:03 +08:00 |
|
Xiaoyu Yao
|
65487b579e
|
HDFS-11491. Ozone: SCM: Add close container RPC. Contributed by Anu Engineer.
|
2017-03-14 21:28:44 -07:00 |
|
Xiaoyu Yao
|
72f4e3f347
|
HDFS-11487. Ozone: Exclude container protobuf files from findbugs check(amends previous fix). Contributed by Yuanbo Liu.
|
2017-03-14 21:18:44 -07:00 |
|
Andrew Wang
|
cc1292e73a
|
HDFS-9705. Refine the behaviour of getFileChecksum when length = 0. Contributed by Kai Zheng and SammiChen.
|
2017-03-14 16:41:10 -07:00 |
|
Anu Engineer
|
39058dd601
|
HDFS-11469. Ozone: SCM: Container allocation based on node report. Contributed by Xiaoyu Yao.
|
2017-03-14 11:54:26 -07:00 |
|
Andrew Wang
|
7515e75103
|
HDFS-11505. Do not enable any erasure coding policies by default. Contributed by Manoj Govindassamy.
|
2017-03-14 11:47:25 -07:00 |
|
Yiqun Lin
|
023b941e3b
|
HDFS-11526. Fix confusing block recovery message. Contributed by Yiqun Lin.
|
2017-03-14 17:49:48 +08:00 |
|
Chen Liang
|
9832ae0ed8
|
HDFS-11482. Add storage type demand to into DFSNetworkTopology#chooseRandom. Contributed by Chen Liang.
|
2017-03-13 17:30:10 -07:00 |
Jing Zhao
|
55796a0946
|
HDFS-11395. RequestHedgingProxyProvider#RequestHedgingInvocationHandler hides the Exception thrown from NameNode. Contributed by Nandakumar.
|
2017-03-13 14:24:51 -07:00 |
|
Yiqun Lin
|
79924266f8
|
HDFS-11512. Increase timeout on TestShortCircuitLocalRead#testSkipWithVerifyChecksum. Contributed by Eric Badger.
|
2017-03-13 18:22:30 +08:00 |
|
Xiaoyu Yao
|
8eca9824cf
|
HDFS-11071. Ozone: SCM: Move SCM config keys to ScmConfig. Contributed by Weiwei Yang.
|
2017-03-10 16:24:24 -08:00 |
Lei Xu
|
6d356b6b4d
|
HDFS-11340. DataNode reconfigure for disks doesn't remove the failed volumes. (Manoj Govindassamy via lei)
|
2017-03-10 14:37:13 -08:00 |
|
Andrew Wang
|
819808a016
|
HDFS-11506. Move ErasureCodingPolicyManager#getSystemDefaultPolicy to test code. Contributed by Manoj Govindassamy.
|
2017-03-09 17:29:11 -08:00 |
Tsz-Wo Nicholas Sze
|
fbc8099b63
|
HDFS-11513. Ozone: Separate XceiverServer and XceiverClient into interfaces and implementations.
|
2017-03-09 11:03:20 -08:00 |
|
Masatake Iwasaki
|
385d2cb777
|
HDFS-11499. Decommissioning stuck because of failing recovery. Contributed by Lukas Majercak and Manoj Govindassamy.
|
2017-03-09 21:13:50 +09:00 |
|
Anu Engineer
|
5e95bdeef2
|
HDFS-10928. Ozone:SCM: Support MXBean for SCM and NodeManager. Contributed by Weiwei Yang.
|
2017-03-08 18:52:57 -08:00 |
|
Andrew Wang
|
33a38a5341
|
HDFS-11314. Enforce set of enabled EC policies on the NameNode.
|
2017-03-08 16:41:44 -08:00 |
|
Andrew Wang
|
5ca6ef0c26
|
HDFS-10983. OIV tool should make an EC file explicit. Contributed by Manoj Govindassamy.
|
2017-03-08 15:36:19 -08:00 |
|
Anu Engineer
|
cc63937e31
|
merge trunk to HDFS-7240
|
2017-03-08 15:34:04 -08:00 |
|
Andrew Wang
|
6b6c61ee74
|
HDFS-11152. Start erasure coding policy ID number from 1 instead of 0 to void potential unexpected errors. Contributed by SammiChen.
|
2017-03-08 15:34:04 -08:00 |
|
Arpit Agarwal
|
647de3c41e
|
HDFS-11477. Simplify file IO profiling configuration. Contributed by Hanisha Koneru.
|
2017-03-08 15:34:01 -08:00 |
|
Arpit Agarwal
|
79b8d7ed38
|
HDFS-10838. Last full block report received time for each DN should be easily discoverable. Contributed by Surendra Singh Lilhore.
|
2017-03-08 15:33:59 -08:00 |
|
Andrew Wang
|
52a53fe71f
|
HDFS-11498. Make RestCsrfPreventionHandler and WebHdfsHandler compatible with Netty 4.0.
|
2017-03-08 15:33:59 -08:00 |
|
Yiqun Lin
|
b13878cf50
|
HDFS-8741. Proper error msg to be printed when invalid operation type is given to WebHDFS operations. Contributed by Surendra Singh Lilhore.
|
2017-03-08 15:33:58 -08:00 |
|
Mingliang Liu
|
370f4da168
|
HDFS-11494. Log message when DN is not selected for block replication. Contributed by Yiqun Lin
|
2017-03-08 15:33:56 -08:00 |
|
Jing Zhao
|
09cfa79dbd
|
HDFS-11476. Fix NPE in FsDatasetImpl#checkAndUpdate. Contributed by Xiaobing Zhou.
|
2017-03-08 15:33:55 -08:00 |
|
Andrew Wang
|
4a09ed01a8
|
HDFS-8112. Relax permission checking for EC related operations.
|
2017-03-08 15:33:55 -08:00 |
|
Anu Engineer
|
4074123636
|
HDFS-11196. Ozone: Improve logging and error handling in the container layer. Contributed by Anu Engineer.
|
2017-03-08 09:36:20 -08:00 |
|
Andrew Wang
|
5addacb1e3
|
HDFS-11152. Start erasure coding policy ID number from 1 instead of 0 to void potential unexpected errors. Contributed by SammiChen.
|
2017-03-08 08:47:38 -08:00 |
|
Anu Engineer
|
dac2b9e7d9
|
HDFS-11509. Ozone: Fix TestEndpoint test regression. Contributed by Anu Engineer.
|
2017-03-07 22:38:11 -08:00 |
|
Anu Engineer
|
f0f4c3e7e3
|
HDFS-11424. Block Storage: add container representation to meta data. Contributed Chen Liang.
|
2017-03-07 13:26:22 -08:00 |
|
Anu Engineer
|
e37c5ed47d
|
HDFS-11451. Ozone: Add protobuf definitions for container reports. Contributed by Anu Engineer.
|
2017-03-07 10:28:21 -08:00 |
|
Arpit Agarwal
|
959940b0ab
|
HDFS-11477. Simplify file IO profiling configuration. Contributed by Hanisha Koneru.
|
2017-03-07 10:12:35 -08:00 |
|
Anu Engineer
|
a13c9782a3
|
HDFS-11158. Ozone: TestDatanodeStateMachine is failing intermittently. Contributed by Weiwei Yang.
|
2017-03-07 10:02:16 -08:00 |
|
Anu Engineer
|
5d0a206a63
|
HDFS-11497. Ozone: Fix Container test regression. Contributed by Anu Engineer.
|
2017-03-06 21:20:30 -08:00 |
|
Arpit Agarwal
|
b5adc5c301
|
HDFS-10838. Last full block report received time for each DN should be easily discoverable. Contributed by Surendra Singh Lilhore.
|
2017-03-06 16:39:53 -08:00 |
|
Andrew Wang
|
5e74196ede
|
HDFS-11498. Make RestCsrfPreventionHandler and WebHdfsHandler compatible with Netty 4.0.
|
2017-03-06 15:04:13 -08:00 |
|
Anu Engineer
|
72f0bed3dd
|
HDFS-11487. Ozone: Exclude container protobuf files from findbugs check. Contributed by Yuanbo Liu.
|
2017-03-06 14:17:41 -08:00 |
|
Yiqun Lin
|
3536ce031c
|
HDFS-8741. Proper error msg to be printed when invalid operation type is given to WebHDFS operations. Contributed by Surendra Singh Lilhore.
|
2017-03-06 19:04:03 +08:00 |
|
Mingliang Liu
|
0f336bab9c
|
HDFS-11494. Log message when DN is not selected for block replication. Contributed by Yiqun Lin
|
2017-03-03 18:47:13 -08:00 |
|
Anu Engineer
|
0951726233
|
Merge branch 'trunk' into HDFS-7240
|
2017-03-03 14:03:35 -08:00 |
|
Jing Zhao
|
ac5ae0065a
|
HDFS-11476. Fix NPE in FsDatasetImpl#checkAndUpdate. Contributed by Xiaobing Zhou.
|
2017-03-03 13:31:20 -08:00 |
|
Andrew Wang
|
3085a60430
|
HDFS-8112. Relax permission checking for EC related operations.
|
2017-03-03 13:00:22 -08:00 |
|
Anu Engineer
|
3ab6bc5329
|
HDFS-11137. Ozone: SCM: Add negative tests cases for datanodeStatemachine. Contributed by Weiwei Yang.
|
2017-03-03 10:29:05 -08:00 |
|
Rakesh Radhakrishnan
|
3749152b66
|
HDFS-11416. Refactor out system default erasure coding policy. Contributed by Andrew Wang.
|
2017-03-03 09:28:03 +05:30 |
|
Andrew Wang
|
8f4817f2c5
|
Revert "HDFS-11477. Simplify file IO profiling configuration. Contributed by Hanisha Koneru."
This reverts commit e61491d476.
|
2017-03-02 16:20:48 -08:00 |
|
Arpit Agarwal
|
e61491d476
|
HDFS-11477. Simplify file IO profiling configuration. Contributed by Hanisha Koneru.
|
2017-03-02 15:38:25 -08:00 |
|
Anu Engineer
|
e79f9da8de
|
HDFS-11484. Ozone: Fix flaky TestNodeManager#testScmNodeReportUpdate. Contributed by Xiaoyu Yao.
|
2017-03-02 15:10:47 -08:00 |
|
Arpit Agarwal
|
b3ec531f40
|
HDFS-11461. DataNode Disk Outlier Detection. Contributed by Hanisha Koneru.
|
2017-03-02 12:45:48 -08:00 |
|
Anu Engineer
|
02c35065f7
|
HDFS-11480. Ozone: TestEndpoint task failure. Contributed by Xiaoyu Yao.
|
2017-03-02 11:18:41 -08:00 |
|
Anu Engineer
|
09ad229db9
|
HDFS-11425. Ozone: add client-facing container APIs and container references. Contributed by Chen Liang.
|
2017-03-02 11:00:25 -08:00 |