Zhe Zhang
|
d8a3309830
|
HDFS-11709. StandbyCheckpointer should handle an non-existing legacyOivImageDir gracefully. Contributed by Erik Krogen.
|
2017-04-27 09:50:30 -07:00 |
Akira Ajisaka
|
249cb210f5
|
HDFS-11697. Add javadoc for storage policy and erasure coding policy. Contributed by Kai Sasaki.
|
2017-04-27 16:12:27 +09:00 |
Konstantin V Shvachko
|
28eb2aabeb
|
HDFS-11384. Balancer disperses getBlocks calls to avoid NameNode's rpc queue saturation. Contributed by Konstantin V Shvachko.
|
2017-04-26 17:28:49 -07:00 |
Chen Liang
|
50dd3a5cfa
|
HDFS-11627. Block Storage: Cblock cache should register with flusher to upload blocks to containers. Contributed by Mukul Kumar Singh.
|
2017-04-26 10:36:56 -07:00 |
|
Akira Ajisaka
|
93fa48fcf2
|
HDFS-11417. Add datanode admin command to get the storage info. Contributed by Surendra Singh Lilhore.
|
2017-04-26 17:43:29 +09:00 |
Chris Douglas
|
2f73396b59
|
HDFS-6708. StorageType should be encoded in the block token. Contributed by Ewan Higgs
|
2017-04-25 23:57:00 -07:00 |
Xiaoyu Yao
|
4ea2778acb
|
HADOOP-14207. "dfsadmin -refreshCallQueue" fails with DecayRpcScheduler. Contributed by Surendra Singh Lihore.
|
2017-04-25 18:45:56 -07:00 |
Jason Lowe
|
e4321ec843
|
HDFS-11691. Add a proper scheme to the datanode links in NN web UI. Contributed by Kihwal Lee
|
2017-04-25 17:30:42 -05:00 |
John Zhuge
|
fda86ef2a3
|
HDFS-11529. Add libHDFS API to return last exception. Contributed by Sailesh Mukil.
|
2017-04-22 02:56:48 -07:00 |
Yongjun Zhang
|
20e3ae260b
|
HDFS-11402. HDFS Snapshots should capture point-in-time copies of OPEN files. (Manoj Govindassamy via Yongjun Zhang)
|
2017-04-21 20:35:48 -07:00 |
|
Yongjun Zhang
|
5078df7be3
|
HDFS-11689. New exception thrown by DFSClient%isHDFSEncryptionEnabled broke hacky hive code. Contributed by Yongjun Zhang.
|
2017-04-21 13:36:31 -07:00 |
Kai Zheng
|
b0803388fc
|
HDFS-11604. Define and parse erasure code policies. Contributed by Lin Zeng
|
2017-04-21 13:33:33 +08:00 |
|
Chen Liang
|
eae8c2a469
|
HDFS-11667. Block Storage:Handling flushing of incomplete block id buffers during shutdown. Contributed by Mukul Kumar Singh.
|
2017-04-20 13:50:29 -07:00 |
|
Xiaoyu Yao
|
a2c6f594ba
|
HDFS-11668. Ozone: misc improvements for SCM CLI. Contributed by Weiwei Yang.
|
2017-04-20 11:32:13 -07:00 |
Yiqun Lin
|
9154d77ca8
|
HDFS-11666. Ozone: Fix compile error due to inconsistent package name. Contributed by Yiqun Lin.
|
2017-04-20 14:22:59 +08:00 |
|
Xiaoyu Yao
|
8ec13a397f
|
HDFS-11504. Ozone: SCM: Add Block APIs. Contributed by Xiaoyu Yao.
|
2017-04-19 22:34:49 -07:00 |
Andrew Wang
|
74a723852d
|
HDFS-11660. TestFsDatasetCache#testPageRounder fails intermittently with AssertionError.
|
2017-04-19 18:10:04 -07:00 |
|
Andrew Wang
|
c1549352cf
|
HDFS-11671. TestReconstructStripedBlocks#test2RecoveryTasksForSameBlockGroup fails.
|
2017-04-19 13:49:56 -07:00 |
|
John Zhuge
|
8c81a16a1f
|
HDFS-11531. Expose hedged read metrics via libHDFS API. Contributed by Sailesh Mukil.
|
2017-04-18 21:11:07 -07:00 |
Weiwei Yang
|
0bf416ac40
|
HDFS-11649. Ozone: SCM: CLI: Add shell code placeholder classes. Contributed by Chen Liang.
|
2017-04-19 11:43:14 +08:00 |
|
John Zhuge
|
ca2488c009
|
HDFS-11665. HttpFSServerWebServer$deprecateEnv may leak secret. Contributed by John Zhuge.
|
2017-04-18 09:28:52 -07:00 |
Anu Engineer
|
d889437c27
|
HDFS-11658. Ozone: SCM daemon is unable to be started via CLI. Contributed by Weiwei Yang.
|
2017-04-17 19:09:11 -07:00 |
|
Anu Engineer
|
368424b465
|
HDFS-11581. Ozone: Support force delete a container. Contributed by Yuanbo Liu.
|
2017-04-17 17:58:54 -07:00 |
|
Konstantin V Shvachko
|
8dfcd95d58
|
HDFS-11634. Optimize BlockIterator when interating starts in the middle. Contributed by Konstantin V Shvachko.
|
2017-04-17 16:56:24 -07:00 |
|
Andrew Wang
|
c0ca785dbb
|
HDFS-11652. Improve ECSchema and ErasureCodingPolicy toString, hashCode, equals.
|
2017-04-17 16:30:25 -07:00 |
|
Zhe Zhang
|
ad49098eb3
|
HDFS-11615. FSNamesystemLock metrics can be inaccurate due to millisecond precision. Contributed by Erik Krogen.
|
2017-04-17 16:22:33 -07:00 |
|
Anu Engineer
|
350220bfb3
|
HDFS-11631. Block Storage : allow cblock server to be started from hdfs commandline. Contributed by Chen Liang.
|
2017-04-17 15:54:39 -07:00 |
|
Anu Engineer
|
49c92ea73d
|
HDFS-11657. Ozone: Add unit test for storage container metrics. Contributed by Yiqun Lin.
|
2017-04-17 12:44:29 -07:00 |
|
Anu Engineer
|
1a418ef2c0
|
HDFS-11582. Block Storage : add SCSI target access daemon. Contributed by Chen Liang.
|
2017-04-13 13:25:53 -07:00 |
|
Anu Engineer
|
3231ead84b
|
Merge branch 'trunk' into HDFS-7240
|
2017-04-12 16:36:41 -07:00 |
|
Anu Engineer
|
6556445792
|
HDFS-11569. Ozone: Implement listKey function for KeyManager. Contributed by Weiwei Yang.
|
2017-04-12 15:36:56 -07:00 |
|
Andrew Wang
|
a7312715a6
|
HDFS-10996. Ability to specify per-file EC policy at create time. Contributed by SammiChen.
|
2017-04-12 12:27:34 -07:00 |
|
Andrew Wang
|
966b1b5b44
|
HDFS-11565. Use compact identifiers for built-in ECPolicies in HdfsFileStatus.
|
2017-04-12 12:24:32 -07:00 |
|
Chen Liang
|
cedacf12c9
|
HDFS-11642. Block Storage: fix TestCBlockCLI and TestCBlockServerPersistence cleanup. Contributed by Xiaoyu Yao.
|
2017-04-12 12:09:10 -07:00 |
|
Anu Engineer
|
abce613356
|
HDFS-11645. DataXceiver thread should log the actual error when getting InvalidMagicNumberException. Contributed by Chen Liang.
|
2017-04-12 11:40:58 -07:00 |
Kihwal Lee
|
d4c01dde49
|
HDFS-11648. Lazy construct the IIP pathname. Contributed by Daryn Sharp.
|
2017-04-12 13:29:24 -05:00 |
|
Chen Liang
|
f4dec00896
|
HDFS-11635. Block Storage: Add metrics for Container Flushes. Contributed by Mukul Kumar Singh.
|
2017-04-12 10:38:30 -07:00 |
Chris Nauroth
|
23b1a7bdf1
|
HDFS-11163. Mover should move the file blocks to default storage once policy is unset. Contributed by Surendra Singh Lilhore.
|
2017-04-11 22:03:09 -07:00 |
Hanisha Koneru
|
62e4573efb
|
HDFS-11630. TestThrottledAsyncCheckerTimeout fails intermittently in Jenkins builds. Contributed by Hanisha Koneru.
|
2017-04-11 21:36:24 -07:00 |
Mingliang Liu
|
3a91376707
|
HDFS-11558. BPServiceActor thread name is too long. Contributed by Xiaobing Zhou
|
2017-04-11 15:29:38 -07:00 |
|
Xiaoyu Yao
|
a2ff806d2e
|
HDFS-11062. Ozone:SCM: Remove null command. Contributed by Yuanbo Liu.
|
2017-04-11 13:33:40 -07:00 |
Wei-Chiu Chuang
|
f050afb578
|
HADOOP-13665. Erasure Coding codec should support fallback coder. Contributed by Kai Sasaki.
|
2017-04-11 07:32:13 -07:00 |
|
Yiqun Lin
|
2fd568fdd4
|
HDFS-11637. Fix javac warning caused by the deprecated key used in TestDFSClientRetries#testFailuresArePerOperation. Contributed by Yiqun Lin.
|
2017-04-11 19:40:09 +08:00 |
|
Chris Douglas
|
a5e57df3c5
|
HADOOP-14225. Remove xmlenc dependency
|
2017-04-10 11:48:40 -07:00 |
|
Andrew Wang
|
e8bdad7385
|
HDFS-11623. Move system erasure coding policies into hadoop-hdfs-client.
|
2017-04-07 16:46:28 -07:00 |
|
Andrew Wang
|
203edc026c
|
HDFS-11633. FSImage failover disables all erasure coding policies. Contributed by Wei-Chiu Chuang.
|
2017-04-07 15:46:11 -07:00 |
|
Chen Liang
|
349a19b2ad
|
HDFS-11618. Block Storage: Add Support for Direct I/O. Contributed by Mukul Kumar Singh.
|
2017-04-07 10:01:19 -07:00 |
Allen Wittenauer
|
96cbb4fce2
|
HADOOP-14202. fix jsvc/secure user var inconsistencies
Signed-off-by: John Zhuge <jzhuge@apache.org>
|
2017-04-07 08:59:21 -07:00 |
|
Xiaoyu Yao
|
0eacd4c13b
|
HDFS-11608. HDFS write crashed with block size greater than 2 GB. Contributed by Xiaobing Zhou.
|
2017-04-06 16:11:55 -07:00 |
|
Xiaoyu Yao
|
a49fac5302
|
HDFS-11362. StorageDirectory should initialize a non-null default StorageDirType. Contribute by Hanisha Koneru.
|
2017-04-06 14:33:16 -07:00 |
Arpit Agarwal
|
8c57aeb5b4
|
HDFS-11131. TestThrottledAsyncChecker#testCancellation is flaky.
|
2017-04-05 17:54:30 -07:00 |
|
Andrew Wang
|
539ef5aa2e
|
HFDS-11596. hadoop-hdfs-client jar is in the wrong directory in release tarball. Contributed by Yuanbo Liu.
|
2017-04-05 16:04:09 -07:00 |
Xiaobing Zhou
|
3db8d68d63
|
HDFS-11628. Clarify the behavior of HDFS Mover in documentation. Contributed by Xiaobing Zhou.
|
2017-04-05 15:33:08 -07:00 |
|
Anu Engineer
|
7ce1090558
|
HDFS-11006. Ozone: support setting chunk size in streaming API. Contributed by Yiqun Lin.
|
2017-04-05 11:07:28 -07:00 |
|
Anu Engineer
|
bc2c5d2d61
|
HDFS-11625. Ozone: Fix UT failures that caused by hard coded datanode data dirs. Contributed by Weiwei Yang.
|
2017-04-05 10:11:44 -07:00 |
|
Andrew Wang
|
9e0e430f18
|
HDFS-11538. Move ClientProtocol HA proxies into hadoop-hdfs-client. Contributed by Huafeng Wang.
|
2017-04-04 23:05:24 -07:00 |
|
Akira Ajisaka
|
8cb7325527
|
HDFS-9651. Add missing robots.txt files.
|
2017-04-05 12:47:45 +09:00 |
|
Akira Ajisaka
|
09e6caec3d
|
HDFS-9651. All web UIs should include a robots.txt file. Contributed by Lars Francke.
|
2017-04-05 12:45:28 +09:00 |
|
Andrew Wang
|
18432130a7
|
HADOOP-14104. Client should always ask namenode for kms provider path. Contributed by Rushabh S Shah.
|
2017-04-04 13:38:25 -07:00 |
|
Anu Engineer
|
adc651044c
|
Merge branch 'trunk' into HDFS-7240
|
2017-04-04 12:50:22 -07:00 |
|
Anu Engineer
|
38dddad74e
|
HDFS-11620. Ozone: Allocate container for MiniOzone cluster fails because of insufficient space error. Contributed by Mukul Kumar Singh.
|
2017-04-04 10:09:40 -07:00 |
|
Anu Engineer
|
3bc2e1d992
|
HDFS-11619. Ozone: Unit tests running failed in Windows. Contributed by Yiqun Lin.
|
2017-04-04 09:57:56 -07:00 |
|
Chris Douglas
|
6eba79232f
|
HADOOP-14271. Correct spelling of 'occurred' and variants. Contributed by Yeliang Cang
|
2017-04-03 20:13:14 -07:00 |
|
Anu Engineer
|
ec4d25fc53
|
HDFS-11566. Ozone: Document missing metrics for container operations. Contributed by Yiqun Lin.
|
2017-04-03 15:01:23 -07:00 |
|
Anu Engineer
|
68eab679e3
|
HDFS-11564. Ozone: SCM: Add Comparable Metric Support. Contributed by Anu Engineer.
|
2017-04-03 13:33:11 -07:00 |
|
Anu Engineer
|
558b478ff2
|
HDFS-11519. Ozone: Implement XceiverServerSpi and XceiverClientSpi using Ratis. Contributed by Tsz Wo Nicholas Sze.
|
2017-04-03 12:40:06 -07:00 |
|
Wei-Chiu Chuang
|
bbd68478d5
|
HDFS-11598. Improve -setrep for Erasure Coded files. Contributed by Yiqun Lin.
|
2017-04-03 07:57:28 -07:00 |
|
Wei-Chiu Chuang
|
bc7aff7cec
|
HDFS-11515. -du throws ConcurrentModificationException. Contributed by Istvan Fajth, Wei-Chiu Chuang.
|
2017-04-03 07:35:09 -07:00 |
|
Chen Liang
|
d00c07c675
|
HDFS-11591. Block Storage: fix TestCBlockServer test cleanup. Contributed by Xiaoyu Yao
|
2017-03-31 14:41:05 -07:00 |
|
Hanisha Koneru
|
73835c73e2
|
HDFS-11560. Expose slow disks via NameNode JMX. Contributed by Hanisha Koneru.
|
2017-03-31 13:50:29 -07:00 |
|
Arpit Agarwal
|
5485d93bda
|
HDFS-11603. Improve slow mirror/disk warnings in BlockReceiver.
|
2017-03-31 12:10:27 -07:00 |
|
Hanisha Koneru
|
28cdc5a8dc
|
HDFS-11551. Handle SlowDiskReport from DataNode at the NameNode. Contributed by Hanisha Koneru.
|
2017-03-30 22:41:26 -07:00 |
|
Yongjun Zhang
|
bf3fb585aa
|
HADOOP-11794. Enable distcp to copy blocks in parallel. Contributed by Yongjun Zhang, Wei-Chiu Chuang, Xiao Chen, Rosie Li.
|
2017-03-30 17:38:56 -07:00 |
|
Yongjun Zhang
|
144f1cf765
|
Revert "HADOOP-11794. Enable distcp to copy blocks in parallel. Contributed by Yongjun Zhang, Wei-Chiu Chuang, Xiao Chen."
This reverts commit 064c8b25ec.
|
2017-03-30 17:38:18 -07:00 |
|
Yongjun Zhang
|
064c8b25ec
|
HADOOP-11794. Enable distcp to copy blocks in parallel. Contributed by Yongjun Zhang, Wei-Chiu Chuang, Xiao Chen.
|
2017-03-30 17:01:15 -07:00 |
|
Anu Engineer
|
fbfdf69904
|
HDFS-11594. Ozone: close container should call compactDB. Contributed by Anu Engineer.
|
2017-03-30 16:53:28 -07:00 |
|
Mingliang Liu
|
e5f0622a6f
|
HDFS-11592. Closing a file has a wasteful preconditions in NameNode. Contributed by Eric Badger
|
2017-03-30 15:44:21 -07:00 |
|
Wei-Chiu Chuang
|
8c591b8d19
|
HDFS-10974. Document replication factor for EC files. Contributed by Yiqun Lin.
|
2017-03-30 11:16:05 -07:00 |
|
Chris Douglas
|
7297e82cb4
|
HADOOP-14250. Correct spelling of 'separate' and variants. Contributed by Doris Gu
|
2017-03-30 10:17:11 -07:00 |
|
Andrew Wang
|
4966a6e26e
|
HADOOP-14223. Extend FileStatus#toString() to include details like Erasure Coding and Encryption. Contributed by Manoj Govindassamy.
|
2017-03-29 14:37:21 -07:00 |
|
Xiaoyu Yao
|
1590b9f7ea
|
HDFS-11567. Ozone: SCM: Support update container. Contributed by Weiwei Yang.
|
2017-03-29 12:19:31 -07:00 |
Daniel Templeton
|
15e3873dc3
|
HDFS-11571. Typo in DataStorage exception message (Contributed by Anna Budai via Daniel Templeton)
|
2017-03-29 10:56:36 -07:00 |
Rakesh Radhakrishnan
|
84d787b9d5
|
HDFS-11541. Call RawErasureEncoder and RawErasureDecoder release() methods. Contributed by SammiChen.
|
2017-03-29 11:41:48 +05:30 |
|
Xiaoyu Yao
|
8617fda2c6
|
HDFS-11537. Block Storage : add cache layer. Contributed by Chen Liang.
|
2017-03-28 19:21:37 -07:00 |
|
Yiqun Lin
|
6b09336438
|
HDFS-11577. Combine the old and the new chooseRandom for better performance. Contributed by Chen Liang.
|
2017-03-28 23:02:07 +08:00 |
|
Anu Engineer
|
8f4d8c43f8
|
HDFS-11548. Ozone: SCM: Add node pool management API. Contributed by Xiaoyu Yao
|
2017-03-27 17:59:49 -07:00 |
Masatake Iwasaki
|
64ea62c1cc
|
HDFS-11486. Client close() should not fail fast if the last block is being decommissioned. Contributed by Wei-Chiu Chuang and Yiqun Lin.
|
2017-03-28 09:13:44 +09:00 |
|
Anu Engineer
|
33dfb72fa3
|
HDFS-11355. Block Storage : Merge configuration into ozone configuration classes. Contributed by Chen Liang.
|
2017-03-27 15:26:13 -07:00 |
|
Anu Engineer
|
ed14373a9f
|
HDFS-11550. Ozone: Add a check to prevent removing a container that has keys in it. Contributed by Weiwei Yang.
|
2017-03-27 08:38:57 -07:00 |
|
Wei-Chiu Chuang
|
46d37a65cf
|
HDFS-10506. Addendum patch to include missing changes. Contributed by Akira Ajisaka.
|
2017-03-27 05:23:45 -07:00 |
|
Yiqun Lin
|
96e2ab8144
|
HDFS-11555. Fix typos in class OfflineImageReconstructor. Contributed by Yiqun Lin.
|
2017-03-27 19:23:37 +08:00 |
Junping Du
|
d174c06b01
|
Add HDFS jdiff for 2.8.0 release.
|
2017-03-25 14:05:20 -07:00 |
Tsuyoshi Ozawa
|
84ddedc0b2
|
HADOOP-10101. Update guava dependency to the latest version. (ozawa)
|
2017-03-25 10:06:52 +09:00 |
|
Hanisha Koneru
|
1f66524432
|
HDFS-11570. Unit test for NameNodeStatusMXBean. Contributed by Hanisha Koneru.
|
2017-03-24 14:44:25 -07:00 |
|
Xiaobing Zhou
|
1168ece596
|
HDFS-11534. Add counters for number of blocks in pending IBR. Contributed by Xiaobing Zhou.
|
2017-03-24 14:33:44 -07:00 |
|
Andrew Wang
|
332a997e10
|
HDFS-11170. Add builder-based create API to FileSystem. Contributed by SammiChen and Wei Zhou.
|
2017-03-24 12:56:46 -07:00 |
|
Andrew Wang
|
52b00600df
|
HADOOP-13715. Add isErasureCoded() API to FileStatus class. Contributed by Manoj Govindassamy.
|
2017-03-24 11:44:46 -07:00 |
Ravi Prakash
|
d4f73e7e27
|
HDFS-11574. Spelling mistakes in the Java source. Contributed by Hu Xiaodong.
|
2017-03-24 09:38:17 -07:00 |
|
Anu Engineer
|
e867baa220
|
HDFS-11361. Block Storage: add cache interface. Contributed by Chen Liang.
|
2017-03-23 14:33:23 -07:00 |
|
Zhe Zhang
|
59d69257a8
|
HADOOP-9631. ViewFs should use underlying FileSystem's server side defaults. Contributed by Lohit Vijayarenu and Erik Krogen.
|
2017-03-22 22:22:22 -07:00 |
|
John Zhuge
|
ed2d03f2a5
|
HDFS-11561. HttpFS doc errors. Contributed by Yuanbo Liu.
|
2017-03-22 22:15:24 -07:00 |
|
Anu Engineer
|
302948531f
|
HDFS-11559. Ozone: MiniOzoneCluster prints too many log messages by default. Contributed by Tsz Wo Nicholas Sze.
|
2017-03-21 22:08:02 -07:00 |
|
Anu Engineer
|
36b20e9fbf
|
HDFS-11496. Ozone: Merge with trunk needed a ignore duplicate entry in pom file due to shading. Contributed by Tsz Wo Nicholas Sze.
|
2017-03-21 15:23:56 -07:00 |
|
Anu Engineer
|
a9f92c4666
|
HDFS-11162. Block Storage: add command line tool. Contributed by Chen Liang.
|
2017-03-21 15:06:18 -07:00 |
|
Anu Engineer
|
6b5dee9c38
|
HDFS-11492. Ozone: Add the ability to handle sendContainerReport Command. Contributed by Anu Engineer.
|
2017-03-21 10:43:27 -07:00 |
|
Yiqun Lin
|
3b908f71c5
|
HDFS-11358. DiskBalancer: Report command supports reading nodes from host file. Contributed by Yiqun Lin.
|
2017-03-21 17:44:17 +08:00 |
|
Arpit Agarwal
|
e7c8da614c
|
HDFS-11545. Propagate DataNode's slow disks info to the NameNode via Heartbeats. Contributed by Hanisha Koneru.
|
2017-03-20 21:54:58 -07:00 |
|
Chris Douglas
|
b104f3a282
|
HDFS-6648. Order of namenodes in ConfiguredFailoverProxyProvider is undefined. Contributed by Inigo Goiri
|
2017-03-20 17:15:13 -07:00 |
|
Anu Engineer
|
603f2c18ec
|
HDFS-11444. Ozone: Fix datanode ID handling in MiniOzoneCluster. Contributed by Weiwei Yang.
|
2017-03-20 13:18:26 -07:00 |
|
Arpit Agarwal
|
ffa160ddb8
|
HDFS-11547. Add logs for slow BlockReceiver while writing data to disk. Contributed by Xiaobing Zhou.
|
2017-03-17 19:02:24 -07:00 |
|
Hanisha Koneru
|
7f8e928400
|
HDFS-11517. Expose slow disks via DataNode JMX. Contributed by Hanisha Koneru
|
2017-03-17 15:42:25 -07:00 |
|
Andrew Wang
|
92ea6d74ec
|
HDFS-11516. Admin command line should print message to stderr in failure case. Contributed by Kai Sasaki.
|
2017-03-17 11:26:02 -07:00 |
|
Xiaobing Zhou
|
7536815039
|
HDFS-10394. move declaration of okhttp version from hdfs-client to hadoop-project POM. Contributed by Xiaobing Zhou.
|
2017-03-16 18:13:43 -07:00 |
|
Andrew Wang
|
4812518b23
|
HDFS-10530. BlockManager reconstruction work scheduling should correctly adhere to EC block placement policy. Contributed by Manoj Govindassamy and Rui Gao.
|
2017-03-16 15:07:38 -07:00 |
|
Kihwal Lee
|
ba62b50eba
|
HDFS-10601. Improve log message to include hostname when the NameNode is in safemode. Contributed by Kuhu Shukla.
|
2017-03-16 10:54:59 -05:00 |
|
Hanisha Koneru
|
d69a82c89c
|
HDFS-11511. Support Timeout when checking single disk. Contributed by Hanisha Koneru.
|
2017-03-15 18:01:45 -07:00 |
Chen Liang
|
615ac09499
|
HDFS-11419. DFSTopologyNodeImpl#chooseRandom optimizations. Contributed by Chen Liang.
|
2017-03-15 12:28:22 -07:00 |
|
Yiqun Lin
|
4416a07c9c
|
HDFS-11420. Edit file should not be processed by the same type processor in OfflineEditsViewer. Contributed by Yiqun Lin.
|
2017-03-15 18:05:03 +08:00 |
|
Xiaoyu Yao
|
65487b579e
|
HDFS-11491. Ozone: SCM: Add close container RPC. Contributed by Anu Engineer.
|
2017-03-14 21:28:44 -07:00 |
|
Xiaoyu Yao
|
72f4e3f347
|
HDFS-11487. Ozone: Exclude container protobuf files from findbugs check(amends previous fix). Contributed by Yuanbo Liu.
|
2017-03-14 21:18:44 -07:00 |
|
Andrew Wang
|
cc1292e73a
|
HDFS-9705. Refine the behaviour of getFileChecksum when length = 0. Contributed by Kai Zheng and SammiChen.
|
2017-03-14 16:41:10 -07:00 |
|
Anu Engineer
|
39058dd601
|
HDFS-11469. Ozone: SCM: Container allocation based on node report. Contributed by Xiaoyu Yao.
|
2017-03-14 11:54:26 -07:00 |
|
Andrew Wang
|
7515e75103
|
HDFS-11505. Do not enable any erasure coding policies by default. Contributed by Manoj Govindassamy.
|
2017-03-14 11:47:25 -07:00 |
|
Yiqun Lin
|
023b941e3b
|
HDFS-11526. Fix confusing block recovery message. Contributed by Yiqun Lin.
|
2017-03-14 17:49:48 +08:00 |
|
Chen Liang
|
9832ae0ed8
|
HDFS-11482. Add storage type demand to into DFSNetworkTopology#chooseRandom. Contributed by Chen Liang.
|
2017-03-13 17:30:10 -07:00 |
Jing Zhao
|
55796a0946
|
HDFS-11395. RequestHedgingProxyProvider#RequestHedgingInvocationHandler hides the Exception thrown from NameNode. Contributed by Nandakumar.
|
2017-03-13 14:24:51 -07:00 |
|
Yiqun Lin
|
79924266f8
|
HDFS-11512. Increase timeout on TestShortCircuitLocalRead#testSkipWithVerifyChecksum. Contributed by Eric Badger.
|
2017-03-13 18:22:30 +08:00 |
|
Xiaoyu Yao
|
8eca9824cf
|
HDFS-11071. Ozone: SCM: Move SCM config keys to ScmConfig. Contributed by Weiwei Yang.
|
2017-03-10 16:24:24 -08:00 |
Lei Xu
|
6d356b6b4d
|
HDFS-11340. DataNode reconfigure for disks doesn't remove the failed volumes. (Manoj Govindassamy via lei)
|
2017-03-10 14:37:13 -08:00 |
|
Andrew Wang
|
819808a016
|
HDFS-11506. Move ErasureCodingPolicyManager#getSystemDefaultPolicy to test code. Contributed by Manoj Govindassamy.
|
2017-03-09 17:29:11 -08:00 |
Tsz-Wo Nicholas Sze
|
fbc8099b63
|
HDFS-11513. Ozone: Separate XceiverServer and XceiverClient into interfaces and implementations.
|
2017-03-09 11:03:20 -08:00 |
|
Masatake Iwasaki
|
385d2cb777
|
HDFS-11499. Decommissioning stuck because of failing recovery. Contributed by Lukas Majercak and Manoj Govindassamy.
|
2017-03-09 21:13:50 +09:00 |
|
Anu Engineer
|
5e95bdeef2
|
HDFS-10928. Ozone:SCM: Support MXBean for SCM and NodeManager. Contributed by Weiwei Yang.
|
2017-03-08 18:52:57 -08:00 |
|
Andrew Wang
|
33a38a5341
|
HDFS-11314. Enforce set of enabled EC policies on the NameNode.
|
2017-03-08 16:41:44 -08:00 |
|
Andrew Wang
|
5ca6ef0c26
|
HDFS-10983. OIV tool should make an EC file explicit. Contributed by Manoj Govindassamy.
|
2017-03-08 15:36:19 -08:00 |
|
Anu Engineer
|
cc63937e31
|
merge trunk to HDFS-7240
|
2017-03-08 15:34:04 -08:00 |
|
Andrew Wang
|
6b6c61ee74
|
HDFS-11152. Start erasure coding policy ID number from 1 instead of 0 to void potential unexpected errors. Contributed by SammiChen.
|
2017-03-08 15:34:04 -08:00 |
|
Arpit Agarwal
|
647de3c41e
|
HDFS-11477. Simplify file IO profiling configuration. Contributed by Hanisha Koneru.
|
2017-03-08 15:34:01 -08:00 |
|
Arpit Agarwal
|
79b8d7ed38
|
HDFS-10838. Last full block report received time for each DN should be easily discoverable. Contributed by Surendra Singh Lilhore.
|
2017-03-08 15:33:59 -08:00 |
|
Andrew Wang
|
52a53fe71f
|
HDFS-11498. Make RestCsrfPreventionHandler and WebHdfsHandler compatible with Netty 4.0.
|
2017-03-08 15:33:59 -08:00 |
|
Yiqun Lin
|
b13878cf50
|
HDFS-8741. Proper error msg to be printed when invalid operation type is given to WebHDFS operations. Contributed by Surendra Singh Lilhore.
|
2017-03-08 15:33:58 -08:00 |
|
Mingliang Liu
|
370f4da168
|
HDFS-11494. Log message when DN is not selected for block replication. Contributed by Yiqun Lin
|
2017-03-08 15:33:56 -08:00 |
|
Jing Zhao
|
09cfa79dbd
|
HDFS-11476. Fix NPE in FsDatasetImpl#checkAndUpdate. Contributed by Xiaobing Zhou.
|
2017-03-08 15:33:55 -08:00 |
|
Andrew Wang
|
4a09ed01a8
|
HDFS-8112. Relax permission checking for EC related operations.
|
2017-03-08 15:33:55 -08:00 |
|
Anu Engineer
|
4074123636
|
HDFS-11196. Ozone: Improve logging and error handling in the container layer. Contributed by Anu Engineer.
|
2017-03-08 09:36:20 -08:00 |
|
Andrew Wang
|
5addacb1e3
|
HDFS-11152. Start erasure coding policy ID number from 1 instead of 0 to void potential unexpected errors. Contributed by SammiChen.
|
2017-03-08 08:47:38 -08:00 |
|
Anu Engineer
|
dac2b9e7d9
|
HDFS-11509. Ozone: Fix TestEndpoint test regression. Contributed by Anu Engineer.
|
2017-03-07 22:38:11 -08:00 |
|
Anu Engineer
|
f0f4c3e7e3
|
HDFS-11424. Block Storage: add container representation to meta data. Contributed Chen Liang.
|
2017-03-07 13:26:22 -08:00 |
|
Anu Engineer
|
e37c5ed47d
|
HDFS-11451. Ozone: Add protobuf definitions for container reports. Contributed by Anu Engineer.
|
2017-03-07 10:28:21 -08:00 |
|
Arpit Agarwal
|
959940b0ab
|
HDFS-11477. Simplify file IO profiling configuration. Contributed by Hanisha Koneru.
|
2017-03-07 10:12:35 -08:00 |
|
Anu Engineer
|
a13c9782a3
|
HDFS-11158. Ozone: TestDatanodeStateMachine is failing intermittently. Contributed by Weiwei Yang.
|
2017-03-07 10:02:16 -08:00 |
|
Anu Engineer
|
5d0a206a63
|
HDFS-11497. Ozone: Fix Container test regression. Contributed by Anu Engineer.
|
2017-03-06 21:20:30 -08:00 |
|
Arpit Agarwal
|
b5adc5c301
|
HDFS-10838. Last full block report received time for each DN should be easily discoverable. Contributed by Surendra Singh Lilhore.
|
2017-03-06 16:39:53 -08:00 |
|
Andrew Wang
|
5e74196ede
|
HDFS-11498. Make RestCsrfPreventionHandler and WebHdfsHandler compatible with Netty 4.0.
|
2017-03-06 15:04:13 -08:00 |
|
Anu Engineer
|
72f0bed3dd
|
HDFS-11487. Ozone: Exclude container protobuf files from findbugs check. Contributed by Yuanbo Liu.
|
2017-03-06 14:17:41 -08:00 |
|
Yiqun Lin
|
3536ce031c
|
HDFS-8741. Proper error msg to be printed when invalid operation type is given to WebHDFS operations. Contributed by Surendra Singh Lilhore.
|
2017-03-06 19:04:03 +08:00 |
|
Mingliang Liu
|
0f336bab9c
|
HDFS-11494. Log message when DN is not selected for block replication. Contributed by Yiqun Lin
|
2017-03-03 18:47:13 -08:00 |
|
Anu Engineer
|
0951726233
|
Merge branch 'trunk' into HDFS-7240
|
2017-03-03 14:03:35 -08:00 |
|
Jing Zhao
|
ac5ae0065a
|
HDFS-11476. Fix NPE in FsDatasetImpl#checkAndUpdate. Contributed by Xiaobing Zhou.
|
2017-03-03 13:31:20 -08:00 |
|
Andrew Wang
|
3085a60430
|
HDFS-8112. Relax permission checking for EC related operations.
|
2017-03-03 13:00:22 -08:00 |
|
Anu Engineer
|
3ab6bc5329
|
HDFS-11137. Ozone: SCM: Add negative tests cases for datanodeStatemachine. Contributed by Weiwei Yang.
|
2017-03-03 10:29:05 -08:00 |
|
Rakesh Radhakrishnan
|
3749152b66
|
HDFS-11416. Refactor out system default erasure coding policy. Contributed by Andrew Wang.
|
2017-03-03 09:28:03 +05:30 |
|
Andrew Wang
|
8f4817f2c5
|
Revert "HDFS-11477. Simplify file IO profiling configuration. Contributed by Hanisha Koneru."
This reverts commit e61491d476.
|
2017-03-02 16:20:48 -08:00 |
|
Arpit Agarwal
|
e61491d476
|
HDFS-11477. Simplify file IO profiling configuration. Contributed by Hanisha Koneru.
|
2017-03-02 15:38:25 -08:00 |
|
Anu Engineer
|
e79f9da8de
|
HDFS-11484. Ozone: Fix flaky TestNodeManager#testScmNodeReportUpdate. Contributed by Xiaoyu Yao.
|
2017-03-02 15:10:47 -08:00 |
|
Arpit Agarwal
|
b3ec531f40
|
HDFS-11461. DataNode Disk Outlier Detection. Contributed by Hanisha Koneru.
|
2017-03-02 12:45:48 -08:00 |
|
Anu Engineer
|
02c35065f7
|
HDFS-11480. Ozone: TestEndpoint task failure. Contributed by Xiaoyu Yao.
|
2017-03-02 11:18:41 -08:00 |
|
Anu Engineer
|
09ad229db9
|
HDFS-11425. Ozone: add client-facing container APIs and container references. Contributed by Chen Liang.
|
2017-03-02 11:00:25 -08:00 |
|
Arpit Agarwal
|
eeca8b0c4e
|
HDFS-11419. HDFS specific network topology classes with storage type info included. Contributed by Chen Liang.
|
2017-03-02 09:21:27 -08:00 |
Ming Ma
|
4e14eaded2
|
Merge branch 'trunk' of https://git-wip-us.apache.org/repos/asf/hadoop into trunk
|
2017-03-01 20:24:49 -08:00 |
|
Ming Ma
|
25c84d279b
|
HDFS-11412. Maintenance minimum replication config value allowable range should be [0, DefaultReplication]. (Manoj Govindassamy via mingma)
|
2017-03-01 20:23:52 -08:00 |
|
Yiqun Lin
|
555d0c3995
|
HDFS-11478. Update EC commands in HDFSCommands.md. Contributed by Yiqun Lin.
|
2017-03-02 12:10:24 +08:00 |
|
Anu Engineer
|
7aa0a44cf1
|
HDFS-11447. Ozone: SCM: Send node report to SCM with heartbeat.Contributed by Xiaoyu Yao.
|
2017-03-01 11:47:22 -08:00 |
|
Anu Engineer
|
3eae84c1be
|
HDFS-11474. Ozone: TestContainerMapping needs to cleanup levelDB files.Contributed by Xiaoyu Yao.
|
2017-03-01 11:30:32 -08:00 |
|
Anu Engineer
|
4cd34e2a18
|
HDFS-11473. Ozone : exclude cblock protobuf files from findbugs check. Contributed by Xiaoyu Yao.
|
2017-03-01 09:40:18 -08:00 |
|
Rakesh Radhakrishnan
|
82ef9accaf
|
HDFS-11428. Change setErasureCodingPolicy to take a required string EC policy name. Contributed by Andrew Wang.
|
2017-03-01 16:06:02 +05:30 |
Brahma Reddy Battula
|
dcd03df9f9
|
HDFS-11432. Federation : Support fully qualified path for Quota/Snapshot/cacheadmin/cryptoadmin commands. Contributed by Brahma Reddy Battula.
|
2017-03-01 10:45:56 +05:30 |
|
Anu Engineer
|
00684d62ca
|
HDFS-11036. Ozone: reuse Xceiver connection. Contributed by Chen Liang.
|
2017-02-28 12:15:26 -08:00 |
|
Arpit Agarwal
|
ad16978e65
|
HDFS-11414. Ozone : move StorageContainerLocation protocol to hdfs-client. Contributed by Chen Liang.
|
2017-02-28 10:28:05 -08:00 |
|
Zhe Zhang
|
d269b488a7
|
HDFS-11466. Change dfs.namenode.write-lock-reporting-threshold-ms default from 1000ms to 5000ms. Contributed by Andrew Wang.
|
2017-02-28 09:00:49 -08:00 |
|
Akira Ajisaka
|
258342e76c
|
HADOOP-14118. move jets3t into a dependency on hadoop-aws JAR.
|
2017-02-28 13:47:44 +09:00 |
|
Andrew Wang
|
55c07bbed2
|
HDFS-11382. Persist Erasure Coding Policy ID in a new optional field in INodeFile in FSImage. Contributed by Manoj Govindassamy.
|
2017-02-27 17:07:45 -08:00 |
|
Anu Engineer
|
d63ec0ca81
|
HDFS-11184. Ozone: SCM: Make SCM use container protocol. Contributed by Anu Engineer.
|
2017-02-27 12:25:03 -08:00 |
|
Anu Engineer
|
ae783b1991
|
HDFS-11463. Ozone: Add metrics for container operations and export over JMX. Contributed by Mukul Kumar Singh.
|
2017-02-27 09:44:48 -08:00 |
|
Wei-Chiu Chuang
|
05391c1845
|
HDFS-10506. OIV's ReverseXML processor cannot reconstruct some snapshot details. Contributed by Akira Ajisaka.
|
2017-02-25 14:38:50 -08:00 |
|
Arpit Agarwal
|
120bef7de8
|
HDFS-11462. Fix occasional BindException in TestNameNodeMetricsLogger.
|
2017-02-24 19:53:39 -08:00 |
|
Yiqun Lin
|
4a58870a04
|
HDFS-11433. Document missing usages of OfflineEditsViewer processors. Contributed by Yiqun Lin.
|
2017-02-25 10:00:05 +08:00 |
Xiao Chen
|
e24ed47d9a
|
HDFS-11421. Make WebHDFS' ACLs RegEx configurable. Contributed by Harsh J.
|
2017-02-24 16:49:46 -08:00 |
|
Arpit Agarwal
|
d2b3ba9b8f
|
HDFS-11295. Check storage remaining instead of node remaining in BlockPlacementPolicyDefault.chooseReplicaToDelete(). Contributed by Marton Elek.
|
2017-02-24 15:44:11 -08:00 |
|
Andrew Wang
|
c1a52b04d0
|
HDFS-11427. Rename rs-default to rs.
|
2017-02-24 10:58:45 -08:00 |
|
Andrew Wang
|
132f758e3d
|
HDFS-11426. Refactor EC CLI to be similar to storage policies CLI.
|
2017-02-23 16:00:11 -08:00 |
|
Jing Zhao
|
13d4bcfe35
|
HDFS-4025. QJM: Sychronize past log segments to JNs that missed them. Contributed by Hanisha Koneru.
|
2017-02-22 16:33:38 -08:00 |
|
Andrew Wang
|
d150f061f4
|
HDFS-11438. Fix typo in error message of StoragePolicyAdmin tool. Contributed by Alison Yu.
|
2017-02-22 15:16:09 -08:00 |
|
Ming Ma
|
cfcd527323
|
HDFS-11411. Avoid OutOfMemoryError in TestMaintenanceState test runs. (Manoj Govindassamy via mingma)
|
2017-02-22 09:41:07 -08:00 |
|
Mingliang Liu
|
003ae00693
|
HDFS-11430. Separate class InnerNode from class NetworkTopology and make it extendable. Contributed by Tsz Wo Nicholas Sze
|
2017-02-21 15:32:46 -08:00 |
|
Andrew Wang
|
8ef7ebbc71
|
HDFS-11406. Remove unused getStartInstance and getFinalizeInstance in FSEditLogOp. Contributed by Alison Yu.
|
2017-02-21 14:54:20 -08:00 |
|
Andrew Wang
|
fc9ad3ce3a
|
HDFS-11405. Rename "erasurecode" CLI subcommand to "ec". Contributed by Manoj Govindassamy.
|
2017-02-21 13:55:27 -08:00 |
Eric Payne
|
a07ddef101
|
HDFS-11404. Increase timeout on TestShortCircuitLocalRead.testDeprecatedGetBlockLocalPathInfoRpc. Contributed by Eric Badger
|
2017-02-21 12:04:25 -06:00 |
Vinayakumar B
|
4804050630
|
HDFS-11177. 'storagepolicies -getStoragePolicy' command should accept URI based path. (Contributed by Surendra Singh Lilhore)
|
2017-02-21 18:13:19 +05:30 |
|
Xiao Chen
|
02c549484a
|
HDFS-11410. Use the cached instance when edit logging SetAclOp, SetXAttrOp and RemoveXAttrOp.
|
2017-02-16 18:07:55 -08:00 |