Commit Graph

6638 Commits

Author SHA1 Message Date
Arpit Agarwal 7da15eac7a HDFS-12579. JournalNodeSyncer should use fromUrl field of EditLogManifestResponse to construct servlet Url. Contributed by Hanisha Koneru. 2017-10-25 14:24:22 -07:00
Xiao Chen f66ad1fab9 HADOOP-14957. ReconfigurationTaskStatus is exposing guava Optional in its public api. Contributed by Haibo Chen, Xiao Chen. 2017-10-25 14:11:30 -07:00
Manoj Govindassamy 075dd45a24 HDFS-12544. SnapshotDiff - support diff generation on any snapshot root descendant directory. 2017-10-25 10:54:40 -07:00
Zhe Zhang 17cd8d0c17 Revert "HDFS-12502. nntop should support a category based on FilesInGetListingOps."
This reverts commit 60bfee270e.
2017-10-24 15:06:50 -07:00
Wei-Chiu Chuang 0f2a69127a HDFS-12249. dfsadmin -metaSave to output maintenance mode blocks. Contributed by Wellington Chevreuil. 2017-10-23 15:24:34 -07:00
Arpit Agarwal 96be795656 HDFS-12650. Use slf4j instead of log4j in LeaseManager. Contributed by Ajay Kumar. 2017-10-23 13:20:46 -07:00
Arpit Agarwal 4b00c9a47f HDFS-12683. DFSZKFailOverController re-order logic for logging Exception. Contributed by Bharat Viswanadham. 2017-10-23 10:47:16 -07:00
Xiao Chen 248d9b6fff HDFS-12518. Re-encryption should handle task cancellation and progress better. 2017-10-20 16:25:04 -07:00
Andrew Wang 0477eff8be HDFS-12497. Re-enable TestDFSStripedOutputStreamWithFailure tests. Contributed by Huafeng Wang. 2017-10-20 13:27:21 -07:00
Kai Zheng ce7cf66e5e HDFS-12448. Make sure user defined erasure coding policy ID will not overflow. Contributed by Huafeng Wang 2017-10-20 09:42:04 +08:00
Inigo Goiri 0f1c037618 HDFS-12620. Backporting HDFS-10467 to branch-2. Contributed by Inigo Goiri. 2017-10-19 18:08:45 -07:00
Wei-Chiu Chuang 4ab0c8f96a HDFS-12619. Do not catch and throw unchecked exceptions if IBRs fail to process. Contributed by Wei-Chiu Chuang. 2017-10-19 06:17:59 -07:00
Zhe Zhang 60bfee270e HDFS-12502. nntop should support a category based on FilesInGetListingOps. 2017-10-18 23:51:24 -07:00
Lei Xu f27a4ad032 HDFS-12612. DFSStripedOutputStream.close will throw if called a second time with a failed streamer. (Lei (Eddy) Xu) 2017-10-17 15:52:09 -07:00
Lei Xu 31ebccc962 HDFS-12613. Native EC coder should implement release() as idempotent function. (Lei (Eddy) Xu) 2017-10-16 19:44:30 -07:00
Manoj Govindassamy b406d8e375 HDFS-12614. FSPermissionChecker#getINodeAttrs() throws NPE when INodeAttributesProvider configured. 2017-10-16 17:42:41 -07:00
Wei-Chiu Chuang 8dbc8909c9 HDFS-12485. expunge may fail to remove trash from encryption zone. Contributed by Wei-Chiu Chuang. 2017-10-16 12:57:48 -07:00
Xiao Chen 21bc855587 HDFS-12642. Log block and datanode details in BlockRecoveryWorker. 2017-10-16 10:34:06 -07:00
Xiao Chen 7bd700941d HDFS-12637. Extend TestDistributedFileSystemWithECFile with a random EC policy. Contributed by Takanobu Asanuma. 2017-10-16 09:55:22 -07:00
Xiao Chen 035c6ee587 HDFS-12603. Enable async edit logging by default. Contributed by Andrew Wang. 2017-10-16 09:51:10 -07:00
Xiao Chen 20575ececb HDFS-12659. Update TestDeadDatanode#testNonDFSUsedONDeadNodeReReg to increase heartbeat recheck interval. Contributed by Ajay Kumar. 2017-10-15 19:28:22 -07:00
Manoj Govindassamy 133d7ca76e HADOOP-13055. Implement linkMergeSlash and linkFallback for ViewFileSystem 2017-10-13 17:43:21 -07:00
Arpit Agarwal 8dd1eeb94f HDFS-12553. Add nameServiceId to QJournalProtocol. Contributed by Bharat Viswanadham 2017-10-13 14:22:21 -07:00
Arpit Agarwal 8acdf5c274 HDFS-12542. Update javadoc and documentation for listStatus. Contributed by Ajay Kumar. 2017-10-11 12:29:35 -07:00
Arpit Agarwal bb0a742aac HDFS-12627. Fix typo in DFSAdmin command output. Contributed by Ajay Kumar. 2017-10-11 12:26:14 -07:00
Akira Ajisaka dc63a6a52b
HDFS-12622. Fix enumerate in HDFSErasureCoding.md. Contributed by Yiqun Lin. 2017-10-11 18:09:53 +09:00
Kai Zheng d8d37b63c7 HDFS-12635. Unnecessary exception declaration of the CellBuffers constructor. Contributed by Huafeng Wang 2017-10-11 15:45:28 +08:00
Andrew Wang a297fb0886 HDFS-12547. Extend TestQuotaWithStripedBlocks with a random EC policy. Contributed by Takanobu Asanuma. 2017-10-10 17:35:49 -07:00
Manoj Govindassamy 78af6cdc53 HDFS-12573. Divide the total blocks metrics into replicated and erasure coded. Contributed by Takanobu Asanuma. 2017-10-10 14:23:29 -07:00
Jitendra Pandey f29e55bf5e HADOOP-14910. Upgrade netty-all jar to latest 4.0.x.Final. Contributed by Vinayakumar B. 2017-10-10 11:00:07 -07:00
Jitendra Pandey d6602b5f39 HDFS-11575. Supporting HDFS NFS gateway with Federated HDFS. Contributed by Mukul Kumar Singh. 2017-10-10 10:38:05 -07:00
Andrew Wang 82cd85d868 Revert "HDFS-12603. Enable async edit logging by default."
This reverts commit afb42aeabf.
2017-10-09 17:53:56 -07:00
Andrew Wang 7938208233 HDFS-12541. Extend TestSafeModeWithStripedFile with a random EC policy. Contributed by Takanobu Asanuma. 2017-10-09 13:03:32 -07:00
Andrew Wang afb42aeabf HDFS-12603. Enable async edit logging by default. 2017-10-09 11:20:00 -07:00
Arpit Agarwal 09ad848b64 HDFS-12599. Remove Mockito dependency from DataNodeTestUtils. Contributed by Ted Yu. 2017-10-09 10:29:01 -07:00
Lei Xu 46644319e1 HDFS-12606. When using native decoder, DFSStripedStream.close crashes JVM after being called multiple times. (Lei (Eddy) Xu) 2017-10-09 10:08:30 -07:00
John Zhuge 2856eb207b HDFS-12494. libhdfs SIGSEGV in setTLSExceptionStrings. Contributed by John Zhuge. 2017-10-06 23:29:28 -07:00
Inigo Goiri 5d63a388d1 HDFS-12577. Rename Router tooling. Contributed by Inigo Goiri.
(cherry picked from commit 53e8d0d030)
2017-10-06 18:50:52 -07:00
Inigo Goiri 81601dac8e HDFS-12273. Federation UI. Contributed by Inigo Goiri.
(cherry picked from commit adbb2e00c7)
2017-10-06 18:50:52 -07:00
Inigo Goiri 6c69e23dcd HDFS-12580. Rebasing HDFS-10467 after HDFS-12447. Contributed by Inigo Goiri.
(cherry picked from commit b12440d347)
2017-10-06 18:50:51 -07:00
Inigo Goiri ad41c81559 HDFS-12381. [Documentation] Adding configuration keys for the Router. Contributed by Inigo Goiri.
(cherry picked from commit c2d6aa7905)
2017-10-06 18:50:51 -07:00
Inigo Goiri 67785fe006 HDFS-12450. Fixing TestNamenodeHeartbeat and support non-HA. Contributed by Inigo Goiri.
(cherry picked from commit 928d1e87f9)
2017-10-06 18:50:50 -07:00
Inigo Goiri 1f06b81ecb HDFS-12430. Rebasing HDFS-10467 After HDFS-12269 and HDFS-12218. Contributed by Inigo Goiri.
(cherry picked from commit 3302e792d4)
2017-10-06 18:50:50 -07:00
Inigo Goiri bc9e588a19 HDFS-12335. Federation Metrics. Contributed by Inigo Goiri.
(cherry picked from commit 3b19e77752)
2017-10-06 18:50:50 -07:00
Inigo Goiri cc58e7a983 HDFS-12384. Fixing compilation issue with BanDuplicateClasses. Contributed by Inigo Goiri.
(cherry picked from commit fabe02c8fa)
2017-10-06 18:50:49 -07:00
Inigo Goiri 7cb6bdf09e HDFS-10631. Federation State Store ZooKeeper implementation. Contributed by Jason Kace and Inigo Goiri.
(cherry picked from commit 23c4ddee11)
2017-10-06 18:50:49 -07:00
Inigo Goiri 346c9fce43 HDFS-12312. Rebasing HDFS-10467 (2). Contributed by Inigo Goiri.
(cherry picked from commit 90ba6843fb)
2017-10-06 18:50:48 -07:00
Inigo Goiri 67d10087af HDFS-11554. [Documentation] Router-based federation documentation. Contributed by Inigo Goiri.
(cherry picked from commit ee3260211d)
2017-10-06 18:50:48 -07:00
Inigo Goiri b3e6bd22e3 HDFS-10646. Federation admin tool. Contributed by Inigo Goiri.
(cherry picked from commit ae27e31fbc)
2017-10-06 18:50:48 -07:00
Inigo Goiri 6f0de27318 HDFS-10880. Federation Mount Table State Store internal API. Contributed by Jason Kace and Inigo Goiri.
(cherry picked from commit 58b97df661)
2017-10-06 18:50:47 -07:00