Commit Graph

4721 Commits

Author SHA1 Message Date
Jason Lowe 605b8560f6 HDFS-12881. Output streams closed with IOUtils suppressing write errors. Contributed by Ajay Kumar
(cherry picked from commit 9ae8d1a8de)
2017-12-15 14:49:43 -06:00
Yiqun Lin c629f33761 HDFS-12895. RBF: Add ACL support for mount table. Contributed by Yiqun Lin.
(cherry picked from commit ee028bfdf1)
2017-12-15 14:14:42 +08:00
Kihwal Lee 43b9fbc2b4 HDFS-12907. Allow read-only access to reserved raw for non-superusers. Contributed by Rushabh S Shah.
(cherry picked from commit 08a50da95f)
2017-12-14 15:06:04 -06:00
Yiqun Lin 053a6fc126 HDFS-12883. RBF: Document Router and State Store metrics. Contributed by Yiqun Lin.
(cherry picked from commit 91c96bdf8e)
2017-12-14 16:04:31 +08:00
Inigo Goiri 118d653eea HDFS-12875. RBF: Complete logic for -readonly option of dfsrouteradmin add command. Contributed by Inigo Goiri.
(cherry picked from commit 5cd1056ad7)
2017-12-11 15:17:49 -08:00
Chris Douglas ae3dc443f4 HDFS-11576. Block recovery will fail indefinitely if recovery time > heartbeat interval. Contributed by Lukas Majercak
(cherry picked from commit afc606c3aa)
2017-12-07 00:47:02 -08:00
Akira Ajisaka 89314b78dd
HDFS-12889. Addendum patch to add missing file.
(cherry picked from commit 6cca5b3bcb)
(cherry picked from commit 046424cf8a)
2017-12-07 13:25:02 +09:00
Akira Ajisaka 7fd6407886
HDFS-12889. Router UI is missing robots.txt file. Contributed by Bharat Viswanadham.
(cherry picked from commit 44b06d34a5)
(cherry picked from commit 4e92b1e89e)
2017-12-06 11:43:08 +09:00
Xiao Chen 55df9df9fb HDFS-12396. Webhdfs file system should get delegation token from kms provider. Contributed by Rushabh S Shah.
(cherry picked from commit 274bbb193f)
2017-12-04 10:45:30 -08:00
Konstantin V Shvachko 0f5ec01ef7 HDFS-12638. Delete copy-on-truncate block along with the original block, when deleting a file being truncated. Contributed by Konstantin Shvachko.
(cherry picked from commit 60fd0d7fd7)
2017-11-30 18:28:18 -08:00
Kihwal Lee 7d2b13f0be HDFS-11754. Make FsServerDefaults cache configurable. Contributed by Mikhail Erofeev.
(cherry picked from commit 53509f295b)
2017-11-29 15:16:17 -06:00
Wei Yan 5e31b109c6 HDFS-12835. Fix the javadoc errors in Router-based federation.
(cherry picked from commit 301641811d)
2017-11-29 09:49:51 -08:00
Konstantin V Shvachko 3f9f0055eb HDFS-12832. INode.getFullPathName may throw ArrayIndexOutOfBoundsException lead to NameNode exit. Contribuited by Konstantin Shvachko.
(cherry picked from commit d331762f24)
2017-11-28 18:11:38 -08:00
Yiqun Lin 83c40758fa HDFS-12858. RBF: Add router admin commands usage in HDFS commands reference doc. Contributed by Yiqun Lin.
(cherry picked from commit 3d73d2f097)
2017-11-28 13:46:02 +08:00
Kihwal Lee 3516ef45f3 HDFS-12754. Lease renewal can hit a deadlock. Contributed by Kuhu Shukla.
(cherry picked from commit 45f59bde60)
2017-11-27 17:01:34 -06:00
Inigo Goiri ee267565b5 HDFS-12801. RBF: Set MountTableResolver as default file resolver. Contributed by Inigo Goiri.
(cherry picked from commit e182e77794)
2017-11-17 10:06:46 -08:00
John Zhuge 120d868963 HDFS-12318. Fix IOException condition for openInfo in DFSInputStream. Contributed by legend.
(cherry picked from commit 3123895db0)
2017-11-09 09:18:53 -08:00
Brahma Reddy Battula ce027c6f48 HDFS-12788. Reset the upload button when file upload fails. Contributed by Brahma Reddy Battula
(cherry picked from commit 410d0319cf)
2017-11-08 14:46:27 +05:30
Arun Suresh bb6a1aa5fa Preparing for 2.9.1 development 2017-11-02 22:49:38 -07:00
Weiwei Yang 3555397179 HDFS-12744. More logs when short-circuit read is failed and disabled. Contributed by Weiwei Yang.
(cherry picked from commit 56b88b0670)
(cherry picked from commit 0f20434e18)
2017-11-01 18:13:28 -07:00
Inigo Goiri 15b839c446 HDFS-12699. TestMountTable fails with Java 7. Contributed by Inigo Goiri.
(cherry picked from commit 982bd2a5bf)
2017-10-31 10:24:12 -07:00
Chris Douglas 9e721775a4 HADOOP-14986. Enforce JDK limitations.
(cherry picked from commit b50def3697)
(cherry picked from commit 1660a638f0)
2017-10-27 21:42:42 -07:00
Arpit Agarwal 8f28af4fac HDFS-9914. Fix configurable WebhDFS connect/read timeout. Contributed by Xiaoyu Yao. 2017-10-27 07:45:11 -07:00
Junping Du 1f2a2ba2be Add several jdiff xml files for 2.8.2 release.
(cherry picked from commit a25b5aa0cf)
2017-10-26 23:20:24 -07:00
John Zhuge 952aa3f168 HDFS-12710. HTTPFS HTTP max header size env variable is not respected in branch-2. Contributed by Istvan Fajth. 2017-10-26 17:43:01 -07:00
Zhe Zhang 736fb3b66c Revert "HDFS-12502. nntop should support a category based on FilesInGetListingOps."
This reverts commit 86c2adc452.
2017-10-24 15:05:26 -07:00
Arpit Agarwal a373094bf9 HDFS-12683. DFSZKFailOverController re-order logic for logging Exception. Contributed by Bharat Viswanadham. 2017-10-23 10:47:35 -07:00
Inigo Goiri 12c81c67d7 HDFS-12620. Backporting HDFS-10467 to branch-2. Contributed by Inigo Goiri. 2017-10-19 17:40:42 -07:00
Inigo Goiri 629b88b4dd HDFS-12577. Rename Router tooling. Contributed by Inigo Goiri.
(cherry picked from commit 53e8d0d030)
(cherry picked from commit 5d63a388d1)
2017-10-19 17:39:27 -07:00
Inigo Goiri 27295eecdd HDFS-12273. Federation UI. Contributed by Inigo Goiri.
(cherry picked from commit adbb2e00c7)
(cherry picked from commit 81601dac8e)
2017-10-19 17:39:19 -07:00
Inigo Goiri 7d795989e1 HDFS-12580. Rebasing HDFS-10467 after HDFS-12447. Contributed by Inigo Goiri.
(cherry picked from commit b12440d347)
(cherry picked from commit 6c69e23dcd)
2017-10-19 17:39:18 -07:00
Inigo Goiri f8a71e2f10 HDFS-12381. [Documentation] Adding configuration keys for the Router. Contributed by Inigo Goiri.
(cherry picked from commit c2d6aa7905)
(cherry picked from commit ad41c81559)
2017-10-19 17:39:17 -07:00
Inigo Goiri 9ad1f90b9d HDFS-12450. Fixing TestNamenodeHeartbeat and support non-HA. Contributed by Inigo Goiri.
(cherry picked from commit 928d1e87f9)
(cherry picked from commit 67785fe006)
2017-10-19 17:39:16 -07:00
Inigo Goiri ec84369538 HDFS-12430. Rebasing HDFS-10467 After HDFS-12269 and HDFS-12218. Contributed by Inigo Goiri.
(cherry picked from commit 3302e792d4)
(cherry picked from commit 1f06b81ecb)
2017-10-19 17:39:15 -07:00
Inigo Goiri 550ce086a1 HDFS-12335. Federation Metrics. Contributed by Inigo Goiri.
(cherry picked from commit 3b19e77752)
(cherry picked from commit bc9e588a19)
2017-10-19 17:39:14 -07:00
Inigo Goiri 23753ff3c5 HDFS-12384. Fixing compilation issue with BanDuplicateClasses. Contributed by Inigo Goiri.
(cherry picked from commit fabe02c8fa)
(cherry picked from commit cc58e7a983)
2017-10-19 17:39:12 -07:00
Inigo Goiri a100f63a16 HDFS-10631. Federation State Store ZooKeeper implementation. Contributed by Jason Kace and Inigo Goiri.
(cherry picked from commit 23c4ddee11)
(cherry picked from commit 7cb6bdf09e)
2017-10-19 17:39:11 -07:00
Inigo Goiri 36c3515fbb HDFS-12312. Rebasing HDFS-10467 (2). Contributed by Inigo Goiri.
(cherry picked from commit 90ba6843fb)
(cherry picked from commit 346c9fce43)
2017-10-19 17:39:08 -07:00
Inigo Goiri 0b599cdc87 HDFS-11554. [Documentation] Router-based federation documentation. Contributed by Inigo Goiri.
(cherry picked from commit ee3260211d)
(cherry picked from commit 67d10087af)
2017-10-19 17:38:57 -07:00
Inigo Goiri 78abcb8f52 HDFS-10646. Federation admin tool. Contributed by Inigo Goiri.
(cherry picked from commit ae27e31fbc)
(cherry picked from commit b3e6bd22e3)
2017-10-19 17:38:54 -07:00
Inigo Goiri cc7c12ff18 HDFS-10880. Federation Mount Table State Store internal API. Contributed by Jason Kace and Inigo Goiri.
(cherry picked from commit 58b97df661)
(cherry picked from commit 6f0de27318)
2017-10-19 17:38:33 -07:00
Inigo Goiri e700db60a6 HDFS-11826. Federation Namenode Heartbeat. Contributed by Inigo Goiri.
(cherry picked from commit 928f8dab52)
(cherry picked from commit d8c8107332)
2017-10-19 17:38:32 -07:00
Inigo Goiri 0228ead4d1 HDFS-10687. Federation Membership State Store internal API. Contributed by Jason Kace and Inigo Goiri.
(cherry picked from commit 95cae08849)
(cherry picked from commit 55da7fd7eb)
2017-10-19 17:38:30 -07:00
Inigo Goiri a09d7219c9 HDFS-12223. Rebasing HDFS-10467. Contributed by Inigo Goiri.
(cherry picked from commit 47db6e9d8e)
(cherry picked from commit 0ec82b8cdf)
2017-10-19 17:38:29 -07:00
Inigo Goiri 2f95eac8f6 HDFS-11546. Federation Router RPC server. Contributed by Jason Kace and Inigo Goiri.
(cherry picked from commit 8a9cdebebf)
(cherry picked from commit ca4f209b49)
2017-10-19 17:38:28 -07:00
Inigo Goiri 7bd91fa2ed HDFS-10630. Federation State Store FS Implementation. Contributed by Jason Kace and Inigo Goiri.
(cherry picked from commit c6e0bd640c)
(cherry picked from commit 4bf877b03f)
2017-10-19 17:38:27 -07:00
Inigo 3f6d18ddf6 HDFS-10882. Federation State Store Interface API. Contributed by Jason Kace and Inigo Goiri.
(cherry picked from commit 6d94c90ece)
(cherry picked from commit 2c740a684a)
2017-10-19 17:38:25 -07:00
Inigo c3b8b5e49f HDFS-10881. Federation State Store Driver API. Contributed by Jason Kace and Inigo Goiri.
(cherry picked from commit 0f88e04915)
(cherry picked from commit 533b986633)
2017-10-19 17:38:24 -07:00
Inigo 096e8c4f35 HDFS-10629. Federation Roter. Contributed by Jason Kace and Inigo Goiri.
(cherry picked from commit 6821e80172)
(cherry picked from commit 2761bbc91a)
2017-10-19 17:38:21 -07:00
Wei-Chiu Chuang ce93a2b84b HDFS-12619. Do not catch and throw unchecked exceptions if IBRs fail to process. Contributed by Wei-Chiu Chuang.
(cherry picked from commit 4ab0c8f96a)
2017-10-19 06:18:40 -07:00