Commit Graph

4732 Commits

Author SHA1 Message Date
Vinayakumar B 62b82d7f41 HDFS-9049. Make Datanode Netty reverse proxy port to be configurable. Contributed by Vinayakumar B.
(cherry picked from commit 09efdfe9e1)
(cherry picked from commit b3eeea0b6e)
2018-01-17 14:23:33 +05:30
Brahma Reddy Battula 28f69755f1 HDFS-8693. refreshNamenodes does not support adding a new standby to a running DN. Contributed by Ajith S.
(cherry picked from commit 880b9d24ff)
2018-01-16 16:33:34 +05:30
Inigo Goiri 6dc0b885a4 HDFS-12802. RBF: Control MountTableResolver cache size. Contrubuted by Inigo Goiri.
(cherry picked from commit d9006d8a4e)
2018-01-09 19:02:45 -08:00
Wei Yan 5e8029eff9 HDFS-12945. Switch to ClientProtocol instead of NamenodeProtocols in NamenodeWebHdfsMethods. Contributed by Wei Yan.
(cherry picked from commit 2ee0d64ace)
2018-01-08 15:13:53 -08:00
Inigo Goiri c1d48cbda0 HDFS-12988. RBF: Mount table entries not properly updated in the local cache. Contributed by Inigo Goiri.
(cherry picked from commit 83b513ac6d)
2018-01-05 09:14:25 -08:00
Tsz-Wo Nicholas Sze f3a92d89f3 HDFS-12347. TestBalancerRPCDelay#testBalancerRPCDelay fails very frequently. Contributed by Bharat Viswanadham
(cherry picked from commit c7499f2d24)
2018-01-04 06:48:04 +05:30
Xiao Chen 141cc8ffa2 HADOOP-15056. Fix TestUnbuffer#testUnbufferException failure. Contributed by Jack Bearden.
(cherry picked from commit 19e0894209)
(cherry picked from commit 1d1401ad38)
(cherry picked from commit 31436a12d5)
2017-12-29 13:57:55 -08:00
Xiao Chen 52adaa43db HADOOP-15012. Add readahead, dropbehind, and unbuffer to StreamCapabilities. Contributed by John Zhuge.
(cherry picked from commit c9d48352c2)
2017-12-29 13:57:55 -08:00
Xiao Chen 947d484d35 HDFS-9023. When NN is not able to identify DN for replication, reason behind it can be logged.
(cherry picked from commit 50b233d356)
2017-12-28 11:56:12 -08:00
Yiqun Lin 06cfe4b11b HDFS-12937. RBF: Add more unit tests for router admin commands. Contributed by Yiqun Lin.
(cherry picked from commit e040c97b77)
2017-12-19 15:36:28 +08:00
Junping Du c6f5d36ff2 Add 2.8.3 release jdiff files.
(cherry picked from commit c89f99aade)
2017-12-18 22:38:26 -08:00
Jason Lowe 605b8560f6 HDFS-12881. Output streams closed with IOUtils suppressing write errors. Contributed by Ajay Kumar
(cherry picked from commit 9ae8d1a8de)
2017-12-15 14:49:43 -06:00
Yiqun Lin c629f33761 HDFS-12895. RBF: Add ACL support for mount table. Contributed by Yiqun Lin.
(cherry picked from commit ee028bfdf1)
2017-12-15 14:14:42 +08:00
Kihwal Lee 43b9fbc2b4 HDFS-12907. Allow read-only access to reserved raw for non-superusers. Contributed by Rushabh S Shah.
(cherry picked from commit 08a50da95f)
2017-12-14 15:06:04 -06:00
Yiqun Lin 053a6fc126 HDFS-12883. RBF: Document Router and State Store metrics. Contributed by Yiqun Lin.
(cherry picked from commit 91c96bdf8e)
2017-12-14 16:04:31 +08:00
Inigo Goiri 118d653eea HDFS-12875. RBF: Complete logic for -readonly option of dfsrouteradmin add command. Contributed by Inigo Goiri.
(cherry picked from commit 5cd1056ad7)
2017-12-11 15:17:49 -08:00
Chris Douglas ae3dc443f4 HDFS-11576. Block recovery will fail indefinitely if recovery time > heartbeat interval. Contributed by Lukas Majercak
(cherry picked from commit afc606c3aa)
2017-12-07 00:47:02 -08:00
Akira Ajisaka 89314b78dd
HDFS-12889. Addendum patch to add missing file.
(cherry picked from commit 6cca5b3bcb)
(cherry picked from commit 046424cf8a)
2017-12-07 13:25:02 +09:00
Akira Ajisaka 7fd6407886
HDFS-12889. Router UI is missing robots.txt file. Contributed by Bharat Viswanadham.
(cherry picked from commit 44b06d34a5)
(cherry picked from commit 4e92b1e89e)
2017-12-06 11:43:08 +09:00
Xiao Chen 55df9df9fb HDFS-12396. Webhdfs file system should get delegation token from kms provider. Contributed by Rushabh S Shah.
(cherry picked from commit 274bbb193f)
2017-12-04 10:45:30 -08:00
Konstantin V Shvachko 0f5ec01ef7 HDFS-12638. Delete copy-on-truncate block along with the original block, when deleting a file being truncated. Contributed by Konstantin Shvachko.
(cherry picked from commit 60fd0d7fd7)
2017-11-30 18:28:18 -08:00
Kihwal Lee 7d2b13f0be HDFS-11754. Make FsServerDefaults cache configurable. Contributed by Mikhail Erofeev.
(cherry picked from commit 53509f295b)
2017-11-29 15:16:17 -06:00
Wei Yan 5e31b109c6 HDFS-12835. Fix the javadoc errors in Router-based federation.
(cherry picked from commit 301641811d)
2017-11-29 09:49:51 -08:00
Konstantin V Shvachko 3f9f0055eb HDFS-12832. INode.getFullPathName may throw ArrayIndexOutOfBoundsException lead to NameNode exit. Contribuited by Konstantin Shvachko.
(cherry picked from commit d331762f24)
2017-11-28 18:11:38 -08:00
Yiqun Lin 83c40758fa HDFS-12858. RBF: Add router admin commands usage in HDFS commands reference doc. Contributed by Yiqun Lin.
(cherry picked from commit 3d73d2f097)
2017-11-28 13:46:02 +08:00
Kihwal Lee 3516ef45f3 HDFS-12754. Lease renewal can hit a deadlock. Contributed by Kuhu Shukla.
(cherry picked from commit 45f59bde60)
2017-11-27 17:01:34 -06:00
Inigo Goiri ee267565b5 HDFS-12801. RBF: Set MountTableResolver as default file resolver. Contributed by Inigo Goiri.
(cherry picked from commit e182e77794)
2017-11-17 10:06:46 -08:00
John Zhuge 120d868963 HDFS-12318. Fix IOException condition for openInfo in DFSInputStream. Contributed by legend.
(cherry picked from commit 3123895db0)
2017-11-09 09:18:53 -08:00
Brahma Reddy Battula ce027c6f48 HDFS-12788. Reset the upload button when file upload fails. Contributed by Brahma Reddy Battula
(cherry picked from commit 410d0319cf)
2017-11-08 14:46:27 +05:30
Arun Suresh bb6a1aa5fa Preparing for 2.9.1 development 2017-11-02 22:49:38 -07:00
Weiwei Yang 3555397179 HDFS-12744. More logs when short-circuit read is failed and disabled. Contributed by Weiwei Yang.
(cherry picked from commit 56b88b0670)
(cherry picked from commit 0f20434e18)
2017-11-01 18:13:28 -07:00
Inigo Goiri 15b839c446 HDFS-12699. TestMountTable fails with Java 7. Contributed by Inigo Goiri.
(cherry picked from commit 982bd2a5bf)
2017-10-31 10:24:12 -07:00
Chris Douglas 9e721775a4 HADOOP-14986. Enforce JDK limitations.
(cherry picked from commit b50def3697)
(cherry picked from commit 1660a638f0)
2017-10-27 21:42:42 -07:00
Arpit Agarwal 8f28af4fac HDFS-9914. Fix configurable WebhDFS connect/read timeout. Contributed by Xiaoyu Yao. 2017-10-27 07:45:11 -07:00
Junping Du 1f2a2ba2be Add several jdiff xml files for 2.8.2 release.
(cherry picked from commit a25b5aa0cf)
2017-10-26 23:20:24 -07:00
John Zhuge 952aa3f168 HDFS-12710. HTTPFS HTTP max header size env variable is not respected in branch-2. Contributed by Istvan Fajth. 2017-10-26 17:43:01 -07:00
Zhe Zhang 736fb3b66c Revert "HDFS-12502. nntop should support a category based on FilesInGetListingOps."
This reverts commit 86c2adc452.
2017-10-24 15:05:26 -07:00
Arpit Agarwal a373094bf9 HDFS-12683. DFSZKFailOverController re-order logic for logging Exception. Contributed by Bharat Viswanadham. 2017-10-23 10:47:35 -07:00
Inigo Goiri 12c81c67d7 HDFS-12620. Backporting HDFS-10467 to branch-2. Contributed by Inigo Goiri. 2017-10-19 17:40:42 -07:00
Inigo Goiri 629b88b4dd HDFS-12577. Rename Router tooling. Contributed by Inigo Goiri.
(cherry picked from commit 53e8d0d030)
(cherry picked from commit 5d63a388d1)
2017-10-19 17:39:27 -07:00
Inigo Goiri 27295eecdd HDFS-12273. Federation UI. Contributed by Inigo Goiri.
(cherry picked from commit adbb2e00c7)
(cherry picked from commit 81601dac8e)
2017-10-19 17:39:19 -07:00
Inigo Goiri 7d795989e1 HDFS-12580. Rebasing HDFS-10467 after HDFS-12447. Contributed by Inigo Goiri.
(cherry picked from commit b12440d347)
(cherry picked from commit 6c69e23dcd)
2017-10-19 17:39:18 -07:00
Inigo Goiri f8a71e2f10 HDFS-12381. [Documentation] Adding configuration keys for the Router. Contributed by Inigo Goiri.
(cherry picked from commit c2d6aa7905)
(cherry picked from commit ad41c81559)
2017-10-19 17:39:17 -07:00
Inigo Goiri 9ad1f90b9d HDFS-12450. Fixing TestNamenodeHeartbeat and support non-HA. Contributed by Inigo Goiri.
(cherry picked from commit 928d1e87f9)
(cherry picked from commit 67785fe006)
2017-10-19 17:39:16 -07:00
Inigo Goiri ec84369538 HDFS-12430. Rebasing HDFS-10467 After HDFS-12269 and HDFS-12218. Contributed by Inigo Goiri.
(cherry picked from commit 3302e792d4)
(cherry picked from commit 1f06b81ecb)
2017-10-19 17:39:15 -07:00
Inigo Goiri 550ce086a1 HDFS-12335. Federation Metrics. Contributed by Inigo Goiri.
(cherry picked from commit 3b19e77752)
(cherry picked from commit bc9e588a19)
2017-10-19 17:39:14 -07:00
Inigo Goiri 23753ff3c5 HDFS-12384. Fixing compilation issue with BanDuplicateClasses. Contributed by Inigo Goiri.
(cherry picked from commit fabe02c8fa)
(cherry picked from commit cc58e7a983)
2017-10-19 17:39:12 -07:00
Inigo Goiri a100f63a16 HDFS-10631. Federation State Store ZooKeeper implementation. Contributed by Jason Kace and Inigo Goiri.
(cherry picked from commit 23c4ddee11)
(cherry picked from commit 7cb6bdf09e)
2017-10-19 17:39:11 -07:00
Inigo Goiri 36c3515fbb HDFS-12312. Rebasing HDFS-10467 (2). Contributed by Inigo Goiri.
(cherry picked from commit 90ba6843fb)
(cherry picked from commit 346c9fce43)
2017-10-19 17:39:08 -07:00
Inigo Goiri 0b599cdc87 HDFS-11554. [Documentation] Router-based federation documentation. Contributed by Inigo Goiri.
(cherry picked from commit ee3260211d)
(cherry picked from commit 67d10087af)
2017-10-19 17:38:57 -07:00