Commit Graph

4709 Commits

Author SHA1 Message Date
Tsz-Wo Nicholas Sze ed879d4a72 HDFS-12813. RequestHedgingProxyProvider can hide Exception thrown from the Namenode for proxy size of 1. Contributed by Mukul Kumar Singh 2017-11-20 17:11:18 -08:00
Inigo Goiri b57ea38fcf HDFS-12801. RBF: Set MountTableResolver as default file resolver. Contributed by Inigo Goiri.
(cherry picked from commit e182e77794)
2017-11-17 10:05:45 -08:00
Arpit Agarwal f671c22e3e HDFS-12705. WebHdfsFileSystem exceptions should retain the caused by exception. Contributed by Hanisha Koneru. 2017-11-13 13:56:13 -08:00
John Zhuge a42a19e139 HDFS-12052. Set SWEBHDFS delegation token kind when ssl is enabled in HttpFS. Contributed by Zoran Dimitrijevic.
(cherry picked from commit 12c8fdceaf)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/java/org/apache/hadoop/fs/http/server/HttpFSServerWebServer.java
	hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/fs/http/server/TestHttpFSServer.java
2017-11-09 09:47:11 -08:00
John Zhuge d946307faa HDFS-12318. Fix IOException condition for openInfo in DFSInputStream. Contributed by legend.
(cherry picked from commit 3123895db0)
2017-11-09 08:58:03 -08:00
Brahma Reddy Battula eca6385fdd HDFS-12788. Reset the upload button when file upload fails. Contributed by Brahma Reddy Battula
(cherry picked from commit 410d0319cf)
2017-11-08 14:43:13 +05:30
Weiwei Yang 0f20434e18 HDFS-12744. More logs when short-circuit read is failed and disabled. Contributed by Weiwei Yang.
(cherry picked from commit 56b88b0670)
2017-11-01 17:01:23 +08:00
Arun Suresh 71a55bebfb Preparing for 2.10.0 development 2017-10-31 12:51:14 -07:00
Inigo Goiri 15b839c446 HDFS-12699. TestMountTable fails with Java 7. Contributed by Inigo Goiri.
(cherry picked from commit 982bd2a5bf)
2017-10-31 10:24:12 -07:00
Chris Douglas 9e721775a4 HADOOP-14986. Enforce JDK limitations.
(cherry picked from commit b50def3697)
(cherry picked from commit 1660a638f0)
2017-10-27 21:42:42 -07:00
Arpit Agarwal 8f28af4fac HDFS-9914. Fix configurable WebhDFS connect/read timeout. Contributed by Xiaoyu Yao. 2017-10-27 07:45:11 -07:00
Junping Du 1f2a2ba2be Add several jdiff xml files for 2.8.2 release.
(cherry picked from commit a25b5aa0cf)
2017-10-26 23:20:24 -07:00
John Zhuge 952aa3f168 HDFS-12710. HTTPFS HTTP max header size env variable is not respected in branch-2. Contributed by Istvan Fajth. 2017-10-26 17:43:01 -07:00
Zhe Zhang 736fb3b66c Revert "HDFS-12502. nntop should support a category based on FilesInGetListingOps."
This reverts commit 86c2adc452.
2017-10-24 15:05:26 -07:00
Arpit Agarwal a373094bf9 HDFS-12683. DFSZKFailOverController re-order logic for logging Exception. Contributed by Bharat Viswanadham. 2017-10-23 10:47:35 -07:00
Inigo Goiri 12c81c67d7 HDFS-12620. Backporting HDFS-10467 to branch-2. Contributed by Inigo Goiri. 2017-10-19 17:40:42 -07:00
Inigo Goiri 629b88b4dd HDFS-12577. Rename Router tooling. Contributed by Inigo Goiri.
(cherry picked from commit 53e8d0d030)
(cherry picked from commit 5d63a388d1)
2017-10-19 17:39:27 -07:00
Inigo Goiri 27295eecdd HDFS-12273. Federation UI. Contributed by Inigo Goiri.
(cherry picked from commit adbb2e00c7)
(cherry picked from commit 81601dac8e)
2017-10-19 17:39:19 -07:00
Inigo Goiri 7d795989e1 HDFS-12580. Rebasing HDFS-10467 after HDFS-12447. Contributed by Inigo Goiri.
(cherry picked from commit b12440d347)
(cherry picked from commit 6c69e23dcd)
2017-10-19 17:39:18 -07:00
Inigo Goiri f8a71e2f10 HDFS-12381. [Documentation] Adding configuration keys for the Router. Contributed by Inigo Goiri.
(cherry picked from commit c2d6aa7905)
(cherry picked from commit ad41c81559)
2017-10-19 17:39:17 -07:00
Inigo Goiri 9ad1f90b9d HDFS-12450. Fixing TestNamenodeHeartbeat and support non-HA. Contributed by Inigo Goiri.
(cherry picked from commit 928d1e87f9)
(cherry picked from commit 67785fe006)
2017-10-19 17:39:16 -07:00
Inigo Goiri ec84369538 HDFS-12430. Rebasing HDFS-10467 After HDFS-12269 and HDFS-12218. Contributed by Inigo Goiri.
(cherry picked from commit 3302e792d4)
(cherry picked from commit 1f06b81ecb)
2017-10-19 17:39:15 -07:00
Inigo Goiri 550ce086a1 HDFS-12335. Federation Metrics. Contributed by Inigo Goiri.
(cherry picked from commit 3b19e77752)
(cherry picked from commit bc9e588a19)
2017-10-19 17:39:14 -07:00
Inigo Goiri 23753ff3c5 HDFS-12384. Fixing compilation issue with BanDuplicateClasses. Contributed by Inigo Goiri.
(cherry picked from commit fabe02c8fa)
(cherry picked from commit cc58e7a983)
2017-10-19 17:39:12 -07:00
Inigo Goiri a100f63a16 HDFS-10631. Federation State Store ZooKeeper implementation. Contributed by Jason Kace and Inigo Goiri.
(cherry picked from commit 23c4ddee11)
(cherry picked from commit 7cb6bdf09e)
2017-10-19 17:39:11 -07:00
Inigo Goiri 36c3515fbb HDFS-12312. Rebasing HDFS-10467 (2). Contributed by Inigo Goiri.
(cherry picked from commit 90ba6843fb)
(cherry picked from commit 346c9fce43)
2017-10-19 17:39:08 -07:00
Inigo Goiri 0b599cdc87 HDFS-11554. [Documentation] Router-based federation documentation. Contributed by Inigo Goiri.
(cherry picked from commit ee3260211d)
(cherry picked from commit 67d10087af)
2017-10-19 17:38:57 -07:00
Inigo Goiri 78abcb8f52 HDFS-10646. Federation admin tool. Contributed by Inigo Goiri.
(cherry picked from commit ae27e31fbc)
(cherry picked from commit b3e6bd22e3)
2017-10-19 17:38:54 -07:00
Inigo Goiri cc7c12ff18 HDFS-10880. Federation Mount Table State Store internal API. Contributed by Jason Kace and Inigo Goiri.
(cherry picked from commit 58b97df661)
(cherry picked from commit 6f0de27318)
2017-10-19 17:38:33 -07:00
Inigo Goiri e700db60a6 HDFS-11826. Federation Namenode Heartbeat. Contributed by Inigo Goiri.
(cherry picked from commit 928f8dab52)
(cherry picked from commit d8c8107332)
2017-10-19 17:38:32 -07:00
Inigo Goiri 0228ead4d1 HDFS-10687. Federation Membership State Store internal API. Contributed by Jason Kace and Inigo Goiri.
(cherry picked from commit 95cae08849)
(cherry picked from commit 55da7fd7eb)
2017-10-19 17:38:30 -07:00
Inigo Goiri a09d7219c9 HDFS-12223. Rebasing HDFS-10467. Contributed by Inigo Goiri.
(cherry picked from commit 47db6e9d8e)
(cherry picked from commit 0ec82b8cdf)
2017-10-19 17:38:29 -07:00
Inigo Goiri 2f95eac8f6 HDFS-11546. Federation Router RPC server. Contributed by Jason Kace and Inigo Goiri.
(cherry picked from commit 8a9cdebebf)
(cherry picked from commit ca4f209b49)
2017-10-19 17:38:28 -07:00
Inigo Goiri 7bd91fa2ed HDFS-10630. Federation State Store FS Implementation. Contributed by Jason Kace and Inigo Goiri.
(cherry picked from commit c6e0bd640c)
(cherry picked from commit 4bf877b03f)
2017-10-19 17:38:27 -07:00
Inigo 3f6d18ddf6 HDFS-10882. Federation State Store Interface API. Contributed by Jason Kace and Inigo Goiri.
(cherry picked from commit 6d94c90ece)
(cherry picked from commit 2c740a684a)
2017-10-19 17:38:25 -07:00
Inigo c3b8b5e49f HDFS-10881. Federation State Store Driver API. Contributed by Jason Kace and Inigo Goiri.
(cherry picked from commit 0f88e04915)
(cherry picked from commit 533b986633)
2017-10-19 17:38:24 -07:00
Inigo 096e8c4f35 HDFS-10629. Federation Roter. Contributed by Jason Kace and Inigo Goiri.
(cherry picked from commit 6821e80172)
(cherry picked from commit 2761bbc91a)
2017-10-19 17:38:21 -07:00
Wei-Chiu Chuang ce93a2b84b HDFS-12619. Do not catch and throw unchecked exceptions if IBRs fail to process. Contributed by Wei-Chiu Chuang.
(cherry picked from commit 4ab0c8f96a)
2017-10-19 06:18:40 -07:00
Zhe Zhang 87f4407396 HDFS-12502. nntop should support a category based on FilesInGetListingOps.
(cherry picked from commit 60bfee270e)
(cherry picked from commit aecf6c50d3)
2017-10-19 00:05:34 -07:00
Arpit Agarwal 0aa1b62b39 HDFS-12420. Add an option to disallow 'namenode format -force'. Contributed by Ajay Kumar.
(cherry picked from commit b6942cbe9b)
(cherry picked from commit 5897095d53)
2017-10-17 23:44:13 -07:00
Wei-Chiu Chuang a596c6f5eb HDFS-12485. expunge may fail to remove trash from encryption zone. Contributed by Wei-Chiu Chuang.
(cherry picked from commit 8dbc8909c9)
2017-10-16 12:59:41 -07:00
Xiao Chen b2f27641dd HDFS-12642. Log block and datanode details in BlockRecoveryWorker.
(cherry picked from commit 971b3ca1acc15d9a1f8e774291813dafd16ef704)
2017-10-16 10:34:24 -07:00
Xiao Chen d82edb49c7 HDFS-12603. Enable async edit logging by default. Contributed by Andrew Wang.
(cherry picked from commit d0311dfc5fe92a0e0f3fb8ae92e412edce609740)
2017-10-16 09:51:27 -07:00
Xiao Chen 4b734fe386 HDFS-12659. Update TestDeadDatanode#testNonDFSUsedONDeadNodeReReg to increase heartbeat recheck interval. Contributed by Ajay Kumar.
(cherry picked from commit 11a7729c1474aa379a62c0440c8c1a11be261a75)
2017-10-15 19:28:38 -07:00
Andrew Wang 1ddc49527a Revert "HDFS-12603. Enable async edit logging by default."
This reverts commit 42d3229e6f.
2017-10-09 13:29:52 -07:00
Andrew Wang 42d3229e6f HDFS-12603. Enable async edit logging by default. 2017-10-09 11:21:43 -07:00
Xiao Chen dd0113d777 HADOOP-14521. KMS client needs retry logic. Contributed by Rushabh S Shah.
(cherry picked from commit 212342d6db14673f8f5652a5209e1c4fcc0f0ede)
2017-10-05 19:47:04 -07:00
Yiqun Lin 2e2f8e42cf HDFS-12495. TestPendingInvalidateBlock#testPendingDeleteUnknownBlocks fails intermittently. Contributed by Eric Badger.
(cherry picked from commit e9b790db9d)
2017-09-27 10:45:44 +08:00
Daryn Sharp 7f3ed5f61e [HDFS-12386] Add fsserver defaults call to WebhdfsFileSystem. (Rushabh Shah via daryn) 2017-09-26 15:21:37 -05:00
Anu Engineer de5744c903 HDFS-12531. Fix conflict in the javadoc of UnderReplicatedBlocks.java in branch-2. Contributed by Bharat Viswanadham. 2017-09-23 11:16:50 -07:00