Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
14,245 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

4748 Commits

Author SHA1 Message Date
Brahma Reddy Battula ed512645b2 HDFS-8693. Addendum patch to execute the command using UGI. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 35c17351ca)
(cherry picked from commit 24af0bc144)
 2018-02-12 22:27:21 +05:30
Arpit Agarwal 41d434d08e HDFS-10453. ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.. Contributed by He Xiaoqiao. 2018-02-12 07:12:02 -08:00
Yiqun Lin 050aa531ba HDFS-13099. RBF: Use the ZooKeeper as the default State Store. Contributed by Yiqun Lin. 
(cherry picked from commit 543f3abbee)
 2018-02-09 14:03:13 +08:00
Xiaoyu Yao 77c6439c33 HDFS-13120. Snapshot diff could be corrupted after concat. Contributed by Xiaoyu Yao. 
(cherry picked from commit 8faf0b50d4)
 2018-02-08 10:20:55 -08:00
Brahma Reddy Battula 3487f2b722 HDFS-12935. Get ambiguous result for DFSAdmin command in HA mode when only one namenode is up. Contributed by Jianfei Jiang. 
(cherry picked from commit 9873eb63a7)
 2018-02-08 18:44:34 +05:30
Yongjun Zhang 1ed6ae7b12 HDFS-13100. Handle IllegalArgumentException when GETSERVERDEFAULTS is not implemented in webhdfs. Contributed by Aaron T. Myers and Yongjun Zhang. 
(cherry picked from commit 4e9a59ce16)
 2018-02-02 23:45:28 -08:00
Yiqun Lin 024127e471 HDFS-13068. RBF: Add router admin option to manage safe mode. Contributed by Yiqun Lin. 
(cherry picked from commit 712e9381d2)
 2018-02-02 17:37:14 +08:00
Inigo Goiri 6769c78cdd HDFS-13043. RBF: Expose the state of the Routers in the federation. Contributed by Inigo Goiri. 
(cherry picked from commit 6ca7204ceb)
 2018-02-01 10:39:25 -08:00
Inigo Goiri 38c3e17117 HDFS-13044. RBF: Add a safe mode for the Router. Contributed by Inigo Goiri. 
(cherry picked from commit 961dcb693d)
 2018-01-31 09:17:40 -08:00
Inigo Goiri ffba476192 HDFS-13083. RBF: Fix doc error setting up client. Contributed by tartarus. 
(cherry picked from commit 5206b2c7ca)
 2018-01-30 18:28:54 -08:00
Kihwal Lee a15df67f65 HDFS-12574. Add CryptoInputStream to WebHdfsFileSystem read call. Contributed by Rushabh S Shah. 
(cherry picked from commit eda786ea12)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestEncryptionZones.java
 2018-01-29 17:57:54 -06:00
Wei Yan 9951c2d04f HDFS-13049. RBF: Inconsistent Router OPTS config in branch-2 and branch-3. Contributed by Wei Yan. 
(cherry picked from commit cefe4b7bb6)
 2018-01-25 12:59:36 -08:00
Yiqun Lin 44cfee9af4 HDFS-13042. RBF: Heartbeat Router State. Contributed by Inigo Goiri. 
(cherry picked from commit 7721fff744)
 2018-01-25 15:55:24 +08:00
Jianfei Jiang 1b5f0e819e
HDFS-13063. Fix the incorrect spelling in HDFSHighAvailabilityWithQJM.md 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit eb2dd08688)
(cherry picked from commit f4656e2150)
 2018-01-25 15:32:36 +09:00
Inigo Goiri a43100adad HDFS-12772. RBF: Federation Router State State Store internal API. Contributed by Inigo Goiri. 
(cherry picked from commit 95743c672e)
 2018-01-23 19:17:47 -08:00
Inigo Goiri 8702882b54 HDFS-13028. RBF: Fix spurious TestRouterRpc#testProxyGetStats. Contributed by Inigo Goiri. 
(cherry picked from commit 130f8bce00)
(cherry picked from commit c6139332f9)
 2018-01-19 09:53:22 -08:00
Vinayakumar B 62b82d7f41 HDFS-9049. Make Datanode Netty reverse proxy port to be configurable. Contributed by Vinayakumar B. 
(cherry picked from commit 09efdfe9e1)
(cherry picked from commit b3eeea0b6e)
 2018-01-17 14:23:33 +05:30
Brahma Reddy Battula 28f69755f1 HDFS-8693. refreshNamenodes does not support adding a new standby to a running DN. Contributed by Ajith S. 
(cherry picked from commit 880b9d24ff)
 2018-01-16 16:33:34 +05:30
Inigo Goiri 6dc0b885a4 HDFS-12802. RBF: Control MountTableResolver cache size. Contrubuted by Inigo Goiri. 
(cherry picked from commit d9006d8a4e)
 2018-01-09 19:02:45 -08:00
Wei Yan 5e8029eff9 HDFS-12945. Switch to ClientProtocol instead of NamenodeProtocols in NamenodeWebHdfsMethods. Contributed by Wei Yan. 
(cherry picked from commit 2ee0d64ace)
 2018-01-08 15:13:53 -08:00
Inigo Goiri c1d48cbda0 HDFS-12988. RBF: Mount table entries not properly updated in the local cache. Contributed by Inigo Goiri. 
(cherry picked from commit 83b513ac6d)
 2018-01-05 09:14:25 -08:00
Tsz-Wo Nicholas Sze f3a92d89f3 HDFS-12347. TestBalancerRPCDelay#testBalancerRPCDelay fails very frequently. Contributed by Bharat Viswanadham 
(cherry picked from commit c7499f2d24)
 2018-01-04 06:48:04 +05:30
Xiao Chen 141cc8ffa2 HADOOP-15056. Fix TestUnbuffer#testUnbufferException failure. Contributed by Jack Bearden. 
(cherry picked from commit 19e0894209)
(cherry picked from commit 1d1401ad38)
(cherry picked from commit 31436a12d5)
 2017-12-29 13:57:55 -08:00
Xiao Chen 52adaa43db HADOOP-15012. Add readahead, dropbehind, and unbuffer to StreamCapabilities. Contributed by John Zhuge. 
(cherry picked from commit c9d48352c2)
 2017-12-29 13:57:55 -08:00
Xiao Chen 947d484d35 HDFS-9023. When NN is not able to identify DN for replication, reason behind it can be logged. 
(cherry picked from commit 50b233d356)
 2017-12-28 11:56:12 -08:00
Yiqun Lin 06cfe4b11b HDFS-12937. RBF: Add more unit tests for router admin commands. Contributed by Yiqun Lin. 
(cherry picked from commit e040c97b77)
 2017-12-19 15:36:28 +08:00
Junping Du c6f5d36ff2 Add 2.8.3 release jdiff files. 
(cherry picked from commit c89f99aade)
 2017-12-18 22:38:26 -08:00
Jason Lowe 605b8560f6 HDFS-12881. Output streams closed with IOUtils suppressing write errors. Contributed by Ajay Kumar 
(cherry picked from commit 9ae8d1a8de)
 2017-12-15 14:49:43 -06:00
Yiqun Lin c629f33761 HDFS-12895. RBF: Add ACL support for mount table. Contributed by Yiqun Lin. 
(cherry picked from commit ee028bfdf1)
 2017-12-15 14:14:42 +08:00
Kihwal Lee 43b9fbc2b4 HDFS-12907. Allow read-only access to reserved raw for non-superusers. Contributed by Rushabh S Shah. 
(cherry picked from commit 08a50da95f)
 2017-12-14 15:06:04 -06:00
Yiqun Lin 053a6fc126 HDFS-12883. RBF: Document Router and State Store metrics. Contributed by Yiqun Lin. 
(cherry picked from commit 91c96bdf8e)
 2017-12-14 16:04:31 +08:00
Inigo Goiri 118d653eea HDFS-12875. RBF: Complete logic for -readonly option of dfsrouteradmin add command. Contributed by Inigo Goiri. 
(cherry picked from commit 5cd1056ad7)
 2017-12-11 15:17:49 -08:00
Chris Douglas ae3dc443f4 HDFS-11576. Block recovery will fail indefinitely if recovery time > heartbeat interval. Contributed by Lukas Majercak 
(cherry picked from commit afc606c3aa)
 2017-12-07 00:47:02 -08:00
Akira Ajisaka 89314b78dd
HDFS-12889. Addendum patch to add missing file. 
(cherry picked from commit 6cca5b3bcb)
(cherry picked from commit 046424cf8a)
 2017-12-07 13:25:02 +09:00
Akira Ajisaka 7fd6407886
HDFS-12889. Router UI is missing robots.txt file. Contributed by Bharat Viswanadham. 
(cherry picked from commit 44b06d34a5)
(cherry picked from commit 4e92b1e89e)
 2017-12-06 11:43:08 +09:00
Xiao Chen 55df9df9fb HDFS-12396. Webhdfs file system should get delegation token from kms provider. Contributed by Rushabh S Shah. 
(cherry picked from commit 274bbb193f)
 2017-12-04 10:45:30 -08:00
Konstantin V Shvachko 0f5ec01ef7 HDFS-12638. Delete copy-on-truncate block along with the original block, when deleting a file being truncated. Contributed by Konstantin Shvachko. 
(cherry picked from commit 60fd0d7fd7)
 2017-11-30 18:28:18 -08:00
Kihwal Lee 7d2b13f0be HDFS-11754. Make FsServerDefaults cache configurable. Contributed by Mikhail Erofeev. 
(cherry picked from commit 53509f295b)
 2017-11-29 15:16:17 -06:00
Wei Yan 5e31b109c6 HDFS-12835. Fix the javadoc errors in Router-based federation. 
(cherry picked from commit 301641811d)
 2017-11-29 09:49:51 -08:00
Konstantin V Shvachko 3f9f0055eb HDFS-12832. INode.getFullPathName may throw ArrayIndexOutOfBoundsException lead to NameNode exit. Contribuited by Konstantin Shvachko. 
(cherry picked from commit d331762f24)
 2017-11-28 18:11:38 -08:00
Yiqun Lin 83c40758fa HDFS-12858. RBF: Add router admin commands usage in HDFS commands reference doc. Contributed by Yiqun Lin. 
(cherry picked from commit 3d73d2f097)
 2017-11-28 13:46:02 +08:00
Kihwal Lee 3516ef45f3 HDFS-12754. Lease renewal can hit a deadlock. Contributed by Kuhu Shukla. 
(cherry picked from commit 45f59bde60)
 2017-11-27 17:01:34 -06:00
Inigo Goiri ee267565b5 HDFS-12801. RBF: Set MountTableResolver as default file resolver. Contributed by Inigo Goiri. 
(cherry picked from commit e182e77794)
 2017-11-17 10:06:46 -08:00
John Zhuge 120d868963 HDFS-12318. Fix IOException condition for openInfo in DFSInputStream. Contributed by legend. 
(cherry picked from commit 3123895db0)
 2017-11-09 09:18:53 -08:00
Brahma Reddy Battula ce027c6f48 HDFS-12788. Reset the upload button when file upload fails. Contributed by Brahma Reddy Battula 
(cherry picked from commit 410d0319cf)
 2017-11-08 14:46:27 +05:30
Arun Suresh bb6a1aa5fa Preparing for 2.9.1 development 2017-11-02 22:49:38 -07:00
Weiwei Yang 3555397179 HDFS-12744. More logs when short-circuit read is failed and disabled. Contributed by Weiwei Yang. 
(cherry picked from commit 56b88b0670)
(cherry picked from commit 0f20434e18)
 2017-11-01 18:13:28 -07:00
Inigo Goiri 15b839c446 HDFS-12699. TestMountTable fails with Java 7. Contributed by Inigo Goiri. 
(cherry picked from commit 982bd2a5bf)
 2017-10-31 10:24:12 -07:00
Chris Douglas 9e721775a4 HADOOP-14986. Enforce JDK limitations. 
(cherry picked from commit b50def3697)
(cherry picked from commit 1660a638f0)
 2017-10-27 21:42:42 -07:00
Arpit Agarwal 8f28af4fac HDFS-9914. Fix configurable WebhDFS connect/read timeout. Contributed by Xiaoyu Yao. 2017-10-27 07:45:11 -07:00