Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
14,279 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

4761 Commits

Author SHA1 Message Date
Kihwal Lee b725fd6924 xattr api cleanup 
(cherry picked from commit da59acd8ca)
 2018-02-15 11:28:45 -06:00
Brahma Reddy Battula 24af0bc144 HDFS-8693. Addendum patch to execute the command using UGI. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 35c17351ca)
 2018-02-12 22:25:44 +05:30
Arpit Agarwal 82530c966a HDFS-10453. ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.. Contributed by He Xiaoqiao. 2018-02-12 07:02:42 -08:00
Yiqun Lin d49074f0a2 HDFS-13099. RBF: Use the ZooKeeper as the default State Store. Contributed by Yiqun Lin. 
(cherry picked from commit 543f3abbee)
 2018-02-09 14:00:55 +08:00
Brahma Reddy Battula 9873eb63a7 HDFS-12935. Get ambiguous result for DFSAdmin command in HA mode when only one namenode is up. Contributed by Jianfei Jiang. 2018-02-08 18:33:11 +05:30
Yongjun Zhang b7f7fb003e HDFS-13115. In getNumUnderConstructionBlocks(), ignore the inodeIds for which the inodes have been deleted. Contributed by Yongjun Zhang. 
(cherry picked from commit f491f717e9)

Conflicts:

	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/LeaseManager.java
(cherry picked from commit 60d82ac61f)
 2018-02-07 15:35:41 -08:00
Yongjun Zhang 6dfea05049 HDFS-13100. Handle IllegalArgumentException when GETSERVERDEFAULTS is not implemented in webhdfs. Contributed by Aaron T. Myers and Yongjun Zhang. 
(cherry picked from commit 4e9a59ce16)
 2018-02-02 23:33:10 -08:00
Yiqun Lin 7cd3770fee HDFS-13068. RBF: Add router admin option to manage safe mode. Contributed by Yiqun Lin. 
(cherry picked from commit b0627c891b)
 2018-02-02 17:38:32 +08:00
Inigo Goiri 7b8cc048cc HDFS-13043. RBF: Expose the state of the Routers in the federation. Contributed by Inigo Goiri. 
(cherry picked from commit 6ca7204ceb)
 2018-02-01 10:38:39 -08:00
Yiqun Lin e5cac88c82 HDFS-13044. RBF: Add a safe mode for the Router. Contributed by Inigo Goiri. 
(cherry picked from commit dbb9dded33)
 2018-01-31 09:14:31 -08:00
Weiwei Yang 0c2c4c20cb HDFS-12528. Add an option to not disable short-circuit reads on failures. Contributed by Xiao Chen. 
(cherry picked from commit 2e7331ca26)
 2018-01-30 21:40:07 -08:00
Inigo Goiri fffa7dc377 HDFS-13083. RBF: Fix doc error setting up client. Contributed by tartarus. 
(cherry picked from commit 5206b2c7ca)
 2018-01-30 18:28:21 -08:00
Kihwal Lee eda786ea12 HDFS-12574. Add CryptoInputStream to WebHdfsFileSystem read call. Contributed by Rushabh S Shah. 2018-01-29 17:52:04 -06:00
Xiao Chen 0922ea0aaf HDFS-12974. Exception message is not printed when creating an encryption zone fails with AuthorizationException. Contributed by fang zhenyi. 
(cherry picked from commit b63dcd583f)
(cherry picked from commit 75be15cf02)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/EncryptionFaultInjector.java
 2018-01-28 22:30:14 -08:00
Arpit Agarwal 7be5a46a41 HDFS-13054. Handling PathIsNotEmptyDirectoryException in DFSClient delete call. Contributed by Nanda kumar. 2018-01-26 11:45:36 -08:00
Wei Yan cefe4b7bb6 HDFS-13049. RBF: Inconsistent Router OPTS config in branch-2 and branch-3. Contributed by Wei Yan. 2018-01-25 12:58:16 -08:00
Yiqun Lin 9ce24d2d50 HDFS-13042. RBF: Heartbeat Router State. Contributed by Inigo Goiri. 
(cherry picked from commit 7721fff744)
 2018-01-25 15:54:20 +08:00
Jianfei Jiang f4656e2150
HDFS-13063. Fix the incorrect spelling in HDFSHighAvailabilityWithQJM.md 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit eb2dd08688)
 2018-01-25 15:32:13 +09:00
Inigo Goiri 1534936ac1 HDFS-12772. RBF: Federation Router State State Store internal API. Contributed by Inigo Goiri. 
(cherry picked from commit 95743c672e)
 2018-01-23 19:17:22 -08:00
Inigo Goiri c6139332f9 HDFS-13028. RBF: Fix spurious TestRouterRpc#testProxyGetStats. Contributed by Inigo Goiri. 
(cherry picked from commit 130f8bce00)
 2018-01-19 09:52:29 -08:00
Yiqun Lin 65507053b4 HDFS-12973. RBF: Document global quota supporting in federation. Contributed by Yiqun Lin. 
(cherry picked from commit 9e4f52d323)
 2018-01-19 14:21:07 +08:00
Vinayakumar B b3eeea0b6e HDFS-9049. Make Datanode Netty reverse proxy port to be configurable. Contributed by Vinayakumar B. 
(cherry picked from commit 09efdfe9e1)
 2018-01-17 14:22:29 +05:30
Brahma Reddy Battula 8e7ce0eb4c HDFS-8693. refreshNamenodes does not support adding a new standby to a running DN. Contributed by Ajith S. 
(cherry picked from commit 880b9d24ff)
 2018-01-16 16:29:13 +05:30
Yiqun Lin e5612f0389 HDFS-12972. RBF: Display mount table quota info in Web UI and admin command. Contributed by Yiqun Lin. 
(cherry picked from commit 9afb8025d6)
 2018-01-13 13:20:07 +08:00
Wei-Chiu Chuang 2273499aef HDFS-11915. Sync rbw dir on the first hsync() to avoid file lost on power failure. Contributed by Vinayakumar B. 2018-01-12 10:01:57 -08:00
Yiqun Lin 66d58d2b9a HDFS-12934. RBF: Federation supports global quota. Contributed by Yiqun Lin. 2018-01-10 19:48:47 +08:00
Inigo Goiri 215a3d800a HDFS-12802. RBF: Control MountTableResolver cache size. Contrubuted by Inigo Goiri. 
(cherry picked from commit d9006d8a4e)
 2018-01-09 19:01:10 -08:00
Manoj Govindassamy eadd3cecf9 HDFS-12985. NameNode crashes during restart after an OpenForWrite file present in the Snapshot got deleted. 2018-01-08 16:21:21 -08:00
Wei Yan 223bb935e2 HDFS-12945. Switch to ClientProtocol instead of NamenodeProtocols in NamenodeWebHdfsMethods. Contributed by Wei Yan. 
(cherry picked from commit 2ee0d64ace)
 2018-01-08 15:23:57 -08:00
Inigo Goiri f7fedac6cd HDFS-12988. RBF: Mount table entries not properly updated in the local cache. Contributed by Inigo Goiri. 
(cherry picked from commit 83b513ac6d)
 2018-01-05 09:13:52 -08:00
Xiao Chen 50b233d356 HDFS-9023. When NN is not able to identify DN for replication, reason behind it can be logged. 2017-12-28 11:55:24 -08:00
Yiqun Lin df3212aad5 HDFS-12937. RBF: Add more unit tests for router admin commands. Contributed by Yiqun Lin. 
(cherry picked from commit e040c97b77)
 2017-12-19 15:35:40 +08:00
Tsz-Wo Nicholas Sze c4e58ea823 HDFS-12347. TestBalancerRPCDelay#testBalancerRPCDelay fails very frequently. Contributed by Bharat Viswanadham 2017-12-19 10:04:00 +08:00
Erik Krogen da4e2f38e1 HDFS-12818. Support multiple storages in DataNodeCluster / SimulatedFSDataset. Contributed by Erik Krogen. 
(cherry picked from commit 94576b17fb)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/SimulatedFSDataset.java
 2017-12-18 12:23:20 -08:00
Jason Lowe 9ae8d1a8de HDFS-12881. Output streams closed with IOUtils suppressing write errors. Contributed by Ajay Kumar 2017-12-15 14:47:54 -06:00
Yiqun Lin 24c4d2a7a2 HDFS-12895. RBF: Add ACL support for mount table. Contributed by Yiqun Lin. 
(cherry picked from commit ee028bfdf1)
 2017-12-15 14:13:54 +08:00
Kihwal Lee 08a50da95f HDFS-12907. Allow read-only access to reserved raw for non-superusers. Contributed by Rushabh S Shah. 2017-12-14 15:03:47 -06:00
Yiqun Lin 22bc62058b HDFS-12883. RBF: Document Router and State Store metrics. Contributed by Yiqun Lin. 
(cherry picked from commit 91c96bdf8e)
 2017-12-14 16:03:34 +08:00
Inigo Goiri 67c2826941 HDFS-12875. RBF: Complete logic for -readonly option of dfsrouteradmin add command. Contributed by Inigo Goiri. 
(cherry picked from commit 5cd1056ad7)
 2017-12-11 15:17:17 -08:00
Xiao Chen 31436a12d5 HADOOP-15056. Fix TestUnbuffer#testUnbufferException failure. Contributed by Jack Bearden. 
(cherry picked from commit 19e0894209)
(cherry picked from commit 1d1401ad38)
 2017-12-07 21:20:33 -08:00
Xiao Chen c9d48352c2 HADOOP-15012. Add readahead, dropbehind, and unbuffer to StreamCapabilities. Contributed by John Zhuge. 2017-12-07 21:20:33 -08:00
Chris Douglas afc606c3aa HDFS-11576. Block recovery will fail indefinitely if recovery time > heartbeat interval. Contributed by Lukas Majercak 2017-12-07 00:43:21 -08:00
Akira Ajisaka 046424cf8a
HDFS-12889. Addendum patch to add missing file. 
(cherry picked from commit 6cca5b3bcb)
 2017-12-07 13:24:45 +09:00
Akira Ajisaka 4e92b1e89e
HDFS-12889. Router UI is missing robots.txt file. Contributed by Bharat Viswanadham. 
(cherry picked from commit 44b06d34a5)
 2017-12-06 11:42:51 +09:00
Brahma Reddy Battula ceb4043ae1 HDFS-11751. DFSZKFailoverController daemon exits with wrong status code. Contributed by Bharat Viswanadham 
(cherry picked from commit 6d16a99ae8)
 2017-12-05 20:01:33 +05:30
Xiao Chen 274bbb193f HDFS-12396. Webhdfs file system should get delegation token from kms provider. Contributed by Rushabh S Shah. 2017-12-04 10:40:22 -08:00
Konstantin V Shvachko 3c57defaa4 HDFS-12638. Delete copy-on-truncate block along with the original block, when deleting a file being truncated. Contributed by Konstantin Shvachko. 
(cherry picked from commit 60fd0d7fd7)
 2017-11-30 19:26:18 -08:00
Kihwal Lee 6fd9d11173 HDFS-11754. Make FsServerDefaults cache configurable. Contributed by Mikhail Erofeev. 
(cherry picked from commit 53509f295b)
 2017-11-29 15:15:41 -06:00
Wei Yan 9452cac210 HDFS-12835. Fix the javadoc errors in Router-based federation. 
(cherry picked from commit 301641811d)
 2017-11-29 10:12:15 -08:00
Konstantin V Shvachko 9d406e5dc8 HDFS-12832. INode.getFullPathName may throw ArrayIndexOutOfBoundsException lead to NameNode exit. Contribuited by Konstantin Shvachko. 
(cherry picked from commit d331762f24)
 2017-11-28 17:52:08 -08:00