Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
17,736 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

17736 Commits

Author SHA1 Message Date
Weiwei Yang 4e105a4b9b YARN-8729. Node status updater thread could be lost after it is restarted. Contributed by Tao Yang. 
(cherry picked from commit 39c1ea1ed4)
 2018-09-13 23:18:16 +08:00
Brahma Reddy Battula 0c8aab690c HDFS-13902. Add JMX, conf and stacks menus to the datanode page. Contributed by fengchuang. 
(cherry picked from commit b2432d254c)
 2018-09-12 06:35:29 +05:30
Xiao Chen a5da4df73c HDFS-13051. Fix dead lock during async editlog rolling if edit queue is full. Contributed by Daryn Sharp. 
(cherry picked from commit 8e54da1511)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestEditLogRace.java

(cherry picked from commit 2dd27c999b)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestEditLogRace.java
 2018-09-10 23:00:41 -07:00
Eric E Payne 48dc8de28b YARN-8709: CS preemption monitor always fails since one under-served queue was deleted. Contributed by Tao Yang. 
(cherry picked from commit 987d8191ad)
 2018-09-10 20:18:14 +00:00
Giovanni Matteo Fumarola 37032a3aca HADOOP-15731. TestDistributedShell fails on Windows. Contributed by Botong Huang. 2018-09-07 16:37:15 -07:00
Inigo Goiri a9392bdb17 HDFS-13836. RBF: Handle mount table znode with null value. Contributed by yanghuafeng. 
(cherry picked from commit 527288ef89)
 2018-09-06 16:49:14 -07:00
Jason Lowe 09e1851b0d MAPREDUCE-7131. Job History Server has race condition where it moves files from intermediate to finished but thinks file is in intermediate. Contributed by Anthony Hsu 
(cherry picked from commit eb0b5a844f)
 2018-09-06 15:14:38 -05:00
Wei-Chiu Chuang e99ed05444 HADOOP-15696. KMS performance regression due to too many open file descriptors after Jetty migration. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit e780556ae9)

Conflicts:
	hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/http/TestHttpServer.java

(cherry picked from commit d1ea7df43d)
 2018-09-05 10:18:56 -07:00
Steve Loughran 9ee9d68e4b HADOOP-10219. ipc.Client.setupIOstreams() needs to check for ClientCache.stopClient requested shutdowns. 
Contributed by Kihwal Lee and Lukas Majercak.

(cherry picked from commit 9e96ac666d)
(cherry picked from commit 142d878c90)
 2018-09-04 22:25:24 -07:00
Hrishikesh Gadre 25337c045a HDFS-13812. Fix the inconsistent default refresh interval on Caching documentation. Contributed by Hrishikesh Gadre. 
Signed-off-by: Xiao Chen <xiao@apache.org>
(cherry picked from commit 6ccb809c2d)
 2018-09-04 21:54:56 -07:00
Inigo Goiri 54d3189cfa HDFS-13857. RBF: Choose to enable the default nameservice to read/write files. Contributed by yanghuafeng. 
(cherry picked from commit 54f2044595)
 2018-09-04 12:18:08 -07:00
bibinchundatt 5514f02a73 YARN-8535. Fix DistributedShell unit tests. Contributed by Abhishek Modi. 
(cherry picked from commit eed8415dc1)
 2018-09-02 13:39:26 +05:30
Wei-Chiu Chuang d06717ef94 Revert "HDFS-13838. WebHdfsFileSystem.getFileStatus() won't return correct "snapshot enabled" status. Contributed by Siyao Meng." 
This reverts commit d89a485b25.
 2018-08-30 11:59:39 -07:00
Vinayakumar B 67a5491962 HDFS-13027. Handle possible NPEs due to deleted blocks in race condition. Contributed by Vinayakumar B. 
(cherry picked from commit 65977e5d81)
 2018-08-30 22:17:00 +05:30
Daniel Templeton 9a02c4ff65 HADOOP-15706. Typo in compatibility doc: SHOUD -> SHOULD 
(Contributed by Laszlo Kollar via Daniel Templeton)

Change-Id: I6e2459d0700df7f3bad4eac8297a11690191c3ba
(cherry picked from commit f2c2a68ec2)
(cherry picked from commit 68301ad7d3)
 2018-08-30 09:15:25 -07:00
Kitti Nanasi fa32269cee HADOOP-15698. KMS log4j is not initialized properly at startup. Contributed by Kitti Nanasi. 
(cherry picked from commit 781437c219)
 2018-08-29 22:09:13 -07:00
Yiqun Lin 6a547856ef HDFS-13863. FsDatasetImpl should log DiskOutOfSpaceException. Contributed by Fei Hui. 
(cherry picked from commit 582cb10ec7)
 2018-08-30 11:24:25 +08:00
Daniel Templeton fbaa11ef4c HADOOP-15705. Typo in the definition of "stable" in the interface classification 
Change-Id: I3eae2143400a534903db4f186400561fc8d2bd56
(cherry picked from commit d53a10b0a5)
(cherry picked from commit 90c8cca783)
 2018-08-29 14:01:19 -07:00
Brahma Reddy Battula 3b01279612 HDFS-13854. RBF: The ProcessingAvgTime and ProxyAvgTime should display by JMX with ms unit. Contributed by yanghuafeng. 
(cherry picked from commit 64ad0298d4)
 2018-08-29 08:32:05 +05:30
Wei-Chiu Chuang 72e1e1904b HDFS-13831. Make block increment deletion number configurable. Contributed by Ryan Wu. 2018-08-28 16:36:30 -07:00
Zsolt Venczel 2d1f819979 HDFS-13731. ReencryptionUpdater fails with ConcurrentModificationException during processCheckpoints. Contributed by Zsolt Venczel. 
(cherry picked from commit 3e18b957eb)
 2018-08-28 15:14:57 -07:00
Wei-Chiu Chuang d89a485b25 HDFS-13838. WebHdfsFileSystem.getFileStatus() won't return correct "snapshot enabled" status. Contributed by Siyao Meng. 
(cherry picked from commit 26c2a97c56)
(cherry picked from commit 41732e7b28)
 2018-08-27 16:04:16 -07:00
John Zhuge 2260718e24
HADOOP-15633. fs.TrashPolicyDefault: Can't create trash directory. Contributed by Fei Hui. 
(cherry picked from commit f9c6fd9471)
 2018-08-27 15:22:19 -07:00
Weiwei Yang fdecbd94c1 YARN-8719. Typo correction for yarn configuration in OpportunisticContainers(federation) docs. Contributed by Y. SREENIVASULU REDDY. 
(cherry picked from commit e8b063f630)
 2018-08-28 01:10:47 +08:00
Konstantin V Shvachko 27abdb390b HDFS-13848. Refactor NameNode failover proxy providers. Contributed by Konstantin Shvachko. 
(cherry picked from commit a4121c71c2)
 2018-08-24 18:51:42 -07:00
Haibo Chen 49590e7c6b YARN-8051. TestRMEmbeddedElector#testCallbackSynchronization is flaky. (Robert Kanter via Haibo Chen) 
(cherry picked from commit 93d47a0ed5)
 2018-08-24 13:27:54 -05:00
Inigo Goiri c3ba06deeb YARN-7773. YARN Federation used Mysql as state store throw exception, Unknown column 'homeSubCluster' in 'field list'. Contributed by Yiran Wu. 
(cherry picked from commit 60e5c1b516)
 2018-08-24 14:26:52 +05:30
Jason Lowe 79ebbec4c8 YARN-8649. NPE in localizer hearbeat processing if a container is killed while localizing. Contributed by lujie 
(cherry picked from commit 585ebd873a)
 2018-08-23 09:40:42 -05:00
Takanobu Asanuma cd8ac03357 HADOOP-14314. The OpenSolaris taxonomy link is dead in InterfaceClassification.md. Contributed by Rui Gao. 
(cherry picked from commit bed8cb6979)
 2018-08-23 21:55:55 +09:00
Yiqun Lin 4ef3025964 HDFS-13821. RBF: Add dfs.federation.router.mount-table.cache.enable so that users can disable cache. Contributed by Fei Hui. 2018-08-22 13:01:13 +08:00
Wei-Chiu Chuang bd46906bd8 HDFS-10240. Race between close/recoverLease leads to missing block. Contributed by Jinglun, zhouyingchao and Wei-Chiu Chuang. 
(cherry picked from commit 865650052b)
 2018-08-21 15:44:08 -07:00
Rohith Sharma K S 7278566f27 YARN-8129. Improve error message for invalid value in fields attribute. Contributed by Abhishek Modi. 
(cherry picked from commit d3fef7a5c5)
 2018-08-21 12:11:32 +05:30
Steve Loughran 53ce37ad29
HADOOP-15679. ShutdownHookManager shutdown time needs to be configurable & extended. Contributed by Steve Loughran. 
Change-Id: Ifd4a6e3f796b4dc88e97f63066289e2534c77a29
(cherry picked from commit 95fcdc0435)
 2018-08-20 19:18:37 -07:00
Yiqun Lin 5e2e68d4bb HDFS-13750. RBF: Router ID in RouterRpcClient is always null. Contributed by Takanobu Asanuma. 
(cherry picked from commit 01ff817814)
 2018-08-20 23:03:19 +08:00
Rohith Sharma K S 675aa2bbc0 YARN-8679. [ATSv2] If HBase cluster is down for long time, high chances that NM ContainerManager dispatcher get blocked. Contributed by Wangda Tan. 
(cherry picked from commit 4aacbfff60)
 2018-08-18 11:06:14 +05:30
Haibo Chen 8118b14db8 YARN-7835. Race condition in NM while publishing events if second attempt is launched on the same node. (Rohith Sharma K S via Haibo Chen) 
(cherry picked from commit d1274c3b71)
 2018-08-18 11:06:02 +05:30
Xiao Chen a41f18098b HADOOP-15674. Test failure TestSSLHttpServer.testExcludedCiphers with TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256 cipher suite. Contributed by Szilard Nemeth. 
(cherry picked from commit 8d7c93186e)
 2018-08-17 10:20:20 -07:00
Xiao Chen 185c8f2abc HDFS-13747. Statistic for list_located_status is incremented incorrectly by listStatusIterator. Contributed by Antal Mihalyi. 
(cherry picked from commit c67b0650ea)
 2018-08-16 23:15:58 -07:00
Rohith Sharma K S 90bf2d3b52 YARN-8612. Fix NM Collector Service Port issue in YarnConfiguration. Contributed by Prabha Manepalli. 
(cherry picked from commit 1697a02306)
 2018-08-17 11:14:10 +05:30
Daniel Templeton 27508086de HDFS-13746. Still occasional "Should be different group" failure in TestRefreshUserMappings#testGroupMappingRefresh 
(Contributed by Siyao Meng via Daniel Templeton)

Change-Id: I9fad1537ace38367a463d9fe67aaa28d3178fc69
(cherry picked from commit 8512e1a91b)
(cherry picked from commit fbedf89377)
 2018-08-16 15:02:18 -07:00
Weiwei Yang 8c0cecb034 YARN-8614. Fix few annotation typos in YarnConfiguration. Contributed by Sen Zhao. 
(cherry picked from commit 8dc07b4723)
 2018-08-15 13:37:21 +08:00
Xiao Chen 5d16301ad9 HDFS-13788. Update EC documentation about rack fault tolerance. Contributed by Kitti Nanasi. 
(cherry picked from commit cede33997f)
 2018-08-14 11:59:05 -07:00
Wei-Chiu Chuang 6f2a46578f HDFS-13758. DatanodeManager should throw exception if it has BlockRecoveryCommand but the block is not under construction. Contributed by chencan. 
(cherry picked from commit 61a9b4f58b)
(cherry picked from commit 7a115e8de4)
 2018-08-14 11:52:55 -07:00
Robert Kanter fd63be750a YARN-8568. Replace the deprecated zk-address property in the HA config example in ResourceManagerHA.md (bsteinbach via rkanter) 
(cherry picked from commit 8478732bb2)
 2018-08-14 10:16:44 -07:00
Jason Lowe c72674ee3c YARN-8640. Restore previous state in container-executor after failure. Contributed by Jim Brennan 
(cherry picked from commit d1d129aa9d)
 2018-08-14 10:29:58 -05:00
Wei-Chiu Chuang d502abe947 HDFS-13738. fsck -list-corruptfileblocks has infinite loop if user is not privileged. Contributed by Yuen-Kuei Hsueh. 
(cherry picked from commit 4023eeba05)
(cherry picked from commit 74d4fd975a)
 2018-08-13 17:37:36 -07:00
Wei-Chiu Chuang 4b606eb9fd HDFS-13813. Exit NameNode if dangling child inode is detected when saving FsImage. Contributed by Siyao Meng. 
(cherry picked from commit 23854443ef)
(cherry picked from commit b38649c59a)
 2018-08-13 16:14:01 -07:00
Vinayakumar B eecfbaff3b HDFS-13786. EC: Display erasure coding policy for sub-directories is not working. Contributed by Ayush Saxena. 
(cherry picked from commit 2b0f977241)
 2018-08-13 13:58:37 -07:00
Chen Liang 2d985b6c81 HDFS-13735. Make QJM HTTP URL connection timeout configurable. Contributed by Chao Sun. 2018-08-13 12:47:17 -07:00
Xiao Chen 7730a85233 HADOOP-15638. KMS Accept Queue Size default changed from 500 to 128 in Hadoop 3.x. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit b94c8874e2)
 2018-08-13 10:41:14 -07:00