Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
19,051 Commits 326 Branches 371 Tags
Commit Graph

19051 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Sunil G
8dccc4ef12 YARN-8726. [UI2] YARN UI2 is not accessible when config.env file failed to load. Contributed by Akhil PB. 
(cherry picked from commit 0cc6e039454127984a3aa5b2ba5d9151e4a72dd4)
 2018-09-18 12:32:30 +05:30
Inigo Goiri
508fd55c79 HDFS-13844. Fix the fmt_bytes function in the dfs-dust.js. Contributed by yanghuafeng. 
(cherry picked from commit a9c1c55cafc0338bb35d2991f217d4157463f1d3)
 2018-09-17 14:38:08 -07:00
Weiwei Yang
f0e5651cf4 YARN-8782. Fix exception message in Resource.throwExceptionWhenArrayOutOfBound. Contributed by Gergely Pollak. 
(cherry picked from commit 9a265fa673ef1b8774cfd69c76cdd29bf344e79d)
 2018-09-17 22:26:09 +08:00
Weiwei Yang
00a469138d YARN-8720. CapacityScheduler does not enforce max resource allocation check at queue level. Contributed by Tarun Parimi. 
(cherry picked from commit f1a893fdbc2dbe949cae786f08bdb2651b88d673)
 2018-09-14 16:40:35 +08:00
Brahma Reddy Battula
c7973292bb HADOOP-15733. Correct the log when Invalid emptier Interval configured. Contributed by Ayush Saxena 
(cherry picked from commit ef5c776a42697fb3958a77646b759e2a6edfe48e)
 2018-09-14 07:33:24 +05:30
Wei-Chiu Chuang
829399a9f3 HDFS-13838. WebHdfsFileSystem.getFileStatus() won't return correct "snapshot enabled" status. Contributed by Siyao Meng. 
(cherry picked from commit a1de8cbac5fb9af403db2a02814575f0940d5f39)
 2018-09-14 05:24:24 +08:00
Jason Lowe
1105f54634 MAPREDUCE-7133. History Server task attempts REST API returns invalid data. Contributed by Oleksandr Shevchenko 
(cherry picked from commit 2886024ac3a8613ecc27f1595b278ce6fc2d03ba)
 2018-09-13 14:43:17 -05:00
Jason Lowe
88687213cc YARN-8680. YARN NM: Implement Iterable Abstraction for LocalResourceTracker state. Contributed by Pradeep Ambati 
(cherry picked from commit 250b50018e8c94d8ca83ff981b01f26bb68c0842)
 2018-09-13 14:12:20 -05:00
Inigo Goiri
2f7d226589 HDFS-13914. Fix DN UI logs link broken when https is enabled after HDFS-13902. Contributed by Jianfei Jiang. 
(cherry picked from commit e1b242a9844d6438c93cdc2ab2443d042b4d5aea)
 2018-09-13 09:17:37 -07:00
Weiwei Yang
a7b1d1e006 YARN-8729. Node status updater thread could be lost after it is restarted. Contributed by Tao Yang. 
(cherry picked from commit 39c1ea1ed454b6c61f0985fc951f20913ed964fb)
 2018-09-13 23:16:52 +08:00
Sunil G
c879ca38de YARN-8630. ATSv2 REST APIs should honor filter-entity-list-by-user in non-secure cluster when ACls are enabled. Contributed by Rohith Sharma K S. 
(cherry picked from commit f4bda5e8e9fee6c5a0dda7c79ef14e73aec20e7e)
 2018-09-13 17:48:01 +05:30
Brahma Reddy Battula
74c00641f9 HDFS-13902. Add JMX, conf and stacks menus to the datanode page. Contributed by fengchuang. 
(cherry picked from commit b2432d254c486d0e360b76b7b094a71a011678ab)
 2018-09-12 06:34:35 +05:30
Xiao Chen
2dd27c999b HDFS-13051. Fix dead lock during async editlog rolling if edit queue is full. Contributed by Daryn Sharp. 
(cherry picked from commit 8e54da1511e78477c1d4655d5ff0a69d0330869f)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestEditLogRace.java
 2018-09-10 22:44:48 -07:00
Brahma Reddy Battula
77dd456461 HDFS-13237. [Documentation] RBF: Mount points across multiple subclusters. Contributed Íñigo Goiri 
(cherry picked from commit 96892c469b16c5aaff1b7c42f66f820344256bc2)
 2018-09-11 10:13:35 +05:30
Eric E Payne
b6bc0f409a YARN-8709: CS preemption monitor always fails since one under-served queue was deleted. Contributed by Tao Yang. 
(cherry picked from commit 987d8191ad409298570f7ef981e9bc8fb72ff16c)
 2018-09-10 20:02:39 +00:00
Steve Loughran
1c2c0ed209
HADOOP-15677. WASB: Add support for StreamCapabilities. 
Contributed by Thomas Marquardt.

(cherry picked from commit 1eef0acfe5725d08d3a4eb76c5138076ff1857f1)
 2018-09-10 14:25:42 +01:00
Vinayakumar B
b8eaeca7e6 HDFS-13895. EC: Fix Intermittent Failure in TestDFSStripedOutputStreamWithFailureWithRandomECPolicy. Contributed by Ayush Saxena. 
(cherry picked from commit eef3bafae8bc0fd31506637cd131599ec97f362f)
 2018-09-10 09:24:08 +05:30
Brahma Reddy Battula
cbcdaefa37 HDFS-13862. RBF: Router logs are not capturing few of the dfsrouteradmin commands. Contributed by Ayush Saxena 
(cherry picked from commit 8944407d938bb8e38c7182a68b4b64d1a7c778ca)
 2018-09-09 23:21:45 +05:30
Eric Yang
0b97dc5869 YARN-8751. Reduce conditions that mark node manager as unhealthy. 
Contributed by Craig Condit

(cherry picked from commit 7d623343879ce9a8f8e64601024d018efc02794c)
 2018-09-07 20:32:11 -04:00
Giovanni Matteo Fumarola
7fed1a07ab HADOOP-15731. TestDistributedShell fails on Windows. Contributed by Botong Huang. 2018-09-07 16:37:03 -07:00
Inigo Goiri
a400ed3aab HDFS-13836. RBF: Handle mount table znode with null value. Contributed by yanghuafeng. 
(cherry picked from commit 527288ef891dc26019d003bd85ddfd50eb4f3b7b)
 2018-09-06 16:48:44 -07:00
Jason Lowe
4a55092c6d MAPREDUCE-7131. Job History Server has race condition where it moves files from intermediate to finished but thinks file is in intermediate. Contributed by Anthony Hsu 
(cherry picked from commit eb0b5a844f960017f6f48d746174d0f5826f0e5f)
 2018-09-06 14:29:51 -05:00
Wei-Chiu Chuang
d1ea7df43d HADOOP-15696. KMS performance regression due to too many open file descriptors after Jetty migration. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit e780556ae9229fe7a90817eb4e5449d7eed35dd8)

Conflicts:
	hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/http/TestHttpServer.java
 2018-09-05 10:17:58 -07:00
Yiqun Lin
c898757f55 HDFS-13815. RBF: Add check to order command. Contributed by Ranith Sardar. 
(cherry picked from commit 9315db5f5da09c2ef86be168465c16932afa2d85)
 2018-09-05 23:35:30 +08:00
Shane Kumpf
2d68708a1d YARN-8638. Allow linux container runtimes to be pluggable. Contributed by Craig Condit 
(cherry picked from commit dffb7bfe6cd2292162f08ec0bded736bc5194c3f)
 2018-09-05 06:55:25 -06:00
Hrishikesh Gadre
fde3b5ac22 HDFS-13812. Fix the inconsistent default refresh interval on Caching documentation. Contributed by Hrishikesh Gadre. 
Signed-off-by: Xiao Chen <xiao@apache.org>
(cherry picked from commit 6ccb809c2d38a45e716153ba16e135cb76167b2b)
 2018-09-04 21:54:43 -07:00
Inigo Goiri
a26565960a HDFS-13857. RBF: Choose to enable the default nameservice to read/write files. Contributed by yanghuafeng. 
(cherry picked from commit 54f2044595206455484284b43e5976c8a1982aaf)
 2018-09-04 12:17:49 -07:00
Steve Loughran
142d878c90 HADOOP-10219. ipc.Client.setupIOstreams() needs to check for ClientCache.stopClient requested shutdowns. 
Contributed by Kihwal Lee and Lukas Majercak.

(cherry picked from commit 9e96ac666d783376a8cdea9c3cc84098c5bdcb56)
 2018-09-04 12:00:31 -07:00
Vinayakumar B
9cf35d99b9 HDFS-13774. EC: 'hdfs ec -getPolicy' is not retrieving policy details when the special REPLICATION policy set on the directory. Contributed by Ayush Saxena. 
(cherry picked from commit 3801436e49822c724c8f4e393e6e5abbd0d2573a)
 2018-09-03 14:39:11 +05:30
Vinayakumar B
6776db5aec HDFS-13867. RBF: Add validation for max arguments for Router admin ls, clrQuota, setQuota, rm and nameservice commands. Contributed by Ayush Saxena. 
(cherry picked from commit 780df9034f265a8e602856b34cc21d9be02f5c48)
 2018-09-03 14:29:28 +05:30
bibinchundatt
e2e0fc26a2 YARN-8535. Fix DistributedShell unit tests. Contributed by Abhishek Modi. 
(cherry picked from commit eed8415dc18fa7415ebd105350bd0532b3b1b6bb)
 2018-09-02 13:37:38 +05:30
Wei-Chiu Chuang
9f0cd2ade2 Revert "HDFS-13838. WebHdfsFileSystem.getFileStatus() won't return correct "snapshot enabled" status. Contributed by Siyao Meng." 
This reverts commit 41732e7b28bb70f7ba56cf6131ac10c062f93fc3.
 2018-08-30 11:58:42 -07:00
Vinayakumar B
65977e5d81 HDFS-13027. Handle possible NPEs due to deleted blocks in race condition. Contributed by Vinayakumar B. 2018-08-30 22:14:47 +05:30
Daniel Templeton
68301ad7d3 HADOOP-15706. Typo in compatibility doc: SHOUD -> SHOULD 
(Contributed by Laszlo Kollar via Daniel Templeton)

Change-Id: I6e2459d0700df7f3bad4eac8297a11690191c3ba
(cherry picked from commit f2c2a68ec208f640e778fc41f95f0284fcc44729)
 2018-08-30 09:14:29 -07:00
Steve Loughran
a0766bf66a
HADOOP-15107. Stabilize/tune S3A committers; review correctness & docs. 
Contributed by Steve Loughran.

(cherry picked from commit 5a0babf76550f63dad4c17173c4da2bf335c6532)
 2018-08-30 15:23:08 +01:00
Steve Loughran
6f939d4294
HADOOP-15680. ITestNativeAzureFileSystemConcurrencyLive times out. 
Contributed by Andras Bokor.

(cherry picked from commit e8d138ca7c1b695688515d816ac693437c87df62)
 2018-08-30 14:37:07 +01:00
Kitti Nanasi
12eb9cc3bb HADOOP-15698. KMS log4j is not initialized properly at startup. Contributed by Kitti Nanasi. 
(cherry picked from commit 781437c219dc3422797a32dc7ba72cd4f5ee38e2)
 2018-08-29 22:09:05 -07:00
Yiqun Lin
8a3be0d5a4 HDFS-13863. FsDatasetImpl should log DiskOutOfSpaceException. Contributed by Fei Hui. 
(cherry picked from commit 582cb10ec74ed5666946a3769002ceb80ba660cb)
 2018-08-30 11:22:57 +08:00
Daniel Templeton
90c8cca783 HADOOP-15705. Typo in the definition of "stable" in the interface classification 
Change-Id: I3eae2143400a534903db4f186400561fc8d2bd56
(cherry picked from commit d53a10b0a552155de700e396fd7f450a4c5f9c22)
 2018-08-29 14:00:42 -07:00
Shane Kumpf
b8618556ee YARN-8642. Add support for tmpfs mounts with the Docker runtime. Contributed by Craig Condit 
(cherry picked from commit 73625168c0f29aa646d7a715c9fb15e43d6c7e05)
 2018-08-29 07:11:38 -06:00
Yiqun Lin
b9b2b97e9d HDFS-13634. RBF: Configurable value in xml for async connection request queue size. Contributed by CR Hota. 
(cherry picked from commit a0ebb6b39f2932d3ea2fb5e287f52b841e108428)
 2018-08-29 16:18:15 +08:00
Weiwei Yang
f164568b47 YARN-8723. Fix a typo in CS init error message when resource calculator is not correctly set. Contributed by Abhishek Modi. 
(cherry picked from commit 3fa46394214181ed1cc7f06b886282bbdf67a10f)
 2018-08-29 11:15:02 +08:00
Brahma Reddy Battula
c01c240f6f HDFS-13854. RBF: The ProcessingAvgTime and ProxyAvgTime should display by JMX with ms unit. Contributed by yanghuafeng. 
(cherry picked from commit 64ad0298d441559951bc9589a40f8aab17c93a5f)
 2018-08-29 08:31:19 +05:30
Zsolt Venczel
5cbb9b1ca9 HDFS-13731. ReencryptionUpdater fails with ConcurrentModificationException during processCheckpoints. Contributed by Zsolt Venczel. 
(cherry picked from commit 3e18b957ebdf20925224ab9c28e6c2f4b6bbdb24)
 2018-08-28 15:14:13 -07:00
Brahma Reddy Battula
450ba6790d HDFS-13861. RBF: Illegal Router Admin command leads to printing usage for all commands. Contributed by Ayush Saxena. 
(cherry picked from commit cb9d371ae2cda1624fc83316ddc09de37d8d0bd3)
 2018-08-29 00:31:16 +05:30
Yiqun Lin
2cbc3c7d43 HDFS-13831. Make block increment deletion number configurable. Contributed by Ryan Wu. 
(cherry picked from commit b9b964d25335943fb15cdfcf369d123bbd7e454a)
 2018-08-28 09:36:02 -07:00
Vinayakumar B
9265d1a61a HDFS-13858. RBF: Add check to have single valid argument to safemode command. Contributed by Ayush Saxena. 
(cherry picked from commit 75691ad600473d4d315434b0876d6d10d3050a6b)
 2018-08-28 09:21:42 +05:30
Wei-Chiu Chuang
41732e7b28 HDFS-13838. WebHdfsFileSystem.getFileStatus() won't return correct "snapshot enabled" status. Contributed by Siyao Meng. 
(cherry picked from commit 26c2a97c566969f50eb8e8432009724c51152a98)
 2018-08-27 16:03:52 -07:00
John Zhuge
84d761d49c
HADOOP-15633. fs.TrashPolicyDefault: Can't create trash directory. Contributed by Fei Hui. 
(cherry picked from commit f9c6fd94711458b77ecf3fa425aad7fda5089376)
 2018-08-27 15:21:39 -07:00
Billie Rinaldi
eefd780918 YARN-8675. Remove default hostname for docker containers when net=host. Contributed by Suma Shivaprasad 
(cherry picked from commit 05b2bbeb357d4fa03e71f2bfd5d8eeb0ea6c3f60)
 2018-08-27 11:42:09 -07:00