Giovanni Matteo Fumarola
37032a3aca
HADOOP-15731. TestDistributedShell fails on Windows. Contributed by Botong Huang.
2018-09-07 16:37:15 -07:00
Inigo Goiri
a9392bdb17
HDFS-13836. RBF: Handle mount table znode with null value. Contributed by yanghuafeng.
...
(cherry picked from commit 527288ef891dc26019d003bd85ddfd50eb4f3b7b)
2018-09-06 16:49:14 -07:00
Jason Lowe
09e1851b0d
MAPREDUCE-7131. Job History Server has race condition where it moves files from intermediate to finished but thinks file is in intermediate. Contributed by Anthony Hsu
...
(cherry picked from commit eb0b5a844f960017f6f48d746174d0f5826f0e5f)
2018-09-06 15:14:38 -05:00
Wei-Chiu Chuang
e99ed05444
HADOOP-15696. KMS performance regression due to too many open file descriptors after Jetty migration. Contributed by Wei-Chiu Chuang.
...
(cherry picked from commit e780556ae9229fe7a90817eb4e5449d7eed35dd8)
Conflicts:
hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/http/TestHttpServer.java
(cherry picked from commit d1ea7df43d6a5623b139acbbc9992831d5c7e484)
2018-09-05 10:18:56 -07:00
Steve Loughran
9ee9d68e4b
HADOOP-10219. ipc.Client.setupIOstreams() needs to check for ClientCache.stopClient requested shutdowns.
...
Contributed by Kihwal Lee and Lukas Majercak.
(cherry picked from commit 9e96ac666d783376a8cdea9c3cc84098c5bdcb56)
(cherry picked from commit 142d878c902da6bc02d0c21cdd5ca8674da7f5c8)
2018-09-04 22:25:24 -07:00
Hrishikesh Gadre
25337c045a
HDFS-13812. Fix the inconsistent default refresh interval on Caching documentation. Contributed by Hrishikesh Gadre.
...
Signed-off-by: Xiao Chen <xiao@apache.org>
(cherry picked from commit 6ccb809c2d38a45e716153ba16e135cb76167b2b)
2018-09-04 21:54:56 -07:00
Inigo Goiri
54d3189cfa
HDFS-13857. RBF: Choose to enable the default nameservice to read/write files. Contributed by yanghuafeng.
...
(cherry picked from commit 54f2044595206455484284b43e5976c8a1982aaf)
2018-09-04 12:18:08 -07:00
bibinchundatt
5514f02a73
YARN-8535. Fix DistributedShell unit tests. Contributed by Abhishek Modi.
...
(cherry picked from commit eed8415dc18fa7415ebd105350bd0532b3b1b6bb)
2018-09-02 13:39:26 +05:30
Wei-Chiu Chuang
d06717ef94
Revert "HDFS-13838. WebHdfsFileSystem.getFileStatus() won't return correct "snapshot enabled" status. Contributed by Siyao Meng."
...
This reverts commit d89a485b2545c759a0f62810ff9757ede6d622f2.
2018-08-30 11:59:39 -07:00
Vinayakumar B
67a5491962
HDFS-13027. Handle possible NPEs due to deleted blocks in race condition. Contributed by Vinayakumar B.
...
(cherry picked from commit 65977e5d8124be2bc208af25beed934933f170b3)
2018-08-30 22:17:00 +05:30
Daniel Templeton
9a02c4ff65
HADOOP-15706. Typo in compatibility doc: SHOUD -> SHOULD
...
(Contributed by Laszlo Kollar via Daniel Templeton)
Change-Id: I6e2459d0700df7f3bad4eac8297a11690191c3ba
(cherry picked from commit f2c2a68ec208f640e778fc41f95f0284fcc44729)
(cherry picked from commit 68301ad7d36d516e265d34dd47c344239e3c6c7d)
2018-08-30 09:15:25 -07:00
Kitti Nanasi
fa32269cee
HADOOP-15698. KMS log4j is not initialized properly at startup. Contributed by Kitti Nanasi.
...
(cherry picked from commit 781437c219dc3422797a32dc7ba72cd4f5ee38e2)
2018-08-29 22:09:13 -07:00
Yiqun Lin
6a547856ef
HDFS-13863. FsDatasetImpl should log DiskOutOfSpaceException. Contributed by Fei Hui.
...
(cherry picked from commit 582cb10ec74ed5666946a3769002ceb80ba660cb)
2018-08-30 11:24:25 +08:00
Daniel Templeton
fbaa11ef4c
HADOOP-15705. Typo in the definition of "stable" in the interface classification
...
Change-Id: I3eae2143400a534903db4f186400561fc8d2bd56
(cherry picked from commit d53a10b0a552155de700e396fd7f450a4c5f9c22)
(cherry picked from commit 90c8cca78389f534429ebf81576ce7ebba9356f7)
2018-08-29 14:01:19 -07:00
Brahma Reddy Battula
3b01279612
HDFS-13854. RBF: The ProcessingAvgTime and ProxyAvgTime should display by JMX with ms unit. Contributed by yanghuafeng.
...
(cherry picked from commit 64ad0298d441559951bc9589a40f8aab17c93a5f)
2018-08-29 08:32:05 +05:30
Wei-Chiu Chuang
72e1e1904b
HDFS-13831. Make block increment deletion number configurable. Contributed by Ryan Wu.
2018-08-28 16:36:30 -07:00
Zsolt Venczel
2d1f819979
HDFS-13731. ReencryptionUpdater fails with ConcurrentModificationException during processCheckpoints. Contributed by Zsolt Venczel.
...
(cherry picked from commit 3e18b957ebdf20925224ab9c28e6c2f4b6bbdb24)
2018-08-28 15:14:57 -07:00
Wei-Chiu Chuang
d89a485b25
HDFS-13838. WebHdfsFileSystem.getFileStatus() won't return correct "snapshot enabled" status. Contributed by Siyao Meng.
...
(cherry picked from commit 26c2a97c566969f50eb8e8432009724c51152a98)
(cherry picked from commit 41732e7b28bb70f7ba56cf6131ac10c062f93fc3)
2018-08-27 16:04:16 -07:00
John Zhuge
2260718e24
HADOOP-15633. fs.TrashPolicyDefault: Can't create trash directory. Contributed by Fei Hui.
...
(cherry picked from commit f9c6fd94711458b77ecf3fa425aad7fda5089376)
2018-08-27 15:22:19 -07:00
Weiwei Yang
fdecbd94c1
YARN-8719. Typo correction for yarn configuration in OpportunisticContainers(federation) docs. Contributed by Y. SREENIVASULU REDDY.
...
(cherry picked from commit e8b063f63049d781f4bd67e2ac928c03fd7b7941)
2018-08-28 01:10:47 +08:00
Konstantin V Shvachko
27abdb390b
HDFS-13848. Refactor NameNode failover proxy providers. Contributed by Konstantin Shvachko.
...
(cherry picked from commit a4121c71c29d13866a605d9c0d013e5de9c147c3)
2018-08-24 18:51:42 -07:00
Haibo Chen
49590e7c6b
YARN-8051. TestRMEmbeddedElector#testCallbackSynchronization is flaky. (Robert Kanter via Haibo Chen)
...
(cherry picked from commit 93d47a0ed504ee81d4b74d340c1815bdbb3c9b14)
2018-08-24 13:27:54 -05:00
Inigo Goiri
c3ba06deeb
YARN-7773. YARN Federation used Mysql as state store throw exception, Unknown column 'homeSubCluster' in 'field list'. Contributed by Yiran Wu.
...
(cherry picked from commit 60e5c1b516647bf99ef3e9501c0ce04deea13ce9)
2018-08-24 14:26:52 +05:30
Jason Lowe
79ebbec4c8
YARN-8649. NPE in localizer hearbeat processing if a container is killed while localizing. Contributed by lujie
...
(cherry picked from commit 585ebd873a55bedd2a364d256837f08ada8ba032)
2018-08-23 09:40:42 -05:00
Takanobu Asanuma
cd8ac03357
HADOOP-14314. The OpenSolaris taxonomy link is dead in InterfaceClassification.md. Contributed by Rui Gao.
...
(cherry picked from commit bed8cb6979e0460141ed77e3b15d4f18db098a8e)
2018-08-23 21:55:55 +09:00
Yiqun Lin
4ef3025964
HDFS-13821. RBF: Add dfs.federation.router.mount-table.cache.enable so that users can disable cache. Contributed by Fei Hui.
2018-08-22 13:01:13 +08:00
Wei-Chiu Chuang
bd46906bd8
HDFS-10240. Race between close/recoverLease leads to missing block. Contributed by Jinglun, zhouyingchao and Wei-Chiu Chuang.
...
(cherry picked from commit 865650052b07c8a20d51306202354ac770ed36d5)
2018-08-21 15:44:08 -07:00
Rohith Sharma K S
7278566f27
YARN-8129. Improve error message for invalid value in fields attribute. Contributed by Abhishek Modi.
...
(cherry picked from commit d3fef7a5c5b83d27e87b5e49928254a7d1b935e5)
2018-08-21 12:11:32 +05:30
Steve Loughran
53ce37ad29
HADOOP-15679. ShutdownHookManager shutdown time needs to be configurable & extended. Contributed by Steve Loughran.
...
Change-Id: Ifd4a6e3f796b4dc88e97f63066289e2534c77a29
(cherry picked from commit 95fcdc04355920697337db1136ffe463d4794616)
2018-08-20 19:18:37 -07:00
Yiqun Lin
5e2e68d4bb
HDFS-13750. RBF: Router ID in RouterRpcClient is always null. Contributed by Takanobu Asanuma.
...
(cherry picked from commit 01ff8178148790f7b0112058cf08d23d031b6868)
2018-08-20 23:03:19 +08:00
Rohith Sharma K S
675aa2bbc0
YARN-8679. [ATSv2] If HBase cluster is down for long time, high chances that NM ContainerManager dispatcher get blocked. Contributed by Wangda Tan.
...
(cherry picked from commit 4aacbfff605262aaf3dbd926258afcadc86c72c0)
2018-08-18 11:06:14 +05:30
Haibo Chen
8118b14db8
YARN-7835. Race condition in NM while publishing events if second attempt is launched on the same node. (Rohith Sharma K S via Haibo Chen)
...
(cherry picked from commit d1274c3b71549cb000868500c293cafd880b3713)
2018-08-18 11:06:02 +05:30
Xiao Chen
a41f18098b
HADOOP-15674. Test failure TestSSLHttpServer.testExcludedCiphers with TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256 cipher suite. Contributed by Szilard Nemeth.
...
(cherry picked from commit 8d7c93186e3090b19aa59006bb6b32ba929bd8e6)
2018-08-17 10:20:20 -07:00
Xiao Chen
185c8f2abc
HDFS-13747. Statistic for list_located_status is incremented incorrectly by listStatusIterator. Contributed by Antal Mihalyi.
...
(cherry picked from commit c67b0650ea10896c6289703595faef0d262c00b3)
2018-08-16 23:15:58 -07:00
Rohith Sharma K S
90bf2d3b52
YARN-8612. Fix NM Collector Service Port issue in YarnConfiguration. Contributed by Prabha Manepalli.
...
(cherry picked from commit 1697a0230696e1ed6d9c19471463b44a6d791dfa)
2018-08-17 11:14:10 +05:30
Daniel Templeton
27508086de
HDFS-13746. Still occasional "Should be different group" failure in TestRefreshUserMappings#testGroupMappingRefresh
...
(Contributed by Siyao Meng via Daniel Templeton)
Change-Id: I9fad1537ace38367a463d9fe67aaa28d3178fc69
(cherry picked from commit 8512e1a91be3e340d919c7cdc9c09dfb762a6a4e)
(cherry picked from commit fbedf89377e540fb10239a880fc2e01ef7021b93)
2018-08-16 15:02:18 -07:00
Weiwei Yang
8c0cecb034
YARN-8614. Fix few annotation typos in YarnConfiguration. Contributed by Sen Zhao.
...
(cherry picked from commit 8dc07b47235358653c5cccda354201564f7545ed)
2018-08-15 13:37:21 +08:00
Xiao Chen
5d16301ad9
HDFS-13788. Update EC documentation about rack fault tolerance. Contributed by Kitti Nanasi.
...
(cherry picked from commit cede33997f7ab09fc046017508b680e282289ce3)
2018-08-14 11:59:05 -07:00
Wei-Chiu Chuang
6f2a46578f
HDFS-13758. DatanodeManager should throw exception if it has BlockRecoveryCommand but the block is not under construction. Contributed by chencan.
...
(cherry picked from commit 61a9b4f58b639e71c564d84b529ac66aaae7f8ef)
(cherry picked from commit 7a115e8de4732d6e96acc21f21e2abad76754e18)
2018-08-14 11:52:55 -07:00
Robert Kanter
fd63be750a
YARN-8568. Replace the deprecated zk-address property in the HA config example in ResourceManagerHA.md (bsteinbach via rkanter)
...
(cherry picked from commit 8478732bb28e9e71061d6b4a043a3a1b5c688902)
2018-08-14 10:16:44 -07:00
Jason Lowe
c72674ee3c
YARN-8640. Restore previous state in container-executor after failure. Contributed by Jim Brennan
...
(cherry picked from commit d1d129aa9deecebf42261947fcb0b2ca46dacad5)
2018-08-14 10:29:58 -05:00
Wei-Chiu Chuang
d502abe947
HDFS-13738. fsck -list-corruptfileblocks has infinite loop if user is not privileged. Contributed by Yuen-Kuei Hsueh.
...
(cherry picked from commit 4023eeba05aefe48384e870da3c95bb3af474514)
(cherry picked from commit 74d4fd975a1f67ae3e1b67554319e1f5e525ed6f)
2018-08-13 17:37:36 -07:00
Wei-Chiu Chuang
4b606eb9fd
HDFS-13813. Exit NameNode if dangling child inode is detected when saving FsImage. Contributed by Siyao Meng.
...
(cherry picked from commit 23854443efa62aa70a1c30c32c3816750e5d7a5b)
(cherry picked from commit b38649c59a70b3112811443464b3b3180f4b9873)
2018-08-13 16:14:01 -07:00
Vinayakumar B
eecfbaff3b
HDFS-13786. EC: Display erasure coding policy for sub-directories is not working. Contributed by Ayush Saxena.
...
(cherry picked from commit 2b0f9772417d205e8df16bac6921c2bb8bdcf740)
2018-08-13 13:58:37 -07:00
Chen Liang
2d985b6c81
HDFS-13735. Make QJM HTTP URL connection timeout configurable. Contributed by Chao Sun.
2018-08-13 12:47:17 -07:00
Xiao Chen
7730a85233
HADOOP-15638. KMS Accept Queue Size default changed from 500 to 128 in Hadoop 3.x. Contributed by Wei-Chiu Chuang.
...
(cherry picked from commit b94c8874e2a634637b1ef5d837f05bc5c5e8e6a6)
2018-08-13 10:41:14 -07:00
Chao Sun
07054c5994
Remove super user privilege requirement for NameNode.getServiceStatus. Contributed by Chao Sun.
...
(cherry picked from commit a2a8c486998b81d2c73804a07cc74f5269bfd904)
2018-08-10 16:12:05 -07:00
Jonathan Hung
0420ca5a6f
YARN-8559. Expose mutable-conf scheduler's configuration in RM /scheduler-conf endpoint. Contributed by Weiwei Yang.
2018-08-10 15:22:11 -07:00
Jason Lowe
b0a364171d
YARN-8331. Race condition in NM container launched after done. Contributed by Pradeep Ambati
...
(cherry picked from commit cd04e954d2db27f0a15b7d1c492b7cdb656a51db)
Conflicts:
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/container/TestContainer.java
2018-08-09 10:31:11 -05:00
Wangda Tan
dc41462af4
Make 3.1.1 awared by other branches - adding missing files
...
(cherry picked from commit 3214cd75acd0474373951870e1ba2ec11833a3da)
(cherry picked from commit f16c311486b8e9236b78e31d1bfe4abb108d9d49)
2018-08-08 13:07:15 -07:00