14987 Commits

Author SHA1 Message Date
Eric E Payne
6e6ebc368c YARN-5714. ContainerExecutor does not order environment map. Contributed by Remi Catherinot and Jim Brennan. 2019-03-07 16:22:36 +00:00
Wei-Chiu Chuang
d71cfe1461 HDFS-14314. fullBlockReportLeaseId should be reset after registering to NN. Contributed by star.
(cherry picked from commit 387dbe587aa66ac99ec5f5b50827ec3e0a327613)
(cherry picked from commit e58ccca3ce131c955ceb115cd0b75e452eea828b)
(cherry picked from commit d951497f57cf6556b0916cad08576481dfe2ae06)
(cherry picked from commit e23a448e0e32ce5139b76d47c73fce621ccb66bd)
2019-03-04 11:30:56 -08:00
Tsz Wo Nicholas Sze
5bed24ad5f HADOOP-16126. ipc.Client.stop() may sleep too long to wait for all connections.
(cherry picked from commit 0edb0c51dc2c4ae2f353e260f01912e28033d70f)
2019-03-01 17:52:53 +09:00
Kai Xie
a49cb4465e
HADOOP-16018. DistCp won't reassemble chunks when blocks per chunk > 0.
Contributed by Kai Xie.
2019-02-27 20:09:27 +00:00
Eric Yang
bae607f734 Revert "HADOOP-13707. Skip authorization for anonymous user to access Hadoop"
This reverts commit 439422fff923ae6aea1f7547fe24d0e23fbd8f7f.
2019-02-21 17:36:59 -05:00
Eric Yang
4a45a9b57e Revert "HADOOP-13707. Skip authorization for anonymous user to access Hadoop"
This reverts commit a4356bb7a5bf2fdf41bbced45968416e8ed945e6.
2019-02-21 17:36:02 -05:00
Eric Yang
da854234a2 Revert "HADOOP-13707. Skip authorization for anonymous user to access Hadoop"
This reverts commit 7993fb5b8127a219e6c936206b5c5c0790e82946.
2019-02-21 17:35:19 -05:00
Daryn Sharp
665cad03f3 HADOOP-15813. Enable more reliable SSL connection reuse. Contributed by Daryn Sharp.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit a87e458432609b7a35a2abd6410b02e8a2ffc974)
(cherry picked from commit ae8839e6e8cc3e8f8d5e50525d3302038ada484b)
(cherry picked from commit 704330a616c17256b3e39370f999928ba1c463e6)
(cherry picked from commit 4eccf2a3cc6b1468085f48ee267b2093b4f5be9d)
2019-02-20 18:22:48 -08:00
Adam Antal
3c7c3366ff
YARN-9283. Javadoc of LinuxContainerExecutor#addSchedPriorityCommand has a wrong property name as reference
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 9385ec45d75109a2e6565faa10527cc56637bf5f)
2019-02-15 19:00:48 +09:00
Jonathan Hung
da67579601 HADOOP-15711. Move branch-2 precommit/nightly test builds to java 8 2019-02-08 17:12:44 -08:00
Masatake Iwasaki
83a9369f7d YARN-9282. Typo in javadoc of class LinuxContainerExecutor: hadoop.security.authetication should be 'authentication'. Contributed by Charan Hebri.
(cherry picked from commit e0ab1bdecec3d7ba7ddc0849781d7f71714f8687)
2019-02-09 00:34:57 +09:00
Eric E Payne
2a7dcc509b YARN-7171: RM UI should sort memory / cores numerically. Contributed by Ahmed Hussein
(cherry picked from commit d1ca9432dd0b3e9b46b4903e8c9d33f5c28fcc1b)
2019-02-07 21:29:23 +00:00
Sunil G
a91933620d YARN-9206. RMServerUtils does not count SHUTDOWN as an accepted state. Contributed by Kuhu Shukla.
(cherry picked from commit 6ffe6ea8999c1216b6e510e350535754431bac2d)
2019-02-07 19:11:12 +05:30
Akira Ajisaka
6485b89133
HADOOP-16089. AliyunOSS: update oss-sdk version to 3.4.1. Contributed by wujinhu.
(cherry picked from commit 0f9aa5b4d58e34653f42e98a244aaf1c806b37cf)
2019-02-04 14:48:40 +09:00
Akira Ajisaka
faae522f52
MAPREDUCE-7177. Disable speculative execution in TestDFSIO. Contributed by Zhaohui Xin.
(cherry picked from commit c991e2ca5a65eae62bad7e5baf81f1eb633b7ec0)
2019-02-04 14:05:00 +09:00
Akira Ajisaka
651d050919
HADOOP-16053. Backport HADOOP-14816 to branch-2. 2019-02-04 13:23:31 +09:00
Eric E Payne
c6c5e94de4 YARN-6616: YARN AHS shows submitTime for jobs same as startTime. Contributed by Prabhu Joseph
(cherry picked from commit 04105bbfdb041a41062c856632641140de84fba8)
2019-01-29 18:22:12 +00:00
Masatake Iwasaki
9688ed3b48 HDFS-12729. Document special paths in HDFS. Contributed by Masatake Iwasaki.
(cherry picked from commit dc5af4c6b7bdf437713a8c6ca3c535c4b6d6992e)
2019-01-29 01:45:30 +09:00
Kai Xie
6d3e7a8570
HADOOP-16049. DistCp result has data and checksum mismatch when blocks per chunk > 0.
Contributed by Kai Xie.
2019-01-27 16:56:57 +00:00
Jonathan Hung
338dbbedf7 YARN-9222. Print launchTime in ApplicationSummary
(cherry picked from commit 6cace58e212d3ee0aec988926a5a17c9cc58e645)
(cherry picked from commit bf760e7e81f8e02ad413c470fccf78aaa9cb9f86)
(cherry picked from commit 80a08c29adc9d07974bbe8087abcec750d5f7916)
(cherry picked from commit c71054c428b3abe00507792099e13a2dad337697)
2019-01-25 13:40:51 -08:00
Akira Ajisaka
7bca49c0d2
HADOOP-16055. Upgrade AWS SDK to 1.11.271 in branch-2. 2019-01-25 21:09:51 +09:00
Haibo Chen
c02c19121e YARN-7088. Add application launch time to Resource Manager REST API. (Kanwaljeet Sachdev via Haibo Chen)
(cherry picked from commit bb92bfb4ef96baa234966b60e464d1773fbf3f22)
(cherry picked from commit 3a764250262e745a6762dd6551b0d0a6af39e891)
(cherry picked from commit 75df8bed6eed86ad7c34460a1167c35d48b559d7)
2019-01-23 12:18:42 -08:00
Weiwei Yang
c77f7e25c9 YARN-9210. RM nodes web page can not display node info. Contributed by Jiandan Yang. 2019-01-23 11:02:15 +08:00
Chen Liang
d3b06d179d HADOOP-15481. Emit FairCallQueue stats as metrics. Contributed by Christopher Gregorian. 2019-01-17 13:30:42 -08:00
Akhil PB
a5f678f54f
HADOOP-15617. Node.js and npm package loading in the Dockerfile failing on branch-2.
Contributed by Akhil PB.
2019-01-17 10:03:21 +00:00
Akira Ajisaka
300d65c4d7
YARN-8747. [UI2] YARN UI2 page loading failed due to js error under some time zone configuration. Contributed by collinma.
(cherry picked from commit 104ef5df36fd45f1c2d07a2f3d441263aa85e22e)
2019-01-16 14:39:17 +09:00
Chen Liang
1dbe6c9780 HADOOP-16013. DecayRpcScheduler decay thread should run as a daemon. Contributed by Erik Krogen. 2019-01-11 12:57:30 -08:00
Akira Ajisaka
1684301485
HADOOP-16016. TestSSLFactory#testServerWeakCiphers fails on Java 1.8.0_191 or upper
(cherry picked from commit d4ca907da636892e4ab98e232fe0f7f77f1f7aac)
2019-01-11 13:05:58 +09:00
Weiwei Yang
c54a689d96 YARN-8833. Avoid potential integer overflow when computing fair shares. Contributed by liyakun. 2019-01-09 14:33:06 +08:00
Weiwei Yang
2a416fe9f2 HADOOP-16030. AliyunOSS: bring fixes back from HADOOP-15671. Contributed by wujinhu.
(cherry picked from commit f87b3b11c46704dcdb63089dd971e2a5ba1deaac)
2019-01-07 17:30:38 +08:00
Sunil G
2c4e4937bd
Revert "HADOOP-15759. AliyunOSS: Update oss-sdk version to 3.0.0. Contributed by Jinhu Wu."
This reverts commit e4fca6aae46a3c04fc56897986a4ab4e5aa98503.

Revert "HADOOP-15671. AliyunOSS: Support Assume Roles in AliyunOSS. Contributed by Jinhu Wu."

This reverts commit 2b635125fb059fc204ed35bc0e264c42dd3a9fe9.

(cherry picked from commit 1f425271a73fff1fdbe3fbfdb71e906fd1ac0574)
2019-01-05 17:51:02 +09:00
Weiwei Yang
37e36617c5 HADOOP-15323. AliyunOSS: Improve copy file performance for AliyunOSSFileSystemStore. Contributed wujinhu.
(cherry picked from commit 040a202b202a37f3b922cd321eb0a8ded457d88b)
2019-01-03 22:18:05 +08:00
Ayush Saxena
f804d7d3de
HADOOP-16025. Update the year to 2019.
Contributed by Ayush Saxena.
2019-01-02 22:27:03 +00:00
Akira Ajisaka
c157ab49c0
HADOOP-16009. Replace the url of the repository in Apache Hadoop source code.
(cherry picked from commit eee29ed7066e9401c7530b8b6f3b221bacef9a8a)
2018-12-31 06:32:31 +09:00
Wei-Chiu Chuang
10cc02f643 HDFS-14171. Performance improvement in Tailing EditLog. Contributed by Kenneth Yang.
(cherry picked from commit e9a005dfcf4d2249235aeff4da85b321dddc1ca9)
(cherry picked from commit c48640ffbd3852b75f898325ae0b3ea0ba864578)
(cherry picked from commit f24684ca9cd70326e24376a33cda937c98295af0)
(cherry picked from commit 054594c6145711c60f3cb848f08e515c4179f0c4)
2018-12-28 10:46:38 -08:00
Botong Huang
15286d9166 YARN 9108. Fix FederationIntercepter merge home and secondary allocate response typo. Contributed by Abhishek Modi. 2018-12-22 12:46:13 -08:00
Jason Lowe
d62bfaf1a4 HADOOP-15973. Configuration: Included properties are not cached if resource is a stream. Contributed by Eric Payne 2018-12-20 10:02:18 -06:00
shwetayakkali@cloudera.com
500b2a0ca6
HADOOP-16008. Fix typo in CommandsManual.md
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-12-18 13:27:14 +09:00
Jonathan Hung
eb8b1eaa9a YARN-9085. Add Guaranteed and MaxCapacity to CSQueueMetrics
(cherry picked from commit cc51607ccdf60f4ebecf7afa3e2056297ca0ac5f)
2018-12-07 10:47:45 -08:00
Inigo Goiri
5cef413a8e HADOOP-15950. Failover for LdapGroupsMapping. Contributed by Lukas Majercak. 2018-12-03 13:23:10 -08:00
Inigo Goiri
a29eb49f85 Revert "HADOOP-15950. Failover for LdapGroupsMapping. Contributed by Lukas Majercak."
This reverts commit b98ffbe3f228b706b8e547f82e134233ab691443.
2018-12-03 13:22:14 -08:00
Giovanni Matteo Fumarola
b98ffbe3f2 HADOOP-15950. Failover for LdapGroupsMapping. Contributed by Lukas Majercak. 2018-12-03 12:46:30 -08:00
Jonathan Hung
74e40981eb YARN-7794. SLSRunner is not loading timeline service jars, causing failure. 2018-11-30 17:03:01 -08:00
Jonathan Hung
7456da99c1 YARN-9036. Escape newlines in health report in YARN UI. Contributed by Keqiu Hu 2018-11-30 10:18:17 -08:00
Steve Loughran
a3470c65d8
HADOOP-15959. Revert "HADOOP-12751. While using kerberos Hadoop incorrectly assumes names with '@' to be non-simple" 2018-11-30 11:33:19 +00:00
Yiqun Lin
50e11dc807 HDFS-13870. WebHDFS: Document ALLOWSNAPSHOT and DISALLOWSNAPSHOT API doc. Contributed by Siyao Meng.
(cherry picked from commit 0e36e935d909862401890d0a5410204504f48b31)
2018-11-30 11:34:28 +08:00
Weiwei Yang
408f60e6d8 HADOOP-15943. AliyunOSS: add missing owner & group attributes for oss FileStatus. Contributed by wujinhu.
(cherry picked from commit 5ff0cf86a940fd83f1425794921cc075b19f1108)
2018-11-23 14:46:48 +08:00
Akira Ajisaka
d892d82ac0
Update jdiff.stable.api from 2.9.1 to 2.9.2. 2018-11-20 14:32:49 +09:00
Akira Ajisaka
6cae964f6c
Add 2.9.2 release notes and changes documents.
(cherry picked from commit 1a00b4e325146988375c9ce5b11016c45f059a4e)
2018-11-20 14:30:09 +09:00
Weiwei Yang
311be8864f HADOOP-15919. AliyunOSS: Enable Yarn to use OSS. Contributed by wujinhu.
(cherry picked from commit be0708c6eb3c759e43639e0f8df7c9910308fb97)
2018-11-19 15:03:54 +08:00