14727 Commits

Author SHA1 Message Date
Masatake Iwasaki
83a9369f7d YARN-9282. Typo in javadoc of class LinuxContainerExecutor: hadoop.security.authetication should be 'authentication'. Contributed by Charan Hebri.
(cherry picked from commit e0ab1bdecec3d7ba7ddc0849781d7f71714f8687)
2019-02-09 00:34:57 +09:00
Eric E Payne
2a7dcc509b YARN-7171: RM UI should sort memory / cores numerically. Contributed by Ahmed Hussein
(cherry picked from commit d1ca9432dd0b3e9b46b4903e8c9d33f5c28fcc1b)
2019-02-07 21:29:23 +00:00
Sunil G
a91933620d YARN-9206. RMServerUtils does not count SHUTDOWN as an accepted state. Contributed by Kuhu Shukla.
(cherry picked from commit 6ffe6ea8999c1216b6e510e350535754431bac2d)
2019-02-07 19:11:12 +05:30
Akira Ajisaka
6485b89133
HADOOP-16089. AliyunOSS: update oss-sdk version to 3.4.1. Contributed by wujinhu.
(cherry picked from commit 0f9aa5b4d58e34653f42e98a244aaf1c806b37cf)
2019-02-04 14:48:40 +09:00
Akira Ajisaka
faae522f52
MAPREDUCE-7177. Disable speculative execution in TestDFSIO. Contributed by Zhaohui Xin.
(cherry picked from commit c991e2ca5a65eae62bad7e5baf81f1eb633b7ec0)
2019-02-04 14:05:00 +09:00
Akira Ajisaka
651d050919
HADOOP-16053. Backport HADOOP-14816 to branch-2. 2019-02-04 13:23:31 +09:00
Eric E Payne
c6c5e94de4 YARN-6616: YARN AHS shows submitTime for jobs same as startTime. Contributed by Prabhu Joseph
(cherry picked from commit 04105bbfdb041a41062c856632641140de84fba8)
2019-01-29 18:22:12 +00:00
Masatake Iwasaki
9688ed3b48 HDFS-12729. Document special paths in HDFS. Contributed by Masatake Iwasaki.
(cherry picked from commit dc5af4c6b7bdf437713a8c6ca3c535c4b6d6992e)
2019-01-29 01:45:30 +09:00
Kai Xie
6d3e7a8570
HADOOP-16049. DistCp result has data and checksum mismatch when blocks per chunk > 0.
Contributed by Kai Xie.
2019-01-27 16:56:57 +00:00
Jonathan Hung
338dbbedf7 YARN-9222. Print launchTime in ApplicationSummary
(cherry picked from commit 6cace58e212d3ee0aec988926a5a17c9cc58e645)
(cherry picked from commit bf760e7e81f8e02ad413c470fccf78aaa9cb9f86)
(cherry picked from commit 80a08c29adc9d07974bbe8087abcec750d5f7916)
(cherry picked from commit c71054c428b3abe00507792099e13a2dad337697)
2019-01-25 13:40:51 -08:00
Akira Ajisaka
7bca49c0d2
HADOOP-16055. Upgrade AWS SDK to 1.11.271 in branch-2. 2019-01-25 21:09:51 +09:00
Haibo Chen
c02c19121e YARN-7088. Add application launch time to Resource Manager REST API. (Kanwaljeet Sachdev via Haibo Chen)
(cherry picked from commit bb92bfb4ef96baa234966b60e464d1773fbf3f22)
(cherry picked from commit 3a764250262e745a6762dd6551b0d0a6af39e891)
(cherry picked from commit 75df8bed6eed86ad7c34460a1167c35d48b559d7)
2019-01-23 12:18:42 -08:00
Weiwei Yang
c77f7e25c9 YARN-9210. RM nodes web page can not display node info. Contributed by Jiandan Yang. 2019-01-23 11:02:15 +08:00
Chen Liang
d3b06d179d HADOOP-15481. Emit FairCallQueue stats as metrics. Contributed by Christopher Gregorian. 2019-01-17 13:30:42 -08:00
Akhil PB
a5f678f54f
HADOOP-15617. Node.js and npm package loading in the Dockerfile failing on branch-2.
Contributed by Akhil PB.
2019-01-17 10:03:21 +00:00
Akira Ajisaka
300d65c4d7
YARN-8747. [UI2] YARN UI2 page loading failed due to js error under some time zone configuration. Contributed by collinma.
(cherry picked from commit 104ef5df36fd45f1c2d07a2f3d441263aa85e22e)
2019-01-16 14:39:17 +09:00
Chen Liang
1dbe6c9780 HADOOP-16013. DecayRpcScheduler decay thread should run as a daemon. Contributed by Erik Krogen. 2019-01-11 12:57:30 -08:00
Akira Ajisaka
1684301485
HADOOP-16016. TestSSLFactory#testServerWeakCiphers fails on Java 1.8.0_191 or upper
(cherry picked from commit d4ca907da636892e4ab98e232fe0f7f77f1f7aac)
2019-01-11 13:05:58 +09:00
Weiwei Yang
c54a689d96 YARN-8833. Avoid potential integer overflow when computing fair shares. Contributed by liyakun. 2019-01-09 14:33:06 +08:00
Weiwei Yang
2a416fe9f2 HADOOP-16030. AliyunOSS: bring fixes back from HADOOP-15671. Contributed by wujinhu.
(cherry picked from commit f87b3b11c46704dcdb63089dd971e2a5ba1deaac)
2019-01-07 17:30:38 +08:00
Sunil G
2c4e4937bd
Revert "HADOOP-15759. AliyunOSS: Update oss-sdk version to 3.0.0. Contributed by Jinhu Wu."
This reverts commit e4fca6aae46a3c04fc56897986a4ab4e5aa98503.

Revert "HADOOP-15671. AliyunOSS: Support Assume Roles in AliyunOSS. Contributed by Jinhu Wu."

This reverts commit 2b635125fb059fc204ed35bc0e264c42dd3a9fe9.

(cherry picked from commit 1f425271a73fff1fdbe3fbfdb71e906fd1ac0574)
2019-01-05 17:51:02 +09:00
Weiwei Yang
37e36617c5 HADOOP-15323. AliyunOSS: Improve copy file performance for AliyunOSSFileSystemStore. Contributed wujinhu.
(cherry picked from commit 040a202b202a37f3b922cd321eb0a8ded457d88b)
2019-01-03 22:18:05 +08:00
Ayush Saxena
f804d7d3de
HADOOP-16025. Update the year to 2019.
Contributed by Ayush Saxena.
2019-01-02 22:27:03 +00:00
Akira Ajisaka
c157ab49c0
HADOOP-16009. Replace the url of the repository in Apache Hadoop source code.
(cherry picked from commit eee29ed7066e9401c7530b8b6f3b221bacef9a8a)
2018-12-31 06:32:31 +09:00
Wei-Chiu Chuang
10cc02f643 HDFS-14171. Performance improvement in Tailing EditLog. Contributed by Kenneth Yang.
(cherry picked from commit e9a005dfcf4d2249235aeff4da85b321dddc1ca9)
(cherry picked from commit c48640ffbd3852b75f898325ae0b3ea0ba864578)
(cherry picked from commit f24684ca9cd70326e24376a33cda937c98295af0)
(cherry picked from commit 054594c6145711c60f3cb848f08e515c4179f0c4)
2018-12-28 10:46:38 -08:00
Botong Huang
15286d9166 YARN 9108. Fix FederationIntercepter merge home and secondary allocate response typo. Contributed by Abhishek Modi. 2018-12-22 12:46:13 -08:00
Jason Lowe
d62bfaf1a4 HADOOP-15973. Configuration: Included properties are not cached if resource is a stream. Contributed by Eric Payne 2018-12-20 10:02:18 -06:00
shwetayakkali@cloudera.com
500b2a0ca6
HADOOP-16008. Fix typo in CommandsManual.md
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-12-18 13:27:14 +09:00
Jonathan Hung
eb8b1eaa9a YARN-9085. Add Guaranteed and MaxCapacity to CSQueueMetrics
(cherry picked from commit cc51607ccdf60f4ebecf7afa3e2056297ca0ac5f)
2018-12-07 10:47:45 -08:00
Inigo Goiri
5cef413a8e HADOOP-15950. Failover for LdapGroupsMapping. Contributed by Lukas Majercak. 2018-12-03 13:23:10 -08:00
Inigo Goiri
a29eb49f85 Revert "HADOOP-15950. Failover for LdapGroupsMapping. Contributed by Lukas Majercak."
This reverts commit b98ffbe3f228b706b8e547f82e134233ab691443.
2018-12-03 13:22:14 -08:00
Giovanni Matteo Fumarola
b98ffbe3f2 HADOOP-15950. Failover for LdapGroupsMapping. Contributed by Lukas Majercak. 2018-12-03 12:46:30 -08:00
Jonathan Hung
74e40981eb YARN-7794. SLSRunner is not loading timeline service jars, causing failure. 2018-11-30 17:03:01 -08:00
Jonathan Hung
7456da99c1 YARN-9036. Escape newlines in health report in YARN UI. Contributed by Keqiu Hu 2018-11-30 10:18:17 -08:00
Steve Loughran
a3470c65d8
HADOOP-15959. Revert "HADOOP-12751. While using kerberos Hadoop incorrectly assumes names with '@' to be non-simple" 2018-11-30 11:33:19 +00:00
Yiqun Lin
50e11dc807 HDFS-13870. WebHDFS: Document ALLOWSNAPSHOT and DISALLOWSNAPSHOT API doc. Contributed by Siyao Meng.
(cherry picked from commit 0e36e935d909862401890d0a5410204504f48b31)
2018-11-30 11:34:28 +08:00
Weiwei Yang
408f60e6d8 HADOOP-15943. AliyunOSS: add missing owner & group attributes for oss FileStatus. Contributed by wujinhu.
(cherry picked from commit 5ff0cf86a940fd83f1425794921cc075b19f1108)
2018-11-23 14:46:48 +08:00
Akira Ajisaka
d892d82ac0
Update jdiff.stable.api from 2.9.1 to 2.9.2. 2018-11-20 14:32:49 +09:00
Akira Ajisaka
6cae964f6c
Add 2.9.2 release notes and changes documents.
(cherry picked from commit 1a00b4e325146988375c9ce5b11016c45f059a4e)
2018-11-20 14:30:09 +09:00
Weiwei Yang
311be8864f HADOOP-15919. AliyunOSS: Enable Yarn to use OSS. Contributed by wujinhu.
(cherry picked from commit be0708c6eb3c759e43639e0f8df7c9910308fb97)
2018-11-19 15:03:54 +08:00
Vinayakumar B
c3f0681f99 HDFS-14056. Fix error messages in HDFS-12716. Contributed by Ayush Saxena.
(cherry picked from commit 886b935630bf2d46f4c6773de013c093d2e44c38)
2018-11-16 18:02:10 +05:30
Vinayakumar B
bc4098eb07 HDFS-13963. NN UI is broken with IE11. Contributed by Ayush Saxena.
(cherry picked from commit 8571507efa3af3e4a5213a7e24c65e26162eac4d)
2018-11-16 17:43:49 +05:30
Akira Ajisaka
c39e1ee2b9
HADOOP-15925. The config and log of gpg-agent are removed in create-release script. Contributed by Dinesh Chitlangia.
(cherry picked from commit af5958f7b6a209d6a6622acee47a66a4a921828d)
2018-11-16 13:18:48 +09:00
Akira Ajisaka
4199086084
HADOOP-15930. Exclude MD5 checksum files from release artifact.
(cherry picked from commit df5e863fee544c9283e28a21c2788c008d7e3e04)
2018-11-15 10:49:37 +09:00
Sammi Chen
3aac324a07 HADOOP-15917. AliyunOSS: fix incorrect ReadOps and WriteOps in statistics. Contributed by Jinhu Wu.
(cherry picked from commit 3fade865ce84dcf68bcd7de5a5ed1c7d904796e9)
(cherry picked from commit 64cb97fb4467513f73fde18f96f391ad34e3bb0a)
(cherry picked from commit 5d532cfc6f23f942ed10edab55ed251eb99a0664)
(cherry picked from commit 37082a664aaf99bc40522a8dfa231d71792dd976)
2018-11-14 13:53:53 +08:00
Akira Ajisaka
a86b665340
HADOOP-15923. create-release script should set max-cache-ttl as well as default-cache-ttl for gpg-agent.
(cherry picked from commit 703b2860a49577629e7b3ef461d8a61292e79c88)
2018-11-13 13:42:37 +09:00
Botong Huang
b7ca20e16e YARN-8933. [AMRMProxy] Fix potential empty fields in allocation response, move SubClusterTimeout to FederationInterceptor. Contributed by Botong Huang. 2018-11-11 19:41:08 -08:00
Akira Ajisaka
ee1cb3b6e8
YARN-8233. NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null. Contributed by Tao Yang. 2018-11-10 21:44:46 +09:00
Jason Lowe
5e433e5bd0 MAPREDUCE-7156. NullPointerException when reaching max shuffle connections. Contributed by Peter Bacsko
(cherry picked from commit ba1f9d66d94ed0b85084d7c40c09a87478b3a05a)
2018-11-06 18:14:12 -06:00
Inigo Goiri
d9b3b58389 HDFS-14048. DFSOutputStream close() throws exception on subsequent call after DataNode restart. Contributed by Erik Krogen. 2018-11-06 12:16:46 -08:00