Commit Graph

18913 Commits

Author SHA1 Message Date
Weiwei Yang b61754b1bd YARN-9210. RM nodes web page can not display node info. Contributed by Jiandan Yang.
(cherry picked from commit d43df31751)
2019-01-22 11:01:00 +08:00
Weiwei Yang 4edd883d48 YARN-9204. RM fails to start if absolute resource is specified for partition capacity in CS queues. Contributed by Jiandan Yang.
(cherry picked from commit abde1e1f58)
2019-01-21 21:27:40 +08:00
Chen Liang 0cfc2d8475 HADOOP-15481. Emit FairCallQueue stats as metrics. Contributed by Christopher Gregorian. 2019-01-18 11:48:26 -08:00
Akira Ajisaka dea75af9a7
HDFS-14213. Remove Jansson from BUILDING.txt. Contributed by Dinesh Chitlangia.
(cherry picked from commit 96a84b61fb)
2019-01-18 15:34:07 +09:00
Wangda Tan a685ffe9a9 YARN-9194. Invalid event: REGISTERED and LAUNCH_FAILED at FAILED, and NullPointerException happens in RM while shutdown a NM. (lujie via wangda)
Change-Id: I4359f59a73a278a941f4bb9d106dd38c9cb471fe
(cherry picked from commit 6d7eedfd28)
(cherry picked from commit fe7cb2d84a)
2019-01-17 15:17:34 -08:00
rahul3 8dea94d071
YARN-9203. Fix typos in yarn-default.xml.
This closes #437

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 0a46baecd3)
2019-01-17 16:20:15 +09:00
Akira Ajisaka d07d275f94
YARN-8747. [UI2] YARN UI2 page loading failed due to js error under some time zone configuration. Contributed by collinma.
(cherry picked from commit 104ef5df36)
2019-01-16 14:38:29 +09:00
luhuachao 4297a3b7ac
HADOOP-16019. ZKDelegationTokenSecretManager won't log exception message occured in function setJaasConfiguration.
Contributed by luhuachao.

(cherry picked from commit ccc43621ab)
2019-01-15 13:16:50 +00:00
Inigo Goiri b05d8de10e HADOOP-16045. Don't run TestDU on Windows. Contributed by Lukas Majercak.
(cherry picked from commit 35fa3bd685)
2019-01-11 18:10:40 -08:00
Surendra Singh Lilhore 6c846cfbf2 HDFS-14198. Upload and Create button doesn't get enabled after getting reset. Contributed by Ayush Saxena.
(cherry picked from commit 9aeaaa0479)
2019-01-11 14:59:17 +05:30
Akira Ajisaka ced32754bb
HADOOP-16016. TestSSLFactory#testServerWeakCiphers fails on Java 1.8.0_191 or upper
(cherry picked from commit d4ca907da6)
2019-01-11 13:05:06 +09:00
Jason Lowe d8aac6c215 Revert "HDFS-14084. Need for more stats in DFSClient. Contributed by Pranay Singh."
This reverts commit e8e55839a0.
2019-01-09 17:48:16 -06:00
Kai Xie fee33057f0
HADOOP-16018. DistCp won't reassemble chunks when blocks per chunk > 0.
Contributed by Kai Xie.

(cherry picked from commit 188bebbe7e)
2019-01-08 13:35:17 +00:00
Weiwei Yang 91e9c9f96e YARN-9173. FairShare calculation broken for large values after YARN-8833. Contributed Wilfred Spiegelenburg. 2019-01-08 13:56:21 +08:00
Wangda Tan 3570713a69 YARN-8822. Nvidia-docker v2 support for YARN GPU feature. (Charo Zhang via wangda)
Change-Id: I416268888a7b6f097d218d84e8497dd70b4b6d8f
2019-01-07 12:30:30 -08:00
Eric Yang a446949f56 HADOOP-16031. Fixed TestSecureLogins unit test. Contributed by Akira Ajisaka
(cherry picked from commit bba76b6f31)
2019-01-07 13:24:50 -05:00
Wangda Tan 31ea2f7806 Preparing for 3.1.3 development
Change-Id: I3c3d3ee47dc4fef239127b4452ff14676fa26e3d
2019-01-07 10:04:58 -08:00
Weiwei Yang 5819f91be0 HADOOP-16030. AliyunOSS: bring fixes back from HADOOP-15671. Contributed by wujinhu.
(cherry picked from commit f87b3b11c4)
2019-01-07 16:15:58 +08:00
Sunil G 87ad2615b0
Revert "HADOOP-15759. AliyunOSS: Update oss-sdk version to 3.0.0. Contributed by Jinhu Wu."
This reverts commit e4fca6aae4.

Revert "HADOOP-15671. AliyunOSS: Support Assume Roles in AliyunOSS. Contributed by Jinhu Wu."

This reverts commit 2b635125fb.

(cherry picked from commit 1f425271a7)
2019-01-05 17:50:11 +09:00
Eric Yang 2ba9c9f7c1 HADOOP-15996. Improved Kerberos username mapping strategy in Hadoop.
Contributed by Bolke de Bruin

(cherry picked from commit d43af8b3db)
(cherry picked from commit febafd0e4f)
2019-01-04 18:04:11 -05:00
Sunil G d3fdbbc2ab HADOOP-15997. KMS client uses wrong UGI after HADOOP-14445. Contributed by Wei-Chiu Chuang.
(cherry picked from commit 51427cbdfb)
2019-01-04 21:51:00 +05:30
Pranay Singh e8e55839a0 HDFS-14084. Need for more stats in DFSClient. Contributed by Pranay Singh.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit ecdeaa7e6a)
(cherry picked from commit 1f39eae7e6)
2019-01-03 09:57:34 -08:00
Weiwei Yang d6464629ca YARN-9164. Shutdown NM may cause NPE when opportunistic container scheduling is enabled. Contributed by lujie.
(cherry picked from commit cfe89e6f96)
2019-01-04 01:37:47 +08:00
Weiwei Yang 3f9fdd2344 HADOOP-15323. AliyunOSS: Improve copy file performance for AliyunOSSFileSystemStore. Contributed wujinhu.
(cherry picked from commit 040a202b20)
2019-01-03 21:55:25 +08:00
Weiwei Yang 2a5b2eda7c MAPREDUCE-7174. Mapreduce example wordmedian should handle generic options. Contributed by Fei Hui.
(cherry picked from commit 9e7196749e)
2019-01-02 21:56:52 +08:00
Akira Ajisaka 32fc4ac752
HADOOP-16009. Replace the url of the repository in Apache Hadoop source code.
(cherry picked from commit eee29ed706)
2018-12-31 06:31:39 +09:00
Wei-Chiu Chuang f24684ca9c HDFS-14171. Performance improvement in Tailing EditLog. Contributed by Kenneth Yang.
(cherry picked from commit e9a005dfcf)
(cherry picked from commit c48640ffbd)
2018-12-28 10:39:14 -08:00
Surendra Singh Lilhore de2b04a74b HDFS-14046. In-Maintenance ICON is missing in datanode info page. Contributed by Ranith Sardar.
(cherry picked from commit 686fcd4db3)
2018-12-24 11:11:21 +05:30
Surendra Singh Lilhore ef94eeebb4 HDFS-14166. Ls with -e option not giving the result in proper format. Contributed by Shubham Dewan.
(cherry picked from commit 763e96ea2b)
2018-12-22 12:46:37 +05:30
Akira Ajisaka 4026cc78a2
YARN-9154. Fix itemization in YARN service quickstart document. Contributed by Ayush Saxena.
(cherry picked from commit e98e963e51)
2018-12-22 13:27:01 +09:00
Jason Lowe 5c5c4438ad HADOOP-15973. Configuration: Included properties are not cached if resource is a stream. Contributed by Eric Payne
(cherry picked from commit 3961690037)
2018-12-20 09:56:12 -06:00
Takanobu Asanuma 9f30916a1b HDFS-13661. Ls command with e option fails when the filesystem is not HDFS.
(cherry picked from commit d963575918)
2018-12-20 10:05:47 +09:00
Eric Yang 956e6cfee6 YARN-9084. Reset container state and defer readiness check for upgrade.
Contributed by Chandni Singh

(cherry picked from commit ccdd982e51)
2018-12-18 18:06:04 -05:00
Eric Yang b4fa1830a8 YARN-9040. Fixed memory leak in LevelDBCacheTimelineStore and DBIterator.
Contributed by Tarun Parimi

(cherry picked from commit 71e0b0d800)
2018-12-17 12:08:35 -05:00
Akira Ajisaka 0ccfee31a5
YARN-9122. Add table of contents to YARN Service API document. Contributed by Zhankun Tang.
(cherry picked from commit 26e55d4ceb)
2018-12-15 10:31:01 +09:00
Eric Yang 690d760174 YARN-9125. Fixed Carriage Return detection in Docker container launch command.
Contributed by Billie Rinaldi

(cherry picked from commit b2d7204ed0)
2018-12-14 17:55:38 -05:00
Akira Ajisaka 51b7376a8d
MAPREDUCE-7170. Doc typo in PluggableShuffleAndPluggableSort.md. Contributed by Zhaohui Xin.
(cherry picked from commit e0d75088f2)
2018-12-13 16:28:18 +09:00
Steve Loughran 1192fad0d2
HADOOP-15808. Harden Token service loader use.
Contributed by Steve Loughran.

Note that the patch for TestToken is much simpler than the 3.2+ patch.
In later branches,it modifies a test case which is not present in this branch.

(cherry picked from commit 202926ac33)
2018-12-11 17:39:55 +00:00
Weiwei Yang 14ecdb62b6 YARN-9009. Fix flaky test TestEntityGroupFSTimelineStore.testCleanLogs. Contributed by OrDTesters.
(cherry picked from commit 1c09a10e96)
2018-12-10 12:17:00 +08:00
Jonathan Hung 7b523e6a77 YARN-9085. Add Guaranteed and MaxCapacity to CSQueueMetrics
(cherry picked from commit 978ab3e958227220cb6f1a08ae6e7cdb8a46628b)
(cherry picked from commit dca69d178dba21c41fd1293187f29143f7e81e19)
2018-12-07 10:45:57 -08:00
Jason Lowe 6e6f43afd8 MAPREDUCE-7159. FrameworkUploader: ensure proper permissions of generated framework tar.gz if restrictive umask is used. Contributed by Peter Bacsko
(cherry picked from commit 9886c27c71)
2018-12-06 15:02:00 -06:00
Eric Yang 7ef4ff1905 YARN-9071. Improved status update for reinitialized containers.
Contributed by Chandni Singh

(cherry picked from commit 1b790f4dd1)
2018-12-05 19:05:26 -05:00
Jason Lowe 293c992e81 HADOOP-15974. Upgrade Curator version to 2.13.0 to fix ZK tests. Contributed by Akira Ajisaka
(cherry picked from commit 9287ab3642)
2018-12-04 16:48:26 -06:00
Steve Loughran 844f51217b
HADOOP-15966. Hadoop Kerberos broken on macos as java.security.krb5.realm is reset.
Contributed by Steve Loughran

(cherry picked from commit db2d8b01c6)
2018-12-04 15:37:13 +00:00
Akira Ajisaka 427eae03fe
HADOOP-15970. Upgrade plexus-utils from 2.0.5 to 3.1.0.
(cherry picked from commit ff31313d83)
2018-12-04 22:47:17 +09:00
Giovanni Matteo Fumarola 023e42fa05 HADOOP-15950. Failover for LdapGroupsMapping. Contributed by Lukas Majercak. 2018-12-03 12:45:05 -08:00
Jonathan Hung 2cb9479bfc YARN-9036. Escape newlines in health report in YARN UI. Contributed by Keqiu Hu 2018-11-30 10:16:39 -08:00
Eric Yang e534be892c HADOOP-15922. Revert patch 004.
(cherry picked from commit 38ea3814bd)
2018-11-30 12:52:36 -05:00
Akira Ajisaka 298c76c485
MAPREDUCE-7165. mapred-site.xml is misformatted in single node setup document. Contributed by Zhaohui Xin.
(cherry picked from commit c9bfca217f)
2018-11-30 13:30:52 +09:00
Brahma Reddy Battula 0b83c95ff4 HDFS-14095. EC: Track Erasure Coding commands in DFS statistics. Contributed by Ayush Saxena.
(cherry picked from commit f534736867)
2018-11-30 00:27:37 +05:30