Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
20,501 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

20501 Commits

Author SHA1 Message Date
Giovanni Matteo Fumarola 314c559971 YARN-9191. Add cli option in DS to support enforceExecutionType in resource requests. Contributed by Abhishek Modi. 
(cherry picked from commit f738b397ae)
 2019-02-12 14:21:06 +08:00
Weiwei Yang fbd03543d8 YARN-8555. Parameterize TestSchedulingRequestContainerAllocation(Async) to cover both PC handler options. Contributed by Prabhu Joseph. 
(cherry picked from commit 0a1637c750)
 2019-02-11 15:56:34 +08:00
Eric Yang 3d552b24ba YARN-8761. Service AM support for decommissioning component instances. 
Contributed by Billie Rinaldi

(cherry picked from commit 4c465f5535)
 2019-02-10 09:26:27 -08:00
Masatake Iwasaki 6229469574 YARN-9282. Typo in javadoc of class LinuxContainerExecutor: hadoop.security.authetication should be 'authentication'. Contributed by Charan Hebri. 
(cherry picked from commit e0ab1bdece)
 2019-02-09 00:28:59 +09:00
Sunil G fbc08145cf YARN-9257. Distributed Shell client throws a NPE for a non-existent queue. Contributed by Charan Hebri. 2019-02-08 11:22:44 +05:30
Surendra Singh Lilhore 2501fcd26b HDFS-14140. JournalNodeSyncer authentication is failing in secure cluster. Contributed by Surendra Singh Lilhore. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 4be87353e3)
 2019-02-07 16:52:53 -08:00
Ranith Sardar c5eca3f7ee
HADOOP-16032. Distcp It should clear sub directory ACL before applying new ACL on. 
Contributed by Ranith Sardar.

(cherry picked from commit 546c5d70ef)
 2019-02-07 21:49:18 +00:00
Eric E Payne 55dde827e6 YARN-7171: RM UI should sort memory / cores numerically. Contributed by Ahmed Hussein 
(cherry picked from commit d1ca9432dd)
 2019-02-07 16:47:15 +00:00
Andrew Olson 36f3e775d4
HADOOP-15281. Distcp to add no-rename copy option. 
Contributed by Andrew Olson.

(cherry picked from commit de804e53b9)
 2019-02-07 10:09:13 +00:00
Vinayakumar B e2b91b2ccb YARN-8498. Yarn NodeManager OOM Listener Fails Compilation on Ubuntu 18.04. Contributed by Ayush Saxena. 2019-02-07 13:03:42 +05:30
Kitti Nanasi 38541b2375 HDFS-14231. DataXceiver#run() should not log exceptions caused by InvalidToken exception as an error. Contributed by Kitti Nanasi. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 49ddd8a6ed)
 2019-02-05 15:15:04 -08:00
Wangda Tan 649da5af04 Make upstream aware of 3.1.2 release 
Change-Id: I397bc6ef75498726df4763bd07a8bf8fe1c38365
(cherry picked from commit 308f3168fa)
 2019-02-05 14:05:51 -08:00
Da Zhou 84ce0f1bfa
HADOOP-16074. WASB: Update container not found error code. 
Contributed by Da Zhou.

(cherry picked from commit ba9efe06fa)
 2019-02-05 14:41:15 +00:00
Weiwei Yang 3a51e50fd8 YARN-9275. Add link to NodeAttributes doc in PlacementConstraints document. Contributed by Masatake Iwasaki. 
(cherry picked from commit aa7ce50e55)
 2019-02-05 16:09:15 +08:00
Larry McCay 410c6b4cb5
HADOOP-16076. SPNEGO+SSL Client Connections with HttpClient Broken. 
Contributed by Larry McCay

(cherry picked from commit 758e9ce781)
 2019-02-04 17:41:20 +00:00
Steve Loughran bdd17be9ec
HDFS-13713. Add specification of Multipart Upload API to FS specification, with contract tests. 
Contributed by Ewan Higgs and Steve Loughran.

(cherry picked from commit c1d24f8483)
 2019-02-04 17:10:19 +00:00
Weiwei Yang b64e9df949 YARN-9262. TestRMAppAttemptTransitions is failing with an NPE. Contributed by lujie. 
(cherry picked from commit 28ad20a711)
 2019-02-04 14:00:30 +05:30
Sunil G 99876a5ab8 YARN-9206. RMServerUtils does not count SHUTDOWN as an accepted state. Contributed by Kuhu Shukla. 
(cherry picked from commit 604b2489a9)
 2019-02-04 12:49:06 +05:30
Weiwei Yang a0fafbc3ef YARN-9263. TestConfigurationNodeAttributesProvider fails after Mockito updated. Contributed by Weiwei Yang. 
(cherry picked from commit f20b043a02)
 2019-02-04 12:45:40 +05:30
Akira Ajisaka 7cd7d5b628
HADOOP-16089. AliyunOSS: update oss-sdk version to 3.4.1. Contributed by wujinhu. 
(cherry picked from commit 0f9aa5b4d5)
 2019-02-04 14:47:48 +09:00
Akira Ajisaka 97fa326b79
MAPREDUCE-7177. Disable speculative execution in TestDFSIO. Contributed by Zhaohui Xin. 
(cherry picked from commit c991e2ca5a)
 2019-02-04 14:04:07 +09:00
Takanobu Asanuma 8887980d32 HDFS-14232. libhdfs is not included in binary tarball. Contributed by Akira Ajisaka. 
(cherry picked from commit ec77e95bbd)
 2019-02-04 10:12:53 +09:00
Steve Loughran 3b47371fe2
HADOOP-16079. Token.toString faulting if any token listed can't load. 
Contributed by Steve Loughran.

(cherry picked from commit 7f46d13dac)
 2019-02-01 14:34:11 +00:00
Sunil G 0e7060a1d5 YARN-9099. GpuResourceAllocator#getReleasingGpus calculates number of GPUs in a wrong way. Contributed by Szilard Nemeth. 
(cherry picked from commit 71c49fa60f)
 2019-01-31 09:26:07 +05:30
Eric E Payne 4052b7ee60 YARN-6616: YARN AHS shows submitTime for jobs same as startTime. Contributed by Prabhu Joseph 
(cherry picked from commit 04105bbfdb)
 2019-01-29 17:52:54 +00:00
Weiwei Yang 6b8dd8d113 YARN-9237. NM should ignore sending finished apps to RM during RM fail-over. Contributed by Jiandan Yang. 
(cherry picked from commit 4f63ffe444)
 2019-01-29 10:42:09 +08:00
Eric Yang 8c332affa8 YARN-8901. Fixed restart policy NEVER/ON_FAILURE with component dependency. 
Contributed by Suma Shivaprasad

(cherry picked from commit f5a95f7998)
 2019-01-28 18:12:04 -05:00
Masatake Iwasaki a86893f875 HDFS-12729. Document special paths in HDFS. Contributed by Masatake Iwasaki. 
(cherry picked from commit dc5af4c6b7)
 2019-01-29 02:28:18 +09:00
Dinesh Chitlangia 636821854c
HADOOP-16075. Upgrade checkstyle version to 8.16. 
Contributed by Dinesh Chitlangia.

(cherry picked from commit 47d6b9bb7f)
 2019-01-27 17:00:35 +00:00
Jonathan Hung bf760e7e81 YARN-9222. Print launchTime in ApplicationSummary 
(cherry picked from commit 6cace58e21)
 2019-01-25 13:23:37 -08:00
Dinesh Chitlangia eb77e60163 HDFS-14228. Incorrect getSnapshottableDirListing() javadoc. Contributed by Dinesh Chitlangia. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 45caeee6cf)
 2019-01-25 07:37:43 -08:00
Akira Ajisaka dc12754ab6
HADOOP-16065. -Ddynamodb should be -Ddynamo in AWS SDK testing document. 
(cherry picked from commit 3c60303ac5)
 2019-01-25 10:28:46 +09:00
Sunil G 4aea4b7c9c YARN-8961. [UI2] Flow Run End Time shows 'Invalid date'. Contributed by Akhil PB 
(cherry picked from commit c726445990)
 2019-01-24 15:02:21 +05:30
Weiwei Yang bc6374f282 YARN-9205. When using custom resource type, application will fail to run due to the CapacityScheduler throws InvalidResourceRequestException(GREATER_THEN_MAX_ALLOCATION). Contributed by Zhankun Tang. 2019-01-23 18:10:28 +08:00
Weiwei Yang 8ad7711605 YARN-8101. Add UT to verify node-attributes in RM nodes rest API. Contributed by Prabhu Joseph. 
(cherry picked from commit 721d5c2a5f)
 2019-01-23 18:07:45 +08:00
Takanobu Asanuma e88db02753 HDFS-14218. EC: Ls -e throw NPE when directory ec policy is disabled. Contributed by Ayush Saxena. 
(cherry picked from commit 7d6792e5d2)
 2019-01-23 10:04:50 +09:00
Eric Yang 65d2b13dc2 HADOOP-15922. Fixed DelegationTokenAuthenticator URL decoding for doAs user. 
Contributed by He Xiaoqiao

(cherry picked from commit 0dd35e218f)
 2019-01-22 19:39:05 -05:00
Da Zhou 29de303e0a
HADOOP-16048. ABFS: Fix Date format parser. 
Contributed by Da Zhou.

(cherry picked from commit 00ad9e23e8)
 2019-01-22 16:41:33 +00:00
Arpit Agarwal 8dd8121f7d HDFS-14221. Replace Guava Optional with Java Optional. Contributed by Arpit Agarwal. 
(cherry picked from commit 1ff658b2ef)
 2019-01-21 20:46:50 -08:00
Arpit Agarwal cd5e7f152f HDFS-14222. Make ThrottledAsyncChecker constructor public. Contributed by Arpit Agarwal. 
(cherry picked from commit 6f0756fc0e)
 2019-01-21 20:46:50 -08:00
Weiwei Yang 2253a86a3f HDFS-14207. ZKFC should catch exception when ha configuration missing. Contributed by Fei Hui. 
(cherry picked from commit de34fc148c)
 2019-01-22 12:08:03 +08:00
Weiwei Yang 9114489566 YARN-9210. RM nodes web page can not display node info. Contributed by Jiandan Yang. 
(cherry picked from commit d43df31751)
 2019-01-22 10:46:37 +08:00
Weiwei Yang ac2f4b64f9 YARN-9204. RM fails to start if absolute resource is specified for partition capacity in CS queues. Contributed by Jiandan Yang. 
(cherry picked from commit abde1e1f58)
 2019-01-21 21:20:01 +08:00
Chen Liang 54d4abdfe9 HADOOP-15481. Emit FairCallQueue stats as metrics. Contributed by Christopher Gregorian. 2019-01-18 11:54:20 -08:00
Akira Ajisaka 2a84f1cf76
HDFS-14213. Remove Jansson from BUILDING.txt. Contributed by Dinesh Chitlangia. 
(cherry picked from commit 96a84b61fb)
 2019-01-18 15:32:27 +09:00
Wangda Tan fe7cb2d84a YARN-9194. Invalid event: REGISTERED and LAUNCH_FAILED at FAILED, and NullPointerException happens in RM while shutdown a NM. (lujie via wangda) 
Change-Id: I4359f59a73a278a941f4bb9d106dd38c9cb471fe
(cherry picked from commit 6d7eedfd28)
 2019-01-17 15:13:42 -08:00
rahul3 4aee7946dc
YARN-9203. Fix typos in yarn-default.xml. 
This closes #437

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 0a46baecd3)
 2019-01-17 16:19:49 +09:00
Akira Ajisaka a415446705
YARN-8747. [UI2] YARN UI2 page loading failed due to js error under some time zone configuration. Contributed by collinma. 
(cherry picked from commit 104ef5df36)
 2019-01-16 14:37:43 +09:00
luhuachao 18becec548
HADOOP-16019. ZKDelegationTokenSecretManager won't log exception message occured in function setJaasConfiguration. 
Contributed by luhuachao.

(cherry picked from commit ccc43621ab)
 2019-01-15 13:16:07 +00:00
Da Zhou 1d4390e16b
HADOOP-16044. ABFS: Better exception handling of DNS errors followup 
Contributed by Da Zhou.

(cherry picked from commit 30863c5ae3)
 2019-01-14 19:45:30 +00:00