Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
20,553 Commits 326 Branches 371 Tags
Commit Graph

20553 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Weiwei Yang
4d4968646a YARN-9252. Allocation Tag Namespace support in Distributed Shell. Contributed by Prabhu Joseph. 
(cherry picked from commit 2b7f828d4646e1837ef81e127ba86c6d77128e9b)
 2019-02-12 16:31:38 +08:00
Weiwei Yang
9cfa5ce0c1 YARN-9253. Add UT to verify Placement Constraint in Distributed Shell. Contributed by Prabhu Joseph. 
(cherry picked from commit 711d22f166b4bb76005ae876a9d7ff7238991f90)
 2019-02-12 16:22:34 +08:00
Giovanni Matteo Fumarola
314c559971 YARN-9191. Add cli option in DS to support enforceExecutionType in resource requests. Contributed by Abhishek Modi. 
(cherry picked from commit f738b397ae021c9be900e4ec51ab55cd69b075e0)
 2019-02-12 14:21:06 +08:00
Weiwei Yang
fbd03543d8 YARN-8555. Parameterize TestSchedulingRequestContainerAllocation(Async) to cover both PC handler options. Contributed by Prabhu Joseph. 
(cherry picked from commit 0a1637c750a5dbe67f1a9b2969ac1b2d4785a11c)
 2019-02-11 15:56:34 +08:00
Eric Yang
3d552b24ba YARN-8761. Service AM support for decommissioning component instances. 
Contributed by Billie Rinaldi

(cherry picked from commit 4c465f5535054dad2ef0b18128fb115129f6939e)
 2019-02-10 09:26:27 -08:00
Masatake Iwasaki
6229469574 YARN-9282. Typo in javadoc of class LinuxContainerExecutor: hadoop.security.authetication should be 'authentication'. Contributed by Charan Hebri. 
(cherry picked from commit e0ab1bdecec3d7ba7ddc0849781d7f71714f8687)
 2019-02-09 00:28:59 +09:00
Sunil G
fbc08145cf YARN-9257. Distributed Shell client throws a NPE for a non-existent queue. Contributed by Charan Hebri. 2019-02-08 11:22:44 +05:30
Surendra Singh Lilhore
2501fcd26b HDFS-14140. JournalNodeSyncer authentication is failing in secure cluster. Contributed by Surendra Singh Lilhore. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 4be87353e35a30d95d8847b09a1890b014bfc6bb)
 2019-02-07 16:52:53 -08:00
Ranith Sardar
c5eca3f7ee
HADOOP-16032. Distcp It should clear sub directory ACL before applying new ACL on. 
Contributed by Ranith Sardar.

(cherry picked from commit 546c5d70efebb828389f609a89b123c4ee51f867)
 2019-02-07 21:49:18 +00:00
Eric E Payne
55dde827e6 YARN-7171: RM UI should sort memory / cores numerically. Contributed by Ahmed Hussein 
(cherry picked from commit d1ca9432dd0b3e9b46b4903e8c9d33f5c28fcc1b)
 2019-02-07 16:47:15 +00:00
Andrew Olson
36f3e775d4
HADOOP-15281. Distcp to add no-rename copy option. 
Contributed by Andrew Olson.

(cherry picked from commit de804e53b9d20a2df75a4c7252bf83ed52011488)
 2019-02-07 10:09:13 +00:00
Vinayakumar B
e2b91b2ccb YARN-8498. Yarn NodeManager OOM Listener Fails Compilation on Ubuntu 18.04. Contributed by Ayush Saxena. 2019-02-07 13:03:42 +05:30
Kitti Nanasi
38541b2375 HDFS-14231. DataXceiver#run() should not log exceptions caused by InvalidToken exception as an error. Contributed by Kitti Nanasi. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 49ddd8a6ed5b40d12defb0771b4c8b53d4ffde3f)
 2019-02-05 15:15:04 -08:00
Wangda Tan
649da5af04 Make upstream aware of 3.1.2 release 
Change-Id: I397bc6ef75498726df4763bd07a8bf8fe1c38365
(cherry picked from commit 308f3168fa221a336ef0dbb1a17358b1ad6f9356)
 2019-02-05 14:05:51 -08:00
Da Zhou
84ce0f1bfa
HADOOP-16074. WASB: Update container not found error code. 
Contributed by Da Zhou.

(cherry picked from commit ba9efe06fadb9631763f3e623d8748bbe59ff748)
 2019-02-05 14:41:15 +00:00
Weiwei Yang
3a51e50fd8 YARN-9275. Add link to NodeAttributes doc in PlacementConstraints document. Contributed by Masatake Iwasaki. 
(cherry picked from commit aa7ce50e557b0257ca7980d1d736a62b1f6ccb5d)
 2019-02-05 16:09:15 +08:00
Larry McCay
410c6b4cb5
HADOOP-16076. SPNEGO+SSL Client Connections with HttpClient Broken. 
Contributed by Larry McCay

(cherry picked from commit 758e9ce781cfa0667eecb33914e4e221e769503d)
 2019-02-04 17:41:20 +00:00
Steve Loughran
bdd17be9ec
HDFS-13713. Add specification of Multipart Upload API to FS specification, with contract tests. 
Contributed by Ewan Higgs and Steve Loughran.

(cherry picked from commit c1d24f848345f6d34a2ac2d570d49e9787a0df6a)
 2019-02-04 17:10:19 +00:00
Weiwei Yang
b64e9df949 YARN-9262. TestRMAppAttemptTransitions is failing with an NPE. Contributed by lujie. 
(cherry picked from commit 28ad20a711735243bc10b10e33866dc525f415eb)
 2019-02-04 14:00:30 +05:30
Sunil G
99876a5ab8 YARN-9206. RMServerUtils does not count SHUTDOWN as an accepted state. Contributed by Kuhu Shukla. 
(cherry picked from commit 604b2489a9e168a0fd702343f6f8844df9e86d17)
 2019-02-04 12:49:06 +05:30
Weiwei Yang
a0fafbc3ef YARN-9263. TestConfigurationNodeAttributesProvider fails after Mockito updated. Contributed by Weiwei Yang. 
(cherry picked from commit f20b043a02bd5b20f68123b2a7ab86f7cb9fe32a)
 2019-02-04 12:45:40 +05:30
Akira Ajisaka
7cd7d5b628
HADOOP-16089. AliyunOSS: update oss-sdk version to 3.4.1. Contributed by wujinhu. 
(cherry picked from commit 0f9aa5b4d58e34653f42e98a244aaf1c806b37cf)
 2019-02-04 14:47:48 +09:00
Akira Ajisaka
97fa326b79
MAPREDUCE-7177. Disable speculative execution in TestDFSIO. Contributed by Zhaohui Xin. 
(cherry picked from commit c991e2ca5a65eae62bad7e5baf81f1eb633b7ec0)
 2019-02-04 14:04:07 +09:00
Takanobu Asanuma
8887980d32 HDFS-14232. libhdfs is not included in binary tarball. Contributed by Akira Ajisaka. 
(cherry picked from commit ec77e95bbd607f1dbfc51132ad02898b4ed1acd0)
 2019-02-04 10:12:53 +09:00
Steve Loughran
3b47371fe2
HADOOP-16079. Token.toString faulting if any token listed can't load. 
Contributed by Steve Loughran.

(cherry picked from commit 7f46d13dac8cf85b094f41b3dd68e02c69e5afbc)
 2019-02-01 14:34:11 +00:00
Sunil G
0e7060a1d5 YARN-9099. GpuResourceAllocator#getReleasingGpus calculates number of GPUs in a wrong way. Contributed by Szilard Nemeth. 
(cherry picked from commit 71c49fa60faad2504b0411979a6e46e595b97a85)
 2019-01-31 09:26:07 +05:30
Eric E Payne
4052b7ee60 YARN-6616: YARN AHS shows submitTime for jobs same as startTime. Contributed by Prabhu Joseph 
(cherry picked from commit 04105bbfdb041a41062c856632641140de84fba8)
 2019-01-29 17:52:54 +00:00
Weiwei Yang
6b8dd8d113 YARN-9237. NM should ignore sending finished apps to RM during RM fail-over. Contributed by Jiandan Yang. 
(cherry picked from commit 4f63ffe444286dac91ed36fd647d8ce69e75b0f0)
 2019-01-29 10:42:09 +08:00
Eric Yang
8c332affa8 YARN-8901. Fixed restart policy NEVER/ON_FAILURE with component dependency. 
Contributed by Suma Shivaprasad

(cherry picked from commit f5a95f7998e110cab81e52acd99b07e13ea9653d)
 2019-01-28 18:12:04 -05:00
Masatake Iwasaki
a86893f875 HDFS-12729. Document special paths in HDFS. Contributed by Masatake Iwasaki. 
(cherry picked from commit dc5af4c6b7bdf437713a8c6ca3c535c4b6d6992e)
 2019-01-29 02:28:18 +09:00
Dinesh Chitlangia
636821854c
HADOOP-16075. Upgrade checkstyle version to 8.16. 
Contributed by Dinesh Chitlangia.

(cherry picked from commit 47d6b9bb7f6c3efb9681f8228df356cc668fe0d3)
 2019-01-27 17:00:35 +00:00
Jonathan Hung
bf760e7e81 YARN-9222. Print launchTime in ApplicationSummary 
(cherry picked from commit 6cace58e212d3ee0aec988926a5a17c9cc58e645)
 2019-01-25 13:23:37 -08:00
Dinesh Chitlangia
eb77e60163 HDFS-14228. Incorrect getSnapshottableDirListing() javadoc. Contributed by Dinesh Chitlangia. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 45caeee6cfcf1ae3355cd880402159cf31e94a8a)
 2019-01-25 07:37:43 -08:00
Akira Ajisaka
dc12754ab6
HADOOP-16065. -Ddynamodb should be -Ddynamo in AWS SDK testing document. 
(cherry picked from commit 3c60303ac59d3b6cc375e7ac10214fc36d330fa4)
 2019-01-25 10:28:46 +09:00
Sunil G
4aea4b7c9c YARN-8961. [UI2] Flow Run End Time shows 'Invalid date'. Contributed by Akhil PB 
(cherry picked from commit c7264459901e59021e180228cea3a6ae334a339f)
 2019-01-24 15:02:21 +05:30
Weiwei Yang
bc6374f282 YARN-9205. When using custom resource type, application will fail to run due to the CapacityScheduler throws InvalidResourceRequestException(GREATER_THEN_MAX_ALLOCATION). Contributed by Zhankun Tang. 2019-01-23 18:10:28 +08:00
Weiwei Yang
8ad7711605 YARN-8101. Add UT to verify node-attributes in RM nodes rest API. Contributed by Prabhu Joseph. 
(cherry picked from commit 721d5c2a5f43b29c9cc4439980f21854d9e8ae27)
 2019-01-23 18:07:45 +08:00
Takanobu Asanuma
e88db02753 HDFS-14218. EC: Ls -e throw NPE when directory ec policy is disabled. Contributed by Ayush Saxena. 
(cherry picked from commit 7d6792e5d2001e1a83ae75a4777324a3b01c557a)
 2019-01-23 10:04:50 +09:00
Eric Yang
65d2b13dc2 HADOOP-15922. Fixed DelegationTokenAuthenticator URL decoding for doAs user. 
Contributed by He Xiaoqiao

(cherry picked from commit 0dd35e218fd4d6c660fd064e893be3112c546c9f)
 2019-01-22 19:39:05 -05:00
Da Zhou
29de303e0a
HADOOP-16048. ABFS: Fix Date format parser. 
Contributed by Da Zhou.

(cherry picked from commit 00ad9e23e88d1e1b1f887b6c9473a7a924a95a97)
 2019-01-22 16:41:33 +00:00
Arpit Agarwal
8dd8121f7d HDFS-14221. Replace Guava Optional with Java Optional. Contributed by Arpit Agarwal. 
(cherry picked from commit 1ff658b2ef3fb933897712c728bc628f3f44bded)
 2019-01-21 20:46:50 -08:00
Arpit Agarwal
cd5e7f152f HDFS-14222. Make ThrottledAsyncChecker constructor public. Contributed by Arpit Agarwal. 
(cherry picked from commit 6f0756fc0e43b785d3dee72a669997d934b57e4c)
 2019-01-21 20:46:50 -08:00
Weiwei Yang
2253a86a3f HDFS-14207. ZKFC should catch exception when ha configuration missing. Contributed by Fei Hui. 
(cherry picked from commit de34fc148ca4785c2ae7204df15096b955e671c4)
 2019-01-22 12:08:03 +08:00
Weiwei Yang
9114489566 YARN-9210. RM nodes web page can not display node info. Contributed by Jiandan Yang. 
(cherry picked from commit d43df31751bcadab77d42b31e3e1dd5748b471b5)
 2019-01-22 10:46:37 +08:00
Weiwei Yang
ac2f4b64f9 YARN-9204. RM fails to start if absolute resource is specified for partition capacity in CS queues. Contributed by Jiandan Yang. 
(cherry picked from commit abde1e1f58d5b699e4b8e460cff68e154738169b)
 2019-01-21 21:20:01 +08:00
Chen Liang
54d4abdfe9 HADOOP-15481. Emit FairCallQueue stats as metrics. Contributed by Christopher Gregorian. 2019-01-18 11:54:20 -08:00
Akira Ajisaka
2a84f1cf76
HDFS-14213. Remove Jansson from BUILDING.txt. Contributed by Dinesh Chitlangia. 
(cherry picked from commit 96a84b61fb693e9657f1f1ae3d6ed3a04a7e8efa)
 2019-01-18 15:32:27 +09:00
Wangda Tan
fe7cb2d84a YARN-9194. Invalid event: REGISTERED and LAUNCH_FAILED at FAILED, and NullPointerException happens in RM while shutdown a NM. (lujie via wangda) 
Change-Id: I4359f59a73a278a941f4bb9d106dd38c9cb471fe
(cherry picked from commit 6d7eedfd28cc1712690db2f6ca8a281b0901ee28)
 2019-01-17 15:13:42 -08:00
rahul3
4aee7946dc
YARN-9203. Fix typos in yarn-default.xml. 
This closes #437

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 0a46baecd31c485d1ea4e567c29c47bfba0b092e)
 2019-01-17 16:19:49 +09:00
Akira Ajisaka
a415446705
YARN-8747. [UI2] YARN UI2 page loading failed due to js error under some time zone configuration. Contributed by collinma. 
(cherry picked from commit 104ef5df36fd45f1c2d07a2f3d441263aa85e22e)
 2019-01-16 14:37:43 +09:00