20479 Commits

Author SHA1 Message Date
Weiwei Yang
cdce1c17a0 YARN-9316. TestPlacementConstraintsUtil#testInterAppConstraintsByAppID fails intermittently. Contributed by Prabhu Joseph.
(cherry picked from commit 9cd5c5447f008b38be43b21ca596d8a36ad0cd55)
2019-02-24 22:48:55 +08:00
Weiwei Yang
604a915bab YARN-9238. Avoid allocating opportunistic containers to previous/removed/non-exist application attempt. Contributed by lujie.
(cherry picked from commit 9c88695bcda0ffe4c7f49d643c649dfa1dce9bde)
2019-02-24 22:21:53 +08:00
bibinchundatt
3e1bd53a37 YARN-9317. Avoid repeated YarnConfiguration#timelineServiceV2Enabled check. Contributed by Prabhu Joseph 2019-02-23 07:59:51 +05:30
bibinchundatt
cf1944eb6e YARN-8132. Final Status of applications shown as UNDEFINED in ATS app queries. Contributed by Prabhu Joseph 2019-02-22 20:51:47 +05:30
Sunil G
d75aa33612 YARN-9118. Handle exceptions with parsing user defined GPU devices in GpuDiscoverer. Contributed by Szilard Nemeth.
(cherry picked from commit 95fbbfed75dd309b5d56032ece64996165572287)
2019-02-22 20:23:24 +05:30
Weiwei Yang
fb2735de16 YARN-9258. Support to specify allocation tags without constraint in distributed shell CLI. Contributed by Prabhu Joseph.
(cherry picked from commit 6c4ab0312b9829f5cb3db0480406fe79f0125f5e)
2019-02-22 00:23:21 +08:00
Surendra Singh Lilhore
2e939515df HDFS-14216. NullPointerException happens in NamenodeWebHdfs. Contributed by lujie.
(cherry picked from commit 92b53c40f070bbfe65c736f6f3eca721b9d227f5)
2019-02-21 20:47:50 +05:30
Steve Loughran
685a41f449
HADOOP-16105. WASB in secure mode does not set connectingUsingSAS.
Contributed by Steve Loughran.

(cherry picked from commit 9cb2f470b759bbe7609a00e8f8f72779e2daae80)
2019-02-21 13:39:37 +00:00
Weiwei Yang
c2ef443359 YARN-9315. TestCapacitySchedulerMetrics fails intermittently. Contributed by Prabhu Joseph. 2019-02-21 18:06:26 +08:00
Daryn Sharp
ae8839e6e8 HADOOP-15813. Enable more reliable SSL connection reuse. Contributed by Daryn Sharp.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit a87e458432609b7a35a2abd6410b02e8a2ffc974)
2019-02-20 18:21:14 -08:00
Masatake Iwasaki
dc9c3ce30b HADOOP-16104. Wasb tests to downgrade to skip when test a/c is namespace enabled. Contributed by Masatake Iwasaki.
(cherry picked from commit aa3ad3660506382884324c4b8997973f5a68e29a)
2019-02-20 22:17:18 +09:00
Surendra Singh Lilhore
b93b127956 HDFS-14235. Handle ArrayIndexOutOfBoundsException in DataNodeDiskMetrics#slowDiskDetectionDaemon. Contributed by Ranith Sardar.
(cherry picked from commit 41e18feda3f5ff924c87c4bed5b5cbbaecb19ae1)
2019-02-20 17:12:58 +05:30
bibinchundatt
e6f2b8730f YARN-9286. [Timeline Server] Sorting based on FinalStatus shows pop-up message. Contributed by Bilwa S T.
(cherry picked from commit b8de78c570babe4f802d951957c495ea0a4b07da)
2019-02-20 01:20:15 +05:30
bibinchundatt
bdfdf12178 YARN-9309. Improve graph text in SLS to avoid overlapping. Contributed by Bilwa S T.
(cherry picked from commit 779dae4de7e518938d58badcef065ea457be911c)
2019-02-20 00:37:47 +05:30
Sunil G
a060e8cb51 YARN-7824. [UI2] Yarn Component Instance page should include link to container logs. Contributed by Akhil PB. 2019-02-17 20:19:46 +05:30
Adam Antal
830aaac023
YARN-9283. Javadoc of LinuxContainerExecutor#addSchedPriorityCommand has a wrong property name as reference
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 9385ec45d75109a2e6565faa10527cc56637bf5f)
2019-02-15 18:48:21 +09:00
Sunil G
b4dc62a120 YARN-8295. [UI2] Improve Resource Usage tab error message when there are no data available. Contributed by Charan Hebri.
(cherry picked from commit 5b55f3538cb27baf8ac08568a5f752423e7b29a4)
2019-02-15 12:43:01 +05:30
Akira Ajisaka
f0b476bb31
YARN-9284. Fix the unit of yarn.service.am-resource.memory in the document. Contributed by Masahiro Tanaka.
(cherry picked from commit 3a39d9a2d28943316dd32196bba10ef326218d6e)
2019-02-15 15:43:32 +09:00
Akira Ajisaka
3e3275a80b
YARN-9308. fairscheduler-statedump.log gets generated regardless of service again after the merge of HDFS-7240. Contributed by Wilfred Spiegelenburg.
(cherry picked from commit dabfeab7854aab9b1eacf05bca954f2cf4e5ab89)
2019-02-15 14:53:36 +09:00
bibinchundatt
a8563d23f5 YARN-9295. [UI2] Fix label typo in Cluster Overview page. Contributed by Charan Hebri.
(cherry picked from commit b66d5ae9e26447113b146be0ffd81ed7d663a778)
2019-02-14 23:10:21 +05:30
bibinchundatt
f06ac51c37 YARN-9293. Optimize MockAMLauncher event handling. Contributed by Bibin A Chundatt.
(cherry picked from commit 134ae8fc8045e2ae1ed7ca54df95f14ffc863d09)
2019-02-14 22:58:37 +05:30
Sunil G
d321d0e747 YARN-7761. [UI2] Clicking 'master container log' or 'Link' next to 'log' under application's appAttempt goes to Old UI's Log link. Contributed by Akhil PB. 2019-02-14 20:55:43 +05:30
Surendra Singh Lilhore
f4b9ba230b HDFS-14263. Remove unnecessary block file exists check from FsDatasetImpl#getBlockInputStream(). Contributed by Surendra Singh Lilhore
(cherry picked from commit 29b411d5f065f177de05a69d2822836209f813c6)
2019-02-13 23:51:36 +05:30
Surendra Singh Lilhore
e163bf2258 HDFS-14274. EC: NPE While Listing EC Policy For A Directory Following Replication Policy. Contributed by Ayush Saxena.
(cherry picked from commit 35d4f32b32a3ba05332811caf3d245d9c3dcf1a5)
2019-02-13 23:21:37 +05:30
Vinayakumar B
49af36b25c HADOOP-16108. Tail Follow Interval Should Allow To Specify The Sleep Interval To Save Unnecessary RPC's. Contributed by Ayush Saxena. 2019-02-13 16:45:34 +05:30
Vinayakumar B
890736828b HDFS-14266. EC : Fsck -blockId shows null for EC Blocks if One Block Is Not Available. Contributed by Ayush Saxena. 2019-02-12 21:58:59 +05:30
Weiwei Yang
4d4968646a YARN-9252. Allocation Tag Namespace support in Distributed Shell. Contributed by Prabhu Joseph.
(cherry picked from commit 2b7f828d4646e1837ef81e127ba86c6d77128e9b)
2019-02-12 16:31:38 +08:00
Weiwei Yang
9cfa5ce0c1 YARN-9253. Add UT to verify Placement Constraint in Distributed Shell. Contributed by Prabhu Joseph.
(cherry picked from commit 711d22f166b4bb76005ae876a9d7ff7238991f90)
2019-02-12 16:22:34 +08:00
Giovanni Matteo Fumarola
314c559971 YARN-9191. Add cli option in DS to support enforceExecutionType in resource requests. Contributed by Abhishek Modi.
(cherry picked from commit f738b397ae021c9be900e4ec51ab55cd69b075e0)
2019-02-12 14:21:06 +08:00
Weiwei Yang
fbd03543d8 YARN-8555. Parameterize TestSchedulingRequestContainerAllocation(Async) to cover both PC handler options. Contributed by Prabhu Joseph.
(cherry picked from commit 0a1637c750a5dbe67f1a9b2969ac1b2d4785a11c)
2019-02-11 15:56:34 +08:00
Eric Yang
3d552b24ba YARN-8761. Service AM support for decommissioning component instances.
Contributed by Billie Rinaldi

(cherry picked from commit 4c465f5535054dad2ef0b18128fb115129f6939e)
2019-02-10 09:26:27 -08:00
Masatake Iwasaki
6229469574 YARN-9282. Typo in javadoc of class LinuxContainerExecutor: hadoop.security.authetication should be 'authentication'. Contributed by Charan Hebri.
(cherry picked from commit e0ab1bdecec3d7ba7ddc0849781d7f71714f8687)
2019-02-09 00:28:59 +09:00
Sunil G
fbc08145cf YARN-9257. Distributed Shell client throws a NPE for a non-existent queue. Contributed by Charan Hebri. 2019-02-08 11:22:44 +05:30
Surendra Singh Lilhore
2501fcd26b HDFS-14140. JournalNodeSyncer authentication is failing in secure cluster. Contributed by Surendra Singh Lilhore.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 4be87353e35a30d95d8847b09a1890b014bfc6bb)
2019-02-07 16:52:53 -08:00
Ranith Sardar
c5eca3f7ee
HADOOP-16032. Distcp It should clear sub directory ACL before applying new ACL on.
Contributed by Ranith Sardar.

(cherry picked from commit 546c5d70efebb828389f609a89b123c4ee51f867)
2019-02-07 21:49:18 +00:00
Eric E Payne
55dde827e6 YARN-7171: RM UI should sort memory / cores numerically. Contributed by Ahmed Hussein
(cherry picked from commit d1ca9432dd0b3e9b46b4903e8c9d33f5c28fcc1b)
2019-02-07 16:47:15 +00:00
Andrew Olson
36f3e775d4
HADOOP-15281. Distcp to add no-rename copy option.
Contributed by Andrew Olson.

(cherry picked from commit de804e53b9d20a2df75a4c7252bf83ed52011488)
2019-02-07 10:09:13 +00:00
Vinayakumar B
e2b91b2ccb YARN-8498. Yarn NodeManager OOM Listener Fails Compilation on Ubuntu 18.04. Contributed by Ayush Saxena. 2019-02-07 13:03:42 +05:30
Kitti Nanasi
38541b2375 HDFS-14231. DataXceiver#run() should not log exceptions caused by InvalidToken exception as an error. Contributed by Kitti Nanasi.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 49ddd8a6ed5b40d12defb0771b4c8b53d4ffde3f)
2019-02-05 15:15:04 -08:00
Wangda Tan
649da5af04 Make upstream aware of 3.1.2 release
Change-Id: I397bc6ef75498726df4763bd07a8bf8fe1c38365
(cherry picked from commit 308f3168fa221a336ef0dbb1a17358b1ad6f9356)
2019-02-05 14:05:51 -08:00
Da Zhou
84ce0f1bfa
HADOOP-16074. WASB: Update container not found error code.
Contributed by Da Zhou.

(cherry picked from commit ba9efe06fadb9631763f3e623d8748bbe59ff748)
2019-02-05 14:41:15 +00:00
Weiwei Yang
3a51e50fd8 YARN-9275. Add link to NodeAttributes doc in PlacementConstraints document. Contributed by Masatake Iwasaki.
(cherry picked from commit aa7ce50e557b0257ca7980d1d736a62b1f6ccb5d)
2019-02-05 16:09:15 +08:00
Larry McCay
410c6b4cb5
HADOOP-16076. SPNEGO+SSL Client Connections with HttpClient Broken.
Contributed by Larry McCay

(cherry picked from commit 758e9ce781cfa0667eecb33914e4e221e769503d)
2019-02-04 17:41:20 +00:00
Steve Loughran
bdd17be9ec
HDFS-13713. Add specification of Multipart Upload API to FS specification, with contract tests.
Contributed by Ewan Higgs and Steve Loughran.

(cherry picked from commit c1d24f848345f6d34a2ac2d570d49e9787a0df6a)
2019-02-04 17:10:19 +00:00
Weiwei Yang
b64e9df949 YARN-9262. TestRMAppAttemptTransitions is failing with an NPE. Contributed by lujie.
(cherry picked from commit 28ad20a711735243bc10b10e33866dc525f415eb)
2019-02-04 14:00:30 +05:30
Sunil G
99876a5ab8 YARN-9206. RMServerUtils does not count SHUTDOWN as an accepted state. Contributed by Kuhu Shukla.
(cherry picked from commit 604b2489a9e168a0fd702343f6f8844df9e86d17)
2019-02-04 12:49:06 +05:30
Weiwei Yang
a0fafbc3ef YARN-9263. TestConfigurationNodeAttributesProvider fails after Mockito updated. Contributed by Weiwei Yang.
(cherry picked from commit f20b043a02bd5b20f68123b2a7ab86f7cb9fe32a)
2019-02-04 12:45:40 +05:30
Akira Ajisaka
7cd7d5b628
HADOOP-16089. AliyunOSS: update oss-sdk version to 3.4.1. Contributed by wujinhu.
(cherry picked from commit 0f9aa5b4d58e34653f42e98a244aaf1c806b37cf)
2019-02-04 14:47:48 +09:00
Akira Ajisaka
97fa326b79
MAPREDUCE-7177. Disable speculative execution in TestDFSIO. Contributed by Zhaohui Xin.
(cherry picked from commit c991e2ca5a65eae62bad7e5baf81f1eb633b7ec0)
2019-02-04 14:04:07 +09:00
Takanobu Asanuma
8887980d32 HDFS-14232. libhdfs is not included in binary tarball. Contributed by Akira Ajisaka.
(cherry picked from commit ec77e95bbd607f1dbfc51132ad02898b4ed1acd0)
2019-02-04 10:12:53 +09:00