18320 Commits

Author SHA1 Message Date
Eric Yang
c6c3b0afa0 YARN-8293. Removed "User Name for service" for deploying secure YARN service.
Contributed by Sunil G

(cherry picked from commit 7802af6e9a85f033e9515cc7b23c125a0e06c325)
2018-05-17 17:07:55 -04:00
Inigo Goiri
e5ff9f3922 HDFS-13558. TestDatanodeHttpXFrame does not shut down cluster. Contributed by Anbang Hu.
(cherry picked from commit 26f1e22fc9ee326e9c76503d347552faeb6c2d3b)
2018-05-17 13:35:40 -07:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
0460201c3a YARN-8128. Documenting the per-node per-app file limit in YARN log aggregation. Contributed by Xuan Gong.
(cherry picked from commit 328f0847e3d98cad8c368d57499f31081c153237)
2018-05-17 13:09:09 -07:00
Steve Loughran
170f1040d4 HADOOP-15469. S3A directory committer commit job fails if _temporary directory created under dest.
Contributed by Steve Loughran.
2018-05-17 19:08:05 +01:00
Steve Loughran
f729faaabb HADOOP-15250. Split-DNS MultiHomed Server Network Cluster Network IPC Client Bind Addr Wrong
Contributed by Ajay Kumar

(cherry picked from commit 8f42dafcf82d5b426dd931dc5ddd177dd6f283f7)
2018-05-17 10:14:27 -07:00
Inigo Goiri
b0c89690ed HDFS-13570. TestQuotaByStorageType,TestQuota,TestDFSOutputStream fail on Windows. Contributed by Anbang Hu.
(cherry picked from commit c0ec061e280c0d3e5299c0735c8b8697e0f31216)
2018-05-17 09:22:29 -07:00
Kihwal Lee
4f1ec6a515 HDFS-13581. DN UI logs link is broken when https is enabled. Contributed by Shashikant Banerjee.
(cherry picked from commit 0ce6290de6a08beab01cb5184d366d97c9abd811)
2018-05-17 09:26:13 -05:00
Rohith Sharma K S
4222e8f21b YARN-8297. Incorrect ATS Url used for Wire encrypted cluster. Contributed by Sunil G.
(cherry picked from commit c95795cd8f649c45f05df1d5faa1dcabd30d7a6e)
2018-05-17 16:25:38 +05:30
Inigo Goiri
1d1806f862 HDFS-13559. TestBlockScanner does not close TestContext properly. Contributed by Anbang Hu.
(cherry picked from commit 454de3b543c8b00a9ab566c7d1c64d7e4cffee0f)
2018-05-16 19:23:33 -07:00
Arpit Agarwal
45dd200a2c HDFS-13512. WebHdfs getFileStatus doesn't return ecPolicy. Contributed by Ajay Kumar. 2018-05-16 11:28:51 -07:00
Inigo Goiri
e12ddd9394 HDFS-13550.TestDebugAdmin#testComputeMetaCommand fails on Windows. Contributed by Anbang Hu.
(cherry picked from commit 55d5549087183cb9c8d805e33267acabe9537667)
2018-05-16 10:09:18 -07:00
Eric Yang
2c3f300464 YARN-8300. Fixed NPE in DefaultUpgradeComponentsFinder.
Contributed by Suma Shivaprasad

(cherry picked from 91357c22ef0fb89652dd2898cf488b47234452ce)
2018-05-16 12:42:22 -04:00
Inigo Goiri
5310542fb4 HDFS-13557. TestDFSAdmin#testListOpenFiles fails on Windows. Contributed by Anbang Hu.
(cherry picked from commit 6b67161ca33881d5f3d7606a57786e9c960759a1)
2018-05-16 09:32:15 -07:00
Jason Lowe
79b2a508e0 YARN-8284. get_docker_command refactoring. Contributed by Eric Badger
(cherry picked from commit d47c09dcb146d0a1cb50486f453a67560812fe5c)
2018-05-16 09:34:24 -05:00
Eric Yang
051d9cff9c YARN-8081. Add support to upgrade a component.
Contributed by Chandni Singh

(cherry picked from commit 8d3b39de89809f5eed06f85f00ab223e2f75e49c)
2018-05-15 20:42:24 -04:00
Inigo Goiri
899a7ec2fb HDFS-13567. TestNameNodeMetrics#testGenerateEDEKTime,TestNameNodeMetrics#testResourceCheck should use a different cluster basedir. Contributed by Anbang Hu.
(cherry picked from commit 63480976a008bab0b84f4da08b1099867e5a9a6b)
2018-05-15 15:36:03 -07:00
Inigo Goiri
34fbc1c2eb HDFS-13548. TestResolveHdfsSymlink#testFcResolveAfs fails on Windows. Contributed by Anbang Hu.
(cherry picked from commit 2d6195c0af4a1840172899ce70bca4ca549eb713)
2018-05-15 11:21:44 -07:00
Inigo Goiri
c168329cc4 HDFS-11700. TestHDFSServerPorts#testBackupNodePorts doesn't pass on Windows. Contributed by Anbang Hu.
(cherry picked from commit eaca7980ad2a750f6b0025a706062740c2ddded2)
2018-05-15 10:28:01 -07:00
Inigo Goiri
583b9b418a HDFS-13551. TestMiniDFSCluster#testClusterSetStorageCapacity does not shut down cluster. Contributed by Anbang Hu.
(cherry picked from commit 92ebd466c75275118107e6ec665cf50e337a29e7)
2018-05-15 10:22:19 -07:00
Steve Loughran
a0cb1e0941 HADOOP-15442. ITestS3AMetrics.testMetricsRegister can't know metrics source's name.
Contributed by Sean Mackrory.

(cherry picked from commit b6708374692e6c4d786e2f3f1f45cc7aa1e4e88f)
2018-05-15 16:15:13 +01:00
Weiwei Yang
2bb39330a4 YARN-8278. DistributedScheduling is not working in HA. Contributed by Bibin A Chundatt.
(Cherry picked from commit 2bb647bb91439e82cf7298e963bb5f7f80bbc3cb)
2018-05-15 18:47:15 +08:00
Sunil G
0a30a548f1 YARN-8236. Invalid kerberos principal file name cause NPE in native service. Contributed by Gour Saha.
(cherry picked from commit 58b97c79e34901938d59acc84ed48c1f9344996a)
2018-05-15 12:18:09 +05:30
Sunil G
d997959560 YARN-8166. [UI2] Service page header links are broken. Contributed by Yesha Vora.
(cherry picked from commit ffb9210dedb79a56075448dc296251896bed49e6)
2018-05-15 12:13:44 +05:30
Sunil G
d0452370cc YARN-8266. [UI2] Clicking on application from cluster view should redirect to application attempt page. Contributed by Yesha Vora.
(cherry picked from commit 796b2b0ee36e8e9225fb76ae35edc58ad907b737)
2018-05-15 12:02:40 +05:30
Haibo Chen
8d3598525d YARN-8130 Race condition when container events are published for KILLED applications. (Rohith Sharma K S via Haibo Chen)
(cherry picked from commit 2d00a0c71b5dde31e2cf8fcb96d9d541d41fb879)
2018-05-15 11:40:47 +05:30
Hanisha Koneru
4f55941390 HDFS-13544. Improve logging for JournalNode in federated cluster.
(cherry picked from commit 6beb25ab7e4f5454dba0315a296081e61753f301)
2018-05-14 10:14:38 -07:00
Xiao Chen
6e731eb20d HDFS-13539. DFSStripedInputStream NPE when reportCheckSumFailure.
(cherry picked from commit 960940e0e08f7839775f2d8a352b444d104d36b4)
2018-05-14 09:29:14 -07:00
Naganarasimha
26e8fdffd6 YARN-8288. Fix wrong number of table columns in Resource Model doc. Contributed by Weiwei Yang.
(cherry picked from commit 8a2b5914f3a68148f40f99105acf5dafcc326e89)
2018-05-15 00:10:58 +08:00
Sunil G
e6c607cc2c YARN-8271. [UI2] Improve labeling of certain tables. Contributed by Yesha Vora.
(cherry picked from commit 89d0b87ad324db09f14e00031d20635083d576ed)
2018-05-14 21:11:59 +05:30
Sammi Chen
e5281d9f8b Add 2.9.1 release notes and changes documents 2018-05-14 15:26:00 +08:00
Rushabh Shah
4d9a58756c HADOOP-15441. Log kms url and token service at debug level. Contributed by Gabor Bota
(cherry picked from commit a5449d36312c3de953e05ba8b3b5acf818a0c7e7)
2018-05-12 12:21:01 -05:00
Eric Yang
8edcbe9460 YARN-8265. Improve DNS handling on docker IP changes.
Contributed by Billie Rinaldi

(cherry picked from commit 0ff94563b9b62d0426d475dc0f84152b68f1ff0d)
2018-05-11 22:41:30 -07:00
Jason Lowe
dfe73334c2 YARN-7654. Support ENTRY_POINT for docker container. Contributed by Eric Yang
(cherry picked from commit 6c8e51ca7eaaeef0626658b3c45d446a537e4dc0)
2018-05-11 18:57:20 -05:00
Billie Rinaldi
355ff085e6 YARN-8243. Flex down should remove instance with largest component instance ID first. Contributed by Gour Saha
(cherry picked from commit ca612e353fc3e3766868ec0816de035e48b1f5b4)
2018-05-11 12:50:40 -07:00
Jason Lowe
f6d6a2ab04 YARN-8244. TestContainerSchedulerQueuing.testStartMultipleContainers failed. Contributed by Jim Brennan
(cherry picked from commit dc912994a1bcb511dfda32a0649cef0c9bdc47d3)
2018-05-11 14:13:55 -05:00
Eric Yang
645429ca28 YARN-8274. Fixed a bug on docker start command.
Contributed by Jason Lowe
2018-05-11 14:26:20 -04:00
Inigo Goiri
e332e011ae HDFS-13542. TestBlockManager#testNeededReplicationWhileAppending fails due to improper cluster shutdown in TestBlockManager#testBlockManagerMachinesArray on Windows. Contributed by Anbang Hu.
(cherry picked from commit d50c4d71dc42576f96ae5c268856fd1a7795f936)
2018-05-11 09:48:45 -07:00
Yiqun Lin
3665217d50 HDFS-13346. RBF: Fix synchronization of router quota and nameservice quota.
(cherry picked from commit a922b9c82cc564e86dc0ef84bcc3597cb7b7c211)
2018-05-11 15:09:54 +08:00
Weiwei Yang
b4213bfd90 YARN-7003. DRAINING state of queues is not recovered after RM restart. Contributed by Tao Yang.
(Cherry picked from commit 9db9cd95bd0348070a286e69e7965c03c9bd39d6)
2018-05-11 10:55:05 +08:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
4c0a6b67f3 YARN-8249. Fixed few REST APIs in RMWebServices to have static-user check. Contributed by Sunil Govindan.
(cherry picked from commit d76fbbc9b82e720d7d5188f9ae2f56a8d78f3a98)
2018-05-10 19:07:23 -07:00
Robert Kanter
0506c762b2 YARN-8202. DefaultAMSProcessor should properly check units of requested custom resource types against minimum/maximum allocation (snemeth via rkanter)
(cherry picked from commit c8b53c43644b4ad22d5385c22cad8ed573c0b1ba)
2018-05-10 09:52:11 -07:00
Inigo Goiri
f4f2912820 HADOOP-15454. TestRollingFileSystemSinkWithLocal fails on Windows. Contributed by Xiao Liang.
(cherry picked from commit 1da8d4190d6e574347ab9d3380513e9401569573)
2018-05-10 09:41:42 -07:00
Vrushali C
ad4d4153da YARN-8247 Incorrect HTTP status code returned by ATSv2 for non-whitelisted users. Contributed by Rohith Sharma K S 2018-05-09 22:30:59 -07:00
bibinchundatt
b29479c93a YARN-8201. Skip stacktrace of few exception from ClientRMService. Contributed by Bilwa S T.
(cherry picked from commit cc0310a5266c8b8351f338f5fc8087a203c68cac)
2018-05-10 09:29:43 +05:30
Inigo Goiri
e3ff9e36df HDFS-13537. TestHdfsHelper does not generate jceks path properly for relative path in Windows. Contributed by Xiao Liang.
(cherry picked from commit 914b98a713f70667d4380ac752f6c4de931520d9)
2018-05-09 16:52:45 -07:00
Inigo Goiri
c649c76566 HDFS-13388. RequestHedgingProxyProvider calls multiple configured NNs all the time. Contributed by Jinglun.
(cherry picked from commit 63803e7051dcfcd8e3d28a8b3217b7735a00b7d8)
2018-05-09 13:56:06 -07:00
Eric Yang
6ce89ea2a8 YARN-8261. Fixed a bug in creation of localized container directory.
Contributed by Jason Lowe

(cherry picked from commit af4fc2e62805a5bd392214521a93650085b8d020)
2018-05-09 13:34:54 -04:00
Rohith Sharma K S
ee19c47d08 YARN-8260. [UI2] Per-application tracking URL is no longer available in YARN UI2. Contributed by Sunil G.
(cherry picked from commit cd68c7cc6942970285dce04775e80f75a5d55afa)
2018-05-09 12:34:11 +05:30
Rohith Sharma K S
438c5b12aa YARN-8264. [UI2] GPU Info tab disappears if we click any sub link under List of Applications or List of Containers. Contributed by Sunil G.
(cherry picked from commit 9acfaee1f080245744f191a7fd080f91413249a6)
2018-05-09 12:34:01 +05:30
Rohith Sharma K S
e3a7dbc4ec YARN-8239. [UI2] Clicking on Node Manager UI under AM container info / App Attempt page goes to old RM UI. Contributed by Sunil G.
(cherry picked from commit eb7b256cc2c74e1b461e45444179584668d34ac6)
2018-05-09 12:33:49 +05:30