Commit Graph

4696 Commits

Author SHA1 Message Date
Billie Rinaldi 1ef0a1db1d YARN-7894. Improve ATS response for DShell DS_CONTAINER when container launch fails. Contributed by Chandni Singh 2018-05-08 13:49:41 -07:00
Jason Lowe a2ea756420 YARN-8207. Docker container launch use popen have risk of shell expansion. Contributed by Eric Yang. 2018-05-08 15:30:36 -05:00
Wangda Tan 6b96a73bb0 YARN-8232. RMContainer lost queue name when RM HA happens. (Hu Ziqian via wangda)
Change-Id: Ia21e1da6871570c993bbedde76ce32929e95970f
2018-05-08 11:34:45 -07:00
Rohith Sharma K S 7450583721 YARN-8253. HTTPS Ats v2 api call fails with 'bad HTTP parsed'. Contributed by Charan Hebri. 2018-05-08 12:28:54 +05:30
Sunil G 2916c90500 YARN-8251. [UI2] Clicking on Application link at the header goes to Diagnostics Tab instead of AppAttempt Tab. Contributed by Yesha Vora. 2018-05-08 11:37:03 +05:30
Sunil G 9832265e1d YARN-5151. [UI2] Support kill application from new YARN UI. Contributed by Gergely Novák. 2018-05-08 10:35:19 +05:30
Weiwei Yang 67f239c42f YARN-8025. UsersManangers#getComputedResourceLimitForActiveUsers throws NPE due to preComputedActiveUserLimit is empty. Contributed by Tao Yang. 2018-05-07 11:33:14 +08:00
Inigo Goiri 6a69239d86 YARN-8163. Add support for Node Labels in opportunistic scheduling. Contributed by Abhishek Modi. 2018-05-04 14:59:59 -07:00
Eric Yang 8cdb032aff YARN-8223. Improved yarn auxiliary service to load jar file from HDFS.
Contributed by Zian Chen
2018-05-04 12:36:31 -04:00
Billie Rinaldi 6795f8072f YARN-8079. Support static and archive unmodified local resources in service AM. Contributed by Suma Shivaprasad 2018-05-04 09:27:07 -07:00
Billie Rinaldi 502914ca32 YARN-7818. Remove privileged operation warnings during container launch for the ContainerRuntimes. Contributed by Shane Kumpf 2018-05-04 08:53:55 -07:00
Eric Yang 7698737207 YARN-8226. Improved anti-affinity description in YARN Service doc.
Contributed by Gour Saha
2018-05-03 13:35:40 -04:00
Eric Yang 7fe3214d4b YARN-7961. Improve status message for YARN service.
Contributed by Gour Saha
2018-05-03 13:27:07 -04:00
Rohith Sharma K S ee2ce923a9 YARN-8217. RmAuthenticationFilterInitializer and TimelineAuthenticationFilterInitializer should use Configuration.getPropsWithPrefix instead of iterator. Contributed by Suma Shivaprasad. 2018-05-03 14:43:40 +05:30
Inigo Goiri e6a80e476d YARN-8151. Yarn RM Epoch should wrap around. Contributed by Young Chen. 2018-05-02 17:23:17 -07:00
Eric Yang f4d280f02b YARN-8194. Fixed reinitialization error for LinuxContainerExecutor.
Contributed by Chandni Singh
2018-05-02 20:07:19 -04:00
Konstantinos Karanasos 3b34fca4b5 YARN-8113. Update placement constraints doc with application namespaces and inter-app constraints. Contributed by Weiwei Yang. 2018-05-02 11:49:56 -07:00
Eric Yang 883f68222a YARN-8209. Fixed NPE in Yarn Service deletion.
Contributed by Eric Badger
2018-05-02 14:33:31 -04:00
Weiwei Yang 251f528814 YARN-8222. Fix potential NPE when gets RMApp from RM context. Contributed by Tao Yang. 2018-05-02 17:54:46 +08:00
Yiqun Lin 3265b55119
YARN-6385. Fix checkstyle warnings in TestFileSystemApplicationHistoryStore
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-05-02 18:14:02 +09:00
Eric Yang 24eeea8b18 YARN-7799. Improved YARN service jar file handling.
Contributed by Billie Rinaldi
2018-05-01 16:46:34 -04:00
Billie Rinaldi 4e1382aca4 YARN-2674. Fix distributed shell AM container relaunch during RM work preserving restart. Contributed by Shane Kumpf 2018-05-01 07:27:47 -07:00
Sunil G d6139c5106 YARN-8187. [UI2] Individual Node page does not contain breadcrumb trail. Contributed by Zian Chen. 2018-05-01 14:01:34 +05:30
Weiwei Yang 2d319e3793 YARN-8212. Pending backlog for async allocation threads should be configurable. Contributed by Tao Yang. 2018-05-01 09:47:10 +08:00
Eric Yang a966ec6e23 YARN-8228. Added hostname length check for docker container.
Contributed by Shane Kumpf
2018-04-30 19:12:53 -04:00
Konstantinos Karanasos 9b09555451 YARN-8195. Fix constraint cardinality check in the presence of multiple target allocation tags. Contributed by Weiwei Yang. 2018-04-30 11:54:30 -07:00
Weiwei Yang 2c95eb8111 YARN-8225. YARN precommit build failing in TestPlacementConstraintTransformations. Contributed by Shane Kumpf. 2018-04-28 17:37:37 +08:00
Wangda Tan 92c5331423 YARN-8005. Add unit tests for queue priority with dominant resource calculator. (Zian Chen via wangda)
Change-Id: I17a645f20869a1e5d86fa7a325c93fec908b91dc
2018-04-27 13:08:43 -07:00
Wangda Tan b1833d9ba2 YARN-8210. AMRMClient logging on every heartbeat to track updation of AM RM token causes too many log lines to be generated in AM logs. (Suma Shivaprasad via wangda)
Change-Id: I70edd6e301fd5e78d479e1882aedc9332a0827aa
2018-04-27 13:07:38 -07:00
Rohith Sharma K S ef3ecc308d YARN-8221. RMWebServices also need to honor yarn.resourcemanager.display.per-user-apps. Contributed by Sunil G. 2018-04-27 22:58:10 +05:30
Eric Yang 24a5ccbf4b YARN-7781. Update YARN service documentation.
Contributed by Gour Saha
2018-04-27 12:38:30 -04:00
Eric Yang 14b47990af YARN-8204. Added a flag to disable YARN service upgrade.
Contributed by Chandni Singh
2018-04-27 12:24:43 -04:00
Billie Rinaldi 9ab3f97089 YARN-8211. Yarn registry dns log finds BufferUnderflowException on port ping. Contributed by Eric Yang 2018-04-27 07:58:43 -07:00
Billie Rinaldi 914d6b5cb1 YARN-8208. Add log statement for Docker client configuration file at INFO level. Contributed by Yesha Vora 2018-04-27 06:10:32 -07:00
Ewan Higgs 84ecfe3ceb
HADOOP-14188. Remove the usage of org.mockito.internal.util.reflection.Whitebox
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-04-27 19:21:37 +09:00
Sunil G 71220d218d YARN-8004. Add unit tests for inter queue preemption for dominant resource calculator. Contributed by Zian Chen. 2018-04-27 10:42:30 +05:30
Sunil G 7fc09c4f72 YARN-8215. ATS v2 returns invalid YARN_CONTAINER_ALLOCATED_HOST_HTTP_ADDRESS from NM. Contributed by Rohith Sharma K S. 2018-04-27 10:33:42 +05:30
Sunil G 1634de0fc1 YARN-8205. Application State is not updated to ATS if AM launching is delayed. Contributed by Rohith Sharma K S. 2018-04-27 10:26:57 +05:30
Eric Yang 93979db840 YARN-8122. Added component health monitoring for YARN service.
Contributed by Gour Saha
2018-04-26 19:17:32 -04:00
Billie Rinaldi 598483e496 YARN-8140. Improve log message when launch cmd is ran for stopped yarn service. Contributed by Eric Yang 2018-04-26 13:54:40 -07:00
Eric Yang 4a7369b095 YARN-7939. Added support to upgrade a component instance.
Contributed by Chandni Singh
2018-04-26 13:54:40 -07:00
Wangda Tan 2a0fa50f9d YARN-8193. YARN RM hangs abruptly (stops allocating resources) when running successive applications. (Zian Chen via wangda)
Change-Id: Ia83dd2499ee9000b9e09ae5a932f21a13c0ddee6
2018-04-26 13:54:40 -07:00
Sunil G 7ac0abdc13 YARN-8188. RM Nodes UI data table index for sorting column need to be corrected post Application tags display. Contributed by Weiwei Yang. 2018-04-26 13:54:40 -07:00
Wangda Tan ebedd69e25 YARN-8183. Fix ConcurrentModificationException inside RMAppAttemptMetrics#convertAtomicLongMaptoLongMap. (Suma Shivaprasad via wangda)
Change-Id: I347871d672001653a3afe2e99adefd74e0d798cd
2018-04-26 13:54:40 -07:00
Eric Yang 3b1dad9123 YARN-8196. Updated documentation for enabling YARN Service REST API.
Contributed by Billie Rinaldi
2018-04-26 13:54:40 -07:00
Owen O'Malley 2adda92de1
HDFS-7240 git commit fixup
Signed-off-by: Owen O'Malley <omalley@apache.org>
2018-04-26 13:52:17 -07:00
Anu Engineer 4e61bc431e HDFS-13258. Ozone: restructure Hdsl/Ozone code to separated maven subprojects.
Contributed by Elek Marton, Mukul Kumar Singh, Xiaoyu Yao, Ajay Kumar, Anu Engineer, Lokesh Jain, Nanda Kumar.
2018-04-26 05:36:04 -07:00
Junping Du 56788d759f YARN-7598. Document how to use classpath isolation for aux-services in YARN. Contributed by Xuan Gong. 2018-04-24 18:29:14 +08:00
Robert Kanter 7ab08a9c37 HADOOP-15390. Yarn RM logs flooded by DelegationTokenRenewer trying to renew KMS tokens (xiaochen via rkanter) 2018-04-23 15:44:15 -07:00
Sunil G 83e5f25d5e YARN-8177. Documentation changes for auto creation of Leaf Queues with node label. Contributed by Suma Shivaprasad. 2018-04-23 13:36:27 +05:30