Commit Graph

358 Commits

Author SHA1 Message Date
Eric Yang 9f15483c5d YARN-8445. Improved error message for duplicated service and component names.
Contributed by Chandni Singh
2018-06-21 11:20:24 -04:00
Eric Yang 69b0596897 YARN-8411. Restart stopped system service during RM start.
Contributed by Billie Rinaldi
2018-06-13 19:05:52 -04:00
Akira Ajisaka 652bcbb3e4
YARN-8363. Upgrade commons-lang version to 3.7 in hadoop-yarn-project. Contributed by Takanobu Asanuma. 2018-06-13 00:35:37 +09:00
Billie Rinaldi 31998643a5 YARN-8342. Enable untrusted docker image to run with launch command. Contributed by Eric Yang 2018-06-02 14:46:32 -07:00
Wangda Tan ff583d3fa3 YARN-8349. Remove YARN registry entries when a service is killed by the RM. (Billie Rinaldi via wangda)
Change-Id: Ia58db3637789a8921482f564aa9bdf99c45cc36c
2018-06-01 14:49:18 -07:00
Wangda Tan 8956e5b8db YARN-8372. Distributed shell app master should not release containers when shutdown if keep-container is true. (Suma Shivaprasad via wangda)
Change-Id: Ief04d1ca865621f348fba4ac85fa78bc47465904
2018-06-01 14:49:18 -07:00
Eric Yang 7dd26d5378 YARN-8308. Fixed YARN Service AM failure with HDFS token renewal.
Contributed by Gour Saha
2018-05-31 21:09:36 -04:00
Billie Rinaldi 778a4a24be YARN-8350. NPE in service AM related to placement policy. Contributed by Gour Saha 2018-05-30 13:19:13 -07:00
Billie Rinaldi 96eefcc84a YARN-8368. yarn app start cli should print applicationId. Contributed by Rohith Sharma K S 2018-05-30 12:37:43 -07:00
Wangda Tan 3061bfcde5 YARN-8339. Service AM should localize static/archive resource types to container working directory instead of 'resources'. (Suma Shivaprasad via wangda)
Change-Id: I9f8e8f621650347f6c2f9e3420edee9eb2f356a4
2018-05-29 09:23:11 -07:00
Eric Yang d9852eb589 YARN-8357. Fixed NPE when YARN service is saved and not deployed.
Contributed by Chandni Singh
2018-05-24 16:32:13 -04:00
Eric Yang a23ff8d880 YARN-7530. Refactored YARN service API project location.
Contributed by Chandni Singh
2018-05-18 17:29:10 -04:00
Eric Yang 2f2dd22aad YARN-8296. Removed unique_component_support from YARN services.
Contributed by Suma Shivaprasad
2018-05-17 20:58:13 -04:00
Eric Yang 989cfdc1e0 YARN-8141. Removed YARN_CONTAINER_RUNTIME_DOCKER_LOCAL_RESOURCE_MOUNTS flag.
Contributed by Chandni Singh
2018-05-17 20:56:04 -04:00
Eric Yang d45a0b7d73 YARN-8141. Removed YARN_CONTAINER_RUNTIME_DOCKER_LOCAL_RESOURCE_MOUNTS flag.
Contributed by Chandni Singh
2018-05-17 17:29:34 -04:00
Eric Yang 7f083ed869 YARN-8080. Add restart policy for YARN services.
Contributed by Suma Shivaprasad
2018-05-17 17:16:50 -04:00
Eric Yang 91357c22ef YARN-8300. Fixed NPE in DefaultUpgradeComponentsFinder.
Contributed by Suma Shivaprasad
2018-05-16 12:38:26 -04:00
Eric Yang 8d3b39de89 YARN-8081. Add support to upgrade a component.
Contributed by Chandni Singh
2018-05-15 20:40:39 -04:00
Sunil G 58b97c79e3 YARN-8236. Invalid kerberos principal file name cause NPE in native service. Contributed by Gour Saha. 2018-05-15 12:17:35 +05:30
Eric Yang 0ff94563b9 YARN-8265. Improve DNS handling on docker IP changes.
Contributed by Billie Rinaldi
2018-05-11 22:37:43 -07:00
Jason Lowe 6c8e51ca7e YARN-7654. Support ENTRY_POINT for docker container. Contributed by Eric Yang 2018-05-11 18:56:05 -05:00
Billie Rinaldi ca612e353f YARN-8243. Flex down should remove instance with largest component instance ID first. Contributed by Gour Saha 2018-05-11 12:49:05 -07:00
Billie Rinaldi 1ef0a1db1d YARN-7894. Improve ATS response for DShell DS_CONTAINER when container launch fails. Contributed by Chandni Singh 2018-05-08 13:49:41 -07:00
Billie Rinaldi 6795f8072f YARN-8079. Support static and archive unmodified local resources in service AM. Contributed by Suma Shivaprasad 2018-05-04 09:27:07 -07:00
Eric Yang 7698737207 YARN-8226. Improved anti-affinity description in YARN Service doc.
Contributed by Gour Saha
2018-05-03 13:35:40 -04:00
Eric Yang 7fe3214d4b YARN-7961. Improve status message for YARN service.
Contributed by Gour Saha
2018-05-03 13:27:07 -04:00
Eric Yang 24eeea8b18 YARN-7799. Improved YARN service jar file handling.
Contributed by Billie Rinaldi
2018-05-01 16:46:34 -04:00
Billie Rinaldi 4e1382aca4 YARN-2674. Fix distributed shell AM container relaunch during RM work preserving restart. Contributed by Shane Kumpf 2018-05-01 07:27:47 -07:00
Eric Yang 24a5ccbf4b YARN-7781. Update YARN service documentation.
Contributed by Gour Saha
2018-04-27 12:38:30 -04:00
Eric Yang 14b47990af YARN-8204. Added a flag to disable YARN service upgrade.
Contributed by Chandni Singh
2018-04-27 12:24:43 -04:00
Billie Rinaldi 914d6b5cb1 YARN-8208. Add log statement for Docker client configuration file at INFO level. Contributed by Yesha Vora 2018-04-27 06:10:32 -07:00
Eric Yang 93979db840 YARN-8122. Added component health monitoring for YARN service.
Contributed by Gour Saha
2018-04-26 19:17:32 -04:00
Billie Rinaldi 598483e496 YARN-8140. Improve log message when launch cmd is ran for stopped yarn service. Contributed by Eric Yang 2018-04-26 13:54:40 -07:00
Eric Yang 4a7369b095 YARN-7939. Added support to upgrade a component instance.
Contributed by Chandni Singh
2018-04-26 13:54:40 -07:00
Konstantinos Karanasos 28e2244390 YARN-8111. Simplify PlacementConstraints API by removing allocationTagToIntraApp. Contributed by Weiwei Yang. 2018-04-20 12:24:48 -07:00
Jason Lowe 1d6e43da51 YARN-7996. Allow user supplied Docker client configurations with YARN native services. Contributed by Shane Kumpf 2018-04-17 08:57:31 -05:00
Sunil G 427ad7ecc4 YARN-8126. Support auto-spawning of admin configured services during bootstrap of RM. Contributed by Rohith Sharma K S. 2018-04-17 15:08:31 +05:30
Eric Yang 2d0662cfd5 YARN-8060. Added default readiness check for service components.
Contributed by Billie Rinaldi
2018-04-16 14:24:26 -04:00
Eric Yang 9031a76d44 YARN-8142. Improve SIGTERM handling for YARN Service Application Master.
Contributed by Billie Rinaldi
2018-04-13 15:34:33 -04:00
Billie Rinaldi 53b3e59473 YARN-7936. Add default service AM Xmx. Contributed by Jian He 2018-04-12 12:38:00 -07:00
Rohith Sharma K S c048711099 YARN-7941. Transitive dependencies for component are not resolved. Contributed by Billie Rinaldi. 2018-04-11 09:18:50 +05:30
Eric Yang d553799030 YARN-7984. Improved YARN service stop/destroy and clean up.
Contributed by Billie Rinaldi
2018-04-10 17:40:49 -04:00
Wangda Tan d4e63ccca0 YARN-8048. Support auto-spawning of admin configured services during bootstrap of RM (Rohith Sharma K S via wangda)
Change-Id: I2d8d61ccad55e1118009294d7e17822df3cd0fd5
2018-04-06 21:24:58 -07:00
Wangda Tan a0bde7d525 YARN-7142. Support placement policy in yarn native services. (Gour Saha via wangda)
Change-Id: I166c67a7a34430627c17365f60bac75b6da1b434
2018-04-02 07:26:01 -07:00
Sunil G 431076f637 YARN-8076. Support to specify application tags in distributed shell. Contributed by Weiwei Yang. 2018-03-29 15:55:39 +05:30
Sunil G d1e378d02b YARN-8075. DShell does not fail when we ask more GPUs than available even though AM throws 'InvalidResourceRequestException'. Contributed by Wangda Tan. 2018-03-28 08:03:18 +05:30
Eric Yang 27d60a1634 YARN-8018. Added support for initiating yarn service upgrade.
Contributed by Chandni Singh
2018-03-26 18:46:31 -04:00
Eric Yang 647058efc0 YARN-8032. Added ability to configure failure validity interval for YARN service.
Contributed by Chandni Singh
2018-03-23 15:54:52 -04:00
Sunil G 22c5ddb7c4 YARN-8063. DistributedShellTimelinePlugin wrongly check for entityId instead of entityType. Contributed by Rohith Sharma K S. 2018-03-23 10:54:00 +05:30
fang zhenyi 5e013d50d1
HADOOP-15305. Replace FileUtils.writeStringToFile(File, String) with (File, String, Charset) to fix deprecation warnings.
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-03-15 16:12:07 +09:00