Commit Graph

87 Commits

Author SHA1 Message Date
Billie Rinaldi e59e9feefa YARN-8342. Enable untrusted docker image to run with launch command. Contributed by Eric Yang
(cherry picked from commit 31998643a5)
2018-06-02 14:49:21 -07:00
Wangda Tan 0be93a7973 YARN-8349. Remove YARN registry entries when a service is killed by the RM. (Billie Rinaldi via wangda)
Change-Id: Ia58db3637789a8921482f564aa9bdf99c45cc36c
(cherry picked from commit ff583d3fa3)
2018-06-01 15:53:26 -07:00
Eric Yang 4193892de6 YARN-8308. Fixed YARN Service AM failure with HDFS token renewal.
Contributed by Gour Saha

(cherry picked from commit 7c7ac07f013f46db89c73681806300699ee534d6)
2018-05-31 21:10:04 -04:00
Billie Rinaldi 58e7d6c3c0 YARN-8350. NPE in service AM related to placement policy. Contributed by Gour Saha
(cherry picked from commit 778a4a24be)
2018-05-30 13:21:17 -07:00
Billie Rinaldi 7bd5d79177 YARN-8368. yarn app start cli should print applicationId. Contributed by Rohith Sharma K S
(cherry picked from commit 96eefcc84a)
2018-05-30 12:38:53 -07:00
Wangda Tan b262ea1381 YARN-8339. Service AM should localize static/archive resource types to container working directory instead of 'resources'. (Suma Shivaprasad via wangda)
Change-Id: I9f8e8f621650347f6c2f9e3420edee9eb2f356a4
(cherry picked from commit 3061bfcde5)
2018-05-29 09:28:27 -07:00
Eric Yang f49e697cc8 YARN-8357. Fixed NPE when YARN service is saved and not deployed.
Contributed by Chandni Singh

(cherry picked from commit d9852eb589)
2018-05-24 16:34:32 -04:00
Eric Yang 05d905f586 YARN-7530. Refactored YARN service API project location.
Contributed by Chandni Singh
2018-05-23 22:43:54 -04:00
Eric Yang 61e8974049 YARN-7530. Refactored YARN service API project location.
Contributed by Chandni Singh
2018-05-18 17:33:18 -04:00
Eric Yang 79351d4fda YARN-8141. Removed YARN_CONTAINER_RUNTIME_DOCKER_LOCAL_RESOURCE_MOUNTS flag.
Contributed by Chandni Singh

(cherry picked from 989cfdc1e0)
2018-05-17 20:57:14 -04:00
Eric Yang aafaa5f99b YARN-8141. Removed YARN_CONTAINER_RUNTIME_DOCKER_LOCAL_RESOURCE_MOUNTS flag.
Contributed by Chandni Singh

(cherry-picked from commit d45a0b7d73)
2018-05-17 17:32:29 -04:00
Eric Yang 044573b628 YARN-8080. Add restart policy for YARN services.
Contributed by Suma Shivaprasad

(cherry picked from commit 7f083ed869)
2018-05-17 17:20:45 -04:00
Eric Yang 2c3f300464 YARN-8300. Fixed NPE in DefaultUpgradeComponentsFinder.
Contributed by Suma Shivaprasad

(cherry picked from 91357c22ef)
2018-05-16 12:42:22 -04:00
Eric Yang 051d9cff9c YARN-8081. Add support to upgrade a component.
Contributed by Chandni Singh

(cherry picked from commit 8d3b39de89)
2018-05-15 20:42:24 -04:00
Sunil G 0a30a548f1 YARN-8236. Invalid kerberos principal file name cause NPE in native service. Contributed by Gour Saha.
(cherry picked from commit 58b97c79e3)
2018-05-15 12:18:09 +05:30
Eric Yang 8edcbe9460 YARN-8265. Improve DNS handling on docker IP changes.
Contributed by Billie Rinaldi

(cherry picked from commit 0ff94563b9)
2018-05-11 22:41:30 -07:00
Jason Lowe dfe73334c2 YARN-7654. Support ENTRY_POINT for docker container. Contributed by Eric Yang
(cherry picked from commit 6c8e51ca7e)
2018-05-11 18:57:20 -05:00
Billie Rinaldi 355ff085e6 YARN-8243. Flex down should remove instance with largest component instance ID first. Contributed by Gour Saha
(cherry picked from commit ca612e353f)
2018-05-11 12:50:40 -07:00
Billie Rinaldi e933ed0ee3 YARN-8079. Support static and archive unmodified local resources in service AM. Contributed by Suma Shivaprasad
(cherry picked from commit 6795f8072f)
2018-05-04 09:47:06 -07:00
Eric Yang a6f3d6ffcb YARN-7799. Improved YARN service jar file handling.
Contributed by Billie Rinaldi
(cherry picked from commit 24eeea8b18)
2018-05-01 16:49:29 -04:00
Eric Yang e75aeacf29 YARN-7781. Update YARN service documentation.
Contributed by Gour Saha
(cherry picked from commit 24a5ccbf4b)
2018-04-27 12:40:24 -04:00
Eric Yang 0e19c0dd72 YARN-8204. Added a flag to disable YARN service upgrade.
Contributed by Chandni Singh
(cherry picked from commit 14b47990af)
2018-04-27 12:25:57 -04:00
Billie Rinaldi b20f68ddaa YARN-8208. Add log statement for Docker client configuration file at INFO level. Contributed by Yesha Vora
(cherry picked from commit 914d6b5cb1)
2018-04-27 06:11:34 -07:00
Eric Yang 2253616064 YARN-8122. Added component health monitoring for YARN service.
Contributed by Gour Saha
(cherry picked from commit 93979db840)
2018-04-26 19:19:29 -04:00
Eric Yang b39d183d92 YARN-7939. Added support to upgrade a component instance.
Contributed by Chandni Singh

(cherry picked from commit 86ae380e55ca3b1b12744b9338d60b34e8c717a6)
2018-04-26 15:54:12 -04:00
Konstantinos Karanasos 18c86a3fb6 YARN-8111. Simplify PlacementConstraints API by removing allocationTagToIntraApp. Contributed by Weiwei Yang.
(cherry picked from commit 28e2244390)
2018-04-20 12:25:08 -07:00
Jason Lowe 42aef3b655 YARN-7996. Allow user supplied Docker client configurations with YARN native services. Contributed by Shane Kumpf
(cherry picked from commit 1d6e43da51)
2018-04-17 11:32:58 -05:00
Sunil G d5adc59017 YARN-8126. Support auto-spawning of admin configured services during bootstrap of RM. Contributed by Rohith Sharma K S.
(cherry picked from commit 427ad7ecc4)
2018-04-17 15:25:31 +05:30
Eric Yang 2911b5406b YARN-8060. Added default readiness check for service components.
Contributed by Billie Rinaldi

(cherry picked from 2d0662cfd5)
2018-04-16 14:53:42 -04:00
Eric Yang 20453488e8 YARN-8032. Added ability to configure failure validity interval for YARN service.
Contributed by Chandni Singh

(cherry-picked from 647058efc0)
2018-04-16 14:52:09 -04:00
Eric Yang 148322ca72 YARN-8142. Improve SIGTERM handling for YARN Service Application Master.
Contributed by Billie Rinaldi

(cherry picked from commit 9031a76d44)
2018-04-14 12:10:37 -07:00
Wangda Tan 0b88683627 YARN-7142. Support placement policy in yarn native services. (Gour Saha via wangda)
Change-Id: I166c67a7a34430627c17365f60bac75b6da1b434
(cherry picked from commit a0bde7d525)
2018-04-14 11:01:59 -07:00
Wangda Tan 7031a853f4 YARN-8048. Support auto-spawning of admin configured services during bootstrap of RM (Rohith Sharma K S via wangda)
Change-Id: I2d8d61ccad55e1118009294d7e17822df3cd0fd5
2018-04-13 10:18:48 -07:00
Eric Yang a375fe8263 YARN-7984. Improved YARN service stop/destroy and clean up.
Contributed by Billie Rinaldi

(cherry picked from commit d553799030)
2018-04-12 18:19:58 -07:00
Eric Yang 150085cc64 YARN-8018. Added support for initiating yarn service upgrade.
Contributed by Chandni Singh

(cherry picked from commit 27d60a1634)
2018-04-12 17:08:27 -04:00
Billie Rinaldi 23179c06a3 YARN-7936. Add default service AM Xmx. Contributed by Jian He
(cherry picked from commit 53b3e59473)
2018-04-12 12:43:30 -07:00
Rohith Sharma K S c1b4c6adf4 YARN-7941. Transitive dependencies for component are not resolved. Contributed by Billie Rinaldi.
(cherry picked from commit c048711099)
2018-04-11 09:19:48 +05:30
Wangda Tan 25bf1d3ac6 Updated branch-3.1 to track 3.1.1
Change-Id: Idd55c79921b8acacc8a8a3258450e476f3abb706
2018-04-09 10:58:50 -07:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.) 0bd99621c5 Preparing for 3.1.0 development 2018-03-19 15:16:54 -07:00
fang zhenyi 5e013d50d1
HADOOP-15305. Replace FileUtils.writeStringToFile(File, String) with (File, String, Charset) to fix deprecation warnings.
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-03-15 16:12:07 +09:00
Billie Rinaldi e1f5251f3c YARN-7523. Introduce description and version field in Service record. Contributed by Chandni Singh 2018-03-10 07:49:10 -08:00
Billie Rinaldi 4f395063bb YARN-8000. Yarn Service component instance name shows up as component name in container record. Contributed by Chandni Singh 2018-03-09 08:50:28 -08:00
Billie Rinaldi 5ed689e33a YARN-7958. ServiceMaster should only wait for recovery of containers with id that match the current application id. Contributed by Chandni Singh 2018-03-01 08:00:13 -08:00
Eric Yang 17f387e3c2 YARN-7985. Removed duplicate service name validation in Yarn Service.
Contributed by Chandni Singh
2018-02-28 20:48:55 -05:00
Billie Rinaldi 315f48e791 YARN-7955. Improve result of calling stop on an already stopped service. Contributed by Gour Saha 2018-02-28 15:01:56 -08:00
Billie Rinaldi 31009034bd YARN-7954. Set component status to STOPPED when YARN service is stopped. Contributed by Gour Saha 2018-02-28 11:57:24 -08:00
Eric Yang b4f1ba1413 YARN-7963. Updated MockServiceAM unit test to prevent test hang.
Contributed by Chandni Singh
2018-02-26 18:49:01 -05:00
Wangda Tan 60f9e60b3b Preparing for 3.2.0 development
Change-Id: I6d0e01f3d665d26573ef2b957add1cf0cddf7938
2018-02-11 11:17:38 +08:00
Eric Yang 0bee3849e3 YARN-7816. Allow same application name submitted by multiple users. (Contributed by Gour Saha) 2018-01-31 20:51:40 -05:00
Eric Yang f9dd5b61f4 YARN-7811. Fixed a bug in user defined docker network settings. (Contributed by Billie Rinaldi) 2018-01-30 12:42:38 -05:00