118 Commits

Author SHA1 Message Date
Eric Yang
a6f3d6ffcb YARN-7799. Improved YARN service jar file handling.
Contributed by Billie Rinaldi
(cherry picked from commit 24eeea8b18749e02ea05b03eb18e3cf0455077c5)
2018-05-01 16:49:29 -04:00
Eric Yang
e75aeacf29 YARN-7781. Update YARN service documentation.
Contributed by Gour Saha
(cherry picked from commit 24a5ccbf4bda413a98480d52c204d56f82ef9ac5)
2018-04-27 12:40:24 -04:00
Eric Yang
0e19c0dd72 YARN-8204. Added a flag to disable YARN service upgrade.
Contributed by Chandni Singh
(cherry picked from commit 14b47990af39de71b0a09d995208f45ea3b79c23)
2018-04-27 12:25:57 -04:00
Billie Rinaldi
b20f68ddaa YARN-8208. Add log statement for Docker client configuration file at INFO level. Contributed by Yesha Vora
(cherry picked from commit 914d6b5cb143f4f9cadd9d689ea4e278383a6779)
2018-04-27 06:11:34 -07:00
Eric Yang
2253616064 YARN-8122. Added component health monitoring for YARN service.
Contributed by Gour Saha
(cherry picked from commit 93979db8400186d6e557c46a2a1e2622821013c1)
2018-04-26 19:19:29 -04:00
Eric Yang
b39d183d92 YARN-7939. Added support to upgrade a component instance.
Contributed by Chandni Singh

(cherry picked from commit 86ae380e55ca3b1b12744b9338d60b34e8c717a6)
2018-04-26 15:54:12 -04:00
Konstantinos Karanasos
18c86a3fb6 YARN-8111. Simplify PlacementConstraints API by removing allocationTagToIntraApp. Contributed by Weiwei Yang.
(cherry picked from commit 28e2244390c990877dc2ee2733cf9b8d2c75128e)
2018-04-20 12:25:08 -07:00
Jason Lowe
42aef3b655 YARN-7996. Allow user supplied Docker client configurations with YARN native services. Contributed by Shane Kumpf
(cherry picked from commit 1d6e43da51aaaab522325bdbe4b51e58934e03f1)
2018-04-17 11:32:58 -05:00
Sunil G
d5adc59017 YARN-8126. Support auto-spawning of admin configured services during bootstrap of RM. Contributed by Rohith Sharma K S.
(cherry picked from commit 427ad7ecc4afbf2cc4acde22c29a7248c46fb22b)
2018-04-17 15:25:31 +05:30
Eric Yang
2911b5406b YARN-8060. Added default readiness check for service components.
Contributed by Billie Rinaldi

(cherry picked from 2d0662cfd57bd438421f912dc172e79a15835442)
2018-04-16 14:53:42 -04:00
Eric Yang
20453488e8 YARN-8032. Added ability to configure failure validity interval for YARN service.
Contributed by Chandni Singh

(cherry-picked from 647058efc0c7a4442b3e64b4d743df1a589f26bc)
2018-04-16 14:52:09 -04:00
Eric Yang
148322ca72 YARN-8142. Improve SIGTERM handling for YARN Service Application Master.
Contributed by Billie Rinaldi

(cherry picked from commit 9031a76d447f0c5eaa392144fd17c5b9812e1b20)
2018-04-14 12:10:37 -07:00
Wangda Tan
0b88683627 YARN-7142. Support placement policy in yarn native services. (Gour Saha via wangda)
Change-Id: I166c67a7a34430627c17365f60bac75b6da1b434
(cherry picked from commit a0bde7d525911680f9e5fb0a939604865eb8e164)
2018-04-14 11:01:59 -07:00
Wangda Tan
7031a853f4 YARN-8048. Support auto-spawning of admin configured services during bootstrap of RM (Rohith Sharma K S via wangda)
Change-Id: I2d8d61ccad55e1118009294d7e17822df3cd0fd5
2018-04-13 10:18:48 -07:00
Eric Yang
a375fe8263 YARN-7984. Improved YARN service stop/destroy and clean up.
Contributed by Billie Rinaldi

(cherry picked from commit d553799030a5a64df328319aceb35734d0b2de20)
2018-04-12 18:19:58 -07:00
Eric Yang
150085cc64 YARN-8018. Added support for initiating yarn service upgrade.
Contributed by Chandni Singh

(cherry picked from commit 27d60a16342fd39973d43b61008f54a8815a6237)
2018-04-12 17:08:27 -04:00
Billie Rinaldi
23179c06a3 YARN-7936. Add default service AM Xmx. Contributed by Jian He
(cherry picked from commit 53b3e594732e7a567dda4e08b9a8af5f87a4472a)
2018-04-12 12:43:30 -07:00
Rohith Sharma K S
c1b4c6adf4 YARN-7941. Transitive dependencies for component are not resolved. Contributed by Billie Rinaldi.
(cherry picked from commit c0487110990958fa985d273eb178bdf76002cf3a)
2018-04-11 09:19:48 +05:30
Wangda Tan
25bf1d3ac6 Updated branch-3.1 to track 3.1.1
Change-Id: Idd55c79921b8acacc8a8a3258450e476f3abb706
2018-04-09 10:58:50 -07:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
0bd99621c5 Preparing for 3.1.0 development 2018-03-19 15:16:54 -07:00
fang zhenyi
5e013d50d1
HADOOP-15305. Replace FileUtils.writeStringToFile(File, String) with (File, String, Charset) to fix deprecation warnings.
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-03-15 16:12:07 +09:00
Billie Rinaldi
e1f5251f3c YARN-7523. Introduce description and version field in Service record. Contributed by Chandni Singh 2018-03-10 07:49:10 -08:00
Billie Rinaldi
4f395063bb YARN-8000. Yarn Service component instance name shows up as component name in container record. Contributed by Chandni Singh 2018-03-09 08:50:28 -08:00
Billie Rinaldi
5ed689e33a YARN-7958. ServiceMaster should only wait for recovery of containers with id that match the current application id. Contributed by Chandni Singh 2018-03-01 08:00:13 -08:00
Eric Yang
17f387e3c2 YARN-7985. Removed duplicate service name validation in Yarn Service.
Contributed by Chandni Singh
2018-02-28 20:48:55 -05:00
Billie Rinaldi
315f48e791 YARN-7955. Improve result of calling stop on an already stopped service. Contributed by Gour Saha 2018-02-28 15:01:56 -08:00
Billie Rinaldi
31009034bd YARN-7954. Set component status to STOPPED when YARN service is stopped. Contributed by Gour Saha 2018-02-28 11:57:24 -08:00
Eric Yang
b4f1ba1413 YARN-7963. Updated MockServiceAM unit test to prevent test hang.
Contributed by Chandni Singh
2018-02-26 18:49:01 -05:00
Wangda Tan
60f9e60b3b Preparing for 3.2.0 development
Change-Id: I6d0e01f3d665d26573ef2b957add1cf0cddf7938
2018-02-11 11:17:38 +08:00
Eric Yang
0bee3849e3 YARN-7816. Allow same application name submitted by multiple users. (Contributed by Gour Saha) 2018-01-31 20:51:40 -05:00
Eric Yang
f9dd5b61f4 YARN-7811. Fixed a bug in user defined docker network settings. (Contributed by Billie Rinaldi) 2018-01-30 12:42:38 -05:00
Billie Rinaldi
0c559b2782 YARN-7777. Fix user name format in YARN Registry DNS name. Contributed by Jian He 2018-01-24 13:50:47 -08:00
Billie Rinaldi
e307edcb47 YARN-7540 and YARN-7605. Convert yarn app cli to call yarn api services and implement doAs for Api Service REST API. Contributed by Eric Yang and Jian He 2018-01-23 17:54:39 -08:00
Jian He
a72cdcc47a YARN-7766. Introduce a new config property for YARN Service dependency tarball location. Contributed by Gour Saha 2018-01-23 10:53:27 -08:00
Billie Rinaldi
37f4696a9c YARN-7740. Fix logging for destroy yarn service cli when app does not exist and some minor bugs. Contributed by Jian He 2018-01-18 12:11:19 -08:00
Billie Rinaldi
53f2768926 YARN-7724. yarn application status should support application name. Contributed by Jian He 2018-01-12 15:33:46 -08:00
Jian He
c05b84703b YARN-7671. Improve Diagonstic message for stop yarn native service. Contributed by Chandni Singh 2018-01-12 14:04:15 -08:00
Jian He
836e3c45e8 Revert "YARN-7540. Route YARN service CLI function through YARN Service API. (Contributed by Eric Yang)"
This reverts commit 438c1d333ebc0a3071bb556532ed959a4bd1e6d6.
2018-01-05 18:25:00 -08:00
Wangda Tan
7467e8fe5a YARN-7555. Support multiple resource types in YARN native services. (wangda)
Change-Id: I330e6ee17a73962dcaadd766a3e72d2888681731
2017-12-29 15:34:08 -08:00
Eric Yang
41b581012a YARN-7616. Map YARN application status to Service Status more accurately. (Contributed by Gour Saha) 2017-12-19 19:14:45 -05:00
Eric Yang
989c75109a YARN-7543. Add check for max cpu limit and missing file for YARN service.
(Contributed by Jian He)
2017-12-19 16:45:04 -05:00
Eric Yang
438c1d333e YARN-7540. Route YARN service CLI function through YARN Service API. (Contributed by Eric Yang) 2017-12-13 19:29:04 -05:00
Jian He
3ebe6a7819 YARN-7565. Yarn service pre-maturely releases the container after AM restart. Contributed by Chandni Singh 2017-12-12 13:35:56 -08:00
Eric Yang
d30d57828f YARN-6669. Implemented Kerberos security for YARN service framework. (Contributed by Jian He) 2017-12-04 15:11:00 -05:00
Billie Rinaldi
6f9d7a146d YARN-7529. TestYarnNativeServices#testRecoverComponentsAfterRMRestart() fails intermittently. Contributed by Chandni Singh 2017-11-20 07:37:04 -08:00
Eric Yang
0940e4f692 YARN-7218. Decouple YARN Services REST API namespace from RM. (Contributed by Eric Yang) 2017-11-17 12:28:12 -05:00
Jian He
6bf2c30192 YARN-7503. Configurable heap size / JVM opts in service AM. Contributed by Jonathan Hung 2017-11-16 10:53:55 -08:00
Billie Rinaldi
f4d5d20286 YARN-7486. Race condition in service AM that can cause NPE. Contributed by Jian He 2017-11-16 07:58:06 -08:00
Jian He
4f40cd314a YARN-7488. Make ServiceClient.getAppId method public to return ApplicationId for a service name. Contributed by Gour Saha 2017-11-13 18:57:56 -08:00
Jian He
a55d0738f1 YARN-7371. Added allocateRequestId in NMContainerStatus for recovery. Contributed by Chandni Singh 2017-11-06 13:30:20 -08:00