Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
18,540 Commits 326 Branches 371 Tags
Commit Graph

362 Commits

Author SHA1 Message Date
Eric Yang
e665c0a9dd YARN-8360. Improve YARN service restart policy and node manager auto restart policy. 
Contributed by Suma Shivaprasad

(cherry picked from commit 84d7bf1eeff6b9418361afa4aa713e5e6f771365)
 2018-07-23 12:59:37 -04:00
bibinchundatt
2aaad4000a YARN-8491. TestServiceCLI#testEnableFastLaunch fail when umask is 077. Contributed by K G Bakthavachalam. 
(cherry picked from commit 52e1bc8539ce769f47743d8b2d318a54c3887ba0)
 2018-07-11 16:24:37 +05:30
Eric Yang
63ce762959 YARN-8445. Improved error message for duplicated service and component names. 
Contributed by Chandni Singh

(cherry picked from commit 9f15483c5d7c94251f4c84e0155449188f202779)
 2018-06-21 11:21:34 -04:00
Eric Yang
aba67c360c YARN-8411. Restart stopped system service during RM start. 
Contributed by Billie Rinaldi

(cherry picked from commit 69b05968974994c6e22d6562a67b9392d1700094)
 2018-06-13 19:10:13 -04:00
Billie Rinaldi
e59e9feefa YARN-8342. Enable untrusted docker image to run with launch command. Contributed by Eric Yang 
(cherry picked from commit 31998643a51f1e08f723f18dc5476ac1512d5b81)
 2018-06-02 14:49:21 -07:00
Wangda Tan
0be93a7973 YARN-8349. Remove YARN registry entries when a service is killed by the RM. (Billie Rinaldi via wangda) 
Change-Id: Ia58db3637789a8921482f564aa9bdf99c45cc36c
(cherry picked from commit ff583d3fa3325029bc691ec22d817aee37e5e85d)
 2018-06-01 15:53:26 -07:00
Wangda Tan
ed20576413 YARN-8372. Distributed shell app master should not release containers when shutdown if keep-container is true. (Suma Shivaprasad via wangda) 
Change-Id: Ief04d1ca865621f348fba4ac85fa78bc47465904
(cherry picked from commit 8956e5b8db3059e0872e49f59adc6affc76e2274)
 2018-06-01 15:47:59 -07:00
Eric Yang
4193892de6 YARN-8308. Fixed YARN Service AM failure with HDFS token renewal. 
Contributed by Gour Saha

(cherry picked from commit 7c7ac07f013f46db89c73681806300699ee534d6)
 2018-05-31 21:10:04 -04:00
Billie Rinaldi
58e7d6c3c0 YARN-8350. NPE in service AM related to placement policy. Contributed by Gour Saha 
(cherry picked from commit 778a4a24be176382a5704f709c00bdfcfe6ddc8c)
 2018-05-30 13:21:17 -07:00
Billie Rinaldi
7bd5d79177 YARN-8368. yarn app start cli should print applicationId. Contributed by Rohith Sharma K S 
(cherry picked from commit 96eefcc84aacc4cc82ad7e3e72c5bdad56f4a7b7)
 2018-05-30 12:38:53 -07:00
Wangda Tan
b262ea1381 YARN-8339. Service AM should localize static/archive resource types to container working directory instead of 'resources'. (Suma Shivaprasad via wangda) 
Change-Id: I9f8e8f621650347f6c2f9e3420edee9eb2f356a4
(cherry picked from commit 3061bfcde53210d2032df3814243498b27a997b7)
 2018-05-29 09:28:27 -07:00
Eric Yang
f49e697cc8 YARN-8357. Fixed NPE when YARN service is saved and not deployed. 
Contributed by Chandni Singh

(cherry picked from commit d9852eb5897a25323ab0302c2c0decb61d310e5e)
 2018-05-24 16:34:32 -04:00
Eric Yang
05d905f586 YARN-7530. Refactored YARN service API project location. 
Contributed by Chandni Singh
 2018-05-23 22:43:54 -04:00
Eric Yang
61e8974049 YARN-7530. Refactored YARN service API project location. 
Contributed by Chandni Singh
 2018-05-18 17:33:18 -04:00
Eric Yang
0791785574 YARN-8296. Removed unique_component_support from YARN services. 
Contributed by Suma Shivaprasad

(cherry picked from commit 2f2dd22aad4a003228b9efe3b4c506a6922d09d8)
 2018-05-17 20:59:50 -04:00
Eric Yang
79351d4fda YARN-8141. Removed YARN_CONTAINER_RUNTIME_DOCKER_LOCAL_RESOURCE_MOUNTS flag. 
Contributed by Chandni Singh

(cherry picked from 989cfdc1e0f1c27b35679c668a9bde6a0be845b5)
 2018-05-17 20:57:14 -04:00
Eric Yang
aafaa5f99b YARN-8141. Removed YARN_CONTAINER_RUNTIME_DOCKER_LOCAL_RESOURCE_MOUNTS flag. 
Contributed by Chandni Singh

(cherry-picked from commit d45a0b7d73519acb78cd94ac3186bd8481f6c13e)
 2018-05-17 17:32:29 -04:00
Eric Yang
044573b628 YARN-8080. Add restart policy for YARN services. 
Contributed by Suma Shivaprasad

(cherry picked from commit 7f083ed8699a720d3fb82e4ec310356902a6ac30)
 2018-05-17 17:20:45 -04:00
Eric Yang
2c3f300464 YARN-8300. Fixed NPE in DefaultUpgradeComponentsFinder. 
Contributed by Suma Shivaprasad

(cherry picked from 91357c22ef0fb89652dd2898cf488b47234452ce)
 2018-05-16 12:42:22 -04:00
Eric Yang
051d9cff9c YARN-8081. Add support to upgrade a component. 
Contributed by Chandni Singh

(cherry picked from commit 8d3b39de89809f5eed06f85f00ab223e2f75e49c)
 2018-05-15 20:42:24 -04:00
Sunil G
0a30a548f1 YARN-8236. Invalid kerberos principal file name cause NPE in native service. Contributed by Gour Saha. 
(cherry picked from commit 58b97c79e34901938d59acc84ed48c1f9344996a)
 2018-05-15 12:18:09 +05:30
Eric Yang
8edcbe9460 YARN-8265. Improve DNS handling on docker IP changes. 
Contributed by Billie Rinaldi

(cherry picked from commit 0ff94563b9b62d0426d475dc0f84152b68f1ff0d)
 2018-05-11 22:41:30 -07:00
Jason Lowe
dfe73334c2 YARN-7654. Support ENTRY_POINT for docker container. Contributed by Eric Yang 
(cherry picked from commit 6c8e51ca7eaaeef0626658b3c45d446a537e4dc0)
 2018-05-11 18:57:20 -05:00
Billie Rinaldi
355ff085e6 YARN-8243. Flex down should remove instance with largest component instance ID first. Contributed by Gour Saha 
(cherry picked from commit ca612e353fc3e3766868ec0816de035e48b1f5b4)
 2018-05-11 12:50:40 -07:00
Billie Rinaldi
f7cbfeb726 YARN-7894. Improve ATS response for DShell DS_CONTAINER when container launch fails. Contributed by Chandni Singh 
(cherry picked from commit 1ef0a1db1d6a412b2a26782329a8325635866d0a)
 2018-05-08 13:51:02 -07:00
Billie Rinaldi
e933ed0ee3 YARN-8079. Support static and archive unmodified local resources in service AM. Contributed by Suma Shivaprasad 
(cherry picked from commit 6795f8072ffbe6138857e77d51af173f33e4e5c1)
 2018-05-04 09:47:06 -07:00
Eric Yang
2148fc1c3a YARN-8226. Improved anti-affinity description in YARN Service doc. 
Contributed by Gour Saha

(cherry picked from commit 7698737207b01e80b1be2b4df60363f952a1c2b4)
 2018-05-03 13:38:21 -04:00
Eric Yang
b09af11117 YARN-7961. Improve status message for YARN service. 
Contributed by Gour Saha
(cherry picked from commit 7fe3214d4bb810c0da18dd936875b4e2588ba518)
 2018-05-03 13:29:07 -04:00
Eric Yang
a6f3d6ffcb YARN-7799. Improved YARN service jar file handling. 
Contributed by Billie Rinaldi
(cherry picked from commit 24eeea8b18749e02ea05b03eb18e3cf0455077c5)
 2018-05-01 16:49:29 -04:00
Billie Rinaldi
4174a0ed25 YARN-2674. Fix distributed shell AM container relaunch during RM work preserving restart. Contributed by Shane Kumpf 
(cherry picked from commit 4e1382aca4cf23ca229bdd24e0f143c22449b329)
 2018-05-01 08:04:39 -07:00
Eric Yang
e75aeacf29 YARN-7781. Update YARN service documentation. 
Contributed by Gour Saha
(cherry picked from commit 24a5ccbf4bda413a98480d52c204d56f82ef9ac5)
 2018-04-27 12:40:24 -04:00
Eric Yang
0e19c0dd72 YARN-8204. Added a flag to disable YARN service upgrade. 
Contributed by Chandni Singh
(cherry picked from commit 14b47990af39de71b0a09d995208f45ea3b79c23)
 2018-04-27 12:25:57 -04:00
Billie Rinaldi
b20f68ddaa YARN-8208. Add log statement for Docker client configuration file at INFO level. Contributed by Yesha Vora 
(cherry picked from commit 914d6b5cb143f4f9cadd9d689ea4e278383a6779)
 2018-04-27 06:11:34 -07:00
Eric Yang
2253616064 YARN-8122. Added component health monitoring for YARN service. 
Contributed by Gour Saha
(cherry picked from commit 93979db8400186d6e557c46a2a1e2622821013c1)
 2018-04-26 19:19:29 -04:00
Billie Rinaldi
91b24278da YARN-8140. Improve log message when launch cmd is ran for stopped yarn service. Contributed by Eric Yang 
(cherry picked from commit ed4e0676c357d5d18c15998b1f6b5d305848cb04)
 2018-04-26 13:18:56 -07:00
Eric Yang
b39d183d92 YARN-7939. Added support to upgrade a component instance. 
Contributed by Chandni Singh

(cherry picked from commit 86ae380e55ca3b1b12744b9338d60b34e8c717a6)
 2018-04-26 15:54:12 -04:00
Konstantinos Karanasos
18c86a3fb6 YARN-8111. Simplify PlacementConstraints API by removing allocationTagToIntraApp. Contributed by Weiwei Yang. 
(cherry picked from commit 28e2244390c990877dc2ee2733cf9b8d2c75128e)
 2018-04-20 12:25:08 -07:00
Jason Lowe
42aef3b655 YARN-7996. Allow user supplied Docker client configurations with YARN native services. Contributed by Shane Kumpf 
(cherry picked from commit 1d6e43da51aaaab522325bdbe4b51e58934e03f1)
 2018-04-17 11:32:58 -05:00
Sunil G
d5adc59017 YARN-8126. Support auto-spawning of admin configured services during bootstrap of RM. Contributed by Rohith Sharma K S. 
(cherry picked from commit 427ad7ecc4afbf2cc4acde22c29a7248c46fb22b)
 2018-04-17 15:25:31 +05:30
Eric Yang
2911b5406b YARN-8060. Added default readiness check for service components. 
Contributed by Billie Rinaldi

(cherry picked from 2d0662cfd57bd438421f912dc172e79a15835442)
 2018-04-16 14:53:42 -04:00
Eric Yang
20453488e8 YARN-8032. Added ability to configure failure validity interval for YARN service. 
Contributed by Chandni Singh

(cherry-picked from 647058efc0c7a4442b3e64b4d743df1a589f26bc)
 2018-04-16 14:52:09 -04:00
Eric Yang
148322ca72 YARN-8142. Improve SIGTERM handling for YARN Service Application Master. 
Contributed by Billie Rinaldi

(cherry picked from commit 9031a76d447f0c5eaa392144fd17c5b9812e1b20)
 2018-04-14 12:10:37 -07:00
Wangda Tan
0b88683627 YARN-7142. Support placement policy in yarn native services. (Gour Saha via wangda) 
Change-Id: I166c67a7a34430627c17365f60bac75b6da1b434
(cherry picked from commit a0bde7d525911680f9e5fb0a939604865eb8e164)
 2018-04-14 11:01:59 -07:00
Wangda Tan
7031a853f4 YARN-8048. Support auto-spawning of admin configured services during bootstrap of RM (Rohith Sharma K S via wangda) 
Change-Id: I2d8d61ccad55e1118009294d7e17822df3cd0fd5
 2018-04-13 10:18:48 -07:00
Eric Yang
a375fe8263 YARN-7984. Improved YARN service stop/destroy and clean up. 
Contributed by Billie Rinaldi

(cherry picked from commit d553799030a5a64df328319aceb35734d0b2de20)
 2018-04-12 18:19:58 -07:00
Eric Yang
150085cc64 YARN-8018. Added support for initiating yarn service upgrade. 
Contributed by Chandni Singh

(cherry picked from commit 27d60a16342fd39973d43b61008f54a8815a6237)
 2018-04-12 17:08:27 -04:00
Billie Rinaldi
23179c06a3 YARN-7936. Add default service AM Xmx. Contributed by Jian He 
(cherry picked from commit 53b3e594732e7a567dda4e08b9a8af5f87a4472a)
 2018-04-12 12:43:30 -07:00
Rohith Sharma K S
c1b4c6adf4 YARN-7941. Transitive dependencies for component are not resolved. Contributed by Billie Rinaldi. 
(cherry picked from commit c0487110990958fa985d273eb178bdf76002cf3a)
 2018-04-11 09:19:48 +05:30
Wangda Tan
25bf1d3ac6 Updated branch-3.1 to track 3.1.1 
Change-Id: Idd55c79921b8acacc8a8a3258450e476f3abb706
 2018-04-09 10:58:50 -07:00
Sunil G
04161bad78 YARN-8076. Support to specify application tags in distributed shell. Contributed by Weiwei Yang. 
(cherry picked from commit 431076f63751f855ab6036ff85825a8552257b93)
 2018-03-29 16:02:49 +05:30