Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
18,754 Commits 326 Branches 371 Tags
Commit Graph

372 Commits

Author SHA1 Message Date
Giovanni Matteo Fumarola
7fed1a07ab HADOOP-15731. TestDistributedShell fails on Windows. Contributed by Botong Huang. 2018-09-07 16:37:03 -07:00
bibinchundatt
e2e0fc26a2 YARN-8535. Fix DistributedShell unit tests. Contributed by Abhishek Modi. 
(cherry picked from commit eed8415dc18fa7415ebd105350bd0532b3b1b6bb)
 2018-09-02 13:37:38 +05:30
Eric Yang
97c1934247 YARN-8474. Fixed ApiServiceClient kerberos negotiation. 
Contributed by Billie Rinaldi

(cherry picked from commit 8990eaf5925afa533fbd9c3641859a146dc5a22c)
 2018-08-16 12:50:52 -04:00
Wangda Tan
f2768eaa38 YARN-8407. Container launch exception in AM log should be printed in ERROR level. (Yesha Vora via wangda) 
Change-Id: I154e873df1df3503a09c41d6b3874ca195af91d9
(cherry picked from commit 861095f761b40171e0dc25f769f486d910cc3e88)
 2018-08-07 13:07:28 -07:00
Eric Yang
680dac26d8 YARN-8610. Fixed initiate upgrade error message. 
Contributed by Chandni Singh

(cherry picked from commit 23f394240e1568a38025e63e9dc0842e8c5235f7)
 2018-08-01 20:43:22 -04:00
Eric Yang
7640d62716 YARN-8579. Recover NMToken of previous attempted component data. 
Contributed by Gour Saha
 2018-07-31 18:35:31 -04:00
Wangda Tan
5583711419 Preparing for 3.1.2 release 
Change-Id: If2793e2ed2b5b349a9e1f98f78df43f309dcfcbd
 2018-07-31 13:08:55 -07:00
Billie Rinaldi
06166f2255 YARN-8571. Validate service principal format prior to launching yarn service. Contributed by Eric Yang 
(cherry picked from commit b429f19d32d8f60a3535e047ef10cfb3edeb54c8)
 2018-07-27 11:35:41 -07:00
Eric Yang
d6627cda9d YARN-8429. Improve diagnostic message when artifact is not set properly. 
Contributed by Gour Saha

(cherry picked from commit 8d3c068e59fdddd18e3f8260713fee83c458aa1d)
 2018-07-27 11:29:43 -04:00
Eric Yang
177f6045ac YARN-8545. Return allocated resource to RM for failed container. 
Contributed by Chandni Singh

(cherry picked from commit 40fad32824d2f8f960c779d78357e62103453da0)
 2018-07-26 18:25:41 -04:00
Eric Yang
e665c0a9dd YARN-8360. Improve YARN service restart policy and node manager auto restart policy. 
Contributed by Suma Shivaprasad

(cherry picked from commit 84d7bf1eeff6b9418361afa4aa713e5e6f771365)
 2018-07-23 12:59:37 -04:00
bibinchundatt
2aaad4000a YARN-8491. TestServiceCLI#testEnableFastLaunch fail when umask is 077. Contributed by K G Bakthavachalam. 
(cherry picked from commit 52e1bc8539ce769f47743d8b2d318a54c3887ba0)
 2018-07-11 16:24:37 +05:30
Eric Yang
63ce762959 YARN-8445. Improved error message for duplicated service and component names. 
Contributed by Chandni Singh

(cherry picked from commit 9f15483c5d7c94251f4c84e0155449188f202779)
 2018-06-21 11:21:34 -04:00
Eric Yang
aba67c360c YARN-8411. Restart stopped system service during RM start. 
Contributed by Billie Rinaldi

(cherry picked from commit 69b05968974994c6e22d6562a67b9392d1700094)
 2018-06-13 19:10:13 -04:00
Billie Rinaldi
e59e9feefa YARN-8342. Enable untrusted docker image to run with launch command. Contributed by Eric Yang 
(cherry picked from commit 31998643a51f1e08f723f18dc5476ac1512d5b81)
 2018-06-02 14:49:21 -07:00
Wangda Tan
0be93a7973 YARN-8349. Remove YARN registry entries when a service is killed by the RM. (Billie Rinaldi via wangda) 
Change-Id: Ia58db3637789a8921482f564aa9bdf99c45cc36c
(cherry picked from commit ff583d3fa3325029bc691ec22d817aee37e5e85d)
 2018-06-01 15:53:26 -07:00
Wangda Tan
ed20576413 YARN-8372. Distributed shell app master should not release containers when shutdown if keep-container is true. (Suma Shivaprasad via wangda) 
Change-Id: Ief04d1ca865621f348fba4ac85fa78bc47465904
(cherry picked from commit 8956e5b8db3059e0872e49f59adc6affc76e2274)
 2018-06-01 15:47:59 -07:00
Eric Yang
4193892de6 YARN-8308. Fixed YARN Service AM failure with HDFS token renewal. 
Contributed by Gour Saha

(cherry picked from commit 7c7ac07f013f46db89c73681806300699ee534d6)
 2018-05-31 21:10:04 -04:00
Billie Rinaldi
58e7d6c3c0 YARN-8350. NPE in service AM related to placement policy. Contributed by Gour Saha 
(cherry picked from commit 778a4a24be176382a5704f709c00bdfcfe6ddc8c)
 2018-05-30 13:21:17 -07:00
Billie Rinaldi
7bd5d79177 YARN-8368. yarn app start cli should print applicationId. Contributed by Rohith Sharma K S 
(cherry picked from commit 96eefcc84aacc4cc82ad7e3e72c5bdad56f4a7b7)
 2018-05-30 12:38:53 -07:00
Wangda Tan
b262ea1381 YARN-8339. Service AM should localize static/archive resource types to container working directory instead of 'resources'. (Suma Shivaprasad via wangda) 
Change-Id: I9f8e8f621650347f6c2f9e3420edee9eb2f356a4
(cherry picked from commit 3061bfcde53210d2032df3814243498b27a997b7)
 2018-05-29 09:28:27 -07:00
Eric Yang
f49e697cc8 YARN-8357. Fixed NPE when YARN service is saved and not deployed. 
Contributed by Chandni Singh

(cherry picked from commit d9852eb5897a25323ab0302c2c0decb61d310e5e)
 2018-05-24 16:34:32 -04:00
Eric Yang
05d905f586 YARN-7530. Refactored YARN service API project location. 
Contributed by Chandni Singh
 2018-05-23 22:43:54 -04:00
Eric Yang
61e8974049 YARN-7530. Refactored YARN service API project location. 
Contributed by Chandni Singh
 2018-05-18 17:33:18 -04:00
Eric Yang
0791785574 YARN-8296. Removed unique_component_support from YARN services. 
Contributed by Suma Shivaprasad

(cherry picked from commit 2f2dd22aad4a003228b9efe3b4c506a6922d09d8)
 2018-05-17 20:59:50 -04:00
Eric Yang
79351d4fda YARN-8141. Removed YARN_CONTAINER_RUNTIME_DOCKER_LOCAL_RESOURCE_MOUNTS flag. 
Contributed by Chandni Singh

(cherry picked from 989cfdc1e0f1c27b35679c668a9bde6a0be845b5)
 2018-05-17 20:57:14 -04:00
Eric Yang
aafaa5f99b YARN-8141. Removed YARN_CONTAINER_RUNTIME_DOCKER_LOCAL_RESOURCE_MOUNTS flag. 
Contributed by Chandni Singh

(cherry-picked from commit d45a0b7d73519acb78cd94ac3186bd8481f6c13e)
 2018-05-17 17:32:29 -04:00
Eric Yang
044573b628 YARN-8080. Add restart policy for YARN services. 
Contributed by Suma Shivaprasad

(cherry picked from commit 7f083ed8699a720d3fb82e4ec310356902a6ac30)
 2018-05-17 17:20:45 -04:00
Eric Yang
2c3f300464 YARN-8300. Fixed NPE in DefaultUpgradeComponentsFinder. 
Contributed by Suma Shivaprasad

(cherry picked from 91357c22ef0fb89652dd2898cf488b47234452ce)
 2018-05-16 12:42:22 -04:00
Eric Yang
051d9cff9c YARN-8081. Add support to upgrade a component. 
Contributed by Chandni Singh

(cherry picked from commit 8d3b39de89809f5eed06f85f00ab223e2f75e49c)
 2018-05-15 20:42:24 -04:00
Sunil G
0a30a548f1 YARN-8236. Invalid kerberos principal file name cause NPE in native service. Contributed by Gour Saha. 
(cherry picked from commit 58b97c79e34901938d59acc84ed48c1f9344996a)
 2018-05-15 12:18:09 +05:30
Eric Yang
8edcbe9460 YARN-8265. Improve DNS handling on docker IP changes. 
Contributed by Billie Rinaldi

(cherry picked from commit 0ff94563b9b62d0426d475dc0f84152b68f1ff0d)
 2018-05-11 22:41:30 -07:00
Jason Lowe
dfe73334c2 YARN-7654. Support ENTRY_POINT for docker container. Contributed by Eric Yang 
(cherry picked from commit 6c8e51ca7eaaeef0626658b3c45d446a537e4dc0)
 2018-05-11 18:57:20 -05:00
Billie Rinaldi
355ff085e6 YARN-8243. Flex down should remove instance with largest component instance ID first. Contributed by Gour Saha 
(cherry picked from commit ca612e353fc3e3766868ec0816de035e48b1f5b4)
 2018-05-11 12:50:40 -07:00
Billie Rinaldi
f7cbfeb726 YARN-7894. Improve ATS response for DShell DS_CONTAINER when container launch fails. Contributed by Chandni Singh 
(cherry picked from commit 1ef0a1db1d6a412b2a26782329a8325635866d0a)
 2018-05-08 13:51:02 -07:00
Billie Rinaldi
e933ed0ee3 YARN-8079. Support static and archive unmodified local resources in service AM. Contributed by Suma Shivaprasad 
(cherry picked from commit 6795f8072ffbe6138857e77d51af173f33e4e5c1)
 2018-05-04 09:47:06 -07:00
Eric Yang
2148fc1c3a YARN-8226. Improved anti-affinity description in YARN Service doc. 
Contributed by Gour Saha

(cherry picked from commit 7698737207b01e80b1be2b4df60363f952a1c2b4)
 2018-05-03 13:38:21 -04:00
Eric Yang
b09af11117 YARN-7961. Improve status message for YARN service. 
Contributed by Gour Saha
(cherry picked from commit 7fe3214d4bb810c0da18dd936875b4e2588ba518)
 2018-05-03 13:29:07 -04:00
Eric Yang
a6f3d6ffcb YARN-7799. Improved YARN service jar file handling. 
Contributed by Billie Rinaldi
(cherry picked from commit 24eeea8b18749e02ea05b03eb18e3cf0455077c5)
 2018-05-01 16:49:29 -04:00
Billie Rinaldi
4174a0ed25 YARN-2674. Fix distributed shell AM container relaunch during RM work preserving restart. Contributed by Shane Kumpf 
(cherry picked from commit 4e1382aca4cf23ca229bdd24e0f143c22449b329)
 2018-05-01 08:04:39 -07:00
Eric Yang
e75aeacf29 YARN-7781. Update YARN service documentation. 
Contributed by Gour Saha
(cherry picked from commit 24a5ccbf4bda413a98480d52c204d56f82ef9ac5)
 2018-04-27 12:40:24 -04:00
Eric Yang
0e19c0dd72 YARN-8204. Added a flag to disable YARN service upgrade. 
Contributed by Chandni Singh
(cherry picked from commit 14b47990af39de71b0a09d995208f45ea3b79c23)
 2018-04-27 12:25:57 -04:00
Billie Rinaldi
b20f68ddaa YARN-8208. Add log statement for Docker client configuration file at INFO level. Contributed by Yesha Vora 
(cherry picked from commit 914d6b5cb143f4f9cadd9d689ea4e278383a6779)
 2018-04-27 06:11:34 -07:00
Eric Yang
2253616064 YARN-8122. Added component health monitoring for YARN service. 
Contributed by Gour Saha
(cherry picked from commit 93979db8400186d6e557c46a2a1e2622821013c1)
 2018-04-26 19:19:29 -04:00
Billie Rinaldi
91b24278da YARN-8140. Improve log message when launch cmd is ran for stopped yarn service. Contributed by Eric Yang 
(cherry picked from commit ed4e0676c357d5d18c15998b1f6b5d305848cb04)
 2018-04-26 13:18:56 -07:00
Eric Yang
b39d183d92 YARN-7939. Added support to upgrade a component instance. 
Contributed by Chandni Singh

(cherry picked from commit 86ae380e55ca3b1b12744b9338d60b34e8c717a6)
 2018-04-26 15:54:12 -04:00
Konstantinos Karanasos
18c86a3fb6 YARN-8111. Simplify PlacementConstraints API by removing allocationTagToIntraApp. Contributed by Weiwei Yang. 
(cherry picked from commit 28e2244390c990877dc2ee2733cf9b8d2c75128e)
 2018-04-20 12:25:08 -07:00
Jason Lowe
42aef3b655 YARN-7996. Allow user supplied Docker client configurations with YARN native services. Contributed by Shane Kumpf 
(cherry picked from commit 1d6e43da51aaaab522325bdbe4b51e58934e03f1)
 2018-04-17 11:32:58 -05:00
Sunil G
d5adc59017 YARN-8126. Support auto-spawning of admin configured services during bootstrap of RM. Contributed by Rohith Sharma K S. 
(cherry picked from commit 427ad7ecc4afbf2cc4acde22c29a7248c46fb22b)
 2018-04-17 15:25:31 +05:30
Eric Yang
2911b5406b YARN-8060. Added default readiness check for service components. 
Contributed by Billie Rinaldi

(cherry picked from 2d0662cfd57bd438421f912dc172e79a15835442)
 2018-04-16 14:53:42 -04:00