Commit Graph

385 Commits

Author SHA1 Message Date
Wangda Tan 31ea2f7806 Preparing for 3.1.3 development
Change-Id: I3c3d3ee47dc4fef239127b4452ff14676fa26e3d
2019-01-07 10:04:58 -08:00
Eric Yang 956e6cfee6 YARN-9084. Reset container state and defer readiness check for upgrade.
Contributed by Chandni Singh

(cherry picked from commit ccdd982e51)
2018-12-18 18:06:04 -05:00
Eric Yang 7ef4ff1905 YARN-9071. Improved status update for reinitialized containers.
Contributed by Chandni Singh

(cherry picked from commit 1b790f4dd1)
2018-12-05 19:05:26 -05:00
Eric Yang 1b731de944 YARN-9067. Fixed Resource Manager resource leak via YARN service.
Contributed by Eric Yang
2018-11-29 13:51:39 -05:00
Eric Yang fc74a3f803 YARN-9056. Improved YARN service upgrade state logic for readiness check.
Contributed by Chandni Singh
2018-11-27 19:43:24 -05:00
Eric Yang bec5036397 YARN-8665. Added Yarn service cancel upgrade option.
Contributed by Chandni Singh
2018-11-27 16:29:08 -05:00
Eric Yang 7741106fd0 YARN-8488. Added SUCCEEDED/FAILED states to YARN service for branch-3.1.
Contributed by Chandni Singh
2018-11-27 13:36:33 -05:00
Eric Yang eb43772896 YARN-8298. Added express upgrade for YARN service.
Contributed by Chandni Singh
2018-11-26 18:55:28 -05:00
Eric Yang fce0350289 YARN-8160. Support upgrade of service that use docker containers.
Contributed by Chandni Singh
2018-11-16 16:01:25 -05:00
Wangda Tan 077a7ab37b YARN-8299. Yarn Service Upgrade: Add GET APIs that returns instances matching query params. (Chandni Singh via wangda)
Change-Id: I7f2aef89c6053d5dc5955f79fdfcd4cd74f74737
2018-11-16 10:32:10 -08:00
Eric Yang 5ec0a34151 YARN-9002. Improve keytab loading for YARN Service.
Contributed by Gour Saha
2018-11-10 01:56:15 -05:00
Eric Yang 7c40f9b37c YARN-8810. Fixed a YARN service bug in comparing ConfigFile object.
Contributed by Chandni Singh
2018-10-16 18:58:28 -04:00
Sunil G 38e187384b YARN-8869. YARN Service Client might not work correctly with RM REST API for Kerberos authentication. Contributed by Eric Yang.
(cherry picked from commit fa94d370b6)
2018-10-15 21:23:07 +05:30
Giovanni Matteo Fumarola 7fed1a07ab HADOOP-15731. TestDistributedShell fails on Windows. Contributed by Botong Huang. 2018-09-07 16:37:03 -07:00
bibinchundatt e2e0fc26a2 YARN-8535. Fix DistributedShell unit tests. Contributed by Abhishek Modi.
(cherry picked from commit eed8415dc1)
2018-09-02 13:37:38 +05:30
Eric Yang 97c1934247 YARN-8474. Fixed ApiServiceClient kerberos negotiation.
Contributed by Billie Rinaldi

(cherry picked from commit 8990eaf592)
2018-08-16 12:50:52 -04:00
Wangda Tan f2768eaa38 YARN-8407. Container launch exception in AM log should be printed in ERROR level. (Yesha Vora via wangda)
Change-Id: I154e873df1df3503a09c41d6b3874ca195af91d9
(cherry picked from commit 861095f761)
2018-08-07 13:07:28 -07:00
Eric Yang 680dac26d8 YARN-8610. Fixed initiate upgrade error message.
Contributed by Chandni Singh

(cherry picked from commit 23f394240e)
2018-08-01 20:43:22 -04:00
Eric Yang 7640d62716 YARN-8579. Recover NMToken of previous attempted component data.
Contributed by Gour Saha
2018-07-31 18:35:31 -04:00
Wangda Tan 5583711419 Preparing for 3.1.2 release
Change-Id: If2793e2ed2b5b349a9e1f98f78df43f309dcfcbd
2018-07-31 13:08:55 -07:00
Billie Rinaldi 06166f2255 YARN-8571. Validate service principal format prior to launching yarn service. Contributed by Eric Yang
(cherry picked from commit b429f19d32)
2018-07-27 11:35:41 -07:00
Eric Yang d6627cda9d YARN-8429. Improve diagnostic message when artifact is not set properly.
Contributed by Gour Saha

(cherry picked from commit 8d3c068e59)
2018-07-27 11:29:43 -04:00
Eric Yang 177f6045ac YARN-8545. Return allocated resource to RM for failed container.
Contributed by Chandni Singh

(cherry picked from commit 40fad32824)
2018-07-26 18:25:41 -04:00
Eric Yang e665c0a9dd YARN-8360. Improve YARN service restart policy and node manager auto restart policy.
Contributed by Suma Shivaprasad

(cherry picked from commit 84d7bf1eef)
2018-07-23 12:59:37 -04:00
bibinchundatt 2aaad4000a YARN-8491. TestServiceCLI#testEnableFastLaunch fail when umask is 077. Contributed by K G Bakthavachalam.
(cherry picked from commit 52e1bc8539)
2018-07-11 16:24:37 +05:30
Eric Yang 63ce762959 YARN-8445. Improved error message for duplicated service and component names.
Contributed by Chandni Singh

(cherry picked from commit 9f15483c5d)
2018-06-21 11:21:34 -04:00
Eric Yang aba67c360c YARN-8411. Restart stopped system service during RM start.
Contributed by Billie Rinaldi

(cherry picked from commit 69b0596897)
2018-06-13 19:10:13 -04:00
Billie Rinaldi e59e9feefa YARN-8342. Enable untrusted docker image to run with launch command. Contributed by Eric Yang
(cherry picked from commit 31998643a5)
2018-06-02 14:49:21 -07:00
Wangda Tan 0be93a7973 YARN-8349. Remove YARN registry entries when a service is killed by the RM. (Billie Rinaldi via wangda)
Change-Id: Ia58db3637789a8921482f564aa9bdf99c45cc36c
(cherry picked from commit ff583d3fa3)
2018-06-01 15:53:26 -07:00
Wangda Tan ed20576413 YARN-8372. Distributed shell app master should not release containers when shutdown if keep-container is true. (Suma Shivaprasad via wangda)
Change-Id: Ief04d1ca865621f348fba4ac85fa78bc47465904
(cherry picked from commit 8956e5b8db)
2018-06-01 15:47:59 -07:00
Eric Yang 4193892de6 YARN-8308. Fixed YARN Service AM failure with HDFS token renewal.
Contributed by Gour Saha

(cherry picked from commit 7c7ac07f013f46db89c73681806300699ee534d6)
2018-05-31 21:10:04 -04:00
Billie Rinaldi 58e7d6c3c0 YARN-8350. NPE in service AM related to placement policy. Contributed by Gour Saha
(cherry picked from commit 778a4a24be)
2018-05-30 13:21:17 -07:00
Billie Rinaldi 7bd5d79177 YARN-8368. yarn app start cli should print applicationId. Contributed by Rohith Sharma K S
(cherry picked from commit 96eefcc84a)
2018-05-30 12:38:53 -07:00
Wangda Tan b262ea1381 YARN-8339. Service AM should localize static/archive resource types to container working directory instead of 'resources'. (Suma Shivaprasad via wangda)
Change-Id: I9f8e8f621650347f6c2f9e3420edee9eb2f356a4
(cherry picked from commit 3061bfcde5)
2018-05-29 09:28:27 -07:00
Eric Yang f49e697cc8 YARN-8357. Fixed NPE when YARN service is saved and not deployed.
Contributed by Chandni Singh

(cherry picked from commit d9852eb589)
2018-05-24 16:34:32 -04:00
Eric Yang 05d905f586 YARN-7530. Refactored YARN service API project location.
Contributed by Chandni Singh
2018-05-23 22:43:54 -04:00
Eric Yang 61e8974049 YARN-7530. Refactored YARN service API project location.
Contributed by Chandni Singh
2018-05-18 17:33:18 -04:00
Eric Yang 0791785574 YARN-8296. Removed unique_component_support from YARN services.
Contributed by Suma Shivaprasad

(cherry picked from commit 2f2dd22aad)
2018-05-17 20:59:50 -04:00
Eric Yang 79351d4fda YARN-8141. Removed YARN_CONTAINER_RUNTIME_DOCKER_LOCAL_RESOURCE_MOUNTS flag.
Contributed by Chandni Singh

(cherry picked from 989cfdc1e0)
2018-05-17 20:57:14 -04:00
Eric Yang aafaa5f99b YARN-8141. Removed YARN_CONTAINER_RUNTIME_DOCKER_LOCAL_RESOURCE_MOUNTS flag.
Contributed by Chandni Singh

(cherry-picked from commit d45a0b7d73)
2018-05-17 17:32:29 -04:00
Eric Yang 044573b628 YARN-8080. Add restart policy for YARN services.
Contributed by Suma Shivaprasad

(cherry picked from commit 7f083ed869)
2018-05-17 17:20:45 -04:00
Eric Yang 2c3f300464 YARN-8300. Fixed NPE in DefaultUpgradeComponentsFinder.
Contributed by Suma Shivaprasad

(cherry picked from 91357c22ef)
2018-05-16 12:42:22 -04:00
Eric Yang 051d9cff9c YARN-8081. Add support to upgrade a component.
Contributed by Chandni Singh

(cherry picked from commit 8d3b39de89)
2018-05-15 20:42:24 -04:00
Sunil G 0a30a548f1 YARN-8236. Invalid kerberos principal file name cause NPE in native service. Contributed by Gour Saha.
(cherry picked from commit 58b97c79e3)
2018-05-15 12:18:09 +05:30
Eric Yang 8edcbe9460 YARN-8265. Improve DNS handling on docker IP changes.
Contributed by Billie Rinaldi

(cherry picked from commit 0ff94563b9)
2018-05-11 22:41:30 -07:00
Jason Lowe dfe73334c2 YARN-7654. Support ENTRY_POINT for docker container. Contributed by Eric Yang
(cherry picked from commit 6c8e51ca7e)
2018-05-11 18:57:20 -05:00
Billie Rinaldi 355ff085e6 YARN-8243. Flex down should remove instance with largest component instance ID first. Contributed by Gour Saha
(cherry picked from commit ca612e353f)
2018-05-11 12:50:40 -07:00
Billie Rinaldi f7cbfeb726 YARN-7894. Improve ATS response for DShell DS_CONTAINER when container launch fails. Contributed by Chandni Singh
(cherry picked from commit 1ef0a1db1d)
2018-05-08 13:51:02 -07:00
Billie Rinaldi e933ed0ee3 YARN-8079. Support static and archive unmodified local resources in service AM. Contributed by Suma Shivaprasad
(cherry picked from commit 6795f8072f)
2018-05-04 09:47:06 -07:00
Eric Yang 2148fc1c3a YARN-8226. Improved anti-affinity description in YARN Service doc.
Contributed by Gour Saha

(cherry picked from commit 7698737207)
2018-05-03 13:38:21 -04:00