Commit Graph

122 Commits

Author SHA1 Message Date
He Xiaoqiao 3274fd139d
Preparing for 3.2.3 development 2020-10-16 14:52:41 +08:00
Ayush Saxena 27a97e4f28 HADOOP-17100. Replace Guava Supplier with Java8+ Supplier in Hadoop. Contributed by Ahmed Hussein. 2020-07-22 18:39:49 +05:30
Eric Yang 345ef049df YARN-9837. Fixed reading YARN Service JSON spec file larger than 128k.
Contributed by Tarun Parimi

(cherry picked from commit eefe9bc85c)
2019-09-17 13:22:53 -04:00
Rohith Sharma K S 7d5bb2ebb7 Preparing for 3.2.2-SNAPSHOT development. 2019-09-07 08:52:08 +05:30
Billie Rinaldi 66627749d0 YARN-9718. Fixed yarn.service.am.java.opts shell injection. Contributed by Eric Yang
(cherry picked from commit 2e2e5401f2)
2019-09-05 12:54:20 -07:00
Weiwei Yang bf3d9f6282 YARN-9682. Wrong log message when finalizing the upgrade. Contributed by kyungwan nam.
(cherry picked from commit 85d9111a88)
2019-07-17 10:47:25 +08:00
Sean Mackrory e0b3cbd221 HADOOP-16213. Update guava to 27.0-jre. Contributed by Gabor Bota. 2019-06-13 07:53:40 -06:00
Takanobu Asanuma a9a3450560 HADOOP-16331. Fix ASF License check in pom.xml. Contributed by Akira Ajisaka.
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
2019-05-29 17:34:16 +09:00
Akira Ajisaka 855dc997d6
HADOOP-16323. https everywhere in Maven settings. 2019-05-27 15:27:33 +09:00
Eric Yang 3d552b24ba YARN-8761. Service AM support for decommissioning component instances.
Contributed by Billie Rinaldi

(cherry picked from commit 4c465f5535)
2019-02-10 09:26:27 -08:00
Eric Yang 8c332affa8 YARN-8901. Fixed restart policy NEVER/ON_FAILURE with component dependency.
Contributed by Suma Shivaprasad

(cherry picked from commit f5a95f7998)
2019-01-28 18:12:04 -05:00
Eric Yang 4e1cef3625 YARN-9084. Reset container state and defer readiness check for upgrade.
Contributed by Chandni Singh

(cherry picked from commit ccdd982e51)
2018-12-18 18:05:40 -05:00
Eric Yang 8c70728f7f YARN-9071. Improved status update for reinitialized containers.
Contributed by Chandni Singh

(cherry picked from commit 1b790f4dd1)
2018-12-05 19:04:55 -05:00
Eric Yang a8f67ad7c9 YARN-9067. Fixed Resource Manager resource leak via YARN service.
Contributed by Eric Yang
2018-11-29 13:50:06 -05:00
Eric Yang db8b2a130c YARN-9056. Improved YARN service upgrade state logic for readiness check.
Contributed by Chandni Singh

(cherry picked from commit f657a2a661)
2018-11-27 19:45:23 -05:00
Wangda Tan bee5bf867b YARN-9001. [Submarine] Use AppAdminClient instead of ServiceClient to sumbit jobs. (Zac Zhou via wangda)
Change-Id: I7e8d1c27ebd37e0907ca570c4f3d56fe7a859635
2018-11-16 10:26:50 -08:00
Eric Yang 5399ff8177 YARN-9002. Improve keytab loading for YARN Service.
Contributed by Gour Saha

(cherry picked from commit 2664248797)
2018-11-10 01:54:59 -05:00
Eric Yang 91c916e209 YARN-8618. Added detection for non-upgradable service.
Contributed by Chandni Singh

(cherry picked from commit 66f059ed1d)
2018-10-18 20:00:50 -04:00
Sunil G bde4fd5ed9 Preparing for 3.2.0 release 2018-10-18 17:07:45 +05:30
Eric Yang fc25def7d7 YARN-8810. Fixed a YARN service bug in comparing ConfigFile object.
Contributed by Chandni Singh
2018-10-16 18:57:50 -04:00
Sunil G a439aa79dc YARN-8879. Kerberos principal is needed when submitting a submarine job. Contributed by Zac Zhou.
(cherry picked from commit 753f149fd3)
2018-10-16 22:18:30 +05:30
Billie Rinaldi d1c1dde309 YARN-8734. Readiness check for remote service belonging to the same user. Contributed by Eric Yang 2018-09-28 09:40:48 -07:00
Eric Yang 913f87dada YARN-8665. Added Yarn service cancel upgrade option.
Contributed by Chandni Singh
2018-09-26 14:51:35 -04:00
Andrew Purtell 568ebecdf4
YARN-8772. Annotation javax.annotation.Generated has moved
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-09-14 15:02:52 +09:00
Eric Yang fd089caf69 YARN-8488. Added SUCCEEDED/FAILED states to YARN service.
Contributed by Suma Shivaprasad
2018-08-28 13:55:28 -04:00
Eric Yang e557c6bd8d YARN-8298. Added express upgrade for YARN service.
Contributed by Chandni Singh
2018-08-21 19:49:26 -04:00
Eric Yang 4cba0741d5 YARN-8160. Support upgrade of service that use docker containers.
Contributed by Chandni Singh
2018-08-14 11:36:26 -04:00
Wangda Tan 861095f761 YARN-8407. Container launch exception in AM log should be printed in ERROR level. (Yesha Vora via wangda)
Change-Id: I154e873df1df3503a09c41d6b3874ca195af91d9
2018-08-07 13:01:13 -07:00
Eric Yang 23f394240e YARN-8610. Fixed initiate upgrade error message.
Contributed by Chandni Singh
2018-08-01 20:41:43 -04:00
Eric Yang c7ebcd76bf YARN-8579. Recover NMToken of previous attempted component data.
Contributed by Gour Saha
2018-07-31 18:01:02 -04:00
Billie Rinaldi b429f19d32 YARN-8571. Validate service principal format prior to launching yarn service. Contributed by Eric Yang 2018-07-27 11:30:19 -07:00
Eric Yang 8d3c068e59 YARN-8429. Improve diagnostic message when artifact is not set properly.
Contributed by Gour Saha
2018-07-26 20:02:13 -04:00
Eric Yang 40fad32824 YARN-8545. Return allocated resource to RM for failed container.
Contributed by Chandni Singh
2018-07-26 18:22:57 -04:00
Eric Yang 84d7bf1eef YARN-8360. Improve YARN service restart policy and node manager auto restart policy.
Contributed by Suma Shivaprasad
2018-07-23 12:57:01 -04:00
Eric Yang 121865c3f9 YARN-8299. Added CLI and REST API for query container status.
Contributed by Chandni Singh
2018-07-16 17:41:23 -04:00
bibinchundatt 52e1bc8539 YARN-8491. TestServiceCLI#testEnableFastLaunch fail when umask is 077. Contributed by K G Bakthavachalam. 2018-07-11 16:20:29 +05:30
Eric Yang 9f15483c5d YARN-8445. Improved error message for duplicated service and component names.
Contributed by Chandni Singh
2018-06-21 11:20:24 -04:00
Eric Yang 69b0596897 YARN-8411. Restart stopped system service during RM start.
Contributed by Billie Rinaldi
2018-06-13 19:05:52 -04:00
Akira Ajisaka 652bcbb3e4
YARN-8363. Upgrade commons-lang version to 3.7 in hadoop-yarn-project. Contributed by Takanobu Asanuma. 2018-06-13 00:35:37 +09:00
Billie Rinaldi 31998643a5 YARN-8342. Enable untrusted docker image to run with launch command. Contributed by Eric Yang 2018-06-02 14:46:32 -07:00
Wangda Tan ff583d3fa3 YARN-8349. Remove YARN registry entries when a service is killed by the RM. (Billie Rinaldi via wangda)
Change-Id: Ia58db3637789a8921482f564aa9bdf99c45cc36c
2018-06-01 14:49:18 -07:00
Eric Yang 7dd26d5378 YARN-8308. Fixed YARN Service AM failure with HDFS token renewal.
Contributed by Gour Saha
2018-05-31 21:09:36 -04:00
Billie Rinaldi 778a4a24be YARN-8350. NPE in service AM related to placement policy. Contributed by Gour Saha 2018-05-30 13:19:13 -07:00
Billie Rinaldi 96eefcc84a YARN-8368. yarn app start cli should print applicationId. Contributed by Rohith Sharma K S 2018-05-30 12:37:43 -07:00
Wangda Tan 3061bfcde5 YARN-8339. Service AM should localize static/archive resource types to container working directory instead of 'resources'. (Suma Shivaprasad via wangda)
Change-Id: I9f8e8f621650347f6c2f9e3420edee9eb2f356a4
2018-05-29 09:23:11 -07:00
Eric Yang d9852eb589 YARN-8357. Fixed NPE when YARN service is saved and not deployed.
Contributed by Chandni Singh
2018-05-24 16:32:13 -04:00
Eric Yang 989cfdc1e0 YARN-8141. Removed YARN_CONTAINER_RUNTIME_DOCKER_LOCAL_RESOURCE_MOUNTS flag.
Contributed by Chandni Singh
2018-05-17 20:56:04 -04:00
Eric Yang d45a0b7d73 YARN-8141. Removed YARN_CONTAINER_RUNTIME_DOCKER_LOCAL_RESOURCE_MOUNTS flag.
Contributed by Chandni Singh
2018-05-17 17:29:34 -04:00
Eric Yang 7f083ed869 YARN-8080. Add restart policy for YARN services.
Contributed by Suma Shivaprasad
2018-05-17 17:16:50 -04:00
Eric Yang 91357c22ef YARN-8300. Fixed NPE in DefaultUpgradeComponentsFinder.
Contributed by Suma Shivaprasad
2018-05-16 12:38:26 -04:00