Commit Graph

459 Commits

Author SHA1 Message Date
Gabor Bota d7979079ea HADOOP-16210. Update guava to 27.0-jre in hadoop-project trunk. Contributed by Gabor Bota. 2019-04-03 12:59:39 -06:00
Giovanni Matteo Fumarola b0d24ef39c YARN-9227. DistributedShell RelativePath is not removed at end. Contributed by Prabhu Joseph. 2019-04-01 10:59:14 -07:00
Billie Rinaldi 35b0a381e7 YARN-9255. Improve recommend applications order and fix findbugs warnings. Contributed by Eric Yang 2019-04-01 09:21:36 -07:00
Billie Rinaldi d9e9e5657d YARN-9348. Application catalog build system bug fixes. Contributed by Eric Yang 2019-03-29 13:51:21 -07:00
Billie Rinaldi 7ee32a2eb1 YARN-7129. Application Catalog for YARN applications. Contributed by Eric Yang 2019-03-29 13:51:21 -07:00
Giovanni Matteo Fumarola 9cd66198ee YARN-9411. TestYarnNativeServices fails sporadically with bind address in use. Contributed by Prabhu Joseph. 2019-03-27 10:44:54 -07:00
Eric Yang 710cbc9bd6 YARN-9405. Fixed flaky tests in TestYarnNativeServices.
Contributed by Prabhu Joseph
2019-03-25 16:34:04 -04:00
Eric Yang 09eabda314 YARN-9364. Remove commons-logging dependency from YARN.
Contributed by Prabhu Joseph
2019-03-18 19:58:42 -04:00
Eric Yang 5f6e225166 YARN-9363. Replaced debug logging with SLF4J parameterized log message.
Contributed by Prabhu Joseph
2019-03-18 13:57:18 -04:00
Eric Yang 19b22c4385 YARN-9385. Fixed ApiServiceClient to use current UGI.
Contributed by Eric Yang
2019-03-18 13:16:34 -04:00
Eric Yang 2064ca015d YARN-9349. Changed logging to use slf4j api.
Contributed by Prabhu Joseph
2019-03-15 19:20:59 -04:00
Billie Rinaldi ab574ffd72 Revert "YARN-7129. Application Catalog for YARN applications. Contributed by Eric Yang"
This reverts commit 2576401928.
2019-03-12 11:50:16 -07:00
Billie Rinaldi 55069bfb09 Revert "YARN-9348. Application catalog build system bug fixes."
This reverts commit 01ada40ea4.
2019-03-12 11:49:55 -07:00
Billie Rinaldi 024b3bae8a Revert "YARN-9255. Improve recommend applications order and fix findbugs warnings. Contributed by Eric Yang"
This reverts commit aab7b77536.
2019-03-12 11:48:55 -07:00
Billie Rinaldi aab7b77536 YARN-9255. Improve recommend applications order and fix findbugs warnings. Contributed by Eric Yang 2019-03-12 10:06:09 -07:00
Eric Badger fa7a0b269a YARN-8805. Automatically convert the launch command to the exec form when using entrypoint support 2019-03-11 12:55:01 -05:00
Eric Yang 39b4a37e02 YARN-9341. Fixed enentrant lock usage in YARN project.
Contributed by Prabhu Joseph
2019-03-07 16:47:45 -05:00
Eric Yang 01ada40ea4 YARN-9348. Application catalog build system bug fixes.
Contributed by Eric Yang
2019-03-06 17:55:48 -05:00
Billie Rinaldi 2576401928 YARN-7129. Application Catalog for YARN applications. Contributed by Eric Yang 2019-03-05 06:14:14 -08:00
Eric Yang 04b228e43b YARN-9334. Allow YARN Service client to send SPNEGO challenge header when authentication type is not simple.
Contributed by Billie Rinaldi
2019-02-27 18:47:14 -05:00
Giovanni Matteo Fumarola 95372657fc YARN-9287. Consecutive StringBuilder append should be reuse. Contributed by Ayush Saxena. 2019-02-25 11:45:37 -08:00
Sunil G 6cec90653d YARN-9168. DistributedShell client timeout should be -1 by default. Contributed by Zhankun Tang. 2019-02-25 15:28:45 +05:30
Weiwei Yang 6c4ab0312b YARN-9258. Support to specify allocation tags without constraint in distributed shell CLI. Contributed by Prabhu Joseph. 2019-02-22 00:18:07 +08:00
Sunil G 9057aa9fc5 SUBMARINE-1. Move code base of submarine from yarn-applications to top directory. Contributed by Wangda Tan. 2019-02-17 20:03:56 +05:30
Weiwei Yang 2b7f828d46 YARN-9252. Allocation Tag Namespace support in Distributed Shell. Contributed by Prabhu Joseph. 2019-02-11 14:42:21 +08:00
Weiwei Yang 711d22f166 YARN-9253. Add UT to verify Placement Constraint in Distributed Shell. Contributed by Prabhu Joseph. 2019-02-06 22:36:51 +08:00
Sunil G ba38db4f5b YARN-9257. Distributed Shell client throws a NPE for a non-existent queue. Contributed by Charan Hebri. 2019-02-05 13:41:44 +05:30
Weiwei Yang 69bcff380f YARN-9231. TestDistributedShell fix timeout. Contributed by Prabhu Joseph. 2019-02-02 23:27:31 +08:00
Giovanni Matteo Fumarola f738b397ae YARN-9191. Add cli option in DS to support enforceExecutionType in resource requests. Contributed by Abhishek Modi. 2019-01-31 11:24:15 -08:00
Akira Ajisaka 1129288cf5
HADOOP-14178. Move Mockito up to version 2.23.4. Contributed by Akira Ajisaka and Masatake Iwasaki. 2019-01-29 18:29:56 -08:00
Eric Yang f5a95f7998 YARN-8901. Fixed restart policy NEVER/ON_FAILURE with component dependency.
Contributed by Suma Shivaprasad
2019-01-28 18:10:33 -05:00
Eric Yang a33ef4fd31 YARN-8867. Added resource localization status to YARN service status call.
Contributed by Chandni Singh
2019-01-24 18:43:21 -05:00
Weiwei Yang a4bd64e724 YARN-9116. Capacity Scheduler: implements queue level maximum-allocation inheritance. Contributed by Aihua Xu. 2019-01-24 17:53:43 +08:00
Eric Yang 824dfa3b09 YARN-8489. Support "dominant" component concept in YARN service.
Contributed by Zac Zhou
2019-01-18 20:23:04 -05:00
Eric Yang 8c7f6b2d4d YARN-9197. Add safe guard against NPE for component instance failure.
Contributed by kyungwan nam
2019-01-18 13:49:56 -05:00
Wangda Tan 2c02aa6ec2 YARN-9160. [Submarine] Document 'PYTHONPATH' environment variable setting when using -localization options. (Zhankun Tang via wangda)
Change-Id: I115b6710eb11501e21ab3e9e7cd1a87f322e5cf8
2019-01-06 10:25:35 -08:00
Wangda Tan 8f004fe4e0 YARN-9141. [Submarine] JobStatus outputs with system UTC clock, not local clock. (Zac Zhou via wangda)
Change-Id: Ib2b17cf7860ddc9188f06498086de3326bc09519
2019-01-06 10:24:29 -08:00
Sunil G f4906ac019 YARN-9038. [CSI] Add ability to publish/unpublish volumes on node managers. Contributed by Weiwei Yang. 2019-01-04 12:10:00 +05:30
Sunil G 742fd978b5 YARN-9090. [Submarine] Update submarine installation script document. Contributed by Xun Liu. 2018-12-26 08:26:48 +05:30
Eric Yang f82922dcfa YARN-5168. Added exposed port information for Docker container.
Contributed by Xun Liu
2018-12-21 19:44:07 -05:00
Eric Yang ccdd982e51 YARN-9084. Reset container state and defer readiness check for upgrade.
Contributed by Chandni Singh
2018-12-18 18:02:03 -05:00
Wangda Tan 9fba6cc247 YARN-9112. [Submarine] Support polling applicationId when it's not ready in cluster. (Zhankun Tang via wangda)
Change-Id: I73d73f3d631b28fb9866faa56571839b13824a97
2018-12-12 11:44:58 -08:00
Wangda Tan c771fe6e10 YARN-8714. [Submarine] Support files/tarballs to be localized for a training job. (Zhankun Tang via wangda)
Change-Id: I845131273e52a9d81dbc813ea6d4af06b205e334
2018-12-12 11:43:23 -08:00
Wangda Tan 8a5361116e YARN-9078. [Submarine] Clean up the code of CliUtils#parseResourcesString. (Zhankun Tang via wangda)
Change-Id: I21ac5757b6115d55ec3157ba25db1b65bc85a37b
2018-12-12 11:42:44 -08:00
Haibo Chen fb55e5201e YARN-9008. Extend YARN distributed shell with file localization feature. (Contributed by Peter Bacsko) 2018-12-11 14:13:34 -08:00
Eric Yang 1b790f4dd1 YARN-9071. Improved status update for reinitialized containers.
Contributed by Chandni Singh
2018-12-05 17:00:56 -05:00
Wangda Tan 228156cfd1 Revert "YARN-8870. [Submarine] Add submarine installation scripts. (Xun Liu via wangda)"
This reverts commit 46d6e00166.
2018-12-04 14:13:06 -08:00
Weiwei Yang efc4d91cbe YARN-9067. YARN Resource Manager is running OOM because of leak of Configuration Object. Contributed by Eric Yang. 2018-11-29 09:34:14 +08:00
Wangda Tan 897643928c YARN-8975. [Submarine] Use predefined Charset object StandardCharsets.UTF_8 instead of String UTF-8. (Zhankun Tang via wangda)
Change-Id: If6c7904aa17895e543cfca245264249eb7328bdc
2018-11-28 14:39:06 -08:00
Eric Yang f657a2a661 YARN-9056. Improved YARN service upgrade state logic for readiness check.
Contributed by Chandni Singh
2018-11-27 18:36:59 -05:00