Commit Graph

213 Commits

Author SHA1 Message Date
Viraj Jasani 618c9218ee
HADOOP-17788. Replace IOUtils#closeQuietly usages by Hadoop's own utility (#3171)
Reviewed-by: Steve Loughran <stevel@apache.org>
Reviewed-by: Akira Ajisaka <aajisaka@apache.org>
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
2021-07-08 16:03:40 +09:00
Ahmed Hussein 890f2da624
YARN-10553. Refactor TestDistributedShell (#2581) 2021-01-09 08:39:21 +09:00
Masatake Iwasaki 5abeecd33f
YARN-10558. Fix failure of TestDistributedShell#testDSShellWithOpportunisticContainers. (#2586) 2021-01-05 13:38:34 +09:00
Ahmed Hussein 513f1995ad
YARN-10334. Close clients in TestDistributedShell (#2571) 2020-12-28 11:09:10 -08:00
Ahmed Hussein 7a88f45366
YARN-10536. Client in distributedShell swallows interrupt exceptions (#2554) 2020-12-17 15:13:28 -08:00
Ayush Saxena 1e3a6efcef
HADOOP-17288. Use shaded guava from thirdparty. (#2342). Contributed by Ayush Saxena. 2020-10-17 12:01:18 +05:30
Prabhu Joseph 5c927eb550 YARN-10360. Support Multi Node Placement in SingleConstraintAppPlacementAllocator
Reviewed by Sunil G.
2020-08-24 15:00:02 +05:30
Ayush Saxena 6bcb24d269 HADOOP-17100. Replace Guava Supplier with Java8+ Supplier in Hadoop. Contributed by Ahmed Hussein. 2020-07-18 14:33:43 +05:30
Brahma Reddy Battula 8914cf9167 Preparing for 3.4.0 development 2020-03-29 23:24:25 +05:30
HUAN-PING SU 8d754c2c39 HADOOP-16351. Change ":" to ApplicationConstants.CLASS_PATH_SEPARATOR. Contributed by kevin su.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2019-08-16 17:26:09 -07:00
Haibo Chen 5915c902aa YARN-9646. DistributedShell tests failed to bind to a local host name. (Contributed by Ray Yang) 2019-07-16 17:36:49 -07:00
Sunil G 649666e118 YARN-9573. DistributedShell cannot specify LogAggregationContext. Contributed by Adam Antal. 2019-06-06 14:51:55 +05:30
Sunil G 30c6dd92e1 YARN-9452. Fix TestDistributedShell and TestTimelineAuthFilterForV2 failures. Contributed by Prabhu Joseph. 2019-05-30 22:32:41 +05:30
Akira Ajisaka afd844059c HADOOP-16331. Fix ASF License check in pom.xml
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
2019-05-29 17:25:13 +09:00
Akira Ajisaka 9f933e6446
HADOOP-16323. https everywhere in Maven settings. 2019-05-27 15:24:59 +09:00
Giovanni Matteo Fumarola 6a0e7dd454 YARN-9482. DistributedShell job with localization fails in unsecure cluster. Contributed by Prabhu Joseph. 2019-05-23 13:27:52 -07:00
Giovanni Matteo Fumarola ec36126346 YARN-9483. DistributedShell does not release container when failed to localize at launch. Contributed by Prabhu Joseph. 2019-05-09 10:59:31 -07:00
Giovanni Matteo Fumarola b0d24ef39c YARN-9227. DistributedShell RelativePath is not removed at end. Contributed by Prabhu Joseph. 2019-04-01 10:59:14 -07:00
Eric Yang 09eabda314 YARN-9364. Remove commons-logging dependency from YARN.
Contributed by Prabhu Joseph
2019-03-18 19:58:42 -04:00
Eric Yang 2064ca015d YARN-9349. Changed logging to use slf4j api.
Contributed by Prabhu Joseph
2019-03-15 19:20:59 -04:00
Giovanni Matteo Fumarola 95372657fc YARN-9287. Consecutive StringBuilder append should be reuse. Contributed by Ayush Saxena. 2019-02-25 11:45:37 -08:00
Sunil G 6cec90653d YARN-9168. DistributedShell client timeout should be -1 by default. Contributed by Zhankun Tang. 2019-02-25 15:28:45 +05:30
Weiwei Yang 6c4ab0312b YARN-9258. Support to specify allocation tags without constraint in distributed shell CLI. Contributed by Prabhu Joseph. 2019-02-22 00:18:07 +08:00
Weiwei Yang 2b7f828d46 YARN-9252. Allocation Tag Namespace support in Distributed Shell. Contributed by Prabhu Joseph. 2019-02-11 14:42:21 +08:00
Weiwei Yang 711d22f166 YARN-9253. Add UT to verify Placement Constraint in Distributed Shell. Contributed by Prabhu Joseph. 2019-02-06 22:36:51 +08:00
Sunil G ba38db4f5b YARN-9257. Distributed Shell client throws a NPE for a non-existent queue. Contributed by Charan Hebri. 2019-02-05 13:41:44 +05:30
Weiwei Yang 69bcff380f YARN-9231. TestDistributedShell fix timeout. Contributed by Prabhu Joseph. 2019-02-02 23:27:31 +08:00
Giovanni Matteo Fumarola f738b397ae YARN-9191. Add cli option in DS to support enforceExecutionType in resource requests. Contributed by Abhishek Modi. 2019-01-31 11:24:15 -08:00
Akira Ajisaka 1129288cf5
HADOOP-14178. Move Mockito up to version 2.23.4. Contributed by Akira Ajisaka and Masatake Iwasaki. 2019-01-29 18:29:56 -08:00
Eric Yang f82922dcfa YARN-5168. Added exposed port information for Docker container.
Contributed by Xun Liu
2018-12-21 19:44:07 -05:00
Haibo Chen fb55e5201e YARN-9008. Extend YARN distributed shell with file localization feature. (Contributed by Peter Bacsko) 2018-12-11 14:13:34 -08:00
Sunil G 58fa96b697 Changed version in trunk to 3.3.0-SNAPSHOT. 2018-10-02 22:41:41 +05:30
Sunil G 33d8327cff YARN-8715. Make allocation tags in the placement spec optional for node-attributes. Contributed by Weiwei Yang. 2018-09-17 10:07:45 +05:30
Naganarasimha 67ae81f0e0 YARN-7863. Modify placement constraints to support node attributes. Contributed by Sunil Govindan. 2018-09-12 16:01:01 +05:30
Giovanni Matteo Fumarola 16333782c1 HADOOP-15731. TestDistributedShell fails on Windows. Contributed by Botong Huang. 2018-09-07 14:19:10 -07:00
bibinchundatt eed8415dc1 YARN-8535. Fix DistributedShell unit tests. Contributed by Abhishek Modi. 2018-09-02 13:35:52 +05:30
Akira Ajisaka 652bcbb3e4
YARN-8363. Upgrade commons-lang version to 3.7 in hadoop-yarn-project. Contributed by Takanobu Asanuma. 2018-06-13 00:35:37 +09:00
Wangda Tan 8956e5b8db YARN-8372. Distributed shell app master should not release containers when shutdown if keep-container is true. (Suma Shivaprasad via wangda)
Change-Id: Ief04d1ca865621f348fba4ac85fa78bc47465904
2018-06-01 14:49:18 -07:00
Billie Rinaldi 1ef0a1db1d YARN-7894. Improve ATS response for DShell DS_CONTAINER when container launch fails. Contributed by Chandni Singh 2018-05-08 13:49:41 -07:00
Billie Rinaldi 4e1382aca4 YARN-2674. Fix distributed shell AM container relaunch during RM work preserving restart. Contributed by Shane Kumpf 2018-05-01 07:27:47 -07:00
Sunil G 431076f637 YARN-8076. Support to specify application tags in distributed shell. Contributed by Weiwei Yang. 2018-03-29 15:55:39 +05:30
Sunil G d1e378d02b YARN-8075. DShell does not fail when we ask more GPUs than available even though AM throws 'InvalidResourceRequestException'. Contributed by Wangda Tan. 2018-03-28 08:03:18 +05:30
Sunil G 22c5ddb7c4 YARN-8063. DistributedShellTimelinePlugin wrongly check for entityId instead of entityType. Contributed by Rohith Sharma K S. 2018-03-23 10:54:00 +05:30
Wangda Tan a5b27b3c67 YARN-5015. Support sliding window retry capability for container restart. (Chandni Singh via wangda)
Change-Id: I07addd3e4ba8d98456ee2ff1d5c540a38fe61dea
2018-03-13 17:55:17 -07:00
Sunil G aae629913c YARN-7292. Retrospect Resource Profile Behavior for overriding capability. Contributed by Wangda Tan. 2018-02-16 12:37:40 +05:30
Weiwei Yang a08c048832 YARN-7838. Support AND/OR constraints in Distributed Shell. Contributed by Weiwei Yang. 2018-02-11 14:20:46 +08:00
Wangda Tan 60f9e60b3b Preparing for 3.2.0 development
Change-Id: I6d0e01f3d665d26573ef2b957add1cf0cddf7938
2018-02-11 11:17:38 +08:00
Jian He eb2449d539 YARN-5428. Allow for specifying the docker client configuration directory. Contributed by Shane Kumpf 2018-02-08 11:35:30 -08:00
Wangda Tan e60f51299d YARN-7745. Allow DistributedShell to take a placement specification for containers it wants to launch. (Arun Suresh via wangda)
Change-Id: Ided146d662e944a8a4692e5d6885f23fd9bbcad5
2018-01-31 01:30:17 -08:00
Sunil G 97607617ce YARN-7806. Distributed Shell should use timeline async api's. Contributed by Rohith Sharma K S 2018-01-24 16:56:13 +05:30