21 Commits

Author SHA1 Message Date
Wangda Tan
cffe5c1ba0 YARN-9160. [Submarine] Document 'PYTHONPATH' environment variable setting when using -localization options. (Zhankun Tang via wangda)
Change-Id: I115b6710eb11501e21ab3e9e7cd1a87f322e5cf8
(cherry picked from commit 2c02aa6ec259128934cc5468cf66104a624d88a7)
2019-01-06 11:10:47 -08:00
Wangda Tan
1ad1ab5d7a YARN-9141. [Submarine] JobStatus outputs with system UTC clock, not local clock. (Zac Zhou via wangda)
Change-Id: Ib2b17cf7860ddc9188f06498086de3326bc09519
(cherry picked from commit 8f004fe4e0d479e26d0063427566edc1606bced5)
2019-01-06 11:10:41 -08:00
Sunil G
9bfea98746 YARN-9090. [Submarine] Update submarine installation script document. Contributed by Xun Liu.
(cherry picked from commit 742fd978b5b585fc14fc3fea7ec37f80c5d7dc97)
2018-12-26 08:27:50 +05:30
Wangda Tan
29e4e5f62c YARN-9112. [Submarine] Support polling applicationId when it's not ready in cluster. (Zhankun Tang via wangda)
Change-Id: I73d73f3d631b28fb9866faa56571839b13824a97
(cherry picked from commit 9fba6cc2471db8df9ca6da7b9df378e3072dfeb2)
2018-12-12 11:52:16 -08:00
Wangda Tan
ef0f835537 YARN-8714. [Submarine] Support files/tarballs to be localized for a training job. (Zhankun Tang via wangda)
Change-Id: I845131273e52a9d81dbc813ea6d4af06b205e334
(cherry picked from commit c771fe6e10bd3f8533a01026de3c33db2a983cf4)
2018-12-12 11:52:07 -08:00
Wangda Tan
559cb99bf6 Revert "YARN-8870. [Submarine] Add submarine installation scripts. (Xun Liu via wangda)"
This reverts commit 920401b2966c2dcd7cd1b3dfd7a764f08412323f.
2018-12-04 14:13:39 -08:00
Wangda Tan
34387599c4 YARN-8960. [Submarine] Can't get submarine service status using the command of "yarn app -status" under security environment. (Zac Zhou via wangda)
Change-Id: I21b1addc9c32817650ea744a8f2e6b5602f2f4d4
(cherry picked from commit 8b2381441558cd49b4c940b0760c8accbb2a5567)
2018-11-19 09:01:21 -08:00
Wangda Tan
bee5bf867b YARN-9001. [Submarine] Use AppAdminClient instead of ServiceClient to sumbit jobs. (Zac Zhou via wangda)
Change-Id: I7e8d1c27ebd37e0907ca570c4f3d56fe7a859635
2018-11-16 10:26:50 -08:00
Wangda Tan
ea753046b0 YARN-8918. [Submarine] Correct method usage of str.subString in CliUtils. (Zhankun Tang via wangda)
Change-Id: Id1f11dbab3aa838dee3a0ec8b8fd5dc32f5dd946
(cherry picked from commit 076b795b2e82d7f89cc91e0a8513c7081ee8b930)
2018-11-13 11:35:06 -08:00
Sunil G
bde4fd5ed9 Preparing for 3.2.0 release 2018-10-18 17:07:45 +05:30
Wangda Tan
aa23c8d739 YARN-8798. [Submarine] Job should not be submitted if --input_path option is missing. (Zhankun Tang via wangda)
Change-Id: I7ae0e44eb5179b04a6ac861ec1c65f3b18c38f0f
(cherry picked from commit 143d74775b2b62884090fdd88874134b9eab2888)
2018-10-16 13:53:03 -07:00
Wangda Tan
920401b296 YARN-8870. [Submarine] Add submarine installation scripts. (Xun Liu via wangda)
Change-Id: I46e8d9fd32c7745c313030da62da41486a77b3ea
(cherry picked from commit 46d6e0016610ced51a76189daeb3ad0e3dbbf94c)
2018-10-16 13:52:58 -07:00
Wangda Tan
8610c20724 YARN-8875. [Submarine] Add documentation for submarine installation script details. (Xun Liu via wangda)
Change-Id: I1c8d39c394e5a30f967ea514919835b951f2c124
(cherry picked from commit ed08dd3b0c9cec20373e8ca4e34d6526bd759943)
2018-10-16 13:52:53 -07:00
Wangda Tan
8e8b748724 YARN-8852. Add documentation for submarine installation details. (Zac Zhou via wangda)
Change-Id: If5681d1ef37ff5dc916735eeef15a6120173d653
(cherry picked from commit a23ea68b9747eae9b176f908bb04b76d30fe3795)
2018-10-09 10:19:16 -07:00
Vidura Mudalige
843e7f81fe
YARN-8819. Fix findbugs warnings in YarnServiceUtils
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit b85ee0d75d450f1c695cec1bebac627f66a97c98)
2018-10-07 00:55:08 +09:00
Sunil G
19ad5be651 YARN-8800. Updated documentation of Submarine with latest examples. Contributed by Wangda Tan. 2018-09-29 00:01:04 +05:30
Sunil G
d0bc6a27fd YARN-8817. [Submarine] In cases when user doesn't ask HDFS path while submitting job but framework requires user to set HDFS related environments. Contributed by Wangda Tan. 2018-09-25 11:23:34 +05:30
Sunil G
0cd6346102 YARN-8769. [Submarine] Allow user to specify customized quicklink(s) when submit Submarine job. Contributed by Wangda Tan. 2018-09-21 23:39:22 +05:30
Sunil G
1824d5d1c4 YARN-8757. [Submarine] Add Tensorboard component when --tensorboard is specified. Contributed by Wangda Tan. 2018-09-19 22:18:55 +05:30
Wangda Tan
de85f841da YARN-8698. [Submarine] Failed to reset Hadoop home environment when submitting a submarine job. (Zac Zhou via wangda)
Change-Id: If7fdc11fcc4e49bed2186ded76cd69164f34f502
2018-09-09 17:45:31 -07:00
Sunil G
cadbc8b57f YARN-8561. [Submarine] Initial implementation: Training job submission and job history retrieval. Contributed by Wangda Tan. 2018-08-13 14:22:55 +05:30