1143 Commits

Author SHA1 Message Date
Eric E Payne
0cb05a9fe3 YARN-6616: YARN AHS shows submitTime for jobs same as startTime. Contributed by Prabhu Joseph
(cherry picked from commit 04105bbfdb041a41062c856632641140de84fba8)
2019-01-29 18:04:01 +00:00
Haibo Chen
61a6cc8d23 YARN-7088. Add application launch time to Resource Manager REST API. (Kanwaljeet Sachdev via Haibo Chen)
(cherry picked from commit bb92bfb4ef96baa234966b60e464d1773fbf3f22)
2019-01-24 15:58:37 -08:00
rahul3
8dea94d071
YARN-9203. Fix typos in yarn-default.xml.
This closes #437

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 0a46baecd31c485d1ea4e567c29c47bfba0b092e)
2019-01-17 16:20:15 +09:00
Wangda Tan
31ea2f7806 Preparing for 3.1.3 development
Change-Id: I3c3d3ee47dc4fef239127b4452ff14676fa26e3d
2019-01-07 10:04:58 -08:00
Eric Yang
bec5036397 YARN-8665. Added Yarn service cancel upgrade option.
Contributed by Chandni Singh
2018-11-27 16:29:08 -05:00
Eric Yang
eb43772896 YARN-8298. Added express upgrade for YARN service.
Contributed by Chandni Singh
2018-11-26 18:55:28 -05:00
Wangda Tan
077a7ab37b YARN-8299. Yarn Service Upgrade: Add GET APIs that returns instances matching query params. (Chandni Singh via wangda)
Change-Id: I7f2aef89c6053d5dc5955f79fdfcd4cd74f74737
2018-11-16 10:32:10 -08:00
Rohith Sharma K S
095635d984 YARN-8303. YarnClient should contact TimelineReader for application/attempt/container report.
(cherry picked from commit ee3355be3cd1cd956296a1b79b264177ff139ce6)
2018-11-16 18:38:11 +05:30
Vrushali C
1dd2cf296d YARN-8834 Provide Java client for fetching Yarn specific entities from TimelineReader. Contributed by Abhishek Modi
(cherry picked from commit a3edfddcf7822ea13bdf4858672eb82cea5e0b5f)
2018-11-16 18:38:11 +05:30
Sunil G
0cb184d6e9 YARN-8868. Set HTTPOnly attribute to Cookie. Contributed by Chandni Singh.
(cherry picked from commit 2202e00ba8a44ad70f0a90e6c519257e3ae56a36)
2018-10-23 09:58:05 +05:30
Wangda Tan
c11d2341af YARN-8908. Fix errors in yarn-default.xml related to GPU/FPGA. (Zhankun Tang via wangda)
Change-Id: I46f511a9b51b65b069e15d5b827530110c41edab
(cherry picked from commit 071b9e19aa2c17bb9fa046c6ddabd6b8f0cc6d14)
2018-10-19 09:55:27 -07:00
Akira Ajisaka
58693c63db
YARN-8840. Add missing cleanupSSLConfig() call for TestTimelineClient test. Contributed by Aki Tanaka.
(cherry picked from commit 39b35036ba47064149003046a7b59feb01575d1e)
2018-10-04 09:53:22 +09:00
Shane Kumpf
b8618556ee YARN-8642. Add support for tmpfs mounts with the Docker runtime. Contributed by Craig Condit
(cherry picked from commit 73625168c0f29aa646d7a715c9fb15e43d6c7e05)
2018-08-29 07:11:38 -06:00
Sunil G
c6013b060d YARN-8633. Update DataTables version in yarn-common in line with JQuery 3 upgrade. Contributed by Akhil PB.
(cherry picked from commit 00013d6ef7fdf65fa8a0f6eb56c0aef2f6e19444)
2018-08-09 12:35:21 +05:30
Bharat Viswanadham
5430aab133 YARN-8426:Upgrade jquery-ui to 1.12.1 in YARN. Contributed by Sunil Govindan
(cherry picked from commit 361ffb26bebf2491bbe3219ef4a83eb753660018)
2018-08-09 12:27:50 +05:30
Shane Kumpf
7773904974 YARN-8287. Update documentation and yarn-default related to the Docker runtime. Contributed by Craig Condit
(cherry picked from commit bcfc9851f4c6d37d9a119c16ea7d4d253d3b9614)
2018-08-03 18:23:37 -06:00
Wangda Tan
f4a3b26f9a YARN-8522. Application fails with InvalidResourceRequestException. (Zian Chen via wangda)
Change-Id: I34dd7fa49bd4d10580c4a78051033b1068d28f1e
(cherry picked from commit 5cc8e99147276a059979813f7fd323dd7d77b248)
2018-07-31 22:35:16 -07:00
Wangda Tan
5583711419 Preparing for 3.1.2 release
Change-Id: If2793e2ed2b5b349a9e1f98f78df43f309dcfcbd
2018-07-31 13:08:55 -07:00
Wangda Tan
7b552c9d72 YARN-8418. App local logs could leaked if log aggregation fails to initialize for the app. (Bibin A Chundatt via wangda)
Change-Id: I29a23ca4b219b48c92e7975cd44cddb8b0e04104
(cherry picked from commit 4b540bbfcf02d828052999215c6135603d98f5db)
2018-07-31 12:13:36 -07:00
Jonathan Hung
b91cf90e1c YARN-7974. Allow updating application tracking url after registration. Contributed by Jonathan Hung 2018-07-30 17:57:25 -07:00
bibinchundatt
8cd2a73777 YARN-8584. Several typos in Log Aggregation related classes. Contributed by Szilard Nemeth.
(cherry picked from commit 2b39ad26984d641bad57db2cfcc0b7515ef95f46)
2018-07-31 00:07:08 +05:30
bibinchundatt
a684a2efb8 YARN-8548. AllocationRespose proto setNMToken initBuilder not done. Contributed by Bilwa S T.
(cherry picked from commit ff7c2eda34c2c40ad71b50df6462a661bd213fbd)
2018-07-24 16:30:31 +05:30
Wangda Tan
8ad82ea5b5 YARN-8506. Make GetApplicationsRequestPBImpl thread safe. (wangda)
Change-Id: I2c006965375823c83036e7f45f7163d13c0bdf90
2018-07-09 11:35:15 -07:00
Xiaoyu Yao
ffe2019887 HADOOP-15571. Multiple FileContexts created with the same configuration object should be allowed to have different umask. Contributed by Vinod Kumar Vavilapalli.
(cherry picked from commit 629f7008b531bad469903e6a1f6f8cb4be691f36)
2018-07-06 11:56:51 -07:00
Sunil G
aa8db00fc3 HADOOP-15483. Upgrade jquery to version 3.3.1. Contributed by Lokesh Jain, Mukul Kumar Singh and Sunil Govindan. 2018-06-26 15:02:49 -07:00
Eric Yang
f6aa6a6981 YARN-8108. Added option to disable loading existing filters to prevent
security filter from initialize twice.
            Contributed by Sunil Govindan

(cherry picked from commit b69ba0f3307a90500aeb0c5db9e582fcda60b501)
2018-06-26 17:45:13 -04:00
Wangda Tan
0be93a7973 YARN-8349. Remove YARN registry entries when a service is killed by the RM. (Billie Rinaldi via wangda)
Change-Id: Ia58db3637789a8921482f564aa9bdf99c45cc36c
(cherry picked from commit ff583d3fa3325029bc691ec22d817aee37e5e85d)
2018-06-01 15:53:26 -07:00
Jason Lowe
a1fd04c4f4 YARN-8329. Docker client configuration can still be set incorrectly. Contributed by Shane Kumpf
(cherry picked from commit 4827e9a9085b306bc379cb6e0b1fe4b92326edcd)
2018-05-29 14:48:01 -05:00
Wangda Tan
3eb1cb18c7 YARN-8369. Javadoc build failed due to 'bad use of >'. (Takanobu Asanuma via wangda)
Change-Id: I79a42154e8f86ab1c3cc939b3745024b8eebe5f4
(cherry picked from commit 17aa40f669f197d43387d67dc00040d14cd00948)
2018-05-29 09:28:34 -07:00
Rohith Sharma K S
f19e8e2246 MAPREDUCE-7097. MapReduce JHS should honor yarn.webapp.filter-entity-list-by-user. Contributed by Sunil Govindan.
(cherry picked from commit 88cbe57c069a1d2dd3bfb32e3ad742566470a10b)
2018-05-28 14:06:50 +05:30
Eric E Payne
053937f436 YARN-8292: Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative. Contributed by Wangda Tan.
(cherry picked from commit 8d5509c68156faaa6641f4e747fc9ff80adccf88)
2018-05-25 16:27:09 +00:00
Miklos Szegedi
1483c90379 YARN-8310. Handle old NMTokenIdentifier, AMRMTokenIdentifier, and ContainerTokenIdentifier formats. Contributed by Robert Kanter.
(cherry picked from commit 3e5f7ea986600e084fcac723b0423e7de1b3bb8a)
2018-05-24 15:14:15 -07:00
Shane Kumpf
de43b41d0f YARN-6919. Add default volume mount list. Contributed by Eric Badger 2018-05-24 09:35:35 -06:00
Rohith Sharma K S
923c833da4 YARN-8319. More YARN pages need to honor yarn.resourcemanager.display.per-user-apps. Contributed by Sunil G.
(cherry picked from commit c05b5d424b000bab766f57e88a07f2b4e9a56647)
2018-05-24 14:22:43 +05:30
Rohith Sharma K S
67842c56fe YARN-8346. Upgrading to 3.1 kills running containers with error 'Opportunistic container queue is full'. Contributed by Jason Lowe.
(cherry picked from commit 4cc0c9b0baa93f5a1c0623eee353874e858a7caa)
2018-05-24 12:25:33 +05:30
Inigo Goiri
fa8af4aab5 YARN-8327. Fix TestAggregatedLogFormat#testReadAcontainerLogs1 on Windows. Contributed by Giovanni Matteo Fumarola.
(cherry picked from commit f09dc73001fd5f3319765fa997f4b0ca9e8f2aff)
2018-05-23 15:59:59 -07:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
0460201c3a YARN-8128. Documenting the per-node per-app file limit in YARN log aggregation. Contributed by Xuan Gong.
(cherry picked from commit 328f0847e3d98cad8c368d57499f31081c153237)
2018-05-17 13:09:09 -07:00
Robert Kanter
0506c762b2 YARN-8202. DefaultAMSProcessor should properly check units of requested custom resource types against minimum/maximum allocation (snemeth via rkanter)
(cherry picked from commit c8b53c43644b4ad22d5385c22cad8ed573c0b1ba)
2018-05-10 09:52:11 -07:00
Weiwei Yang
36fc9a6939 YARN-8225. YARN precommit build failing in TestPlacementConstraintTransformations. Contributed by Shane Kumpf.
(cherry picked from commit 2c95eb8111a7b03fd4683f740123cd4720b62c3e)
2018-04-28 18:50:51 +08:00
Billie Rinaldi
b20f68ddaa YARN-8208. Add log statement for Docker client configuration file at INFO level. Contributed by Yesha Vora
(cherry picked from commit 914d6b5cb143f4f9cadd9d689ea4e278383a6779)
2018-04-27 06:11:34 -07:00
Jason Lowe
42aef3b655 YARN-7996. Allow user supplied Docker client configurations with YARN native services. Contributed by Shane Kumpf
(cherry picked from commit 1d6e43da51aaaab522325bdbe4b51e58934e03f1)
2018-04-17 11:32:58 -05:00
Wangda Tan
0b88683627 YARN-7142. Support placement policy in yarn native services. (Gour Saha via wangda)
Change-Id: I166c67a7a34430627c17365f60bac75b6da1b434
(cherry picked from commit a0bde7d525911680f9e5fb0a939604865eb8e164)
2018-04-14 11:01:59 -07:00
Rohith Sharma K S
eb1026dffa YARN-8156. Increase the default value of yarn.timeline-service.app-collector.linger-period.ms. Contributed by Charan Hebri.
(cherry picked from commit 669eb7bdea34f26e9b9b8a2260ae4356791622e7)
2018-04-14 10:57:02 +05:30
Vrushali C
67cd7acf99 YARN-8073 TimelineClientImpl doesn't honor yarn.timeline-service.versions configuration. Contributed by Rohith Sharma K S
(cherry picked from commit 345e7624d58a058a1bad666bd1e5ce4b346a9056)
2018-04-11 09:41:04 +05:30
Wangda Tan
25bf1d3ac6 Updated branch-3.1 to track 3.1.1
Change-Id: Idd55c79921b8acacc8a8a3258450e476f3abb706
2018-04-09 10:58:50 -07:00
Haibo Chen
6658018410 YARN-6936. [Atsv2] Retrospect storing entities into sub application table from client perspective. (Rohith Sharma K S via Haibo Chen)
(cherry picked from commit f8b8bd53c4797d406bea5b1b0cdb179e209169cc)
2018-04-05 11:31:17 -07:00
Wangda Tan
2f326159f1 YARN-8106. Update LogAggregationIndexedFileController to use readFull instead read to avoid IOException while loading log meta. (Prabhu Joseph via wangda)
Change-Id: I63a65f73f8d1636e2c99ed9c8c2bbd05efcff80f
(cherry picked from commit b779f4f0f614fe47e05bc2be5494cf3cbcf6f63c)
2018-04-03 21:15:37 -07:00
Subru Krishnan
ed49f59e18 Revert "YARN-8010. Add config in FederationRMFailoverProxy to not bypass facade cache when failing over. (Botong Huang via Subru)."
This reverts commit 85eebf1bebc7b191dcd692395f77903257cd85c4.
2018-03-28 11:35:30 -07:00
Subru Krishnan
85eebf1beb YARN-8010. Add config in FederationRMFailoverProxy to not bypass facade cache when failing over. (Botong Huang via Subru).
(cherry picked from commit 2a2ef15caf791f30c471526c1b74e68803f0c405)
2018-03-27 17:44:00 -07:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
0bd99621c5 Preparing for 3.1.0 development 2018-03-19 15:16:54 -07:00