f5568e15d0
Fix container-executor
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 9c7b8cf54e
2021-06-06 08:01:39 +09:00
bf0d058b69
YARN-10460. Upgrading to JUnit 4.13 causes tests in TestNodeStatusUpdater to fail. Contributed by Peter Bacsko.
2021-04-19 20:06:36 +00:00
d93f2c8cb8
YARN-10716. Fix typo in ContainerRuntime. Contributed by xishuhai.
...
(cherry picked from commit 8ad77a26c9
2021-03-30 17:48:20 +09:00
4a98b518d6
[YARN-10687] Add option to disable/enable free disk space checking and percentage checking for full and not-full disks. Contributed by Qi Zhu.
...
(cherry picked from commit 5f067cf0f3
2021-03-12 17:38:18 +00:00
f30d1092bc
YARN-10664. Allow parameter expansion in NM_ADMIN_USER_ENV. Contributed by Jim
...
Brennan.
2021-03-08 20:20:52 +00:00
e6f5dbbe7f
[YARN-10626] Log resource allocation in NM log at container start time. Contributed by Eric Badger
2021-02-16 17:19:15 +00:00
6cc0eb3e30
[YARN-10607] User environment is unable to prepend PATH when mapreduce.admin.user.env also sets PATH. Contributed by Eric Badger.
...
(cherry picked from commit c22c77af43
2021-02-05 17:52:16 +00:00
d79f705a30
YARN-10562. Follow up changes for YARN-9833. Contributed by Jim Brennan.
...
(cherry picked from commit 768e2f42ba
2021-01-13 23:53:16 +00:00
a093bd859d
YARN-4589: Diagnostics for localization timeouts is lacking. Contributed by Chang Li (lichangleo) and Jim Brennan (Jim_Brennan)
2021-01-13 19:44:26 +00:00
264dd67018
YARN-10540. Node page is broken in YARN UI1 and UI2 including RMWebService api
...
for nodes. Contributed by Jim Brennan.
(cherry picked from commit 4c5d88e230
2020-12-21 23:22:43 +00:00
d6a55caa9a
YARN-10479. RMProxy should retry on SocketTimeout Exceptions. Contributed by Jim Brennan (Jim_Brennan)
...
(cherry picked from commit 55339c2bdd
2020-11-05 22:23:24 +00:00
63888afdd0
YARN-10471. Prevent logs for any container from becoming larger than a configurable size. Contributed by Eric Payne
2020-10-29 20:17:51 +00:00
3274fd139d
Preparing for 3.2.3 development
2020-10-16 14:52:41 +08:00
e1c6804ace
YARN-9667. Container-executor.c duplicates messages to stdout. Contributed by Peter Bacsko
2020-10-08 21:09:30 +00:00
4ef9cf9d71
YARN-10455. TestNMProxy.testNMProxyRPCRetry is not consistent. Contributed by Ahmed Hussein
...
(cherry picked from commit deb35a32ba
2020-10-08 19:01:38 +00:00
b7420eb4b0
YARN-10393. MR job live lock caused by completed state container leak in heartbeat between node manager and RM. Contributed by zhenzhao wang and Jim Brennan
...
(cherry picked from commit a1f7e760df
2020-10-05 10:39:14 +02:00
947b0a154a
YARN-9809. Added node manager health status to resource manager registration call. Contributed by Eric Badger (ebadger).
2020-09-28 18:50:44 +00:00
1efb54bd52
YARN-10430. Log improvements in NodeStatusUpdaterImpl. Contributed by Bilwa S T.
2020-09-15 16:27:08 +00:00
01ada576f3
[YARN-10353] Log vcores used and cumulative cpu in containers monitor.
...
Contributed by Jim Brennan
(cherry picked from commit 736bed6d6d
2020-09-08 16:14:26 +00:00
863689ff9a
YARN-1529: Add Localization overhead metrics to NM. Contributed by Jim_Brennan.
...
(cherry picked from commit e0c9653166
2020-07-30 17:08:02 +00:00
7350773b69
YARN-4771. Some containers can be skipped during log aggregation after NM
...
restart. Contributed by Jason Lowe and Jim Brennan.
(cherry picked from commit ac5f21dbef
2020-07-24 22:55:08 +00:00
27a97e4f28
HADOOP-17100. Replace Guava Supplier with Java8+ Supplier in Hadoop. Contributed by Ahmed Hussein.
2020-07-22 18:39:49 +05:30
8fd3dcc9ce
HADOOP-17099. Replace Guava Predicate with Java8+ Predicate
...
Signed-off-by: Jonathan Eagles <jeagles@gmail.com>
(cherry picked from commit 1f71c4ae71
2020-07-15 12:05:49 -05:00
b23a585cb1
YARN-10256. Refactor TestContainerSchedulerQueuing.testContainerUpdateExecTypeGuaranteedToOpportunistic (Ahmed Hussein via jeagles)
...
Signed-off-by: Jonathan Eagles <jeagles@gmail.com>
(cherry picked from commit f5081a9a5d
2020-05-04 10:49:45 -05:00
48f1c8ffb6
Revert "YARN-10063. Add container-executor arguments --http/--https to usage. Contributed by Siddharth Ahuja"
...
This reverts commit a2067aafa9
2020-04-23 12:37:21 -07:00
a2067aafa9
YARN-10063. Add container-executor arguments --http/--https to usage. Contributed by Siddharth Ahuja
...
Conflicts:
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/native/container-executor/impl/main.c
(cherry picked from commit 2214005c0f
2020-04-08 13:12:31 +10:00
9e0d742025
YARN-9419. Log a warning if GPU isolation is enabled but LinuxContainerExecutor is disabled. Contribued by Andras Gyori
2020-03-10 16:39:03 +01:00
153eac1d21
YARN-942. TestContainerSchedulerQueuing.testKillOnlyRequiredOpportunisticContainers fails sporadically Contributed by Ahmed Hussein (ahussein)
...
(cherry picked from commit ede05b19d1
2020-03-10 14:28:13 +00:00
6aec712c6c
YARN-10101. Support listing of aggregated logs for containers belonging to an application attempt. Contributed by Adam Antal
2020-02-11 09:18:44 +01:00
3ba0fd1e50
YARN-9018. Add functionality to AuxiliaryLocalPathHandler to return all locations to read for a given path. Contributed by Kuhu Shukla (kshukla)
...
(cherry picked from commit 93233a7d6e
2020-01-09 17:22:10 +00:00
58db04ce15
YARN-8672. TestContainerManager#testLocalingResourceWhileContainerRunning occasionally times out. Contributed by Chandni Singh and Jim Brennan.
2020-01-08 19:44:43 +00:00
dcc453b4b8
YARN-9968. Public Localizer is exiting in NodeManager due to NullPointerException. Contributed by Tarun Parimi
2019-11-22 12:59:35 +01:00
fa6b27ea8d
YARN-9914. Use separate configs for free disk space checking for full and not-full disks. Contributed by Jim Brennan
...
(cherry picked from commit eef34f2d87
2019-10-25 17:15:48 +00:00
da35a22083
Revert "YARN-9128. Use SerializationUtils from apache commons to serialize / deserialize ResourceMappings. Contributed by Zoltan Siegl"
...
This reverts commit 42177e8b78
2019-10-09 19:58:46 +02:00
42177e8b78
YARN-9128. Use SerializationUtils from apache commons to serialize / deserialize ResourceMappings. Contributed by Zoltan Siegl
...
(cherry picked from commit 6f1ab95168
2019-10-09 13:28:01 +02:00
3e0025d877
YARN-9833. Race condition when DirectoryCollection.checkDirs() runs during container launch. Contributed by Peter Bacsko.
...
(cherry picked from commit c474e24c0b
2019-09-18 09:22:48 +05:30
7d5bb2ebb7
Preparing for 3.2.2-SNAPSHOT development.
2019-09-07 08:52:08 +05:30
6acc1a2bd0
YARN-9382 Publish container killed, paused and resumed events to ATSv2. Contributed by Abhishesk Modi.
2019-09-05 15:39:38 +05:30
998aa3de2c
YARN-9418. ATSV2 /apps//entities/YARN_CONTAINER rest api does not show metrics. Contributed by Prabhu Joseph.
2019-09-05 15:39:38 +05:30
108c569e3b
YARN-6735. Have a way to turn off container metrics from NMs. Contributed by Abhishek Modi.
2019-09-05 12:42:06 +05:30
6980f1740f
YARN-9217. Nodemanager will fail to start if GPU is misconfigured on the node or GPU drivers missing. Contributed by Peter Bacsko
2019-08-21 16:49:34 +02:00
a83718f130
YARN-9100. Add tests for GpuResourceAllocator and do minor code cleanup. Contributed by Peter Bacsko
2019-08-16 15:24:44 +02:00
8fee3808c5
YARN-9749. TestAppLogAggregatorImpl#testDFSQuotaExceeded fails on trunk. Contributed by Adam Antal
...
(cherry picked from commit 2a05e0ff3b
2019-08-16 08:52:34 +02:00
d5446b3a23
YARN-9676. Add DEBUG and TRACE level messages to AppLogAggregatorImpl… ( #1261 )
...
* YARN-9676. Add DEBUG and TRACE level messages to AppLogAggregatorImpl and connected classes
* Using {} placeholder, and increasing loglevel if log aggregation failed.
(cherry picked from commit c89bdfacc8
2019-08-14 17:36:41 +02:00
4bb238c480
YARN-9133. Make tests more easy to comprehend in TestGpuResourceHandler. Contributed by Peter Bacsko
2019-08-14 17:16:54 +02:00
4dc477b606
YARN-9140. Code cleanup in ResourcePluginManager.initialize and in TestResourcePluginManager. Contributed by Peter Bacsko
2019-08-14 17:01:41 +02:00
cec71691be
YARN-9442. container working directory has group read permissions. Contributed by Jim Brennan.
...
(cherry picked from commit 2ac029b949
2019-08-13 16:34:29 +00:00
b20fd9e212
YARN-9135. NM State store ResourceMappings serialization are tested with Strings instead of real Device objects. Contributed by Peter Bacsko
2019-08-12 14:02:17 +02:00
2e6beb1550
Logging fileSize of log files under NM Local Dir. Contributed by Prabhu Joseph
...
(cherry picked from commit 54ac80176e
2019-08-09 13:20:10 +02:00
02d0e54596
YARN-9092. Create an object for cgroups mount enable and cgroups mount path as they belong together. Contributed by Gergely Pollak
...
(cherry picked from commit e0c21c6da9
2019-08-09 10:23:10 +02:00
Hideyuki Furue
Eric Badger
Akira Ajisaka
Jim Brennan
Eric Payne
He Xiaoqiao
Adam Antal
Eric E Payne
Ayush Saxena
Ahmed Hussein
Wei-Chiu Chuang
Wilfred Spiegelenburg
Szilard Nemeth
Sunil G
Rohith Sharma K S
Vrushali C
Giovanni Matteo Fumarola
Rohith Sharma K S