Szilard Nemeth
7aea2e1b5c
YARN-10428. Zombie applications in the YARN queue using FAIR + sizebasedweight. Contributed by Guang Yang, Andras Gyori
...
(cherry picked from commit 79a46599f7
)
Conflicts:
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/policy/TestFairOrderingPolicy.java
2021-09-01 10:58:41 +09:00
Abhishek Modi
6a02596f42
YARN-9744. RollingLevelDBTimelineStore.getEntityByTime fails with NPE. Contributed by Prabhu Joseph.
...
(cherry picked from commit b4097b96a3
)
2021-08-18 17:48:17 -05:00
Brahma Reddy Battula
3cf2479c04
Preparing for 3.2.4 development.
2021-08-08 18:35:16 +05:30
Akira Ajisaka
c40abe10c0
YARN-10809. Missing dependency causing NoClassDefFoundError in TestHBaseTimelineStorageUtils ( #3265 )
...
* YARN-10809. Missing dependency causing NoClassDefFoundError in TestHBaseTimelineStorageUtils (#3081 )
Reviewed-by: Takanobu Asanuma <tasanuma@apache.org>
(cherry picked from commit ca27744770
)
* Use mockito 1.x
Co-authored-by: Viraj Jasani <vjasani@apache.org>
2021-08-05 10:05:10 +09:00
Abhishek Modi
c5e2ec465b
YARN-9990. Testcase fails with Insufficient configured threads: required=16 < max=10. Contributed by Prabhu Joseph.
...
(cherry picked from commit a2dadac790
)
2021-08-04 17:05:35 +09:00
Jim Brennan
1f9a315625
YARN-10337. Amendment to fix import as in HADOOP-17100
...
(cherry picked from commit 53a1c7653f
)
2021-08-04 16:38:52 +09:00
Prabhu Joseph
b9d0412fd5
YARN-10337. Fix failing testcase TestRMHATimelineCollectors.
...
Contributed by Bilwa S T.
(cherry picked from commit 2bbd00dff4
)
2021-08-04 16:37:47 +09:00
Akira Ajisaka
d830e84217
YARN-9875. Improve fair scheduler configuration store on HDFS. ( #3262 )
...
Contributed by Prabhu Joseph
(cherry picked from commit 155864da00
)
Conflicts:
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/conf/TestFSSchedulerConfigurationStore.java
Co-authored-by: Eric Yang <eyang@apache.org>
2021-08-04 16:12:54 +09:00
Akira Ajisaka
e259d85a99
YARN-8992. Fair scheduler can delete a dynamic queue while an application attempt is being added to the queue. (Contributed by Wilfred Spiegelenburg) ( #3257 )
...
(cherry picked from commit a41b648e98
)
Co-authored-by: Haibo Chen <haibochen@apache.org>
2021-08-04 10:17:51 +09:00
Akira Ajisaka
786a43e729
YARN-8990. Fix fair scheduler race condition in app submit and queue cleanup. (Contributed by Wilfred Spiegelenburg) ( #3254 )
...
(cherry picked from commit 524a7523c4
)
Conflicts:
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/FairScheduler.java
Co-authored-by: Haibo Chen <haibochen@apache.org>
2021-08-03 13:12:01 +09:00
Vrushali C
521c1085b4
YARN-9338 Timeline related testcases are failing. Contributed by Abhishek Modi.
...
(cherry picked from commit 17a3e14d25
)
2021-08-03 11:42:28 +09:00
Szilard Nemeth
e4df745c13
YARN-6221. Entities missing from ATS when summary log file info got returned to the ATS before the domain log. Contributed by Xiaomin Zhang
2021-07-31 14:54:51 +02:00
Szilard Nemeth
7a8b6265c6
YARN-10789. RM HA startup can fail due to race conditions in ZKConfigurationStore. Contributed by Tarun Parimi
2021-07-29 19:22:57 +02:00
9uapaw
1dc343726c
YARN-9551. TestTimelineClientV2Impl.testSyncCall fails intermittent ( #3212 )
...
Co-authored-by: Andras Gyori <gandras@cloudera.com>
(cherry picked from commit b4a524722a
)
(cherry picked from commit f001595b47
)
2021-07-28 17:14:33 +02:00
Szilard Nemeth
6bf02a63e7
YARN-10813. Set default capacity of root for node labels. Contributed by Andras Gyori
2021-07-28 14:54:36 +02:00
zhuqi-lucas
cfe36ba762
YARN-10860. Make max container per heartbeat configs refreshable. Contributed by Eric Badger.
2021-07-22 10:13:55 +08:00
Masatake Iwasaki
f3dac4ac23
YARN-10858. [UI2] YARN-10826 breaks Queue view. ( #3213 )
...
(cherry picked from commit 17bf2fcbc5
)
2021-07-20 14:16:35 +09:00
Jim Brennan
4a70248cb6
YARN-10456. RM PartitionQueueMetrics records are named QueueMetrics in Simon metrics registry. Contributed by Eric Payne.
...
(cherry picked from commit 632f64cadb
)
2021-07-15 14:49:22 +00:00
Artem Smotrakov
6c7f192f0f
HADOOP-17793. Better token validation ( #3189 )
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit ba325a8ada
)
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/security/token/block/BlockTokenSecretManager.java
2021-07-10 14:25:08 +09:00
Jim Brennan
c3c86b18cb
YARN-10834. Intra-queue preemption: apps that don't use defined custom resource won't be preempted. Contributed by Eric Payne.
...
(cherry picked from commit dc6f456e95
)
2021-06-28 15:28:38 +00:00
Jim Brennan
9c4ac62d68
YARN-10824. Title not set for JHS and NM webpages. Contributed by Bilwa S T.
...
(cherry picked from commit 7c7d02edbd
)
2021-06-25 20:50:11 +00:00
Szilard Nemeth
c8b090d9a4
YARN-10828. Backport YARN-9789 to branch-3.2. Contributed by Tarun Parimi
2021-06-24 20:20:23 +02:00
Masatake Iwasaki
7d2186ffcf
YARN-10826. [UI2] Upgrade Node.js to v12.22.1. ( #3128 )
...
(cherry picked from commit 11d144d228
)
Conflicts:
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-ui/src/main/webapp/yarn.lock
2021-06-24 14:45:44 +09:00
dependabot[bot]
b8f0be3299
Bump bower from 1.7.7 to 1.8.8 ( #1683 )
...
Bumps [bower](https://github.com/bower/bower ) from 1.7.7 to 1.8.8.
- [Release notes](https://github.com/bower/bower/releases )
- [Changelog](https://github.com/bower/bower/blob/master/CHANGELOG.md )
- [Commits](https://github.com/bower/bower/compare/v1.7.7...v1.8.8 )
Signed-off-by: dependabot[bot] <support@github.com>
(cherry picked from commit e9c5bb8078
)
2021-06-24 14:33:33 +09:00
Akira Ajisaka
99d8133968
YARN-10560. Upgrade node.js to 10.23.1 and yarn to 1.22.5 in Web UI v2. ( #2592 )
...
(cherry picked from commit ae4945fb2c
)
Conflicts:
dev-support/docker/Dockerfile
dev-support/docker/Dockerfile_aarch64
2021-06-24 13:17:47 +09:00
Akira Ajisaka
6827d49b10
YARN-10331. Upgrade node.js to 10.21.0. ( #2106 )
...
(cherry picked from commit cd188ea9f0
)
Conflicts:
dev-support/docker/Dockerfile_aarch64
2021-06-24 13:14:37 +09:00
Masatake Iwasaki
2eb6bf6bb1
YARN-10037. Upgrade build tools for YARN Web UI v2.
...
(cherry picked from commit 7868da894a
)
2021-06-24 13:12:44 +09:00
Masatake Iwasaki
3a224b7a93
YARN-10020. Fix build instruction of hadoop-yarn-ui. ( #1750 )
...
(cherry picked from commit 92c8962f98
)
2021-06-24 13:09:44 +09:00
Jim Brennan
2636b630b4
YARN-10767. Yarn Logs Command retrying on Standby RM for 30 times. Contributed by D M Murali Krishna Reddy.
...
(cherry picked from commit 9a6a11c452
)
2021-06-15 19:51:18 +00:00
Suma Shivaprasad
e62cdf915f
YARN-9246 NPE when executing a command yarn node -status or -states without additional arguments. Contributed by Masahiro Tanaka
...
(cherry picked from commit 2044967e75
)
2021-06-10 21:47:40 +09:00
Hideyuki Furue
f5568e15d0
Fix container-executor
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 9c7b8cf54e
)
2021-06-06 08:01:39 +09:00
Akira Ajisaka
996a065c3b
YARN-10770. container-executor permission is wrong in SecureContainer.md. Contributed by Siddharth Ahuja.
...
(cherry picked from commit 1cbcde04f3
)
2021-05-25 18:29:39 +09:00
Szilard Nemeth
3951fb6dea
YARN-10123. Error message around yarn app -stop/start can be improved. Contributed by Siddharth Ahuja
2021-05-22 14:35:47 +02:00
lujiefsi
bc97dd0d26
YARN-10555. Missing access check before getAppAttempts ( #2608 )
...
Co-authored-by: lujie <lujie@foxmail.com>
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit d92a25b790
)
2021-05-17 14:05:26 +09:00
Akira Ajisaka
a5bb211a2b
YARN-10756. Remove additional junit 4.11 dependency from javadoc. ( #2960 )
...
Reviewed-by: Viraj Jasani <vjasani@apache.org>
Reviewed-by: Bilwa S T <stbilwa@gmail.com>
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
(cherry picked from commit 7cb7b8adc1
)
2021-05-07 00:25:43 +09:00
Eric Badger
951ce9b371
YARN-10479. Can't remove all node labels after add node label without
...
nodemanager port, broken by YARN-10647. Contributed by D M Murali Krishna Reddy
(cherry picked from commit 6857a05d6a
)
2021-04-23 22:55:25 +00:00
Eric Badger
b36810ee3f
YARN-10723. Change CS nodes page in UI to support custom resource. Contributed by Qi Zhu
...
(cherry picked from commit 6cb90005a7
)
2021-04-20 17:54:20 +00:00
Eric Badger
bf0d058b69
YARN-10460. Upgrading to JUnit 4.13 causes tests in TestNodeStatusUpdater to fail. Contributed by Peter Bacsko.
2021-04-19 20:06:36 +00:00
Eric Badger
899cef53bd
YARN-10702. Add cluster metric for amount of CPU used by RM Event Processor.
...
Contributed by Jim Brennan.
2021-04-08 18:33:42 +00:00
Akira Ajisaka
d93f2c8cb8
YARN-10716. Fix typo in ContainerRuntime. Contributed by xishuhai.
...
(cherry picked from commit 8ad77a26c9
)
2021-03-30 17:48:20 +09:00
Takanobu Asanuma
9060972172
HADOOP-17138. Fix spotbugs warnings surfaced after upgrade to 4.0.6. ( #2155 ) ( #2806 )
...
(cherry picked from commit 1b29c9bfee
)
Co-authored-by: Masatake Iwasaki <iwasakims@apache.org>
2021-03-24 17:09:43 +09:00
Jim Brennan
0fcb2f28ce
YARN-10697. Resources are displayed in bytes in UI for schedulers other than capacity. Contributed by Bilwa S T.
...
(cherry picked from commit 174f3a96b1
)
2021-03-23 18:37:32 +00:00
Eric Badger
8bfa4cc6d8
YARN-10688. ClusterMetrics should support GPU capacity related metrics.. Contributed by Qi Zhu.
...
(cherry picked from commit 49f89f1d3d
)
Conflicts:
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ClusterMetrics.java
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/TestCSAllocateCustomResource.java
2021-03-17 18:50:00 +00:00
Eric Payne
5617bfa0d4
YARN-10588. Percentage of queue and cluster is zero in WebUI . Contributed by Bilwa S T
...
(cherry picked from commit aa4c17b9d7
)
2021-03-15 19:38:33 +00:00
Jim Brennan
4a98b518d6
[YARN-10687] Add option to disable/enable free disk space checking and percentage checking for full and not-full disks. Contributed by Qi Zhu.
...
(cherry picked from commit 5f067cf0f3
)
2021-03-12 17:38:18 +00:00
Akira Ajisaka
0b278502e2
HADOOP-16870. Use spotbugs-maven-plugin instead of findbugs-maven-plugin ( #2753 )
...
Removed findbugs from the hadoop build images and added spotbugs instead.
Upgraded SpotBugs to 4.2.2 and spotbugs-maven-plugin to 4.2.0.
Reviewed-by: Masatake Iwasaki <iwasakims@apache.org>
(cherry picked from commit 23b343aed1
)
Conflicts:
dev-support/docker/Dockerfile
hadoop-project/pom.xml
(cherry picked from commit de2904f123
)
Conflicts:
dev-support/docker/Dockerfile_aarch64
hadoop-cloud-storage-project/hadoop-cos/pom.xml
hadoop-common-project/hadoop-registry/pom.xml
hadoop-project/pom.xml
2021-03-11 15:37:56 +09:00
Eric Badger
f30d1092bc
YARN-10664. Allow parameter expansion in NM_ADMIN_USER_ENV. Contributed by Jim
...
Brennan.
2021-03-08 20:20:52 +00:00
Peter Bacsko
0b8bfc50c6
YARN-10672. All testcases in TestReservations are flaky. Contributed by Szilard Nemeth.
2021-03-08 14:32:13 +01:00
Peter Bacsko
0d032d7b68
YARN-10642. Race condition: AsyncDispatcher can get stuck by the changes introduced in YARN-8995. Contributed by zhengchenyu.
2021-03-08 14:22:14 +01:00
Ahmed Hussein
e4c638eb21
MAPREDUCE-7320. organize test directories for ClusterMapReduceTestCase ( #2722 ). Contributed by Ahmed Hussein
...
(cherry picked from commit e04bcb3a06
)
2021-02-26 20:38:13 +00:00