Ashutosh Gupta
62c6a08ffd
HADOOP-16515. Update the link to compatibility guide ( #4226 )
...
Co-authored-by: Ashutosh Gupta <ashugpt@amazon.com>
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit ae47846a5b
)
2022-05-08 07:39:17 +09:00
jteagles
f155abc572
YARN-11116. Migrate Times util from SimpleDateFormat to thread-safe DateTimeFormatter class ( #4242 )
...
Co-authored-by: Jonathan Eagles <jeagles@verizonmedia.com>
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit d4a91bd0c0
)
2022-05-03 03:15:10 +09:00
Ashutosh Gupta
4f9e607126
YARN-10187. Removing hadoop-yarn-project/hadoop-yarn/README as it is no longer maintained. ( #4222 )
...
Co-authored-by: Ashutosh Gupta <ashugpt@amazon.com>
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit a74acc755e
)
2022-05-03 03:10:43 +09:00
Steve Loughran
e123de9f19
HADOOP-16202. Enhanced openFile(): mapreduce and YARN changes. (#2584/2)
...
These changes ensure that sequential files are opened with the
right read policy, and split start/end is passed in.
As well as offering opportunities for filesystem clients to
choose fetch/cache/seek policies, the settings ensure that
processing text files on an s3 bucket where the default policy
is "random" will still be processed efficiently.
This commit depends on the associated hadoop-common patch,
which must be committed first.
Contributed by Steve Loughran.
Change-Id: Ic6713fd752441cf42ebe8739d05c2293a5db9f94
2022-04-27 19:23:25 +01:00
Viraj Jasani
bb13e228bc
HADOOP-17956. Replace all default Charset usage with UTF-8 ( #3529 )
...
Change-Id: I0094a84619ce19acf340d8dd1040cfe9bd88184e
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2022-04-27 10:30:07 +01:00
Steve Loughran
caecec45f5
HADOOP-17650. Bump solr to unblock build failure with Maven 3.8.1 ( #2939 )
...
Reviewed-by: Siyao Meng <siyao@apache.org>
Contributed by Viraj Jasani
2022-04-20 16:36:51 +01:00
Akira Ajisaka
2112ef61e0
YARN-10553. Refactor TestDistributedShell ( #4159 )
...
(cherry picked from commit 890f2da624
)
Conflicts:
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/test/java/org/apache/hadoop/yarn/applications/distributedshell/TestDSWithMultipleNodeManager.java
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/test/java/org/apache/hadoop/yarn/applications/distributedshell/TestDistributedShell.java
Co-authored-by: Ahmed Hussein <50450311+amahussein@users.noreply.github.com>
2022-04-13 12:22:17 +09:00
Steve Loughran
44e662272f
HADOOP-18198. Preparing for 3.3.4 development
...
Change-Id: I2bf19beb541739af22fced38c2545f09c4e1bd53
2022-04-12 14:09:08 +01:00
Masatake Iwasaki
160b6d106d
HADOOP-18088. Replace log4j 1.x with reload4j. ( #4052 )
...
Co-authored-by: Wei-Chiu Chuang <weichiu@apache.org>
2022-04-07 08:33:13 +09:00
Peter Bacsko
ab5ea272ec
YARN-10720. YARN WebAppProxyServlet should support connection timeout to prevent proxy server from hanging. Contributed by Qi Zhu.
...
(cherry picked from commit a0deda1a77
)
2022-03-24 14:11:23 +09:00
Siyao Meng
4153c16324
YARN-10747. Bump YARN CSI protobuf version to 3.7.1 ( #2946 )
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
Change-Id: Ib2a4bf775a5804641a91c6f9a486772c9d87c17e
(cherry picked from commit 5b09ba75ec
)
2022-03-22 14:46:45 +09:00
Fei Hui
5a38ed2f22
HADOOP-17276. Extend CallerContext to make it include many items ( #2327 )
...
Cherry-picked from d0d10f7e
by Owen O'Malley
2022-03-14 10:28:38 -07:00
Tamas Domok
d7c375da40
YARN-11076. Upgrade jQuery version in Yarn UI2. ( #4046 )
...
Change-Id: I3cb1677741df5a1978e83029443d4a2d5d7e3d7f
(cherry picked from commit 22fe79cee3
)
2022-03-03 23:55:26 +09:00
Szilard Nemeth
856e483592
YARN-11022. Fix the documentation for max-parallel-apps in CS. Contributed by Tamas Domok
2022-03-02 16:13:35 +01:00
Szilard Nemeth
192f53283b
YARN-10894. Follow up YARN-10237: fix the new test case in TestRMWebServicesCapacitySched. Contributed by Tamas Domok
2022-03-02 16:04:38 +01:00
Szilard Nemeth
3ef3c5a05b
YARN-11033. isAbsoluteResource is not correct for dynamically created queues. Contributed by Tamas Domok
2022-03-02 14:45:31 +01:00
Szilard Nemeth
f06f44b1c2
YARN-11014. YARN incorrectly validates maximum capacity resources on the validation API. Contributed by Benjamin Teke
2022-03-02 14:23:00 +01:00
Szilard Nemeth
935619a28c
YARN-11075. Explicitly declare serialVersionUID in LogMutation class. Contributed by Benjamin Teke
2022-03-01 18:05:04 +01:00
Akira Ajisaka
352656999f
YARN-10788. TestCsiClient fails ( #3989 )
...
Create unix domain socket in java.io.tmpdir instead of
test.build.dir to avoid 'File name too long' error.
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
(cherry picked from commit 7fd90cdcbe
)
2022-02-15 01:14:31 +09:00
luoyuan3471
752a7b6d49
HADOOP-18044. Hadoop - Upgrade to jQuery 3.6.0 ( #3791 )
...
Co-authored-by: luoyuan <luoyuan@shopee.com>
(cherry picked from commit e2d620192a
)
2022-02-11 23:18:25 +08:00
Akira Ajisaka
8032b680fb
YARN-10561. Upgrade node.js to 12.22.1 and yarn to 1.22.5 in YARN application catalog webapp ( #2591 )
...
Reviewed-by: Masatake Iwasaki <iwasakims@apache.org>
(cherry picked from commit 9cb535caf2
)
2022-01-28 15:52:33 +09:00
dependabot[bot]
55192570a1
YARN-11065. Bump follow-redirects from 1.13.3 to 1.14.7 in hadoop-yarn-ui ( #3890 )
...
Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects ) from 1.13.3 to 1.14.7.
- [Release notes](https://github.com/follow-redirects/follow-redirects/releases )
- [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.13.3...v1.14.7 )
---
updated-dependencies:
- dependency-name: follow-redirects
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit dae33cf935
)
2022-01-20 21:45:53 +09:00
Gera Shegalov
6c58f83b78
YARN-11055. Add missing newline in cgroups-operations.c ( #3851 )
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit a94e9fcbde
)
2022-01-17 16:21:13 +09:00
Cheng Pan
7b51e6824d
YARN-11053. AuxService should not use class name as default system classes ( #3816 )
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 4db27acf06
)
2021-12-24 11:09:42 +09:00
Ashutosh Gupta
1c99810b89
YARN-8234. Improve RM system metrics publisher's performance by pushing events to timeline server in batch ( #3793 )
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 00e2405fbd
)
2021-12-23 17:16:09 +09:00
Eric Payne
ccaba2561a
YARN-10178: Global Scheduler async thread crash caused by 'Comparison method violates its general contract. Contributed by Andras Gyori (gandras) and Qi Zhu (zhuqi).
...
(cherry picked from commit e2d6fd075d
)
2021-12-21 19:20:21 +00:00
Szilard Nemeth
357423b57a
YARN-6862. Nodemanager resource usage metrics sometimes are negative. Contributed by Benjamin Teke
2021-12-17 14:51:41 +01:00
Viraj Jasani
b0c1158829
HADOOP-18033. Upgrade fasterxml Jackson to 2.13.0 ( #3764 )
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2021-12-13 13:52:44 +09:00
Szilard Nemeth
8053b0f205
YARN-11020. [UI2] No container is found for an application attempt with a single AM container. Contributed by Andras Gyori
2021-12-09 13:02:55 +01:00
Ashutosh Gupta
53f76b9b1c
YARN-9063. ATS 1.5 fails to start if RollingLevelDb files are corrupt or missing ( #3728 )
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 5a950b8900
)
2021-12-06 20:10:38 +09:00
Prabhu Joseph
edfd68e248
YARN-10820. Make GetClusterNodesRequestPBImpl thread safe. Contributed by Swathi Chandrashekar.
...
(cherry picked from commit 6b4987f09c
)
2021-12-06 14:45:18 +09:00
GuoPhilipse
a13a03ec10
YARN-11007. Correct words in YARN documents ( #3680 )
...
Reviewed-by: cxorm <lianp964@gmail.com>
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit c9d64bad37
)
2021-11-25 17:51:38 +09:00
Ashutosh Gupta
17b8ad3d48
YARN-10991. Fix to ignore the grouping "[]" for resourcesStr in parseResourcesString method ( #3592 )
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 08f3df3ea2
)
2021-11-24 18:42:41 +09:00
Shubham Gupta
c44f109860
YARN-10438. Handle null containerId in ClientRMService#getContainerReport() ( #2313 )
...
Co-authored-by: Shubham Gupta <gshubham@microsoft.com>
(cherry picked from commit e3cd627069
)
2021-11-19 00:23:48 +09:00
Chao Sun
e079fa6577
Preparing for 3.3.3 development
2021-11-16 16:02:34 -08:00
Ahmed Hussein
742d88b1c6
YARN-1115: Provide optional means for a scheduler to check real user ACLs. Contributed by Eric Payne (epayne)
2021-10-21 17:04:29 +00:00
lujiefsi
4024afec28
YARN-10976. Fix resource leak due to Files.walk ( #3552 )
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit ae95caa60e
)
2021-10-18 15:27:17 +09:00
Benjamin Teke
700045896c
YARN-10869. CS considers only the default maximum-allocation-mb/vcore property as a maximum when it creates dynamic queues ( #3504 )
...
Co-authored-by: Benjamin Teke <bteke@cloudera.com>
2021-10-12 18:05:50 +02:00
Viraj Jasani
77ee5a4266
HADOOP-17950. Provide replacement for deprecated APIs of commons-io IOUtils ( #3515 )
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 8071dbb9c6
)
2021-10-07 11:00:19 +09:00
Neil
88deac0479
YARN-10970. Standby RM should expose prom endpoint ( #3480 )
...
Reviewed-by: Adam Antal <adamantal@apache.org>
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 4bd0c36189
)
2021-09-29 15:48:02 +09:00
Peter Bacsko
99d84b941b
YARN-9606. Set sslfactory for AuthenticatedURL() while creating LogsCLI#webServiceClient. Contributed by Bilwa S T.
2021-09-23 13:58:56 +02:00
Eric Badger
52ba50fd3c
YARN-10935. AM Total Queue Limit goes below per-user AM Limit if parent is full. Contributed by Eric Payne.
...
(cherry picked from commit 43f0a34dd4
)
2021-09-16 16:46:44 +00:00
Szilard Nemeth
6c68211062
YARN-10870. Missing user filtering check -> yarn.webapp.filter-entity-list-by-user for RM Scheduler page. Contributed by Gergely Pollak
2021-09-14 18:08:34 +02:00
Tamas Domok
8e4ac01135
YARN-10901. Permission checking error on an existing directory in LogAggregationFileController#verifyAndCreateRemoteLogDir ( #3409 )
...
Co-authored-by: Tamas Domok <tdomok@cloudera.com>
2021-09-14 17:34:32 +02:00
Szilard Nemeth
0a726250ea
YARN-10428. Zombie applications in the YARN queue using FAIR + sizebasedweight. Contributed by Guang Yang, Andras Gyori
...
(cherry picked from commit 79a46599f7
)
2021-09-01 10:44:15 +09:00
Szilard Nemeth
0a0628b1cb
YARN-6221. Entities missing from ATS when summary log file info got returned to the ATS before the domain log. Contributed by Xiaomin Zhang
2021-07-31 14:53:30 +02:00
Szilard Nemeth
a272adc5fa
YARN-10789. RM HA startup can fail due to race conditions in ZKConfigurationStore. Contributed by Tarun Parimi
2021-07-29 19:21:58 +02:00
9uapaw
f001595b47
YARN-9551. TestTimelineClientV2Impl.testSyncCall fails intermittent ( #3212 )
...
Co-authored-by: Andras Gyori <gandras@cloudera.com>
(cherry picked from commit b4a524722a
)
2021-07-28 17:12:40 +02:00
Szilard Nemeth
72801be13a
YARN-10813. Set default capacity of root for node labels. Contributed by Andras Gyori
2021-07-28 14:55:19 +02:00
dependabot[bot]
e533efc58e
[UI2] Bump http-proxy to 1.18.1 ( #2891 )
...
Bumps [http-proxy](https://github.com/http-party/node-http-proxy ) from 1.18.0 to 1.18.1.
- [Release notes](https://github.com/http-party/node-http-proxy/releases )
- [Changelog](https://github.com/http-party/node-http-proxy/blob/master/CHANGELOG.md )
- [Commits](https://github.com/http-party/node-http-proxy/compare/1.18.0...1.18.1 )
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Reviewed-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit b7431c3ed5
)
2021-07-26 02:17:36 +09:00