9a895a90d9
YARN-8210. AMRMClient logging on every heartbeat to track updation of AM RM token causes too many log lines to be generated in AM logs. (Suma Shivaprasad via wangda)
...
Change-Id: I70edd6e301fd5e78d479e1882aedc9332a0827aa
(cherry picked from commit b1833d9ba2f9add5fdd9
2020-09-10 14:40:05 -07:00
7d8ee990cd
HADOOP-17253. Upgrade zookeeper to 3.4.14 on branch-2.10. ( #2289 )
2020-09-10 20:37:32 +09:00
42ac46ff18
HADOOP-17249. Upgrade jackson-databind to 2.9.10.6 on branch-2.10. ( #2279 )
2020-09-09 09:55:11 +09:00
0574de5f2f
HADOOP-17251. Upgrade netty-all to 4.1.50.Final on branch-2.10. ( #2285 )
2020-09-09 07:19:23 +09:00
43c6c54b8c
HADOOP-14910. Upgrade netty-all jar to latest 4.0.x.Final. Contributed by Vinayakumar B.
...
(cherry picked from commit f29e55bf5e
2020-09-08 22:35:01 +09:00
7c838bf6ed
Bump nimbus-jose-jwt from 4.41.1 to 7.9 ( #1682 )
...
Bumps [nimbus-jose-jwt](https://bitbucket.org/connect2id/nimbus-jose-jwt ) from 4.41.1 to 7.9.
- [Changelog](https://bitbucket.org/connect2id/nimbus-jose-jwt/src/master/CHANGELOG.txt )
- [Commits](https://bitbucket.org/connect2id/nimbus-jose-jwt/branches/compare/7.9..4.41.1 )
Signed-off-by: dependabot[bot] <support@github.com>
(cherry picked from commit c1d393a156
2020-09-08 21:35:40 +09:00
e5bd8d2840
YARN-10177: Backport YARN-7307 to branch-2.10 Allow client/AM update supported resource types via YARN APIs
2020-09-04 18:23:08 +00:00
a75f2915f9
HADOOP-17199. S3A Directory Marker HADOOP-13230 backport
...
This backports the listing-side changes of HADOOP-13230.
With this patch in, this branch of Hadoop is compatible with S3A clients
which do not delete directory markers when files are created underneath.
It does not allow this version to disable marker deletion; if the
fs.s3a.marker.retention option is changed to request this, a message
is printed at INFO and the policy remains at "delete"
The s3guard bucket-info command has been extended to support
probing for marker retention, as has the hasPathCapability method on
S3AFileSystem.
Read the documentation!
Change-Id: Ief23c39256b194abcc445231b5f7a018185ea9f6
2020-09-03 18:29:30 +01:00
ecf88b972f
YARN-10358. Fix findbugs warnings in hadoop-yarn-project on branch-2.10. ( #2164 )
2020-08-31 13:52:29 +09:00
2b6b5476ba
HDFS-15290. NPE in HttpServer during NameNode startup. Contributed by Simbarashe Dzinamarira.
...
(cherry picked from commit f734455e5d
2020-08-28 17:48:38 -07:00
e645204733
HADOOP-17159. Make UGI support forceful relogin from keytab ignoring the last login time ( #2245 )
...
Contributed by Sandeep Guggilam.
Signed-off-by: Mingliang Liu <liuml07@apache.org>
Signed-off-by: Steve Loughran <stevel@apache.org>
2020-08-27 15:21:20 -07:00
a9f82a11df
HADOOP-17202. Fix findbugs warnings in hadoop-tools on branch-2.10. ( #2214 )
2020-08-18 13:58:35 +09:00
c7ab3195de
HADOOP-17205. Move personality file from Yetus to Hadoop repository ( #2226 )
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit fefacf2578
2020-08-18 12:12:57 +09:00
30c95ddaff
MAPREDUCE-7249. Fix Invalid event TA_TOO_MANY_FETCH_FAILURE at SUCCESS_CONTAINER_CLEANUP causes job failure.
...
Contributed by Wilfred Spiegelenburg.
(cherry picked from commit a97f7776bd
2020-08-17 14:39:41 -07:00
f4f00d56a1
MAPREDUCE-7240. Fix Invalid event: TA_TOO_MANY_FETCH_FAILURE at SUCCESS_FINISHING_CONTAINER.
...
Contributed by Huachao and Peter Bacsko. Reviewed by Wilfred Spiegelenburg.
(cherry picked from commit 6a4966f336
2020-08-17 14:39:02 -07:00
283def8bc5
MAPREDUCE-7069. Add ability to specify user environment variables individually. Contributed by Jim Brennan
...
(cherry picked from commit 4571351ccc
2020-08-13 18:54:31 -05:00
b87e080433
HADOOP-17204. Fix typo in Hadoop KMS document. Contributed by Xieming Li.
...
(cherry picked from commit 141c62584b
2020-08-12 16:10:11 +09:00
2dffc1d8cb
HADOOP-14400. Fix warnings from spotbugs in hadoop-tools. Contributed by Weiwei Yang.
...
(cherry picked from commit 2ba9903932
2020-08-11 14:19:35 +09:00
7dedf344de
MAPREDUCE-6881. Fix warnings from Spotbugs in hadoop-mapreduce. Contributed by Weiwei Yang.
...
(cherry picked from commit 3ed3062fe3
2020-08-11 11:19:01 +09:00
21788f9fd4
YARN-8459. Improve Capacity Scheduler logs to debug invalid states. Contributed by Wangda Tan and Jim Brennan.
2020-08-10 20:52:44 +00:00
865828ae63
YARN-10251. Show extended resources on legacy RM UI. Contributed by Eric Payne
2020-08-07 17:45:04 -07:00
120cd9eae6
YARN-7677. Docker image cannot set HADOOP_CONF_DIR. Contributed by Jim Brennan.
2020-08-06 19:40:33 +00:00
9bf554deae
YARN-4575. ApplicationResourceUsageReport should return ALL reserved resource.
...
Contributed by Bibin Chundatt and Eric Payne.
(cherry picked from commit 647be0c0f6
2020-08-05 23:20:52 +00:00
4eb1f81876
HADOOP-17164 UGI loginUserFromKeytab doesn't set the last login time ( #2194 )
...
Contributed by Sandeep Guggilam.
Signed-off-by: Mingliang Liu <liuml07@apache.org>
Signed-off-by: Steve Loughran <stevel@apache.org>
2020-08-05 09:04:01 -07:00
8d5821b9c3
HDFS-15499. Clean up httpfs/pom.xml to remove aws-java-sdk-s3 exclusion ( #2188 )
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2020-08-04 23:27:46 -07:00
cd596a0fdb
HADOOP-17185. Set MAVEN_OPTS in Jenkinsfile ( #2195 )
2020-08-05 15:22:09 +09:00
39c118c802
HADOOP-14056. Update maven-javadoc-plugin to 2.10.4.
...
(cherry picked from commit fad766e1d2
2020-08-05 12:04:09 +09:00
0d4ddd9066
HADOOP-17184. Add --mvn-custom-repos parameter to yetus calls ( #2193 )
...
(cherry picked from commit 49996f67f7
2020-08-05 10:53:21 +09:00
c84ae8f3d9
YARN-10363. TestRMAdminCLI.testHelp is failing in branch-2.10. Contributed by
...
Bilwa S T.
(cherry picked from commit 87816e8a51
2020-07-31 22:40:41 +00:00
898ee03181
YARN-1529: Add Localization overhead metrics to NM. Contributed by Jim_Brennan.
2020-07-30 20:02:22 +00:00
a1fe3eed9b
HDFS-15313. Ensure inodes in active filesytem are not deleted during snapshot delete. Contributed by Shashikant Banerjee.
2020-07-30 15:48:15 +01:00
50e68e67b6
YARN-10343. Legacy RM UI should include labeled metrics for allocated, total, and reserved resources. Contributed by Eric Payne
2020-07-28 13:45:14 -07:00
2fae1c5b05
YARN-4771. Some containers can be skipped during log aggregation after NM
...
restart. Contributed by Jason Lowe and Jim Brennan.
(cherry picked from commit ac5f21dbef
2020-07-24 23:08:31 +00:00
8cd8b4152d
YARN-6515. Fix warnings from Spotbugs in hadoop-yarn-server-nodemanager. Contributed by Naganarasimha G R.
...
(cherry picked from commit 1a18d5e514
2020-07-21 22:02:41 +09:00
3044a13080
HDFS-15404. ShellCommandFencer should expose info about source. Contributed by Chen Liang.
...
(cherry picked from commit 3833c616e0370efc6d951e33696bc8
2020-07-20 15:26:44 -07:00
e53186954d
HADOOP-16753. Refactor HAAdmin. Contributed by Xieming Li.
...
(cherry picked from commit 1defe3a65a0d949d375e635067d03d
2020-07-20 13:39:00 -07:00
685b81f447
HDFS-14498. LeaseManager can loop forever on the file for which create has failed. Contributed by Stephen O'Donnell.
2020-07-17 00:17:17 +08:00
f36d524a10
HADOOP-17127. Use RpcMetrics.TIMEUNIT to initialize rpc queueTime and processingTime. Contributed by Jim Brennan.
2020-07-15 08:33:42 -07:00
a4b419cdf5
YARN-10348. Allow RM to always cancel tokens after app completes. Contributed by
...
Jim Brennan.
(cherry picked from commit 09f1547697
2020-07-14 18:33:56 +00:00
7190507aa2
YARN-10297. TestContinuousScheduling#testFairSchedulerContinuousSchedulingInitTime fails intermittently. Contributed by Jim Brennan (Jim_Brennan)
...
(cherry picked from commit 0427100b75
2020-07-13 21:51:32 +00:00
b2c44db79e
Revert "HDFS-14498 LeaseManager can loop forever on the file for which create has failed. Contributed by Stephen O'Donnell."
...
This reverts commit 3ebd783dc7
2020-07-13 23:57:11 +08:00
3ebd783dc7
HDFS-14498 LeaseManager can loop forever on the file for which create has failed. Contributed by Stephen O'Donnell.
2020-07-13 14:45:09 +08:00
c63068be5f
HDFS-11696. Fix warnings from Spotbugs in hadoop-hdfs. Contributed by Yiqun Lin.
...
(cherry picked from commit 2e43c28e01
2020-07-10 15:16:51 +09:00
d50f5b7df4
HADOOP-14354. SysInfoWindows is not thread safe. Contributed by Inigo Goiri
...
(cherry picked from commit 689fb2fc66
2020-07-10 14:37:05 +09:00
3969327077
HADOOP-12940. Fix warnings from Spotbugs in hadoop-common.
...
Conflicts:
hadoop-common-project/hadoop-common/dev-support/findbugsExcludeFile.xml
hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/erasurecode/ECSchema.java
2020-07-10 13:38:08 +09:00
7257b17793
HADOOP-17120. Fix failure of docker image creation due to pip2 install error. ( #2130 )
...
(cherry picked from commit 53cfe60904
2020-07-09 03:43:22 +00:00
9ac6c63c0d
HADOOP-17090. Increase precommit job timeout from 5 hours to 20 hours. ( #2111 ). Contributed by Akira Ajisaka.
...
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2020-07-01 15:17:52 +05:30
76fa956d3b
YARN-9903: Support reservations continue looking for Node Labels. Contributed by Jim Brennan (Jim_Brennan).
...
(cherry picked from commit e6794f2fc4
2020-06-29 19:55:18 +00:00
d755af71c9
HADOOP-17094. vulnerabilities reported in jackson and jackson-databind in branch-2.10. Contributed by Ahmed Hussein.
...
Signed-off-by: Masatake Iwasaki <iwasakims@apache.org>
2020-06-29 08:57:49 +09:00
fb694e87a6
HDFS-15421. IBR leak causes standby NN to be stuck in safe mode.
...
(cherry picked from commit c71ce7ac33
2020-06-28 17:23:27 +09:00
Wangda Tan
Masatake Iwasaki
Jitendra Pandey
dependabot[bot]
Eric E Payne
Steve Loughran
Chen Liang
sguggilam
Chao Sun
prabhujoseph
Kihwal Lee
Akira Ajisaka
Jonathan Hung
Eric Badger
Mingliang Liu
S O'Donnell
He Xiaoqiao
Erik Krogen
Yiqun Lin
Chris Douglas