Masatake Iwasaki
fdd8610ab2
HADOOP-17254. Upgrade hbase to 1.4.13 on branch-2.10. ( #2290 )
2020-09-11 08:54:30 +09:00
Wangda Tan
9a895a90d9
YARN-8210. AMRMClient logging on every heartbeat to track updation of AM RM token causes too many log lines to be generated in AM logs. (Suma Shivaprasad via wangda)
...
Change-Id: I70edd6e301fd5e78d479e1882aedc9332a0827aa
(cherry picked from commit b1833d9ba2
)
(cherry picked from commit f9add5fdd9
)
2020-09-10 14:40:05 -07:00
Masatake Iwasaki
7d8ee990cd
HADOOP-17253. Upgrade zookeeper to 3.4.14 on branch-2.10. ( #2289 )
2020-09-10 20:37:32 +09:00
Masatake Iwasaki
42ac46ff18
HADOOP-17249. Upgrade jackson-databind to 2.9.10.6 on branch-2.10. ( #2279 )
2020-09-09 09:55:11 +09:00
Masatake Iwasaki
0574de5f2f
HADOOP-17251. Upgrade netty-all to 4.1.50.Final on branch-2.10. ( #2285 )
2020-09-09 07:19:23 +09:00
Jitendra Pandey
43c6c54b8c
HADOOP-14910. Upgrade netty-all jar to latest 4.0.x.Final. Contributed by Vinayakumar B.
...
(cherry picked from commit f29e55bf5e
)
2020-09-08 22:35:01 +09:00
dependabot[bot]
7c838bf6ed
Bump nimbus-jose-jwt from 4.41.1 to 7.9 ( #1682 )
...
Bumps [nimbus-jose-jwt](https://bitbucket.org/connect2id/nimbus-jose-jwt ) from 4.41.1 to 7.9.
- [Changelog](https://bitbucket.org/connect2id/nimbus-jose-jwt/src/master/CHANGELOG.txt )
- [Commits](https://bitbucket.org/connect2id/nimbus-jose-jwt/branches/compare/7.9..4.41.1 )
Signed-off-by: dependabot[bot] <support@github.com>
(cherry picked from commit c1d393a156
)
2020-09-08 21:35:40 +09:00
Eric E Payne
e5bd8d2840
YARN-10177: Backport YARN-7307 to branch-2.10 Allow client/AM update supported resource types via YARN APIs
2020-09-04 18:23:08 +00:00
Steve Loughran
a75f2915f9
HADOOP-17199. S3A Directory Marker HADOOP-13230 backport
...
This backports the listing-side changes of HADOOP-13230.
With this patch in, this branch of Hadoop is compatible with S3A clients
which do not delete directory markers when files are created underneath.
It does not allow this version to disable marker deletion; if the
fs.s3a.marker.retention option is changed to request this, a message
is printed at INFO and the policy remains at "delete"
The s3guard bucket-info command has been extended to support
probing for marker retention, as has the hasPathCapability method on
S3AFileSystem.
Read the documentation!
Change-Id: Ief23c39256b194abcc445231b5f7a018185ea9f6
2020-09-03 18:29:30 +01:00
Masatake Iwasaki
ecf88b972f
YARN-10358. Fix findbugs warnings in hadoop-yarn-project on branch-2.10. ( #2164 )
2020-08-31 13:52:29 +09:00
Chen Liang
2b6b5476ba
HDFS-15290. NPE in HttpServer during NameNode startup. Contributed by Simbarashe Dzinamarira.
...
(cherry picked from commit f734455e5d
)
2020-08-28 17:48:38 -07:00
sguggilam
e645204733
HADOOP-17159. Make UGI support forceful relogin from keytab ignoring the last login time ( #2245 )
...
Contributed by Sandeep Guggilam.
Signed-off-by: Mingliang Liu <liuml07@apache.org>
Signed-off-by: Steve Loughran <stevel@apache.org>
2020-08-27 15:21:20 -07:00
Masatake Iwasaki
a9f82a11df
HADOOP-17202. Fix findbugs warnings in hadoop-tools on branch-2.10. ( #2214 )
2020-08-18 13:58:35 +09:00
Chao Sun
c7ab3195de
HADOOP-17205. Move personality file from Yetus to Hadoop repository ( #2226 )
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit fefacf2578
)
2020-08-18 12:12:57 +09:00
prabhujoseph
30c95ddaff
MAPREDUCE-7249. Fix Invalid event TA_TOO_MANY_FETCH_FAILURE at SUCCESS_CONTAINER_CLEANUP causes job failure.
...
Contributed by Wilfred Spiegelenburg.
(cherry picked from commit a97f7776bd
)
2020-08-17 14:39:41 -07:00
prabhujoseph
f4f00d56a1
MAPREDUCE-7240. Fix Invalid event: TA_TOO_MANY_FETCH_FAILURE at SUCCESS_FINISHING_CONTAINER.
...
Contributed by Huachao and Peter Bacsko. Reviewed by Wilfred Spiegelenburg.
(cherry picked from commit 6a4966f336
)
2020-08-17 14:39:02 -07:00
Kihwal Lee
283def8bc5
MAPREDUCE-7069. Add ability to specify user environment variables individually. Contributed by Jim Brennan
...
(cherry picked from commit 4571351ccc
)
2020-08-13 18:54:31 -05:00
Akira Ajisaka
b87e080433
HADOOP-17204. Fix typo in Hadoop KMS document. Contributed by Xieming Li.
...
(cherry picked from commit 141c62584b
)
2020-08-12 16:10:11 +09:00
Akira Ajisaka
2dffc1d8cb
HADOOP-14400. Fix warnings from spotbugs in hadoop-tools. Contributed by Weiwei Yang.
...
(cherry picked from commit 2ba9903932
)
2020-08-11 14:19:35 +09:00
Akira Ajisaka
7dedf344de
MAPREDUCE-6881. Fix warnings from Spotbugs in hadoop-mapreduce. Contributed by Weiwei Yang.
...
(cherry picked from commit 3ed3062fe3
)
2020-08-11 11:19:01 +09:00
Eric E Payne
21788f9fd4
YARN-8459. Improve Capacity Scheduler logs to debug invalid states. Contributed by Wangda Tan and Jim Brennan.
2020-08-10 20:52:44 +00:00
Jonathan Hung
865828ae63
YARN-10251. Show extended resources on legacy RM UI. Contributed by Eric Payne
2020-08-07 17:45:04 -07:00
Eric Badger
120cd9eae6
YARN-7677. Docker image cannot set HADOOP_CONF_DIR. Contributed by Jim Brennan.
2020-08-06 19:40:33 +00:00
Eric Badger
9bf554deae
YARN-4575. ApplicationResourceUsageReport should return ALL reserved resource.
...
Contributed by Bibin Chundatt and Eric Payne.
(cherry picked from commit 647be0c0f6
)
2020-08-05 23:20:52 +00:00
sguggilam
4eb1f81876
HADOOP-17164 UGI loginUserFromKeytab doesn't set the last login time ( #2194 )
...
Contributed by Sandeep Guggilam.
Signed-off-by: Mingliang Liu <liuml07@apache.org>
Signed-off-by: Steve Loughran <stevel@apache.org>
2020-08-05 09:04:01 -07:00
Mingliang Liu
8d5821b9c3
HDFS-15499. Clean up httpfs/pom.xml to remove aws-java-sdk-s3 exclusion ( #2188 )
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2020-08-04 23:27:46 -07:00
Akira Ajisaka
cd596a0fdb
HADOOP-17185. Set MAVEN_OPTS in Jenkinsfile ( #2195 )
2020-08-05 15:22:09 +09:00
Akira Ajisaka
39c118c802
HADOOP-14056. Update maven-javadoc-plugin to 2.10.4.
...
(cherry picked from commit fad766e1d2
)
2020-08-05 12:04:09 +09:00
Mingliang Liu
0d4ddd9066
HADOOP-17184. Add --mvn-custom-repos parameter to yetus calls ( #2193 )
...
(cherry picked from commit 49996f67f7
)
2020-08-05 10:53:21 +09:00
Eric Badger
c84ae8f3d9
YARN-10363. TestRMAdminCLI.testHelp is failing in branch-2.10. Contributed by
...
Bilwa S T.
(cherry picked from commit 87816e8a51
)
2020-07-31 22:40:41 +00:00
Eric E Payne
898ee03181
YARN-1529: Add Localization overhead metrics to NM. Contributed by Jim_Brennan.
2020-07-30 20:02:22 +00:00
S O'Donnell
a1fe3eed9b
HDFS-15313. Ensure inodes in active filesytem are not deleted during snapshot delete. Contributed by Shashikant Banerjee.
2020-07-30 15:48:15 +01:00
Jonathan Hung
50e68e67b6
YARN-10343. Legacy RM UI should include labeled metrics for allocated, total, and reserved resources. Contributed by Eric Payne
2020-07-28 13:45:14 -07:00
Eric Badger
2fae1c5b05
YARN-4771. Some containers can be skipped during log aggregation after NM
...
restart. Contributed by Jason Lowe and Jim Brennan.
(cherry picked from commit ac5f21dbef
)
2020-07-24 23:08:31 +00:00
Akira Ajisaka
8cd8b4152d
YARN-6515. Fix warnings from Spotbugs in hadoop-yarn-server-nodemanager. Contributed by Naganarasimha G R.
...
(cherry picked from commit 1a18d5e514
)
Conflicts:
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/localizer/ContainerLocalizer.java
2020-07-21 22:02:41 +09:00
Chen Liang
3044a13080
HDFS-15404. ShellCommandFencer should expose info about source. Contributed by Chen Liang.
...
(cherry picked from commit 3833c616e0
)
(cherry picked from commit 370efc6d95
)
(cherry picked from commit 1e33696bc8
)
2020-07-20 15:26:44 -07:00
Akira Ajisaka
e53186954d
HADOOP-16753. Refactor HAAdmin. Contributed by Xieming Li.
...
(cherry picked from commit 1defe3a65a
)
(cherry picked from commit 0d949d375e
)
(cherry picked from commit 635067d03d
)
2020-07-20 13:39:00 -07:00
He Xiaoqiao
685b81f447
HDFS-14498. LeaseManager can loop forever on the file for which create has failed. Contributed by Stephen O'Donnell.
2020-07-17 00:17:17 +08:00
Erik Krogen
f36d524a10
HADOOP-17127. Use RpcMetrics.TIMEUNIT to initialize rpc queueTime and processingTime. Contributed by Jim Brennan.
2020-07-15 08:33:42 -07:00
Eric Badger
a4b419cdf5
YARN-10348. Allow RM to always cancel tokens after app completes. Contributed by
...
Jim Brennan.
(cherry picked from commit 09f1547697
)
2020-07-14 18:33:56 +00:00
Eric E Payne
7190507aa2
YARN-10297. TestContinuousScheduling#testFairSchedulerContinuousSchedulingInitTime fails intermittently. Contributed by Jim Brennan (Jim_Brennan)
...
(cherry picked from commit 0427100b75
)
2020-07-13 21:51:32 +00:00
He Xiaoqiao
b2c44db79e
Revert "HDFS-14498 LeaseManager can loop forever on the file for which create has failed. Contributed by Stephen O'Donnell."
...
This reverts commit 3ebd783dc7
.
2020-07-13 23:57:11 +08:00
He Xiaoqiao
3ebd783dc7
HDFS-14498 LeaseManager can loop forever on the file for which create has failed. Contributed by Stephen O'Donnell.
2020-07-13 14:45:09 +08:00
Yiqun Lin
c63068be5f
HDFS-11696. Fix warnings from Spotbugs in hadoop-hdfs. Contributed by Yiqun Lin.
...
(cherry picked from commit 2e43c28e01
)
Conflicts:
hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DFSClient.java
2020-07-10 15:16:51 +09:00
Chris Douglas
d50f5b7df4
HADOOP-14354. SysInfoWindows is not thread safe. Contributed by Inigo Goiri
...
(cherry picked from commit 689fb2fc66
)
2020-07-10 14:37:05 +09:00
Akira Ajisaka
3969327077
HADOOP-12940. Fix warnings from Spotbugs in hadoop-common.
...
Conflicts:
hadoop-common-project/hadoop-common/dev-support/findbugsExcludeFile.xml
hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/erasurecode/ECSchema.java
2020-07-10 13:38:08 +09:00
Masatake Iwasaki
7257b17793
HADOOP-17120. Fix failure of docker image creation due to pip2 install error. ( #2130 )
...
(cherry picked from commit 53cfe60904
)
2020-07-09 03:43:22 +00:00
Akira Ajisaka
9ac6c63c0d
HADOOP-17090. Increase precommit job timeout from 5 hours to 20 hours. ( #2111 ). Contributed by Akira Ajisaka.
...
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2020-07-01 15:17:52 +05:30
Eric E Payne
76fa956d3b
YARN-9903: Support reservations continue looking for Node Labels. Contributed by Jim Brennan (Jim_Brennan).
...
(cherry picked from commit e6794f2fc4
)
2020-06-29 19:55:18 +00:00
Masatake Iwasaki
d755af71c9
HADOOP-17094. vulnerabilities reported in jackson and jackson-databind in branch-2.10. Contributed by Ahmed Hussein.
...
Signed-off-by: Masatake Iwasaki <iwasakims@apache.org>
2020-06-29 08:57:49 +09:00