5119d0c72f
HDFS-16982 Use the right Quantiles Array for Inverse Quantiles snapshot ( #5556 )
2023-04-18 10:47:37 -07:00
0e3aafe6c0
HADOOP-18399. S3A Prefetch - SingleFilePerBlockCache to use LocalDirAllocator ( #5054 )
...
Contributed by Viraj Jasani
2023-04-18 16:37:48 +01:00
405ed1dde6
HADOOP-18470. Hadoop 3.3.5 release wrap-up ( #5558 )
...
Post-release updates of the branches
* Add jdiff xml files from 3.3.5 release.
* Declare 3.3.5 as the latest stable release.
* Copy release notes.
2023-04-18 10:12:07 +01:00
2b60d0c1f4
[HDFS-16971] Add read metrics for remote reads in FileSystem Statistics #5534 ( #5536 )
2023-04-13 09:07:42 -07:00
3e2ae1da00
HDFS-16949 Introduce inverse quantiles for metrics where higher numer… ( #5495 )
2023-04-10 08:56:00 -07:00
e45451f9c7
HADOOP-18687. hadoop-auth: remove unnecessary dependency on json-smart ( #5524 )
...
Contributed by Michiel de Jong
2023-04-06 16:00:33 +01:00
b4bcbb9515
HDFS-16959. RBF: State store cache loading metrics ( #5497 )
2023-03-29 10:43:13 -07:00
ee01c64c6c
HADOOP-18676. jettison dependency override in hadoop-common lib ( #5513 )
2023-03-27 09:59:02 +02:00
b82bcbd8ad
Revert "HADOOP-18676. Fixing jettison vulnerability of hadoop-common lib ( #5507 )"
...
This reverts commit 72b0122706
2023-03-25 12:04:28 +05:30
72b0122706
HADOOP-18676. Fixing jettison vulnerability of hadoop-common lib ( #5507 )
...
* HADOOP-18587. Fixing jettison vulnerability of hadoop-common lib
* no need for excluding, let it come
Change-Id: Ia6e4ad351158dd4b0510dec34bbde531a60e7654
2023-03-24 16:31:45 +01:00
e3cb9573e1
HADOOP-18662. ListFiles with recursive fails with FNF. ( #5477 ). Contributed by Ayush Saxena.
...
Reviewed-by: Steve Loughran <stevel@apache.org
2023-03-23 08:30:08 +05:30
67e02a92e0
HADOOP-18666. A whitelist of endpoints to skip Kerberos authentication doesn't work for ResourceManager and Job History Server ( #5480 )
2023-03-22 10:54:41 +09:00
9a8287c36f
HADOOP-18669. Remove Log4Json Layout ( #5493 )
2023-03-21 10:07:06 +08:00
405bfa2800
HADOOP-18654. Remove unused custom appender TaskLogAppender ( #5457 )
2023-03-16 00:45:37 +08:00
aff840c59c
HADOOP-18653. LogLevel servlet to determine log impl before using setLevel ( #5456 )
...
The log level can only be set on Log4J log implementations;
probes are used to downgrade to a warning when other
logging back ends are used
Contributed by Viraj Jasani
2023-03-13 12:30:12 +00:00
09469bf47d
HADOOP-18661. Fix bin/hadoop usage script terminology. ( #5473 )
...
Followup to HADOOP-13209: s/slaves/r/workers in
the usage message you get when you type "bin/hadoop"
Contributed by Steve Loughran
2023-03-13 12:24:36 +00:00
e1ca466bdb
HADOOP-18648. Avoid loading kms log4j properties dynamically by KMSWebServer ( #5441 )
2023-03-02 08:02:07 +08:00
28d2753d2f
HADOOP-18645. Provide keytab file key name with ServiceStateException ( #5433 )
...
Signed-off-by: Tao Li <tomscut@apache.org>
2023-03-01 09:34:12 +08:00
0ca5686034
HDFS-16917 Add transfer rate quantile metrics for DataNode reads ( #5397 )
...
Co-authored-by: Ravindra Dingankar <rdingankar@linkedin.com>
2023-02-27 18:26:32 +00:00
4cc33e5e37
HDFS-16901: RBF: Propagates real user's username via the caller context, when a proxy user is being used. ( #5346 )
2023-02-22 21:58:44 +00:00
fb31393b65
HADOOP-18535. Implement token storage solution based on MySQL
...
Fixes #1240
Signed-off-by: Owen O'Malley <oomalley@linkedin.com>
2023-02-22 10:38:50 -08:00
11a220c6e7
HADOOP-18636 LocalDirAllocator cannot recover from directory tree deletion ( #5412 )
...
Even though DiskChecker.mkdirsWithExistsCheck() will create the directory tree,
it is only called *after* the enumeration of directories with available
space has completed.
Directories which don't exist are reported as having 0 space, therefore
the mkdirs code is never reached.
Adding a simple mkdirs() -without bothering to check the outcome-
ensures that if a dir has been deleted then it will be reconstructed
if possible. If it can't it will still have 0 bytes of space
reported and so be excluded from the allocation.
Contributed by Steve Loughran
2023-02-22 11:48:12 +00:00
02fd87a4d8
HADOOP-18627. Add stronger wording in 'secure mode' introduction ( #5406 )
...
Make it more clear that when deploying Hadoop 'secure mode' is generally not optional.
Contributed by Arnout Engelen
2023-02-17 16:30:41 +00:00
7e19bc31b6
HADOOP-18215. Enhance WritableName to be able to return aliases for classes that use serializers ( #4215 )
2023-02-16 18:13:25 +00:00
c3706597a3
YARN-11349. [Federation] Router Support DelegationToken With SQL. ( #5244 )
2023-02-15 14:38:41 -08:00
f4f2793f3b
HADOOP-18351. Reduce excess logging of errors during S3A prefetching reads ( #5274 )
...
Contributed by Ankit Saurabh
2023-02-15 18:28:42 +00:00
d56977e909
HADOOP-18470. More in the 3.3.5 index.html about security ( #5383 )
...
Expands on the comments in cluster config to tell people
they shouldn't be running a cluster without a private VLAN
in cloud, that Knox is good here, and unsecured clusters
without a VLAN are just computation-as-a-service to crypto miners
Contributed by Steve Loughran
2023-02-14 17:22:59 +00:00
021fcc6c5e
HADOOP-18628. IPC Server Connection should log host name before returning VersionMismatch error ( #5385 )
...
Contributed by Viraj Jasani
2023-02-14 11:48:48 +00:00
90de1ff151
HADOOP-18206 Cleanup the commons-logging references and restrict its usage in future ( #5315 )
2023-02-14 03:24:06 +08:00
26fba8701c
HDFS-18324. Fix race condition in closing IPC connections. ( #5371 )
2023-02-10 17:51:03 +00:00
113a9e40cb
HADOOP-18625. Fix method name of RPC.Builder#setnumReaders ( #5301 )
...
Changes method name of RPC.Builder#setnumReaders to setNumReaders()
The original method is still there, just marked deprecated.
It is the one which should be used when working with older branches.
Contributed by Haiyang Hu
2023-02-09 13:28:34 +00:00
4fcceff535
HADOOP-18620 Avoid using grizzly-http-* APIs ( #5356 )
2023-02-09 10:45:07 +08:00
8714403dc7
HADOOP-18621. Resource leak in CryptoOutputStream.close() ( #5347 )
...
When closing we need to wrap the flush() in a try .. finally, otherwise
when flush throws it will stop completion of the remainder of the
close activities and in particular the close of the underlying wrapped
stream object resulting in a resource leak.
Contributed by Colm Dougan
2023-02-07 12:01:57 +00:00
5f5157ac53
HADOOP-18612. Avoid mixing canonical and non-canonical when performing comparisons ( #5339 )
...
Contributed by Steve Vaughan Jr
2023-02-06 18:28:29 +00:00
aed6fcee5b
HADOOP-18576. Java 11 JavaDoc fails due to missing package comments ( #5344 )
...
Add JavaDoc comments to package-info.java to avoid errors resulting from the use of Hadoop annotations.
Contributed by Steve Vaughan Jr
2023-02-06 18:17:57 +00:00
be564f5c20
[HDFS-16903]. Fix javadoc of LightWeightResizableGSet class ( #5338 )
2023-02-06 13:21:28 +09:00
ad0cff2f97
HADOOP-18592. Sasl connection failure should log remote address. ( #5294 )
...
Contributed by Viraj Jasani <vjasani@apache.org>
Signed-off-by: Chris Nauroth <cnauroth@apache.org>
Signed-off-by: Steve Loughran <stevel@apache.org>
Signed-off-by: Mingliang Liu <liuml07@apache.org>
2023-02-01 10:15:20 -08:00
9d47108b50
HADOOP-18584. [NFS GW] Fix regression after netty4 migration. ( #5252 )
...
Reviewed-by: Tsz-Wo Nicholas Sze <szetszwo@apache.org>
2023-01-31 01:17:04 +08:00
952d707240
HADOOP-18604. Add compile platform in the hadoop version output. ( #5327 ). Contributed by Ayush Saxena.
...
Signed-off-by: Chris Nauroth <cnauroth@apache.org>
2023-01-28 14:19:19 +05:30
4de31123ce
Fix "the the" and friends typos ( #5267 )
...
Signed-off-by: Nikita Eshkeev <neshkeev@yandex.ru>
2023-01-17 03:33:59 +08:00
d81d98388c
HADOOP-18575: followup: try to avoid repeatedly hitting exceptions when transformer factories do not support attributes ( #5253 )
...
Part of HADOOP-18469 and the hardening of XML/XSL parsers.
Followup to the main HADOOP-18575 patch, to improve performance when
working with xml/xsl engines which don't support the relevant attributes.
Include this change when backporting.
Contributed by PJ Fanning.
2023-01-16 13:15:37 +00:00
a90e424d9f
HADOOP-18591. Fix a typo in Trash ( #5291 )
...
Signed-off-by: Tao Li <tomscut@apache.org>
Signed-off-by: Chris Nauroth <cnauroth@apache.org>
2023-01-12 13:21:21 -08:00
3d21cff263
YARN-11413. Fix Junit Test ERROR Introduced By YARN-6412. ( #5289 )
...
* YARN-11413. Fix Junit Test ERROR Introduced By YARN-6412.
* YARN-11413. Fix CheckStyle.
* YARN-11413. Fix CheckStyle.
Co-authored-by: slfan1989 <louj1988@@>
2023-01-12 14:29:05 +01:00
4cf304de45
HDFS-16872. Fix log throttling by declaring LogThrottlingHelper as static members ( #5246 )
...
Co-authored-by: Chengbing Liu <liuchengbing@qiyi.com>
Signed-off-by: Erik Krogen <xkrogen@apache.org>
2023-01-10 10:03:25 -08:00
a65d24488a
HADOOP-18581 : Handle Server KDC re-login when Server and Client run … ( #5248 )
...
* HADOOP-18581 : Handle Server KDC re-login when Server and Client run in same JVM.
2023-01-08 23:55:06 +05:30
b63b777c84
HDFS-16873 FileStatus compareTo specify ordering by path ( #5219 )
2022-12-21 10:11:55 +08:00
6a07b5dc10
HADOOP-18575. Make XML transformer factory more lenient ( #5224 )
...
Due diligence followup to
HADOOP-18469. Add secure XML parser factories to XMLUtils (#4940 )
Contributed by P J Fanning
2022-12-18 12:25:10 +00:00
ca3526da92
HADOOP-18567. LogThrottlingHelper: properly trigger dependent recorders in cases of infrequent logging ( #5215 )
...
Signed-off-by: Erik Krogen <xkrogen@apache.org>
Co-authored-by: Chengbing Liu <liuchengbing@qiyi.com>
2022-12-16 09:15:11 -08:00
f7b1bb4dcc
HADOOP-18573. Improve error reporting on non-standard kerberos names ( #5221 )
...
The kerberos RPC does not declare any restriction on
characters used in kerberos names, though
implementations MAY be more restrictive.
If the kerberos controller supports use non-conventional
principal names *and the kerberos admin chooses to use them*
this can confuse some of the parsing.
The obvious solution is for the enterprise admins to "not do that"
as a lot of things break, bits of hadoop included.
Harden the hadoop code slightly so at least we fail more gracefully,
so people can then get in touch with their sysadmin and tell them
to stop it.
2022-12-15 11:42:36 +00:00
32414cfe46
HADOOP-18574. Changing log level of IOStatistics increment to make the DEBUG logs less noisy ( #5223 )
...
Contributed by: Mehakmeet Singh
2022-12-15 10:19:18 +05:30
rdingankar
Viraj Jasani
Steve Loughran
Melissa You
mjwiq
Andras Katona
Ayush Saxena
Yubi Lee
Simbarashe Dzinamarira
hchaverr
Arnout Engelen
Bryan Beaudreault
slfan1989
Ankit Saurabh
Owen O'Malley
huhaiyang
gardenia
Steve Vaughan
hfutatzhanghb
Wei-Chiu Chuang
Nikita Eshkeev
PJ Fanning
huangxiaoping
Chengbing Liu
Surendra Singh Lilhore
David Dillon
Mehakmeet Singh