Fixes CVE-2018-7489 in shaded jackson.
+Add more commands in testing.md
to the CLI tests needed when qualifying
a release
Contributed by Steve Loughran
Partial/Incomplete groups list can be returned in LDAP groups lookup.
Backported in #4550; minor tuning of parameters needed.
Contributed by larry mccay
This downgrades jackson from the version switched to in
HADOOP-18033 (2.13.0), to Jackson 2.12.7.
This removes the dependency on javax.ws.rs-api,
so avoiding runtime problems with applications using
jersey-core v1 and/or jsr311-api.
The 2.12.7 release still contains the fix for CVE-2020-36518.
Contributed by PJ Fanning
Part of HADOOP-17198. Support S3 Access Points.
HADOOP-18068. "upgrade AWS SDK to 1.12.132" broke the access point endpoint
translation.
Correct endpoints should start with "s3-accesspoint.", after SDK upgrade they start with
"s3.accesspoint-" which messes up tests + region detection by the SDK.
Contributed by Bogdan Stolojan
Change-Id: I0c0181628ab803afc39036003777eaec79aa378c
With this update, the versions of key shaded dependencies are
jackson 2.12.3
httpclient 4.5.13
Contributed by Steve Loughran
Change-Id: Id9ed677352d54e8ea71b9729b6a4bfedc6142825
Workaround for HADOOP-18159; this ensures that projects declaring
a dependency on hadoop-cloud-storage do _not_ have their s3 http
connections broken by an out of date mozilla/public-suffix-list.txt
resource on the classpath.
Contributed by Steve Loughran
Change-Id: Ib90d07f1ebe1ceaf91263e4d2aa09218e6d4e518
java-8-openjdk become openjdk-8-jdk (see both ubuntu and debian package's name)
Contributed by Giovambattista Vieri
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
Change-Id: I63b2bbfdd575cf56d20cd6c8fff33a70cadda7f2
Adds the 3.3.2 jdiff files which were left out of the
release commit...the ones the release doc didn't mention.
This is needed for the 3.3.3 build to complete.
Change-Id: I296103b7a51ac851ecc0503672af234519a7f0f9
Since April 2022/CVE-2022-24765, git refuses to work in directories
whose owner != the current user, unless explicitly told to trust it.
This patches the create-release script to trust the /build/source
dir mounted from the hosting OS, whose userid is inevitably different
from that of the account in the container running git.
Contributed by: Steve Loughran, Ayush Saxena and the new git error messages
Change-Id: I855a105e6d0ab533468f9436578c8d4f81b0840b
(cherry picked from commit d0fa9b5775)
Conflicts:
hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FileUtil.java
hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestFileUtil.java
Change-Id: I2bba28c56dd08da315856066b58b1778b67bfb45
Co-authored-by: Gautham B A <gautham.bangalore@gmail.com>
Add support for S3 Access Points. This provides extra security as it
ensures applications are not working with buckets belong to third parties.
To bind a bucket to an access point, set the access point (ap) ARN,
which must be done for each specific bucket, using the pattern
fs.s3a.bucket.$BUCKET.accesspoint.arn = ARN
* The global/bucket option `fs.s3a.accesspoint.required` to
mandate that buckets must declare their access point.
* This is not compatible with S3Guard.
Consult the documentation for further details.
See HADOOP-18091. S3A auditing leaks memory through ThreadLocal references
* Adds a new option fs.s3a.audit.enabled to controls whether or not auditing
is enabled. This is false by default.
* When false, the S3A auditing manager is NoopAuditManagerS3A,
which was formerly only used for unit tests and
during filsystem initialization.
* When true, ActiveAuditManagerS3A is used for managing auditing,
allowing auditing events to be reported.
* updates documentation and tests.
This patch does not fix the underlying leak. When auditing is enabled,
long-lived threads will retain references to the audit managers
of S3A filesystem instances which have already been closed.
Contributed by Steve Loughran.
Change-Id: I671e594cd59e8ca77a1f65be791ad0ae9530b8d9
Steve Loughran
Wei-Chiu Chuang
PJ Fanning
Petre Bogdan Stolojan
Owen O'Malley
Ashutosh Gupta
Szilard Nemeth
Akira Ajisaka
Giovambattista Vieri
Dongjoon Hyun
Akira Ajisaka
André Fonseca
Masatake Iwasaki
litao
Kengo Seki
GuoPhilipse
Peter Bacsko
qinyuren
Thinker313
Ayush Saxena
Viraj Jasani
Chentao Yu
daimin
singer-bin
Chao Sun
Xiangyi Zhu
ahmarsuhail
Mukund Thakur
monthonk