Steve Loughran
8ccc586af6
HADOOP-17409. Remove s3guard from S3A module ( #3534 )
...
Completely removes S3Guard support from the S3A codebase.
If the connector is configured to use any metastore other than
the null and local stores (i.e. DynamoDB is selected) the s3a client
will raise an exception and refuse to initialize.
This is to ensure that there is no mix of S3Guard enabled and disabled
deployments with the same configuration but different hadoop releases
-it must be turned off completely.
The "hadoop s3guard" command has been retained -but the supported
subcommands have been reduced to those which are not purely S3Guard
related: "bucket-info" and "uploads".
This is major change in terms of the number of files
changed; before cherry picking subsequent s3a patches into
older releases, this patch will probably need backporting
first.
Goodbye S3Guard, your work is done. Time to die.
Contributed by Steve Loughran.
2022-01-18 18:04:48 +00:00
Steve Loughran
47ba977ca9
HADOOP-18068. upgrade AWS SDK to 1.12.132 ( #3864 )
...
With this update, the versions of key shaded dependencies are
jackson 2.12.3
httpclient 4.5.13
This backport patch does not include the TestArn changes needed
for the test to work with this version of the SDK; it is only
to be applied to branches without HADOOP-17198. "Support S3 Access Points".
If that patch is backported later, that test suite MUST be
updated to the latest version.
Contributed by Steve Loughran
Change-Id: I8d2b71781ee8472b16469531f9cd0de32dd3356f
2022-01-18 12:20:12 +00:00
Ayush Saxena
53249a40db
HADOOP-18061. Update the year to 2022. ( #3845 ). Contributed by Ayush Saxena.
...
Reviewed-by: Akira Ajisaka <aajisaka@apache.org>
2022-01-04 07:59:45 +05:30
Igor Dvorzhak
5d72fdfcb2
HADOOP-13464. Upgrade Gson dependency to version 2.8.9 ( #2524 )
...
Change-Id: Ifd3fb9ec6ebfc8874bb799bc198219511fe55a2f
Update pom.xml
Update pom.xml
(cherry picked from commit 795054882a
)
2021-12-30 21:37:14 +00:00
Viraj Jasani
b0c1158829
HADOOP-18033. Upgrade fasterxml Jackson to 2.13.0 ( #3764 )
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2021-12-13 13:52:44 +09:00
Akira Ajisaka
35c5c6bb83
HADOOP-18040. Use maven.test.failure.ignore instead of ignoreTestFailure ( #3774 )
...
Reviewed-by: Masatake Iwasaki <iwasakims@apache.org>
(cherry picked from commit 9b9e2ef87f
)
Conflicts:
hadoop-tools/hadoop-federation-balance/pom.xml
2021-12-10 01:38:26 +09:00
Chao Sun
e079fa6577
Preparing for 3.3.3 development
2021-11-16 16:02:34 -08:00
Renukaprasad C
3bb4a09295
HADOOP-17946. Upgrade commons-lang to 3.12.0 ( #3575 )
...
(cherry picked from commit b923fa7a1c
)
2021-11-16 22:59:25 +08:00
Masatake Iwasaki
9e2936f8d1
HADOOP-17424. Replace HTrace with No-Op tracer ( #3520 )
...
(cherry picked from commit 1a205cc3ad
)
Conflicts:
hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DataStreamer.java
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataNode.java
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/tracing/TestTracing.java
Co-authored-by: Siyao Meng <50227127+smengcl@users.noreply.github.com>
2021-10-12 00:07:09 +09:00
Takanobu Asanuma
038fa67db4
HADOOP-17955. Bump netty to the latest 4.1.68. ( #3528 )
...
Reviewed-by: Masatake Iwasaki <iwasakims@apache.org>
(cherry picked from commit cf4d2d826c
)
2021-10-08 10:37:14 +09:00
Warren Zhu
e33509b094
HADOOP-17941. Update xerces to 2.12.1 ( #3496 )
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 1db5eb43ad
)
2021-09-29 18:49:52 +09:00
Takanobu Asanuma
f00ab40b4d
HADOOP-17940. Upgrade Kafka to 2.8.1 ( #3488 )
...
Reviewed-by: Masatake Iwasaki <iwasakims@apache.org>
(cherry picked from commit 2068b0041c
)
2021-09-28 13:31:53 +09:00
Dongjoon Hyun
ca7fb6a813
HADOOP-17939. Support building on Apple Silicon ( #3486 )
...
Support building on Apple Silicon with ARM CPUs by using the x86_64 version of protoc.
Contributed by Dongjoon Hyun
Change-Id: I4b8330098822f1fd28f0113650eb709d53bcc690
2021-09-27 13:27:56 +01:00
Ahmed Hussein
fc5d67dfb4
HADOOP-17886. Upgrade ant to 1.10.11 ( #3371 )
...
(cherry picked from commit 051207375b
)
2021-09-02 16:17:32 -05:00
Siyao Meng
226f94b4fc
HADOOP-17834. Bump aliyun-sdk-oss to 3.13.0 ( #3261 )
...
Change-Id: I335d4a2cb08c75dc24ef36bdfab51111f87e0762
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 3aaac8a1f6
)
2021-08-16 00:32:05 +09:00
Renukaprasad C
5b566c3914
HADOOP-17844. Upgrade JSON smart to 2.4.7 ( #3299 )
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit b90389ae98
)
Conflicts:
LICENSE-binary
2021-08-14 20:00:38 +09:00
Akira Ajisaka
025ecf42be
HADOOP-17370. Upgrade commons-compress to 1.21 ( #3274 )
...
(cherry picked from commit 3565c9477d
)
2021-08-08 11:25:26 +09:00
Renukaprasad C
d37192a613
HADOOP-17796. Upgrade jetty version to 9.4.43 ( #3208 )
...
(cherry picked from commit dbd255f4a9
)
2021-07-22 16:37:39 +08:00
Ahmed Hussein
22e7567475
HADOOP-17769. Upgrade JUnit to 4.13.2. fixes TestBlockRecovery ( #3130 ). Contributed by Ahmed Hussein. ( #3138 )
...
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
(cherry picked from commit 581f43dce1
)
2021-06-25 22:48:56 +05:30
Wei-Chiu Chuang
5cebd02bbe
HADOOP-17739. Use hadoop-thirdparty 1.1.1. ( #3064 )
...
Reviewed-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 9a0a808338
)
2021-06-01 11:36:27 +08:00
Steve Loughran
bb04b60197
HADOOP-17735. Upgrade AWS SDK to 1.11.1026 ( #3057 )
...
Change-Id: Ia9b32ab35454ada5f5e3d47b72cd9f2a2446a309
2021-05-31 21:49:39 +01:00
Takanobu Asanuma
d8689f1a08
Revert "HADOOP-17563. Update Bouncy Castle to 1.68. ( #2740 )" ( #3055 )
...
This reverts commit 0774116756
.
Reviewed-by: Wei-Chiu Chuang <weichiu@apache.org>
Reviewed-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 53ff2dfed3
)
2021-05-27 13:17:24 +09:00
Akira Ajisaka
86682a83aa
HADOOP-17663. Remove useless property hadoop.assemblies.version in pom file. ( #3025 )
...
Reviewed-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 3f5a66c158
)
Conflicts:
hadoop-project/pom.xml
2021-05-20 10:49:40 +09:00
Wei-Chiu Chuang
fa4915fdbb
Preparing for 3.3.2 development
2021-05-19 21:52:37 +08:00
Wei-Chiu Chuang
611ed04aff
HADOOP-17426. Upgrade to hadoop-thirdparty-1.1.0. ( #3024 )
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
Change-Id: Ibf27246b3eb1b074b938f44f4906db9184466303
(cherry picked from commit 2960d83c25
)
2021-05-19 14:57:45 +09:00
dependabot[bot]
b2897fdd66
HADOOP-17683. Update commons-io to 2.8.0 ( #2974 )
...
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Akira Ajisaka <aajisaka@apache.org>
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 29105ffb63
)
2021-05-12 10:58:39 +09:00
Wei-Chiu Chuang
99e4e9bad6
HADOOP-17661. mvn versions:set fails to parse pom.xml. ( #2956 )
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
Change-Id: I7de255cb9a167e3a5e25ae339b050e82cb4b7c30
(cherry picked from commit 64264d726d
)
2021-04-27 10:43:18 +09:00
Wei-Chiu Chuang
1425512032
Revert "HADOOP-17661. mvn versions:set fails to parse pom.xml. ( #2952 )"
...
This reverts commit d525e1e33d
.
2021-04-26 16:42:44 +08:00
Wei-Chiu Chuang
d525e1e33d
HADOOP-17661. mvn versions:set fails to parse pom.xml. ( #2952 )
...
Reviewed-by: Akira Ajisaka <aajisaka@apache.org>
Reviewed-by: Hui Fei <ferhui@apache.org>
(cherry picked from commit 66dda86fec
)
2021-04-26 14:07:35 +08:00
Akira Ajisaka
842714d99f
HADOOP-17655. Upgrade Jetty to 9.4.40. ( #2947 )
...
Reviewed-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 0b04c9694d
)
2021-04-23 19:53:30 +09:00
Viraj Jasani
49f6326a9f
HADOOP-17633. Bump json-smart to 2.4.2 and nimbus-jose-jwt to 9.8 due to CVEs ( #2895 ). Contributed by Viraj Jasani.
...
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2021-04-16 12:41:06 +05:30
Wei-Chiu Chuang
7f7535534d
HADOOP-17625. Update to Jetty 9.4.39. ( #2870 )
...
Reviewed-by: cxorm <lianp964@gmail.com>
(cherry picked from commit 6040e86e99
)
2021-04-08 14:28:03 +08:00
Wei-Chiu Chuang
cc0cc7ab5f
HADOOP-17614. Bump netty to the latest 4.1.61. ( #2850 )
...
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
(cherry picked from commit 29a6769b68
)
2021-04-05 08:37:10 +08:00
Akira Ajisaka
80d4636067
HADOOP-17602. Upgrade JUnit to 4.13.1. Contributed by Ahmed Hussein.
...
(cherry picked from commit c5929c00a3
)
Conflicts:
hadoop-cloud-storage-project/hadoop-huaweicloud/pom.xml
2021-03-25 19:54:51 +09:00
Mingliang Liu
23082ac6c7
YARN-10706. Upgrade com.github.eirslett:frontend-maven-plugin to 1.11.2 ( #2791 )
...
Contributed by Mingliang Liu.
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2021-03-21 21:14:12 -07:00
Ayush Saxena
28e89509a3
HADOOP-17586. Upgrade org.codehaus.woodstox:stax2-api to 4.2.1. ( #2769 ). Contributed by Ayush Saxena.
...
Signed-off-by: Mingliang Liu <liuml07@apache.org>
2021-03-13 15:10:27 +05:30
Viraj Jasani
36313b38cb
HADOOP-17571 : Bump up woodstox-core to 5.3.0 due to security concerns ( #2757 )
...
Contributed by Viraj Jasani.
Signed-off-by: Mingliang Liu <liuml07@apache.org>
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2021-03-11 11:55:09 -08:00
Akira Ajisaka
de2904f123
HADOOP-16870. Use spotbugs-maven-plugin instead of findbugs-maven-plugin ( #2753 )
...
Removed findbugs from the hadoop build images and added spotbugs instead.
Upgraded SpotBugs to 4.2.2 and spotbugs-maven-plugin to 4.2.0.
Reviewed-by: Masatake Iwasaki <iwasakims@apache.org>
(cherry picked from commit 23b343aed1
)
Conflicts:
dev-support/docker/Dockerfile
hadoop-project/pom.xml
2021-03-11 14:57:03 +09:00
Takanobu Asanuma
e607d03995
HADOOP-17563. Update Bouncy Castle to 1.68. ( #2740 )
...
(cherry picked from commit 0774116756
)
2021-03-05 22:59:09 +09:00
Masatake Iwasaki
cc42f5dafd
HADOOP-17538. Add kms-default.xml and httpfs-default.xml to site index. ( #2716 )
...
(cherry picked from commit e9a3c2950e
)
2021-02-23 22:55:10 +00:00
Akira Ajisaka
852db790d3
HADOOP-17534. Update Jackson to 2.10.5 and Jackson databind to 2.10.5.1 ( #2708 )
...
Reviewed-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit e119063a07
)
2021-02-22 17:34:43 +09:00
Akira Ajisaka
98eec71218
HADOOP-17516. Upgrade ant to 1.10.9. ( #2683 )
...
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
(cherry picked from commit 933fbeffee
)
2021-02-11 08:07:55 +09:00
Akira Ajisaka
7106a789f4
HDFS-15731. Reduce threadCount for unit tests to reduce the memory usage ( #2556 )
...
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
(cherry picked from commit 9cf408d6ba
)
2021-01-24 22:52:51 +09:00
Wei-Chiu Chuang
6340ac857b
HADOOP-17371. Bump Jetty to the latest version 9.4.34. Contributed by Wei-Chiu Chuang. ( #2453 )
...
(cherry picked from commit 66ee0a6df0
)
2021-01-04 11:28:26 -08:00
Liang-Chi Hsieh
87064df1f2
HADOOP-17292. Using lz4-java in Lz4Codec ( #2350 )
...
Contributed by Liang-Chi Hsieh.
2020-12-29 13:17:26 -08:00
He Xiaoqiao
3736f6eb57
HADOOP-17445. Update the year to 2021. Contributed by He Xiaoqiao.
2020-12-24 20:47:16 +08:00
Liang-Chi Hsieh
485e4e3348
HADOOP-17425. Bump up snappy-java to 1.1.8.2. ( #2536 )
...
(cherry picked from commit c2cecfc9b9
)
Conflicts:
hadoop-project/pom.xml
2020-12-10 13:58:49 +00:00
Masatake Iwasaki
3a50148809
HADOOP-17369. Bump up snappy-java to 1.1.8.1. ( #2451 )
...
(cherry picked from commit 0946f58cae
)
2020-12-10 13:57:35 +00:00
Ayush Saxena
8378ab9f92
HADOOP-17288. Use shaded guava from thirdparty. Contributed by Ayush Saxena. #2505
2020-12-10 05:50:55 +05:30
Steve Loughran
e4bc64cce0
HADOOP-17343. Upgrade AWS SDK to 1.11.901 ( #2468 )
...
Contributed by Steve Loughran.
2020-11-23 14:09:14 +00:00