Commit Graph

740 Commits

Author SHA1 Message Date
Steve Loughran d8ab84275e
HADOOP-18068. upgrade AWS SDK to 1.12.132 (#3864)
With this update, the versions of key shaded dependencies are

  jackson    2.12.3
  httpclient 4.5.13

Contributed by Steve Loughran
2022-01-18 10:31:28 +00:00
Steve Loughran 14ba19af06
HADOOP-17409. Remove s3guard from S3A module (#3534)
Completely removes S3Guard support from the S3A codebase.

If the connector is configured to use any metastore other than
the null and local stores (i.e. DynamoDB is selected) the s3a client
will raise an exception and refuse to initialize.

This is to ensure that there is no mix of S3Guard enabled and disabled
deployments with the same configuration but different hadoop releases
-it must be turned off completely.

The "hadoop s3guard" command has been retained -but the supported
subcommands have been reduced to those which are not purely S3Guard
related: "bucket-info" and "uploads".

This is major change in terms of the number of files
changed; before cherry picking subsequent s3a patches into
older releases, this patch will probably need backporting
first.

Goodbye S3Guard, your work is done. Time to die.

Contributed by Steve Loughran.
2022-01-17 18:08:57 +00:00
Viraj Jasani f64fda0f00
HADOOP-18055. Async Profiler endpoint for Hadoop daemons (#3824)
Reviewed-by: Akira Ajisaka <aajisaka@apache.org>
2022-01-06 17:56:49 +08:00
Ayush Saxena 0c51dec124
HADOOP-18061. Update the year to 2022. (#3845). Contributed by Ayush Saxena.
Reviewed-by: Akira Ajisaka <aajisaka@apache.org>
2022-01-04 07:48:03 +05:30
Igor Dvorzhak 795054882a
HADOOP-13464. Upgrade Gson dependency to version 2.8.9 (#2524)
Change-Id: Ifd3fb9ec6ebfc8874bb799bc198219511fe55a2f

Update pom.xml

Update pom.xml
2021-12-30 13:27:54 -08:00
Viraj Jasani 6185056f4d
YARN-11047. ResourceManager and NodeManager unable to connect to Hbase when ATSv2 is enabled (#3802) 2021-12-20 18:02:57 +08:00
Viraj Jasani 04b6b9a87b
HADOOP-16908. Prune Jackson 1 from the codebase and restrict it's usage for future (#3789)
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2021-12-20 16:01:34 +09:00
Wei-Chiu Chuang bdec546671
Revert "HDFS-16384. Upgrade Netty to 4.1.72.Final (#3798)"
This reverts commit a4557f9ed9.
2021-12-16 21:27:08 +08:00
Tamás Pénzes a4557f9ed9
HDFS-16384. Upgrade Netty to 4.1.72.Final (#3798) 2021-12-16 12:38:42 +08:00
Akira Ajisaka 40464a5e6c
HADOOP-18043. Use mina-core 2.0.22 to fix LDAP unit test failures (#3792)
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
2021-12-13 17:49:22 +09:00
Viraj Jasani 4e326f0c97
HADOOP-18039. Upgrade hbase2 version and fix TestTimelineWriterHBaseDown (#3768)
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2021-12-13 14:03:32 +09:00
Akira Ajisaka 9b9e2ef87f
HADOOP-18040. Use maven.test.failure.ignore instead of ignoreTestFailure (#3774)
Reviewed-by: Masatake Iwasaki <iwasakims@apache.org>
2021-12-10 01:36:31 +09:00
better3471 b85c66a035
HADOOP-18001. Upgrade jetty version to 9.4.44 (#3700). Contributed by Yuan Luo.
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2021-12-09 13:16:10 +05:30
dependabot[bot] 8d9dec7e80
HADOOP-18034. Bump mina-core from 2.0.16 to 2.1.5 in /hadoop-project. (#3706)
Reviewed-by: Akira Ajisaka <aajisaka@apache.org>
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-12-09 00:08:54 +05:30
Viraj Jasani 53edd0de5a
HADOOP-18033. Upgrade fasterxml Jackson to 2.13.0 (#3749)
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2021-12-08 16:52:22 +09:00
Viraj Jasani b34dcb5b3a
HADOOP-18025. Upgrade HBase version to 1.7.1 for hbase1 profile (#3722) 2021-12-02 10:40:30 +08:00
Renukaprasad C b923fa7a1c
HADOOP-17946. Upgrade commons-lang to 3.12.0 (#3575) 2021-10-26 09:16:50 +08:00
Takanobu Asanuma cf4d2d826c
HADOOP-17955. Bump netty to the latest 4.1.68. (#3528)
Reviewed-by: Masatake Iwasaki <iwasakims@apache.org>
2021-10-08 10:34:51 +09:00
Warren Zhu 1db5eb43ad
HADOOP-17941. Update xerces to 2.12.1 (#3496)
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2021-09-29 18:48:52 +09:00
Takanobu Asanuma 2068b0041c
HADOOP-17940. Upgrade Kafka to 2.8.1 (#3488)
Reviewed-by: Masatake Iwasaki <iwasakims@apache.org>
2021-09-28 13:21:55 +09:00
Dongjoon Hyun b79cacf97b
HADOOP-17939. Support building on Apple Silicon (#3486)
Support building on Apple Silicon with ARM CPUs by using the x86_64 version of protoc.

Contributed by  Dongjoon Hyun
2021-09-27 13:27:10 +01:00
Ahmed Hussein 051207375b
HADOOP-17886. Upgrade ant to 1.10.11 (#3371) 2021-09-02 16:11:07 -05:00
Siyao Meng 3aaac8a1f6
HADOOP-17834. Bump aliyun-sdk-oss to 3.13.0 (#3261)
Change-Id: I335d4a2cb08c75dc24ef36bdfab51111f87e0762
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2021-08-14 21:19:10 +09:00
Renukaprasad C b90389ae98
HADOOP-17844. Upgrade JSON smart to 2.4.7 (#3299)
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2021-08-14 19:55:32 +09:00
Akira Ajisaka 3565c9477d
HADOOP-17370. Upgrade commons-compress to 1.21 (#3274) 2021-08-08 11:23:28 +09:00
Tamas Domok a5811dda7b
YARN-10874. Refactor NM ContainerLaunch#getEnvDependencies's unit tests (#3248)
Co-authored-by: Tamas Domok <tdomok@cloudera.com>
2021-08-03 16:19:04 +02:00
Viraj Jasani ccfa072dc7
HADOOP-17612. Upgrade Zookeeper to 3.6.3 and Curator to 5.2.0 (#3241)
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2021-08-03 14:44:00 +09:00
Akira Ajisaka 4c35466359
HADOOP-17317. [JDK 11] Upgrade dnsjava to remove illegal access warnings (#2442)
Reviewed-by: Masatake Iwasaki <iwasakims@apache.org>
2021-07-24 14:48:25 +09:00
Renukaprasad C dbd255f4a9
HADOOP-17796. Upgrade jetty version to 9.4.43 (#3208) 2021-07-22 01:15:00 -07:00
Viraj Jasani d0ee065cc4
HADOOP-16272. Upgrade HikariCP to 4.0.3 (#3204)
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2021-07-16 12:17:17 +09:00
Ahmed Hussein 581f43dce1
HADOOP-17769. Upgrade JUnit to 4.13.2. fixes TestBlockRecovery (#3130). Contributed by Ahmed Hussein.
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2021-06-24 17:57:52 +05:30
Wei-Chiu Chuang 9a0a808338
HADOOP-17739. Use hadoop-thirdparty 1.1.1. (#3064)
Reviewed-by: Akira Ajisaka <aajisaka@apache.org>
2021-05-31 20:34:48 -07:00
Steve Loughran bd7b97ba13
HADOOP-17735. Upgrade AWS SDK to 1.11.1026 (#3057) 2021-05-31 21:43:26 +01:00
Takanobu Asanuma 53ff2dfed3
Revert "HADOOP-17563. Update Bouncy Castle to 1.68. (#2740)" (#3055)
This reverts commit 0774116756.

Reviewed-by: Wei-Chiu Chuang <weichiu@apache.org>
Reviewed-by: Akira Ajisaka <aajisaka@apache.org>
2021-05-27 13:14:17 +09:00
Akira Ajisaka 3f5a66c158
HADOOP-17663. Remove useless property hadoop.assemblies.version in pom file. (#3025)
Reviewed-by: Wei-Chiu Chuang <weichiu@apache.org>
2021-05-20 10:47:33 +09:00
Wei-Chiu Chuang 2960d83c25
HADOOP-17426. Upgrade to hadoop-thirdparty-1.1.0. (#3024)
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>

Change-Id: Ibf27246b3eb1b074b938f44f4906db9184466303
2021-05-19 14:55:47 +09:00
dependabot[bot] 29105ffb63
HADOOP-17683. Update commons-io to 2.8.0 (#2974)
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Akira Ajisaka <aajisaka@apache.org>
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2021-05-12 10:57:45 +09:00
Wei-Chiu Chuang 64264d726d
HADOOP-17661. mvn versions:set fails to parse pom.xml. (#2956)
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>

Change-Id: I7de255cb9a167e3a5e25ae339b050e82cb4b7c30
2021-04-27 10:42:42 +09:00
Wei-Chiu Chuang bbf62a0562 Revert "HADOOP-17661. mvn versions:set fails to parse pom.xml. (#2952)"
This reverts commit 66dda86fec.
2021-04-26 16:42:32 +08:00
Viraj Jasani 538ce9c354
HADOOP-17650. Bump solr to unblock build failure with Maven 3.8.1 (#2939)
Reviewed-by: Siyao Meng <siyao@apache.org>
2021-04-25 23:48:39 -07:00
Wei-Chiu Chuang 66dda86fec
HADOOP-17661. mvn versions:set fails to parse pom.xml. (#2952)
Reviewed-by: Akira Ajisaka <aajisaka@apache.org>
Reviewed-by: Hui Fei <ferhui@apache.org>
2021-04-25 23:04:52 -07:00
Akira Ajisaka 0b04c9694d
HADOOP-17655. Upgrade Jetty to 9.4.40. (#2947)
Reviewed-by: Wei-Chiu Chuang <weichiu@apache.org>
2021-04-23 19:52:41 +09:00
Viraj Jasani f182798695
HADOOP-17633. Bump json-smart to 2.4.2 and nimbus-jose-jwt to 9.8 due to CVEs (#2895). Contributed by Viraj Jasani.
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2021-04-16 12:36:01 +05:30
Wei-Chiu Chuang 6040e86e99
HADOOP-17625. Update to Jetty 9.4.39. (#2870)
Reviewed-by: cxorm <lianp964@gmail.com>
2021-04-07 23:25:11 -07:00
Wei-Chiu Chuang 29a6769b68
HADOOP-17614. Bump netty to the latest 4.1.61. (#2850)
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
2021-04-04 17:35:30 -07:00
Akira Ajisaka c5929c00a3
HADOOP-17602. Upgrade JUnit to 4.13.1. Contributed by Ahmed Hussein. 2021-03-25 19:53:30 +09:00
Mingliang Liu 648bbbdad6
YARN-10706. Upgrade com.github.eirslett:frontend-maven-plugin to 1.11.2 (#2791)
Contributed by Mingliang Liu.

Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2021-03-21 21:12:27 -07:00
Ayush Saxena 167603ba0d
HADOOP-17586. Upgrade org.codehaus.woodstox:stax2-api to 4.2.1. (#2769). Contributed by Ayush Saxena.
Signed-off-by: Mingliang Liu <liuml07@apache.org>
2021-03-13 15:09:03 +05:30
Viraj Jasani 54ae6bcfc3
HADOOP-17571 : Bump up woodstox-core to 5.3.0 due to security concerns (#2757)
Contributed by Viraj Jasani.

Signed-off-by: Mingliang Liu <liuml07@apache.org>
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2021-03-11 11:51:24 -08:00
Akira Ajisaka 23b343aed1
HADOOP-16870. Use spotbugs-maven-plugin instead of findbugs-maven-plugin (#2753)
Removed findbugs from the hadoop build images and added spotbugs instead.
Upgraded SpotBugs to 4.2.2 and spotbugs-maven-plugin to 4.2.0.

Reviewed-by: Masatake Iwasaki <iwasakims@apache.org>
2021-03-11 10:56:07 +09:00