Commit Graph

156 Commits

Author SHA1 Message Date
Mukund Thakur 2daf0a814f HADOOP-11867. Add a high-performance vectored read API. (#3904)
part of HADOOP-18103.
Add support for multiple ranged vectored read api in PositionedReadable.
The default iterates through the ranges to read each synchronously,
but the intent is that FSDataInputStream subclasses can make more
efficient readers especially in object stores implementation.

Also added implementation in S3A where smaller ranges are merged and
sliced byte buffers are returned to the readers. All the merged ranged are
fetched from S3 asynchronously.

Contributed By: Owen O'Malley and Mukund Thakur
2022-06-22 17:29:32 +01:00
Viraj Jasani 0733e968ab
HADOOP-18224. Upgrade maven compiler plugin to 3.10.1 (#4267)
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2022-05-21 03:21:13 +09:00
Ashutosh Gupta 56cfd60617
HADOOP-17551. Upgrade maven-site-plugin to 3.11.0 (#4196)
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2022-04-21 22:16:12 +09:00
Viraj Jasani 66b72406bd
HADOOP-18131. Upgrade maven enforcer plugin and relevant dependencies (#4000)
Reviewed-by: Akira Ajisaka <aajisaka@apache.org>
Reviewed-by: Wei-Chiu Chuang <weichiu@apache.org>
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
2022-03-08 17:27:04 +09:00
Viraj Jasani 04b6b9a87b
HADOOP-16908. Prune Jackson 1 from the codebase and restrict it's usage for future (#3789)
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2021-12-20 16:01:34 +09:00
Szilard Nemeth 79cc7b46af YARN-10757. jsonschema2pojo-maven-plugin version is not defined. Contributed by Tamas Domok 2021-12-07 14:56:55 +01:00
Viraj Jasani 4dea4a7b67
HADOOP-18027. Include static imports in the maven plugin rules (#3733)
Reviewed-by: Steve Loughran <stevel@apache.org>
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
2021-12-01 16:48:43 +09:00
Viraj Jasani 215388beea
HADOOP-18022. Add restrict-imports-enforcer-rule for Guava Preconditions and remove remaining usages (#3712)
Reviewed-by: Akira Ajisaka <aajisaka@apache.org>
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
2021-11-29 17:37:30 +09:00
Viraj Jasani d96ce9c23a
HADOOP-17968 Migrate checkstyle module illegalimport to maven enforcer banned-illegal-imports (#3584)
Reviewed-by: Ahmed Hussein <ahussein@apache.org>
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
2021-10-28 15:57:15 +09:00
Viraj Jasani 516f36c6f1
HADOOP-17967. Keep restrict-imports-enforcer-rule for Guava VisibleForTesting in hadoop-main pom (#3555) 2021-10-21 16:54:25 +09:00
Wanqiang Ji c005195b78
HADOOP-17777. Update clover-maven-plugin version from 3.3.0 to 4.4.1 (#3152) 2021-06-29 18:32:16 -07:00
Viraj Jasani 4ef27a596f
HADOOP-17753. Keep restrict-imports-enforcer-rule for Guava Lists in top level hadoop-main pom (#3087) 2021-06-11 12:15:52 +09:00
Takanobu Asanuma b3c7254563
HADOOP-17750. Fix asf license errors in newly added files by HADOOP-17727. (#3083)
Reviewed-by: Viraj Jasani <vjasani@apache.org>
Reviewed-by: Masatake Iwasaki <iwasakims@apache.org>
Reviewed-by: Akira Ajisaka <aajisaka@apache.org>
Reviewed-by: Gautham B A <gautham.bangalore@gmail.com>
2021-06-09 15:32:07 +09:00
Viraj Jasani 986d0a4f1d
HADOOP-17732. Keep restrict-imports-enforcer-rule for Guava Sets in hadoop-main pom (#3049)
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
2021-05-26 17:14:31 +09:00
Viraj Jasani 62bcc79a2c
HADOOP-17676. Restrict imports from org.apache.curator.shaded (#2969)
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2021-05-04 01:10:26 +09:00
Akira Ajisaka 23b343aed1
HADOOP-16870. Use spotbugs-maven-plugin instead of findbugs-maven-plugin (#2753)
Removed findbugs from the hadoop build images and added spotbugs instead.
Upgraded SpotBugs to 4.2.2 and spotbugs-maven-plugin to 4.2.0.

Reviewed-by: Masatake Iwasaki <iwasakims@apache.org>
2021-03-11 10:56:07 +09:00
Akira Ajisaka 9a298d180d
Revert "HADOOP-16870. Use spotbugs-maven-plugin instead of findbugs-maven-plugin (#2454)"
This reverts commit 4cf3531583.
2021-02-19 11:09:10 +09:00
Akira Ajisaka 4cf3531583
HADOOP-16870. Use spotbugs-maven-plugin instead of findbugs-maven-plugin (#2454)
Use spotbugs instead of findbugs. Removed findbugs from the hadoop build images,
and added spotbugs in the images instead.

Reviewed-by: Masatake Iwasaki <iwasakims@apache.org>
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
Reviewed-by: Dinesh Chitlangia <dineshc@apache.org>
2021-02-17 10:38:20 +09:00
Brahma Reddy Battula 3eeb2466e9 upate the hadoop.version property in the root pom.xml and hadoop.assemblies.version in hadoop-project/pom.xml (see HADOOP-15369) 2020-03-29 23:44:20 +05:30
Brahma Reddy Battula 8914cf9167 Preparing for 3.4.0 development 2020-03-29 23:24:25 +05:30
dependabot[bot] fafe78fea7
Bump checkstyle from 8.26 to 8.29 (#1828)
Bumps [checkstyle](https://github.com/checkstyle/checkstyle) from 8.26 to 8.29.
- [Release notes](https://github.com/checkstyle/checkstyle/releases)
- [Commits](https://github.com/checkstyle/checkstyle/compare/checkstyle-8.26...checkstyle-8.29)

Signed-off-by: dependabot[bot] <support@github.com>
2020-02-07 19:32:10 +09:00
Zhankun Tang d40d7cc4f9 HADOOP-16670. Stripping Submarine code from Hadoop codebase. Contributed by Zhankun Tang.
Reviewed-by: Akira Ajisaka <aajisaka@apache.org>
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2020-01-21 20:07:31 -08:00
Akira Ajisaka f777cd398f
HADOOP-16771. Update checkstyle to 8.26 and maven-checkstyle-plugin to 3.1.0. Contributed by Andras Bokor. 2019-12-20 13:10:26 +09:00
Wanqiang Ji dfc61d8ea5 HADOOP-16719. Remove the disallowed element config within maven-checkstyle-plugin (#1724) 2019-11-20 16:18:56 +09:00
Sandeep Nemuri 9f0610fb83 HADOOP-16654:Delete hadoop-ozone and hadoop-hdds subprojects from apache trunk
Signed-off-by: Dinesh Chitlangia <dineshchitlangia@gmail.com>
2019-11-15 14:53:28 -05:00
Eric Yang ac6b6a6a85 HADOOP-16614. Add aarch64 support for dependent leveldbjni.
Contributed by liusheng
close #1546
2019-10-24 11:45:57 -04:00
Akira Ajisaka dacc44821d
HADOOP-15184. Add GitHub pull request template. (#1419) 2019-09-11 11:10:11 +09:00
Nanda kumar ac5a0ae6d0
HADOOP-16534. Exclude submarine from hadoop source build. (#1356) 2019-09-03 17:40:38 +05:30
Nanda kumar 22a58615a2
HDDS-2058. Remove hadoop dependencies in ozone build
Closes #1376
2019-08-30 10:21:04 +02:00
Akira Ajisaka 567091aa9b
HADOOP-15958. Revisiting LICENSE and NOTICE files.
This closes #1307

Reviewed-by: Masatake Iwasaki <iwasakims@apache.org>
2019-08-27 13:47:12 +09:00
Zhankun Tang cd17cc2868 SUBMARINE-89. Add submarine-src profile to generate source package. Contributed by Sunil Govindan. 2019-06-05 10:44:44 +08:00
Akira Ajisaka afd844059c HADOOP-16331. Fix ASF License check in pom.xml
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
2019-05-29 17:25:13 +09:00
Akira Ajisaka 9f933e6446
HADOOP-16323. https everywhere in Maven settings. 2019-05-27 15:24:59 +09:00
Akira Ajisaka 4b4fef2f0e
HADOOP-16227. Upgrade checkstyle to 8.19 2019-04-15 10:46:10 +09:00
Sunil G 09a9938db7 SUBMARINE-41. Fix ASF warnings related to submarine target files. Contributed by Dinesh Chitlangia. This closes #559. 2019-03-07 10:36:32 +05:30
Sunil G 9057aa9fc5 SUBMARINE-1. Move code base of submarine from yarn-applications to top directory. Contributed by Wangda Tan. 2019-02-17 20:03:56 +05:30
Dinesh Chitlangia 47d6b9bb7f
HADOOP-16075. Upgrade checkstyle version to 8.16.
Contributed by Dinesh Chitlangia.
2019-01-27 16:59:28 +00:00
Bharat Viswanadham a4b9b7c130 HDDS-702:Used fixed/external version from hadoop jars in hdds/ozone projects. Contributed by Elek Marton. 2018-10-25 16:26:48 -07:00
Márton Elek 600438bcde HDDS-602. Bump Ozone version to 0.4.0-SNAPSHOT after ozone-0.3 branch cut. 2018-10-09 19:04:25 +02:00
Robert Kanter 96ae4ac45f Changed version in trunk to 3.3.0-SNAPSHOT addendum 2018-10-02 16:48:59 -07:00
Sunil G 58fa96b697 Changed version in trunk to 3.3.0-SNAPSHOT. 2018-10-02 22:41:41 +05:30
Takanobu Asanuma 281c192e7f
[JDK10] Upgrade Maven Javadoc Plugin from 3.0.0-M1 to 3.0.1.
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-09-18 09:32:27 +09:00
Bharat Viswanadham 8b2f5e60fa HDDS-352. Separate install and testing phases in acceptance tests. Contributed by Elek Marton. 2018-09-17 17:13:52 -07:00
Márton Elek 94ed5cffd7 HDDS-214. Bump ozone/hdds version after the release branch cut 2018-09-07 17:45:26 +02:00
Sean Mackrory 1da3b55659 HADOOP-15504. Upgrade Maven Core and Maven Wagon dependencies. 2018-06-15 16:06:26 -06:00
Bharat Viswanadham a58acd9080 HADOOP-15490:Multiple declaration of maven-enforcer-plugin found in pom.xml. Contributed by Nanda kumar 2018-05-31 10:56:17 -07:00
Anu Engineer 699a6918ac HDDS-110. Checkstyle is not working in the HDDS precommit hook.
Contributed by Elek, Marton.
2018-05-23 10:01:53 -07:00
Xiaoyu Yao 9da4caee89 HDFS-13422. Ozone: Fix whitespaces and license issues in HDFS-7240 branch. Contributed by Lokesh Jain. 2018-04-26 05:36:04 -07:00
Xiaoyu Yao 20dab05564 HDFS-13407. Ozone: Use separated version schema for Hdds/Ozone projects. Contributed by Elek Marton. 2018-04-26 05:36:04 -07:00
Mukul Kumar Singh ec6c8742e5 HDFS-13415. Ozone: Remove cblock code from HDFS-7240. Contributed by Elek, Marton. 2018-04-26 05:36:04 -07:00