Commit Graph

19 Commits

Author SHA1 Message Date
Mukund Thakur 2daf0a814f HADOOP-11867. Add a high-performance vectored read API. (#3904)
part of HADOOP-18103.
Add support for multiple ranged vectored read api in PositionedReadable.
The default iterates through the ranges to read each synchronously,
but the intent is that FSDataInputStream subclasses can make more
efficient readers especially in object stores implementation.

Also added implementation in S3A where smaller ranges are merged and
sliced byte buffers are returned to the readers. All the merged ranged are
fetched from S3 asynchronously.

Contributed By: Owen O'Malley and Mukund Thakur
2022-06-22 17:29:32 +01:00
Ashutosh Gupta 84b0455cf8
HADOOP-18240. Upgrade Yetus to 0.14.0 (#4328)
Co-authored-by: Ashutosh Gupta <ashugpt@amazon.com>
Reviewed-by: Chris Nauroth <cnauroth@apache.org>
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2022-05-25 17:31:18 +09:00
Gautham B A bccf2f3ef4
HADOOP-17985. Disable JIRA plugin for Yetus run (#3601)
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2021-11-01 02:18:23 +09:00
Ayush Saxena 4d18a2eb99
HADOOP-17904. Test Result Not Working In Jenkins Result. (#3413). Contributed by Ayush Saxena. 2021-09-11 05:15:54 +05:30
Gautham B A c8e5864838
HADOOP-17854. Run junit in Jenkins only if surefire reports exist (#3319) 2021-08-24 10:26:26 -07:00
Gautham B A 4fd97e01e5
HADOOP-17787. Refactor fetching of credentials in Jenkins (#3167) 2021-08-06 11:56:27 -07:00
Gautham B A 13467f4524
HADOOP-17815. Run CI for Centos 7 (#3231) 2021-07-29 10:50:57 -07:00
Gautham B A 97c88c97de
HADOOP-17807. Use separate src dir for platform builds (#3210) 2021-07-26 13:09:36 -07:00
Gautham B A 7c999e2d9a
HADOOP-17778. CI for Centos 8 (#3151) 2021-06-30 22:04:54 -07:00
Gautham B A ef5dbc7283
HADOOP-17766. CI for Debian 10 (#3129) 2021-06-23 10:02:33 -07:00
Takanobu Asanuma ae9630f580
HADOOP-17756. Increase precommit job timeout from 20 hours to 24 hours. (#3090)
Reviewed-by: Akira Ajisaka <aajisaka@apache.org>
Reviewed-by: Viraj Jasani <vjasani@apache.org>
2021-06-14 10:17:39 +09:00
Gautham B A 02b9506c5a
HDFS-15948. Fix test4tests for libhdfspp (#2873)
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2021-04-07 19:06:25 +09:00
Akira Ajisaka 2b62b12d0d
HADOOP-17582. Replace GitHub App Token with GitHub OAuth token (#2766)
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
2021-03-12 18:04:00 +09:00
Akira Ajisaka 9b78de2550
HADOOP-17570. Apply YETUS-1102 to re-enable GitHub comments (#2745)
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
2021-03-11 21:48:47 +09:00
Akira Ajisaka 23b343aed1
HADOOP-16870. Use spotbugs-maven-plugin instead of findbugs-maven-plugin (#2753)
Removed findbugs from the hadoop build images and added spotbugs instead.
Upgraded SpotBugs to 4.2.2 and spotbugs-maven-plugin to 4.2.0.

Reviewed-by: Masatake Iwasaki <iwasakims@apache.org>
2021-03-11 10:56:07 +09:00
Akira Ajisaka b9b49ed956
HADOOP-16748. Migrate to Python 3 and upgrade Yetus to 0.13.0 (#1738)
- Upgrade Yetus to 0.13.0 to support Python 3 for the release scripts.
- Removed determine-flaky-tests-hadoop.py.
- Temporarily disabled shelldocs check due to YETUS-1099.

Reviewed-by: Inigo Goiri <inigoiri@apache.org>
Reviewed-by: Mingliang Liu <liuml07@apache.org>
2021-02-20 17:18:23 +09:00
Akira Ajisaka 9a298d180d
Revert "HADOOP-16870. Use spotbugs-maven-plugin instead of findbugs-maven-plugin (#2454)"
This reverts commit 4cf3531583.
2021-02-19 11:09:10 +09:00
Akira Ajisaka 4cf3531583
HADOOP-16870. Use spotbugs-maven-plugin instead of findbugs-maven-plugin (#2454)
Use spotbugs instead of findbugs. Removed findbugs from the hadoop build images,
and added spotbugs in the images instead.

Reviewed-by: Masatake Iwasaki <iwasakims@apache.org>
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
Reviewed-by: Dinesh Chitlangia <dineshc@apache.org>
2021-02-17 10:38:20 +09:00
Akira Ajisaka 84b154ebc0
HADOOP-17354. Move Jenkinsfile outside of the root directory. (#2647)
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
2021-02-01 18:51:00 +09:00