Commit Graph

69 Commits

Author SHA1 Message Date
Gautham B A 1c0b2edde9
HADOOP-17727. Modularize docker images (#3043)
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
2021-06-07 20:11:08 -07:00
Wei-Chiu Chuang ad923ad564
HADOOP-17718. Explicitly set locale in the Dockerfile. (#3034)
Reviewed-by: Akira Ajisaka <aajisaka@apache.org>
2021-05-21 09:26:50 -07:00
Ayush Saxena fcd4140e5f
HDFS-15988. Stabilise HDFS Pre-Commit. (#2860). Contributed by Ayush Saxena.
Signed-off-by: He Xiaoqiao <hexiaoqiao@apache.org>
2021-05-16 00:45:11 +05:30
Akira Ajisaka 23b343aed1
HADOOP-16870. Use spotbugs-maven-plugin instead of findbugs-maven-plugin (#2753)
Removed findbugs from the hadoop build images and added spotbugs instead.
Upgraded SpotBugs to 4.2.2 and spotbugs-maven-plugin to 4.2.0.

Reviewed-by: Masatake Iwasaki <iwasakims@apache.org>
2021-03-11 10:56:07 +09:00
Akira Ajisaka b9b49ed956
HADOOP-16748. Migrate to Python 3 and upgrade Yetus to 0.13.0 (#1738)
- Upgrade Yetus to 0.13.0 to support Python 3 for the release scripts.
- Removed determine-flaky-tests-hadoop.py.
- Temporarily disabled shelldocs check due to YETUS-1099.

Reviewed-by: Inigo Goiri <inigoiri@apache.org>
Reviewed-by: Mingliang Liu <liuml07@apache.org>
2021-02-20 17:18:23 +09:00
Akira Ajisaka 9a298d180d
Revert "HADOOP-16870. Use spotbugs-maven-plugin instead of findbugs-maven-plugin (#2454)"
This reverts commit 4cf3531583.
2021-02-19 11:09:10 +09:00
Akira Ajisaka 4cf3531583
HADOOP-16870. Use spotbugs-maven-plugin instead of findbugs-maven-plugin (#2454)
Use spotbugs instead of findbugs. Removed findbugs from the hadoop build images,
and added spotbugs in the images instead.

Reviewed-by: Masatake Iwasaki <iwasakims@apache.org>
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
Reviewed-by: Dinesh Chitlangia <dineshc@apache.org>
2021-02-17 10:38:20 +09:00
Gautham B A 6c891c0dd4
HADOOP-17509. Parallelize building of dependencies (#2669)
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2021-02-03 00:09:30 +09:00
Gautham B A a9ff726e42
HADOOP-17496. Install a supported version of pip (#2653)
pip version 21 ended support for python 2.7. Thus we need to
install a version of pip that supports python 2.7.

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2021-01-26 23:06:38 +09:00
Gautham B A b441ca8699
HADOOP-17465. Upgrade to Focal (#2613) 2021-01-25 21:15:43 -08:00
Takanobu Asanuma d09e3c929f
HADOOP-17224. Install Intel ISA-L library in Dockerfile. (#2537) 2021-01-22 10:27:06 +09:00
Akira Ajisaka ae4945fb2c
YARN-10560. Upgrade node.js to 10.23.1 and yarn to 1.22.5 in Web UI v2. (#2592) 2021-01-06 12:12:46 +09:00
Takanobu Asanuma 4b312810ae
Revert "HADOOP-17224. Install Intel ISA-L library in Dockerfile. (#2243)" (#2440) 2020-11-06 11:20:45 +09:00
tkuramoto33 3fc007a37b
HADOOP-17282. libzstd-dev should be used instead of libzstd1-dev on Ubuntu 18.04 or higher. (#2336) 2020-09-25 14:17:50 +09:00
Wanqiang Ji ce86183691
HADOOP-17246. Fix build the hadoop-build Docker image failed (#2277) 2020-09-16 16:23:57 +09:00
Takanobu Asanuma 931adbaa14
HADOOP-17224. Install Intel ISA-L library in Dockerfile. (#2243) 2020-08-26 23:15:24 +09:00
Akira Ajisaka e277d338da
YARN-10367. Failed to get nodejs 10.21.0 when building docker image (#2171) 2020-07-27 00:51:44 +09:00
Gautham B A cce5a6f609
HDFS-15385 Upgrade boost library to 1.72 (#2051)
* Removed the asio-1.10.2 that was
  checked in under libhdfspp/third_party
  directory.
2020-07-15 13:39:48 +09:00
Akira Ajisaka cd188ea9f0
YARN-10331. Upgrade node.js to 10.21.0. (#2106) 2020-06-30 16:52:57 +09:00
Akira Ajisaka 9821b94c94
HADOOP-16888. [JDK11] Support JDK11 in the precommit job (#2012)
* Install JDK 11 in the docker image
* Refactor Dockerfile
* Add compile test with JDK11 via Yetus multijdk feature
2020-06-19 13:29:44 +09:00
Akira Ajisaka 5157118bd7
HADOOP-17056. Addendum patch: Fix typo 2020-06-04 16:34:46 +09:00
Akira Ajisaka 9c290c08db
HADOOP-17056. shelldoc fails in hadoop-common. (#2045)
In the docker build image, skip GPG verification when downloading
Yetus tarball via yetus-wrapper.
2020-06-03 18:01:37 +09:00
Wanqiang Ji d9838f2d42
HADOOP-17055. Remove residual code of Ozone (#2039) 2020-05-29 16:49:18 +09:00
Akira Ajisaka 81d8b71534
HADOOP-16054. Update Dockerfile to use Bionic (#1966) 2020-04-26 02:54:45 +09:00
Akira Ajisaka e6455cc864
HADOOP-16949. pylint fails in the build environment (#1926) 2020-04-04 16:52:04 +09:00
Akira Ajisaka 4454c6d14b
Revert "HADOOP-16054. Update Dockerfile to use Bionic." (#1911)
This reverts commit 367833cf41.
2020-03-24 22:05:33 +09:00
Akira Ajisaka 367833cf41
HADOOP-16054. Update Dockerfile to use Bionic.
Contributed by Akira Ajisaka.
2020-03-18 13:44:44 +00:00
Akira Ajisaka c44943d1fc
YARN-10054. Upgrade yarn to 1.21.1 in Dockerfile. (#1777) 2019-12-23 14:08:14 +09:00
Akira Ajisaka bc825b9628
YARN-10036. Install yarnpkg and upgrade nodejs in Dockerfile (#1772) 2019-12-23 10:30:26 +09:00
Kevin Su e573ea4908
HADOOP-16754. Fix docker failed to build yetus/hadoop.
Contributed by Kevin Su.

Change-Id: Ie9cf27b7a7ba5923405f24d39b95b0248f3718b7
2019-12-11 16:56:25 +00:00
Ayush Saxena 104ccca916 HDFS-14900. Fix build failure of hadoop-hdfs-native-client. Contributed by Masatake Iwasaki. 2019-10-10 21:36:02 +05:30
pingsutw 1dde3efb91
HADOOP-16624. Upgrade hugo to the latest version in Dockerfile
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2019-10-04 10:01:07 +09:00
Akira Ajisaka 0e026cb0ce
HADOOP-16620. [pb-upgrade] Remove protocol buffers 3.7.1 from requirements in BUILDING.txt (#1558)
* Removed protobuf 3.7.1 from Dockerfile
2019-10-03 15:24:47 +09:00
Vinayakumar B efed4450bf
HADOOP-16589. [pb-upgrade] Update docker image to make 3.7.1 protoc as default (#1482). Contributed by Vinayakumar B. 2019-09-21 10:07:26 +05:30
Vinayakumar B 39e82acc48 HADOOP-16562. [pb-upgrade] Update docker image to have 3.7.1 protoc executable (#1429).
Addendum patch. Moved protobuf-3.7.1 installation within YETUS marker.
2019-09-13 16:50:16 +05:30
Vinayakumar B f4f9f0fe4f
HADOOP-16562. [pb-upgrade] Update docker image to have 3.7.1 protoc executable (#1429). Contributed by Vinayakumar B. 2019-09-12 16:47:54 +05:30
Xieming Li bdbca0e53b
HADOOP-16052. Remove Subversion and Forrest from Dockerfile
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2019-04-11 19:56:15 +09:00
Akira Ajisaka 8f97d6f2cd
HADOOP-15822. zstd compressor can fail with a small output buffer. Contributed by Jason Lowe. 2018-10-24 13:49:28 +09:00
Allen Wittenauer 4b8c2b1c1c
HADOOP-14671. Upgrade Apache Yetus to 0.8.0
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-09-11 08:55:34 -07:00
Eric Yang ba1ab08fda HADOOP-15610. Fixed pylint version for Hadoop docker image.
Contributed by Jack Bearden
2018-07-18 20:09:43 -04:00
Anu Engineer abb62dd7ef HDFS-12702. Ozone: Add hugo to the dev docker image. Contributed by Elek, Marton. 2018-04-26 05:36:04 -07:00
James Clampffer 8620d2bdf9 HDFS-12110: libhdfs++: Rebase HDFS-8707 on trunk, minor conflict resolution in this patch. Contributed by Deepak Majeti and Anatoli Shein. 2018-03-22 17:19:47 -04:00
James Clampffer 033433bce7 HDFS-12026: libhdfs++: Fix compilation errors and warnings when compiling with Clang. Contributed by Anatoli Shein. 2018-03-22 17:19:47 -04:00
Bob Hansen 549a5dbce9 HDFS-10450: libhdfs++: Add Cyrus SASL support. Contributed by Don Davis. 2018-03-22 17:19:47 -04:00
James dba377bfcc HDFS-9448. Enable valgrind for libhdfspp unit tests. Contributed by Bob Hansen. 2018-03-22 17:19:46 -04:00
Allen Wittenauer d4cc50f622 HADOOP-15279. increase maven heap size recommendations
Signed-off-by: Jason Lowe <jlowe@apache.org>
Signed-off-by: Chris Douglas <cdouglas@apache.org>
2018-03-01 15:32:43 -08:00
Akira Ajisaka 5b98639400
HADOOP-14977. Xenial dockerfile needs ant in main build for findbugs
Signed-off-by: Allen Wittenauer <aw@apache.org>
2017-10-25 08:08:22 -07:00
Chris Douglas ca8ddc6aa4 HADOOP-14816. Update Dockerfile to use Xenial. Contributed by Allen Wittenauer 2017-10-19 16:45:18 -07:00
Akira Ajisaka 0de40f0e27
Revert "HADOOP-13514. Upgrade maven surefire plugin to 2.19.1."
This reverts commit 3d04c00aed.
2017-10-13 18:00:25 +09:00
Akira Ajisaka 3d04c00aed
HADOOP-13514. Upgrade maven surefire plugin to 2.19.1. 2017-10-11 10:42:32 +09:00