Commit Graph

87 Commits

Author SHA1 Message Date
Chris Nauroth 14c5810d5e HADOOP-18680: Insufficient heap during full test runs in Docker container.
Closes #5522

Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2023-04-03 22:53:29 +00:00
Gautham B A 5694d7e25f
Add Dockerfile_windows_10 (#4936) 2022-10-12 09:30:54 -07:00
Gautham B A 7ac271307c
HADOOP-18274. Use CMake 3.19.0 in Debian 10 (#4395) 2022-06-02 11:16:05 -07:00
Gautham B A 712e009172
HADOOP-18268. Install maven from Apache archives (#4373)
* The remote server hosting maven
  was temporarily unavailable causing
  the Hadoop Jenkins CI to fail.
* Thus, we're switching to use a CDN
  to mitigate such issues.
2022-06-02 17:05:18 +05:30
Gautham B A 19561846df
HADOOP-18151. Switch the baseurl for Centos 8 (#4047)
* Centos 8 has reached its
  End-of-Life and thus its
  packages are no longer
  accessible from
  mirror.centos.org.
* This PR switches the baseurl
  to vault.centos.org where
  the packages are archived.
2022-03-05 07:11:22 +05:30
Gautham B A d6eb077247
HADOOP-17902. Fix Hadoop build on Debian 10 (#3408) 2021-09-18 11:51:33 -07:00
Gautham B A 16ca362564
HADOOP-17913. Filter deps with release labels (#3437) 2021-09-16 09:18:58 -07:00
Gautham B A 13467f4524
HADOOP-17815. Run CI for Centos 7 (#3231) 2021-07-29 10:50:57 -07:00
Masatake Iwasaki c42441a1ec
HADOOP-17775. Remove JavaScript package from Docker environment. (#3137)
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2021-07-07 11:07:10 +09:00
Gautham B A 7c999e2d9a
HADOOP-17778. CI for Centos 8 (#3151) 2021-06-30 22:04:54 -07:00
Gautham B A ef5dbc7283
HADOOP-17766. CI for Debian 10 (#3129) 2021-06-23 10:02:33 -07:00
Gautham B A 51991c4907
HADOOP-17724. Add Dockerfile for Debian 10 (#3038) 2021-06-17 10:14:44 -07:00
Gautham B A 1c0b2edde9
HADOOP-17727. Modularize docker images (#3043)
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
2021-06-07 20:11:08 -07:00
Wei-Chiu Chuang 1576f81dfe
HADOOP-17723. [build] fix the Dockerfile for ARM (#3037)
Reviewed-by: Akira Ajisaka <aajisaka@apache.org>
2021-05-24 03:19:58 -07:00
Wei-Chiu Chuang ad923ad564
HADOOP-17718. Explicitly set locale in the Dockerfile. (#3034)
Reviewed-by: Akira Ajisaka <aajisaka@apache.org>
2021-05-21 09:26:50 -07:00
Ayush Saxena fcd4140e5f
HDFS-15988. Stabilise HDFS Pre-Commit. (#2860). Contributed by Ayush Saxena.
Signed-off-by: He Xiaoqiao <hexiaoqiao@apache.org>
2021-05-16 00:45:11 +05:30
Gautham B A 2e58fb671b
HADOOP-17693. Dockerfile for building on Centos 8 (#3006) 2021-05-13 09:28:27 -07:00
Gautham B A 8f850b46a0
HADOOP-17678. Add Dockerfile for Centos 7 (#2967) 2021-05-10 10:05:14 -07:00
Akira Ajisaka 23b343aed1
HADOOP-16870. Use spotbugs-maven-plugin instead of findbugs-maven-plugin (#2753)
Removed findbugs from the hadoop build images and added spotbugs instead.
Upgraded SpotBugs to 4.2.2 and spotbugs-maven-plugin to 4.2.0.

Reviewed-by: Masatake Iwasaki <iwasakims@apache.org>
2021-03-11 10:56:07 +09:00
Akira Ajisaka b9b49ed956
HADOOP-16748. Migrate to Python 3 and upgrade Yetus to 0.13.0 (#1738)
- Upgrade Yetus to 0.13.0 to support Python 3 for the release scripts.
- Removed determine-flaky-tests-hadoop.py.
- Temporarily disabled shelldocs check due to YETUS-1099.

Reviewed-by: Inigo Goiri <inigoiri@apache.org>
Reviewed-by: Mingliang Liu <liuml07@apache.org>
2021-02-20 17:18:23 +09:00
Akira Ajisaka 9a298d180d
Revert "HADOOP-16870. Use spotbugs-maven-plugin instead of findbugs-maven-plugin (#2454)"
This reverts commit 4cf3531583.
2021-02-19 11:09:10 +09:00
Akira Ajisaka 4cf3531583
HADOOP-16870. Use spotbugs-maven-plugin instead of findbugs-maven-plugin (#2454)
Use spotbugs instead of findbugs. Removed findbugs from the hadoop build images,
and added spotbugs in the images instead.

Reviewed-by: Masatake Iwasaki <iwasakims@apache.org>
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
Reviewed-by: Dinesh Chitlangia <dineshc@apache.org>
2021-02-17 10:38:20 +09:00
Gautham B A 6c891c0dd4
HADOOP-17509. Parallelize building of dependencies (#2669)
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2021-02-03 00:09:30 +09:00
Gautham B A a9ff726e42
HADOOP-17496. Install a supported version of pip (#2653)
pip version 21 ended support for python 2.7. Thus we need to
install a version of pip that supports python 2.7.

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2021-01-26 23:06:38 +09:00
Gautham B A b441ca8699
HADOOP-17465. Upgrade to Focal (#2613) 2021-01-25 21:15:43 -08:00
Takanobu Asanuma d09e3c929f
HADOOP-17224. Install Intel ISA-L library in Dockerfile. (#2537) 2021-01-22 10:27:06 +09:00
Akira Ajisaka ae4945fb2c
YARN-10560. Upgrade node.js to 10.23.1 and yarn to 1.22.5 in Web UI v2. (#2592) 2021-01-06 12:12:46 +09:00
Takanobu Asanuma 4b312810ae
Revert "HADOOP-17224. Install Intel ISA-L library in Dockerfile. (#2243)" (#2440) 2020-11-06 11:20:45 +09:00
tkuramoto33 3fc007a37b
HADOOP-17282. libzstd-dev should be used instead of libzstd1-dev on Ubuntu 18.04 or higher. (#2336) 2020-09-25 14:17:50 +09:00
Wanqiang Ji ce86183691
HADOOP-17246. Fix build the hadoop-build Docker image failed (#2277) 2020-09-16 16:23:57 +09:00
Takanobu Asanuma 931adbaa14
HADOOP-17224. Install Intel ISA-L library in Dockerfile. (#2243) 2020-08-26 23:15:24 +09:00
Akira Ajisaka e277d338da
YARN-10367. Failed to get nodejs 10.21.0 when building docker image (#2171) 2020-07-27 00:51:44 +09:00
Gautham B A cce5a6f609
HDFS-15385 Upgrade boost library to 1.72 (#2051)
* Removed the asio-1.10.2 that was
  checked in under libhdfspp/third_party
  directory.
2020-07-15 13:39:48 +09:00
zhaorenhai 6c57be4897
HADOOP-17084 Update Dockerfile_aarch64 to use Bionic (#2103). Contributed by zhaorenhai.
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2020-07-01 15:27:11 +05:30
Akira Ajisaka cd188ea9f0
YARN-10331. Upgrade node.js to 10.21.0. (#2106) 2020-06-30 16:52:57 +09:00
Akira Ajisaka 9821b94c94
HADOOP-16888. [JDK11] Support JDK11 in the precommit job (#2012)
* Install JDK 11 in the docker image
* Refactor Dockerfile
* Add compile test with JDK11 via Yetus multijdk feature
2020-06-19 13:29:44 +09:00
Akira Ajisaka 5157118bd7
HADOOP-17056. Addendum patch: Fix typo 2020-06-04 16:34:46 +09:00
Akira Ajisaka 9c290c08db
HADOOP-17056. shelldoc fails in hadoop-common. (#2045)
In the docker build image, skip GPG verification when downloading
Yetus tarball via yetus-wrapper.
2020-06-03 18:01:37 +09:00
Wanqiang Ji d9838f2d42
HADOOP-17055. Remove residual code of Ozone (#2039) 2020-05-29 16:49:18 +09:00
Akira Ajisaka 81d8b71534
HADOOP-16054. Update Dockerfile to use Bionic (#1966) 2020-04-26 02:54:45 +09:00
Akira Ajisaka e6455cc864
HADOOP-16949. pylint fails in the build environment (#1926) 2020-04-04 16:52:04 +09:00
Akira Ajisaka 4454c6d14b
Revert "HADOOP-16054. Update Dockerfile to use Bionic." (#1911)
This reverts commit 367833cf41.
2020-03-24 22:05:33 +09:00
Akira Ajisaka 367833cf41
HADOOP-16054. Update Dockerfile to use Bionic.
Contributed by Akira Ajisaka.
2020-03-18 13:44:44 +00:00
Vinayakumar B 52b360a928
HADOOP-16797. Add Dockerfile for ARM builds. Contributed by Vinayakumar B. (#1801) 2020-01-13 10:40:29 +05:30
Akira Ajisaka c44943d1fc
YARN-10054. Upgrade yarn to 1.21.1 in Dockerfile. (#1777) 2019-12-23 14:08:14 +09:00
Akira Ajisaka bc825b9628
YARN-10036. Install yarnpkg and upgrade nodejs in Dockerfile (#1772) 2019-12-23 10:30:26 +09:00
Kevin Su e573ea4908
HADOOP-16754. Fix docker failed to build yetus/hadoop.
Contributed by Kevin Su.

Change-Id: Ie9cf27b7a7ba5923405f24d39b95b0248f3718b7
2019-12-11 16:56:25 +00:00
Ayush Saxena 104ccca916 HDFS-14900. Fix build failure of hadoop-hdfs-native-client. Contributed by Masatake Iwasaki. 2019-10-10 21:36:02 +05:30
pingsutw 1dde3efb91
HADOOP-16624. Upgrade hugo to the latest version in Dockerfile
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2019-10-04 10:01:07 +09:00
Akira Ajisaka 0e026cb0ce
HADOOP-16620. [pb-upgrade] Remove protocol buffers 3.7.1 from requirements in BUILDING.txt (#1558)
* Removed protobuf 3.7.1 from Dockerfile
2019-10-03 15:24:47 +09:00