Commit Graph

41 Commits

Author SHA1 Message Date
Akira Ajisaka 3e2534c032
HADOOP-16748. Migrate to Python 3 and upgrade Yetus to 0.13.0 (branch-3.2) (#2717)
- Upgrade Yetus to 0.13.0 to support Python 3 for the release scripts.
- Removed determine-flaky-tests-hadoop.py.
- Temporarily disabled shelldocs check due to YETUS-1099.

Reviewed-by: Inigo Goiri <inigoiri@apache.org>
Reviewed-by: Mingliang Liu <liuml07@apache.org>
(cherry picked from commit b9b49ed956)

 Conflicts:
	dev-support/Jenkinsfile
	dev-support/docker/Dockerfile

(cherry picked from commit ff8b79f890)
(cherry picked from commit 08652eeee7)
2021-03-27 00:33:16 +09:00
Akira Ajisaka db94908212
HADOOP-16054. Update Dockerfile to use Bionic (#2713)
(cherry picked from commit 81d8b71534)

 Conflicts:
	dev-support/docker/Dockerfile

(cherry picked from commit fa5c9a1886)
2021-03-27 00:19:55 +09:00
Akira Ajisaka 332c2a637d
YARN-10036. Install yarnpkg and upgrade nodejs in Dockerfile (#1772)
(cherry picked from commit bc825b9628)
(cherry picked from commit 710a24b6cd)

 Conflicts:
	dev-support/docker/Dockerfile
2021-03-24 16:29:33 +09:00
Kevin Su 65b1945f22
HADOOP-16754. Fix docker failed to build yetus/hadoop.
Contributed by Kevin Su.

Change-Id: Ie9cf27b7a7ba5923405f24d39b95b0248f3718b7
(cherry picked from commit 0f25cbbb25)
2021-03-24 16:25:07 +09:00
Allen Wittenauer 1bcde89983
HADOOP-14671. Upgrade Apache Yetus to 0.8.0
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 4b8c2b1c1c)

 Conflicts:
	dev-support/docker/Dockerfile
	hadoop-common-project/hadoop-common/src/site/markdown/release/2.10.0/RELEASENOTES.2.10.0.md
	hadoop-common-project/hadoop-common/src/site/markdown/release/3.0.2/CHANGELOG.3.0.2.md
	hadoop-common-project/hadoop-common/src/site/markdown/release/3.1.2/RELEASENOTES.3.1.2.md
2021-03-24 16:04:11 +09:00
Xieming Li d6797520b9
HADOOP-16052. Remove Subversion and Forrest from Dockerfile
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit bdbca0e53b)
2021-02-22 23:34:17 +09:00
Akira Ajisaka 3c932dd3d5
Revert "HADOOP-17246. Fix build the hadoop-build Docker image failed (#2277)"
This reverts commit 63c8e39a2c.
2020-09-16 16:47:08 +09:00
Wanqiang Ji 63c8e39a2c
HADOOP-17246. Fix build the hadoop-build Docker image failed (#2277)
(cherry picked from commit ce86183691)

 Conflicts:
	dev-support/docker/Dockerfile_aarch64

(cherry picked from commit ffc101a27b)
2020-09-16 16:26:36 +09:00
Masatake Iwasaki 53cfe60904
HADOOP-17120. Fix failure of docker image creation due to pip2 install error. (#2130) 2020-07-09 11:35:52 +09:00
Masatake Iwasaki d84386ccf7
HADOOP-17097. start-build-env.sh fails in branch-3.1. (#2108) 2020-06-30 10:47:41 +09:00
Akira Ajisaka f30abb3e73
HADOOP-17056. Addendum patch: Fix typo
(cherry picked from commit 5157118bd7)
(cherry picked from commit 59e7275beb)
2020-06-04 16:43:23 +09:00
Akira Ajisaka de4f1aabfa
HADOOP-17056. shelldoc fails in hadoop-common. (#2045)
In the docker build image, skip GPG verification when downloading
Yetus tarball via yetus-wrapper.

(cherry picked from commit 9c290c08db)

 Conflicts:
	dev-support/docker/Dockerfile
	dev-support/docker/Dockerfile_aarch64

(cherry picked from commit aa19a2af17)
2020-06-04 16:41:22 +09:00
Akira Ajisaka a6371bfdb8
HADOOP-16949. pylint fails in the build environment (#1926)
(cherry picked from commit e6455cc864)

Conflicts:
	dev-support/docker/Dockerfile_aarch64
(cherry picked from commit 11aff6c269)
2020-04-04 16:57:53 +09:00
pingsutw 70a0ef5d4a
HADOOP-16754. Fix docker failed to build yetus/hadoop
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2019-12-12 11:03:51 +09:00
Akira Ajisaka 080e9d0f9b
HADOOP-15822. zstd compressor can fail with a small output buffer. Contributed by Jason Lowe.
(cherry picked from commit 8f97d6f2cd)

Conflicts:
	dev-support/docker/Dockerfile
2018-10-24 13:54:30 +09:00
Eric Yang a607c02f15 HADOOP-15610. Fixed pylint version for Hadoop docker image.
Contributed by Jack Bearden

(cherry picked from commit ba1ab08fda)
2018-07-18 20:11:39 -04:00
Allen Wittenauer d4cc50f622 HADOOP-15279. increase maven heap size recommendations
Signed-off-by: Jason Lowe <jlowe@apache.org>
Signed-off-by: Chris Douglas <cdouglas@apache.org>
2018-03-01 15:32:43 -08:00
Akira Ajisaka 5b98639400
HADOOP-14977. Xenial dockerfile needs ant in main build for findbugs
Signed-off-by: Allen Wittenauer <aw@apache.org>
2017-10-25 08:08:22 -07:00
Chris Douglas ca8ddc6aa4 HADOOP-14816. Update Dockerfile to use Xenial. Contributed by Allen Wittenauer 2017-10-19 16:45:18 -07:00
Akira Ajisaka 0de40f0e27
Revert "HADOOP-13514. Upgrade maven surefire plugin to 2.19.1."
This reverts commit 3d04c00aed.
2017-10-13 18:00:25 +09:00
Akira Ajisaka 3d04c00aed
HADOOP-13514. Upgrade maven surefire plugin to 2.19.1. 2017-10-11 10:42:32 +09:00
Allen Wittenauer 71bbb86d69
HADOOP-14670. Increase minimum cmake version for all platforms
Signed-off-by: Chris Douglas <cdouglas@apache.org>
2017-08-30 21:47:24 -07:00
Arpit Agarwal a6fdeb8a87 HADOOP-13963. /bin/bash is hard coded in some of the scripts. Contributed by Ajay Yadav. 2017-08-04 10:40:52 -07:00
Sangjin Lee 14b5c93f3c HADOOP-14366. Maven upgrade broke start-build-env.sh. Contributed by
Akira Ajisaka.
2017-05-01 15:54:01 -07:00
Arun Suresh 0ac17dc644 HADOOP-14311. Add python2.7-dev to Dockerfile (Allen Wittenauer via asuresh) 2017-04-14 16:56:16 -07:00
Akira Ajisaka 612578fe67
HADOOP-14285. Update minimum version of Maven from 3.0 to 3.3. 2017-04-08 14:23:26 +09:00
Wangda Tan a9ad5d6c81 YARN-5868. Update npm to latest version in Dockerfile to avoid random failures of npm while run maven build. (Sunil G via wangda) 2016-11-11 10:58:50 -08:00
sunilg e8096911ac YARN-5598. [YARN-3368] Fix create-release to be able to generate bits for the new yarn-ui (Wangda Tan via Sunil G) 2016-11-06 13:13:31 -08:00
Wangda Tan 266784b849 YARN-4849. [YARN-3368] cleanup code base, integrate web UI related build to mvn, and fix licenses. (wangda) 2016-11-06 13:13:31 -08:00
Ravi Prakash 9560f252cf HADOOP-13342. ISAL download is breaking the Dockerfile 2016-07-05 11:11:34 -07:00
Akira Ajisaka 85209cc591 HADOOP-13307. add rsync to Dockerfile so that precommit archive works. Contributed by Allen Wittenauer. 2016-06-23 15:11:58 +09:00
Allen Wittenauer e2f640942b HADOOP-13245. Fix up some misc create-release issues (aw) 2016-06-14 16:03:20 -07:00
Allen Wittenauer 2c91fd8241 HADOOP-13161. remove JDK7 from Dockerfile (aw) 2016-05-16 20:25:40 -07:00
Allen Wittenauer cf2ee45f71 HADOOP-13067. cleanup the dockerfile 2016-04-28 10:03:45 -07:00
Allen Wittenauer 7b1c37a13a HADOOP-12892. fix/rewrite create-release (aw) 2016-04-27 08:38:22 -07:00
Colin Patrick Mccabe fbe3e86970 HADOOP-12626. Intel ISA-L libraries should be added to the Dockerfile (Kai Zheng via cmccabe) 2016-03-18 12:17:32 -07:00
Haohui Mai 0ca8df716a HADOOP-12562. Make hadoop dockerfile usable by Yetus. Contributed by Allen Wittenauer. 2015-11-12 10:19:22 -08:00
Tsuyoshi Ozawa 123b3db743 HADOOP-12513. Dockerfile lacks initial 'apt-get update'. Contributed by Akihiro Suda. 2015-10-26 23:18:52 +09:00
Allen Wittenauer a890a31529 HADOOP-10854. unit tests for the shell scripts (aw) 2015-07-31 14:34:48 -07:00
Allen Wittenauer ab5058de8e HADOOP-11936. Dockerfile references a removed image (aw) 2015-05-07 11:46:32 -07:00
cnauroth 80935268f5 HADOOP-11843. Make setting up the build environment easier. Contributed by Niels Basjes. 2015-04-24 13:05:18 -07:00