Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
19,911 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

207 Commits

Author SHA1 Message Date
Tamas Domok f7ac747b6a
YARN-10882. Fix branch-3.1 build: zstd library is missing from the Dockerfile (#3297) 
Co-authored-by: Tamas Domok <tdomok@cloudera.com>
 2021-08-11 18:29:00 +02:00
Wei-Chiu Chuang d4f45100c7
HADOOP-17703. checkcompatibility.py errors out when specifying annotations. (#3017) 
Reviewed-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 110cda3de6)
(cherry picked from commit 0df4743284)
(cherry picked from commit 2823d77f19)
 2021-05-18 11:37:08 +08:00
Gautham B A 1f3697b3a4
HDFS-15948. Fix test4tests for libhdfspp (#2873) 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 02b9506c5a)
 2021-04-07 19:58:37 +09:00
Akira Ajisaka 7b7ec5687e
HADOOP-16870. Use spotbugs-maven-plugin instead of findbugs-maven-plugin (#2753) 
Removed findbugs from the hadoop build images and added spotbugs instead.
Upgraded SpotBugs to 4.2.2 and spotbugs-maven-plugin to 4.2.0.

Reviewed-by: Masatake Iwasaki <iwasakims@apache.org>
(cherry picked from commit 23b343aed1)

 Conflicts:
	dev-support/docker/Dockerfile
	hadoop-project/pom.xml

(cherry picked from commit de2904f123)

 Conflicts:
	dev-support/docker/Dockerfile_aarch64
	hadoop-cloud-storage-project/hadoop-cos/pom.xml
	hadoop-common-project/hadoop-registry/pom.xml
	hadoop-project/pom.xml

(cherry picked from commit 0b278502e2)

 Conflicts:
	dev-support/docker/Dockerfile
	hadoop-project/pom.xml
 2021-03-27 00:40:24 +09:00
Akira Ajisaka c18ecc5de6
HADOOP-17582. Replace GitHub App Token with GitHub OAuth token (#2766) 
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
(cherry picked from commit 2b62b12d0d)
 2021-03-27 00:36:50 +09:00
Akira Ajisaka 408cffe2d0
HADOOP-17570. Apply YETUS-1102 to re-enable GitHub comments (#2745) 
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
(cherry picked from commit 9b78de2550)
 2021-03-27 00:36:17 +09:00
Akira Ajisaka 3e2534c032
HADOOP-16748. Migrate to Python 3 and upgrade Yetus to 0.13.0 (branch-3.2) (#2717) 
- Upgrade Yetus to 0.13.0 to support Python 3 for the release scripts.
- Removed determine-flaky-tests-hadoop.py.
- Temporarily disabled shelldocs check due to YETUS-1099.

Reviewed-by: Inigo Goiri <inigoiri@apache.org>
Reviewed-by: Mingliang Liu <liuml07@apache.org>
(cherry picked from commit b9b49ed956)

 Conflicts:
	dev-support/Jenkinsfile
	dev-support/docker/Dockerfile

(cherry picked from commit ff8b79f890)
(cherry picked from commit 08652eeee7)
 2021-03-27 00:33:16 +09:00
Akira Ajisaka ce08b9d2eb
HADOOP-16061. Upgrade Yetus to 0.10.0 
This closes #1298

(cherry picked from commit 5e156b9dde)
(cherry picked from commit 43b8396b77)
 2021-03-27 00:33:00 +09:00
Akira Ajisaka db94908212
HADOOP-16054. Update Dockerfile to use Bionic (#2713) 
(cherry picked from commit 81d8b71534)

 Conflicts:
	dev-support/docker/Dockerfile

(cherry picked from commit fa5c9a1886)
 2021-03-27 00:19:55 +09:00
Akira Ajisaka 332c2a637d
YARN-10036. Install yarnpkg and upgrade nodejs in Dockerfile (#1772) 
(cherry picked from commit bc825b9628)
(cherry picked from commit 710a24b6cd)

 Conflicts:
	dev-support/docker/Dockerfile
 2021-03-24 16:29:33 +09:00
Kevin Su 65b1945f22
HADOOP-16754. Fix docker failed to build yetus/hadoop. 
Contributed by Kevin Su.

Change-Id: Ie9cf27b7a7ba5923405f24d39b95b0248f3718b7
(cherry picked from commit 0f25cbbb25)
 2021-03-24 16:25:07 +09:00
Allen Wittenauer 1bcde89983
HADOOP-14671. Upgrade Apache Yetus to 0.8.0 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 4b8c2b1c1c)

 Conflicts:
	dev-support/docker/Dockerfile
	hadoop-common-project/hadoop-common/src/site/markdown/release/2.10.0/RELEASENOTES.2.10.0.md
	hadoop-common-project/hadoop-common/src/site/markdown/release/3.0.2/CHANGELOG.3.0.2.md
	hadoop-common-project/hadoop-common/src/site/markdown/release/3.1.2/RELEASENOTES.3.1.2.md
 2021-03-24 16:04:11 +09:00
Akira Ajisaka be253c2fd0
HADOOP-17557. skip-dir option is not processed by Yetus. Contributed by Ahmed Hussein. 
(cherry picked from commit 63aa142b77)
 2021-03-09 11:11:32 +09:00
Xieming Li d6797520b9
HADOOP-16052. Remove Subversion and Forrest from Dockerfile 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit bdbca0e53b)
 2021-02-22 23:34:17 +09:00
Akira Ajisaka 5302731ac4
HADOOP-17354. Move Jenkinsfile outside of the root directory. (#2647) 
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
(cherry picked from commit 84b154ebc0)
 2021-02-01 18:53:42 +09:00
Akira Ajisaka 5085934c90
HADOOP-17352. Update PATCH_NAMING_RULE in the personality file. (#2433) 
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
(cherry picked from commit 34e2abd811)
 2020-11-10 14:01:28 +09:00
Akira Ajisaka 3c932dd3d5
Revert "HADOOP-17246. Fix build the hadoop-build Docker image failed (#2277)" 
This reverts commit 63c8e39a2c.
 2020-09-16 16:47:08 +09:00
Wanqiang Ji 63c8e39a2c
HADOOP-17246. Fix build the hadoop-build Docker image failed (#2277) 
(cherry picked from commit ce86183691)

 Conflicts:
	dev-support/docker/Dockerfile_aarch64

(cherry picked from commit ffc101a27b)
 2020-09-16 16:26:36 +09:00
Chao Sun bd3817b8cd
HADOOP-17205. Move personality file from Yetus to Hadoop repository (#2226) 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit fefacf2578)
 2020-08-18 12:12:32 +09:00
Masatake Iwasaki 53cfe60904
HADOOP-17120. Fix failure of docker image creation due to pip2 install error. (#2130) 2020-07-09 11:35:52 +09:00
Masatake Iwasaki d84386ccf7
HADOOP-17097. start-build-env.sh fails in branch-3.1. (#2108) 2020-06-30 10:47:41 +09:00
Akira Ajisaka f30abb3e73
HADOOP-17056. Addendum patch: Fix typo 
(cherry picked from commit 5157118bd7)
(cherry picked from commit 59e7275beb)
 2020-06-04 16:43:23 +09:00
Akira Ajisaka de4f1aabfa
HADOOP-17056. shelldoc fails in hadoop-common. (#2045) 
In the docker build image, skip GPG verification when downloading
Yetus tarball via yetus-wrapper.

(cherry picked from commit 9c290c08db)

 Conflicts:
	dev-support/docker/Dockerfile
	dev-support/docker/Dockerfile_aarch64

(cherry picked from commit aa19a2af17)
 2020-06-04 16:41:22 +09:00
Akira Ajisaka a6371bfdb8
HADOOP-16949. pylint fails in the build environment (#1926) 
(cherry picked from commit e6455cc864)

Conflicts:
	dev-support/docker/Dockerfile_aarch64
(cherry picked from commit 11aff6c269)
 2020-04-04 16:57:53 +09:00
pingsutw 70a0ef5d4a
HADOOP-16754. Fix docker failed to build yetus/hadoop 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
 2019-12-12 11:03:51 +09:00
Sammi Chen 9281b72550 HDFS-14356. Implement HDFS cache on SCM with native PMDK libs. Contributed by Feilong He. 
(cherry picked from commit d1aad44490)
 2019-10-27 22:23:44 +05:30
Akira Ajisaka 244385d7eb
Revert "HADOOP-16061. Upgrade Yetus to 0.10.0" 
This reverts commit 565751e739.
 2019-09-09 18:58:38 +09:00
Akira Ajisaka 565751e739
HADOOP-16061. Upgrade Yetus to 0.10.0 
This closes #1298

(cherry picked from commit 5e156b9dde)

 Conflicts:
	dev-support/bin/yetus-wrapper
 2019-08-22 13:05:19 +09:00
Akira Ajisaka ec3a5d1db1
HADOOP-16494. Add SHA-512 checksum to release artifact to comply with the release distribution policy. 
This closes #1243

(cherry picked from commit 34dd9ee366)
 2019-08-22 11:03:40 +09:00
Wanqiang Ji 2133bb561d
HADOOP-16334. Fix yetus-wrapper not working when HADOOP_YETUS_VERSION >= 0.9.0 
This closes #864

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit d23e8e9232)
 2019-05-30 15:13:20 +09:00
Akira Ajisaka b151b50048
HADOOP-15925. The config and log of gpg-agent are removed in create-release script. Contributed by Dinesh Chitlangia. 
(cherry picked from commit af5958f7b6)
 2018-11-16 13:18:17 +09:00
Akira Ajisaka ba75aeec28
HADOOP-15930. Exclude MD5 checksum files from release artifact. 
(cherry picked from commit df5e863fee)
 2018-11-15 10:47:32 +09:00
Akira Ajisaka e67e00724e
HADOOP-15923. create-release script should set max-cache-ttl as well as default-cache-ttl for gpg-agent. 
(cherry picked from commit 703b2860a4)
 2018-11-13 13:42:01 +09:00
Akira Ajisaka 080e9d0f9b
HADOOP-15822. zstd compressor can fail with a small output buffer. Contributed by Jason Lowe. 
(cherry picked from commit 8f97d6f2cd)

Conflicts:
	dev-support/docker/Dockerfile
 2018-10-24 13:54:30 +09:00
Eric Yang a607c02f15 HADOOP-15610. Fixed pylint version for Hadoop docker image. 
Contributed by Jack Bearden

(cherry picked from commit ba1ab08fda)
 2018-07-18 20:11:39 -04:00
Chris Douglas ffc39ec3ab HADOOP-14667. Flexible Visual Studio support. Contributed by Allen Wittenauer 2018-04-13 10:11:35 -07:00
weiy c804b28462 HDFS-13215. RBF: Move Router to its own module. 2018-03-19 23:05:33 -07:00
Allen Wittenauer d4cc50f622 HADOOP-15279. increase maven heap size recommendations 
Signed-off-by: Jason Lowe <jlowe@apache.org>
Signed-off-by: Chris Douglas <cdouglas@apache.org>
 2018-03-01 15:32:43 -08:00
Chris Douglas 329a4fdd07 HADOOP-13374. Add the L&N verification script. Contributed by Allen Wittenauer 2018-02-23 17:07:22 -08:00
Sean Mackrory 5533648241 HADOOP-15058. create-release site build outputs dummy shaded jars due to skipShade. Contributed by Andrew Wang. 2017-12-04 15:39:43 -07:00
Andrew Wang 51e882d5c9 HADOOP-15018. Update JAVA_HOME in create-release for Xenial Dockerfile. 2017-11-07 16:39:04 -08:00
Akira Ajisaka 5b98639400
HADOOP-14977. Xenial dockerfile needs ant in main build for findbugs 
Signed-off-by: Allen Wittenauer <aw@apache.org>
 2017-10-25 08:08:22 -07:00
Chris Douglas ca8ddc6aa4 HADOOP-14816. Update Dockerfile to use Xenial. Contributed by Allen Wittenauer 2017-10-19 16:45:18 -07:00
Akira Ajisaka 0de40f0e27
Revert "HADOOP-13514. Upgrade maven surefire plugin to 2.19.1." 
This reverts commit 3d04c00aed.
 2017-10-13 18:00:25 +09:00
Akira Ajisaka 3d04c00aed
HADOOP-13514. Upgrade maven surefire plugin to 2.19.1. 2017-10-11 10:42:32 +09:00
Andrew Wang 3cf3540f19 HADOOP-14835. mvn site build throws SAX errors. Contributed by Andrew Wang and Sean Mackrory. 2017-09-18 15:13:42 -07:00
Allen Wittenauer 71bbb86d69
HADOOP-14670. Increase minimum cmake version for all platforms 
Signed-off-by: Chris Douglas <cdouglas@apache.org>
 2017-08-30 21:47:24 -07:00
Akira Ajisaka 99926756fc
Revert "HADOOP-14671. Upgrade to Apache Yetus 0.5.0." 
This reverts commit 33afa94af1.
 2017-08-30 16:54:30 +02:00
Akira Ajisaka 33afa94af1
HADOOP-14671. Upgrade to Apache Yetus 0.5.0. 2017-08-29 13:36:22 +02:00
Arpit Agarwal a6fdeb8a87 HADOOP-13963. /bin/bash is hard coded in some of the scripts. Contributed by Ajay Yadav. 2017-08-04 10:40:52 -07:00