Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
19,864 Commits 326 Branches 371 Tags
Commit Graph

204 Commits

Author SHA1 Message Date
Akira Ajisaka
7b7ec5687e
HADOOP-16870. Use spotbugs-maven-plugin instead of findbugs-maven-plugin (#2753) 
Removed findbugs from the hadoop build images and added spotbugs instead.
Upgraded SpotBugs to 4.2.2 and spotbugs-maven-plugin to 4.2.0.

Reviewed-by: Masatake Iwasaki <iwasakims@apache.org>
(cherry picked from commit 23b343aed17119b905dfa61ab1ce32ab554bfb57)

 Conflicts:
	dev-support/docker/Dockerfile
	hadoop-project/pom.xml

(cherry picked from commit de2904f123a7e3a56e4f8572f24b2e75ea606e80)

 Conflicts:
	dev-support/docker/Dockerfile_aarch64
	hadoop-cloud-storage-project/hadoop-cos/pom.xml
	hadoop-common-project/hadoop-registry/pom.xml
	hadoop-project/pom.xml

(cherry picked from commit 0b278502e25e7a5d52bc9c2873058413f77dd7fa)

 Conflicts:
	dev-support/docker/Dockerfile
	hadoop-project/pom.xml
 2021-03-27 00:40:24 +09:00
Akira Ajisaka
c18ecc5de6
HADOOP-17582. Replace GitHub App Token with GitHub OAuth token (#2766) 
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
(cherry picked from commit 2b62b12d0d77de469384edd19d67092ae140faf0)
 2021-03-27 00:36:50 +09:00
Akira Ajisaka
408cffe2d0
HADOOP-17570. Apply YETUS-1102 to re-enable GitHub comments (#2745) 
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
(cherry picked from commit 9b78de25507bc22ff5a44da4b2a112fbccc64500)
 2021-03-27 00:36:17 +09:00
Akira Ajisaka
3e2534c032
HADOOP-16748. Migrate to Python 3 and upgrade Yetus to 0.13.0 (branch-3.2) (#2717) 
- Upgrade Yetus to 0.13.0 to support Python 3 for the release scripts.
- Removed determine-flaky-tests-hadoop.py.
- Temporarily disabled shelldocs check due to YETUS-1099.

Reviewed-by: Inigo Goiri <inigoiri@apache.org>
Reviewed-by: Mingliang Liu <liuml07@apache.org>
(cherry picked from commit b9b49ed956e6fa9b55758f3d2c1b92ae2597cdbb)

 Conflicts:
	dev-support/Jenkinsfile
	dev-support/docker/Dockerfile

(cherry picked from commit ff8b79f890d65c4215c5e19cdf45cc2a4f0a348e)
(cherry picked from commit 08652eeee76ea06465157c95740741dcc3e12479)
 2021-03-27 00:33:16 +09:00
Akira Ajisaka
ce08b9d2eb
HADOOP-16061. Upgrade Yetus to 0.10.0 
This closes #1298

(cherry picked from commit 5e156b9ddec46d6b7d1336bb88136d8826972e7a)
(cherry picked from commit 43b8396b77a00de8182f2e5f65ed52195c32437e)
 2021-03-27 00:33:00 +09:00
Akira Ajisaka
db94908212
HADOOP-16054. Update Dockerfile to use Bionic (#2713) 
(cherry picked from commit 81d8b71534645a2109a037115fb955351edfbf64)

 Conflicts:
	dev-support/docker/Dockerfile

(cherry picked from commit fa5c9a18866fa7b52ff90f7412b9869487f600c8)
 2021-03-27 00:19:55 +09:00
Akira Ajisaka
332c2a637d
YARN-10036. Install yarnpkg and upgrade nodejs in Dockerfile (#1772) 
(cherry picked from commit bc825b9628f2fca9d250f91728d4aebb155f1331)
(cherry picked from commit 710a24b6cd7a9895a131471377f0af52f7c098d9)

 Conflicts:
	dev-support/docker/Dockerfile
 2021-03-24 16:29:33 +09:00
Kevin Su
65b1945f22
HADOOP-16754. Fix docker failed to build yetus/hadoop. 
Contributed by Kevin Su.

Change-Id: Ie9cf27b7a7ba5923405f24d39b95b0248f3718b7
(cherry picked from commit 0f25cbbb251002a87ff48686eba3a427fc6d06f8)
 2021-03-24 16:25:07 +09:00
Allen Wittenauer
1bcde89983
HADOOP-14671. Upgrade Apache Yetus to 0.8.0 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 4b8c2b1c1c9e070002ab3a2afb850d9d7b810d0a)

 Conflicts:
	dev-support/docker/Dockerfile
	hadoop-common-project/hadoop-common/src/site/markdown/release/2.10.0/RELEASENOTES.2.10.0.md
	hadoop-common-project/hadoop-common/src/site/markdown/release/3.0.2/CHANGELOG.3.0.2.md
	hadoop-common-project/hadoop-common/src/site/markdown/release/3.1.2/RELEASENOTES.3.1.2.md
 2021-03-24 16:04:11 +09:00
Akira Ajisaka
be253c2fd0
HADOOP-17557. skip-dir option is not processed by Yetus. Contributed by Ahmed Hussein. 
(cherry picked from commit 63aa142b770eda31e83ca6c6e5e96cb802b8b6a9)
 2021-03-09 11:11:32 +09:00
Xieming Li
d6797520b9
HADOOP-16052. Remove Subversion and Forrest from Dockerfile 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit bdbca0e53b4e0e728c71bc51f99e035d9081c7b1)
 2021-02-22 23:34:17 +09:00
Akira Ajisaka
5302731ac4
HADOOP-17354. Move Jenkinsfile outside of the root directory. (#2647) 
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
(cherry picked from commit 84b154ebc054843234e9a3c4c27748f87582807f)
 2021-02-01 18:53:42 +09:00
Akira Ajisaka
5085934c90
HADOOP-17352. Update PATCH_NAMING_RULE in the personality file. (#2433) 
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
(cherry picked from commit 34e2abd811b271708c82bf4d5bedfc9d721366bf)
 2020-11-10 14:01:28 +09:00
Akira Ajisaka
3c932dd3d5
Revert "HADOOP-17246. Fix build the hadoop-build Docker image failed (#2277)" 
This reverts commit 63c8e39a2ca9e768ab2b39877e596ba88b8b321a.
 2020-09-16 16:47:08 +09:00
Wanqiang Ji
63c8e39a2c
HADOOP-17246. Fix build the hadoop-build Docker image failed (#2277) 
(cherry picked from commit ce861836918c0c8e6f0294827e82e90edc984ec3)

 Conflicts:
	dev-support/docker/Dockerfile_aarch64

(cherry picked from commit ffc101a27be197a63bab29cf916748289e3baa04)
 2020-09-16 16:26:36 +09:00
Chao Sun
bd3817b8cd
HADOOP-17205. Move personality file from Yetus to Hadoop repository (#2226) 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit fefacf2578e58cf7bf96d920f5b01dba66909ca2)
 2020-08-18 12:12:32 +09:00
Masatake Iwasaki
53cfe60904
HADOOP-17120. Fix failure of docker image creation due to pip2 install error. (#2130) 2020-07-09 11:35:52 +09:00
Masatake Iwasaki
d84386ccf7
HADOOP-17097. start-build-env.sh fails in branch-3.1. (#2108) 2020-06-30 10:47:41 +09:00
Akira Ajisaka
f30abb3e73
HADOOP-17056. Addendum patch: Fix typo 
(cherry picked from commit 5157118bd7f3448949da885e323c163828c35aee)
(cherry picked from commit 59e7275beb9d364389f090455973d66c0591a93b)
 2020-06-04 16:43:23 +09:00
Akira Ajisaka
de4f1aabfa
HADOOP-17056. shelldoc fails in hadoop-common. (#2045) 
In the docker build image, skip GPG verification when downloading
Yetus tarball via yetus-wrapper.

(cherry picked from commit 9c290c08db4361de29f392b0569312c2623b8321)

 Conflicts:
	dev-support/docker/Dockerfile
	dev-support/docker/Dockerfile_aarch64

(cherry picked from commit aa19a2af17fa4269f3206bdaec23c10dc91dd11a)
 2020-06-04 16:41:22 +09:00
Akira Ajisaka
a6371bfdb8
HADOOP-16949. pylint fails in the build environment (#1926) 
(cherry picked from commit e6455cc864d932469610e86644162fa324589067)

Conflicts:
	dev-support/docker/Dockerfile_aarch64
(cherry picked from commit 11aff6c269fed38ba68dd69aaf17adba59a6fec8)
 2020-04-04 16:57:53 +09:00
pingsutw
70a0ef5d4a
HADOOP-16754. Fix docker failed to build yetus/hadoop 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
 2019-12-12 11:03:51 +09:00
Sammi Chen
9281b72550 HDFS-14356. Implement HDFS cache on SCM with native PMDK libs. Contributed by Feilong He. 
(cherry picked from commit d1aad444907e1fc5314e8e64529e57c51ed7561c)
 2019-10-27 22:23:44 +05:30
Akira Ajisaka
244385d7eb
Revert "HADOOP-16061. Upgrade Yetus to 0.10.0" 
This reverts commit 565751e73901fb0e4017297480e8cc272d06f915.
 2019-09-09 18:58:38 +09:00
Akira Ajisaka
565751e739
HADOOP-16061. Upgrade Yetus to 0.10.0 
This closes #1298

(cherry picked from commit 5e156b9ddec46d6b7d1336bb88136d8826972e7a)

 Conflicts:
	dev-support/bin/yetus-wrapper
 2019-08-22 13:05:19 +09:00
Akira Ajisaka
ec3a5d1db1
HADOOP-16494. Add SHA-512 checksum to release artifact to comply with the release distribution policy. 
This closes #1243

(cherry picked from commit 34dd9ee36674be670013d4fc3d9b8f5b36886812)
 2019-08-22 11:03:40 +09:00
Wanqiang Ji
2133bb561d
HADOOP-16334. Fix yetus-wrapper not working when HADOOP_YETUS_VERSION >= 0.9.0 
This closes #864

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit d23e8e9232f030fcdeff91b9e8a625516244dc72)
 2019-05-30 15:13:20 +09:00
Akira Ajisaka
b151b50048
HADOOP-15925. The config and log of gpg-agent are removed in create-release script. Contributed by Dinesh Chitlangia. 
(cherry picked from commit af5958f7b6a209d6a6622acee47a66a4a921828d)
 2018-11-16 13:18:17 +09:00
Akira Ajisaka
ba75aeec28
HADOOP-15930. Exclude MD5 checksum files from release artifact. 
(cherry picked from commit df5e863fee544c9283e28a21c2788c008d7e3e04)
 2018-11-15 10:47:32 +09:00
Akira Ajisaka
e67e00724e
HADOOP-15923. create-release script should set max-cache-ttl as well as default-cache-ttl for gpg-agent. 
(cherry picked from commit 703b2860a49577629e7b3ef461d8a61292e79c88)
 2018-11-13 13:42:01 +09:00
Akira Ajisaka
080e9d0f9b
HADOOP-15822. zstd compressor can fail with a small output buffer. Contributed by Jason Lowe. 
(cherry picked from commit 8f97d6f2cdfccefba5457ae3d561e9ce0109da3f)

Conflicts:
	dev-support/docker/Dockerfile
 2018-10-24 13:54:30 +09:00
Eric Yang
a607c02f15 HADOOP-15610. Fixed pylint version for Hadoop docker image. 
Contributed by Jack Bearden

(cherry picked from commit ba1ab08fdae96ad7c9c4f4bf8672abd741b7f758)
 2018-07-18 20:11:39 -04:00
Chris Douglas
ffc39ec3ab HADOOP-14667. Flexible Visual Studio support. Contributed by Allen Wittenauer 2018-04-13 10:11:35 -07:00
weiy
c804b28462 HDFS-13215. RBF: Move Router to its own module. 2018-03-19 23:05:33 -07:00
Allen Wittenauer
d4cc50f622 HADOOP-15279. increase maven heap size recommendations 
Signed-off-by: Jason Lowe <jlowe@apache.org>
Signed-off-by: Chris Douglas <cdouglas@apache.org>
 2018-03-01 15:32:43 -08:00
Chris Douglas
329a4fdd07 HADOOP-13374. Add the L&N verification script. Contributed by Allen Wittenauer 2018-02-23 17:07:22 -08:00
Sean Mackrory
5533648241 HADOOP-15058. create-release site build outputs dummy shaded jars due to skipShade. Contributed by Andrew Wang. 2017-12-04 15:39:43 -07:00
Andrew Wang
51e882d5c9 HADOOP-15018. Update JAVA_HOME in create-release for Xenial Dockerfile. 2017-11-07 16:39:04 -08:00
Akira Ajisaka
5b98639400
HADOOP-14977. Xenial dockerfile needs ant in main build for findbugs 
Signed-off-by: Allen Wittenauer <aw@apache.org>
 2017-10-25 08:08:22 -07:00
Chris Douglas
ca8ddc6aa4 HADOOP-14816. Update Dockerfile to use Xenial. Contributed by Allen Wittenauer 2017-10-19 16:45:18 -07:00
Akira Ajisaka
0de40f0e27
Revert "HADOOP-13514. Upgrade maven surefire plugin to 2.19.1." 
This reverts commit 3d04c00aed63ca49420210f5f34efe39897aae63.
 2017-10-13 18:00:25 +09:00
Akira Ajisaka
3d04c00aed
HADOOP-13514. Upgrade maven surefire plugin to 2.19.1. 2017-10-11 10:42:32 +09:00
Andrew Wang
3cf3540f19 HADOOP-14835. mvn site build throws SAX errors. Contributed by Andrew Wang and Sean Mackrory. 2017-09-18 15:13:42 -07:00
Allen Wittenauer
71bbb86d69
HADOOP-14670. Increase minimum cmake version for all platforms 
Signed-off-by: Chris Douglas <cdouglas@apache.org>
 2017-08-30 21:47:24 -07:00
Akira Ajisaka
99926756fc
Revert "HADOOP-14671. Upgrade to Apache Yetus 0.5.0." 
This reverts commit 33afa94af1af7b00506284da6493c7175dbad3c0.
 2017-08-30 16:54:30 +02:00
Akira Ajisaka
33afa94af1
HADOOP-14671. Upgrade to Apache Yetus 0.5.0. 2017-08-29 13:36:22 +02:00
Arpit Agarwal
a6fdeb8a87 HADOOP-13963. /bin/bash is hard coded in some of the scripts. Contributed by Ajay Yadav. 2017-08-04 10:40:52 -07:00
Allen Wittenauer
0c52da7d3e HADOOP-14602. allow custom release notes/changelog during create-release 
Signed-off-by: Chris Douglas <cdouglas@apache.org>
 2017-06-29 08:03:16 -07:00
Sangjin Lee
14b5c93f3c HADOOP-14366. Maven upgrade broke start-build-env.sh. Contributed by 
Akira Ajisaka.
 2017-05-01 15:54:01 -07:00
Arun Suresh
0ac17dc644 HADOOP-14311. Add python2.7-dev to Dockerfile (Allen Wittenauer via asuresh) 2017-04-14 16:56:16 -07:00