Commit Graph

235 Commits

Author SHA1 Message Date
Masatake Iwasaki 11929ec0e7
HADOOP-17775. Remove JavaScript package from Docker environment. (#3183)
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2021-07-07 17:49:41 +09:00
Akira Ajisaka 99d8133968
YARN-10560. Upgrade node.js to 10.23.1 and yarn to 1.22.5 in Web UI v2. (#2592)
(cherry picked from commit ae4945fb2c)

 Conflicts:
	dev-support/docker/Dockerfile
	dev-support/docker/Dockerfile_aarch64
2021-06-24 13:17:47 +09:00
Akira Ajisaka 6827d49b10
YARN-10331. Upgrade node.js to 10.21.0. (#2106)
(cherry picked from commit cd188ea9f0)

 Conflicts:
	dev-support/docker/Dockerfile_aarch64
2021-06-24 13:14:37 +09:00
Takanobu Asanuma 8e6b09c0c2 HADOOP-17756. Increase precommit job timeout from 20 hours to 24 hours. (#3090)
Reviewed-by: Akira Ajisaka <aajisaka@apache.org>
Reviewed-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit ae9630f580)
2021-06-14 10:22:14 +09:00
Wei-Chiu Chuang 2823d77f19
HADOOP-17703. checkcompatibility.py errors out when specifying annotations. (#3017)
Reviewed-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 110cda3de6)
(cherry picked from commit 0df4743284)
2021-05-18 11:36:56 +08:00
Gautham B A 78ee59afb6
HDFS-15948. Fix test4tests for libhdfspp (#2873)
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 02b9506c5a)
2021-04-07 19:58:20 +09:00
Akira Ajisaka cd2d8f95c8
HADOOP-17582. Replace GitHub App Token with GitHub OAuth token (#2766)
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
(cherry picked from commit 2b62b12d0d)
2021-03-12 18:05:21 +09:00
Akira Ajisaka 6a24757718
HADOOP-17570. Apply YETUS-1102 to re-enable GitHub comments (#2745)
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
(cherry picked from commit 9b78de2550)
(cherry picked from commit 0c1ba49c37)
2021-03-12 01:25:20 +09:00
Akira Ajisaka 0b278502e2
HADOOP-16870. Use spotbugs-maven-plugin instead of findbugs-maven-plugin (#2753)
Removed findbugs from the hadoop build images and added spotbugs instead.
Upgraded SpotBugs to 4.2.2 and spotbugs-maven-plugin to 4.2.0.

Reviewed-by: Masatake Iwasaki <iwasakims@apache.org>
(cherry picked from commit 23b343aed1)

 Conflicts:
	dev-support/docker/Dockerfile
	hadoop-project/pom.xml

(cherry picked from commit de2904f123)

 Conflicts:
	dev-support/docker/Dockerfile_aarch64
	hadoop-cloud-storage-project/hadoop-cos/pom.xml
	hadoop-common-project/hadoop-registry/pom.xml
	hadoop-project/pom.xml
2021-03-11 15:37:56 +09:00
Akira Ajisaka 8d71ee12d2
HADOOP-17557. skip-dir option is not processed by Yetus. Contributed by Ahmed Hussein.
(cherry picked from commit 63aa142b77)
2021-03-09 11:11:10 +09:00
Akira Ajisaka 08652eeee7
HADOOP-16748. Migrate to Python 3 and upgrade Yetus to 0.13.0 (branch-3.2) (#2717)
- Upgrade Yetus to 0.13.0 to support Python 3 for the release scripts.
- Removed determine-flaky-tests-hadoop.py.
- Temporarily disabled shelldocs check due to YETUS-1099.

Reviewed-by: Inigo Goiri <inigoiri@apache.org>
Reviewed-by: Mingliang Liu <liuml07@apache.org>
(cherry picked from commit b9b49ed956)

 Conflicts:
	dev-support/Jenkinsfile
	dev-support/docker/Dockerfile

(cherry picked from commit ff8b79f890)
2021-02-24 11:05:58 +09:00
Xieming Li b1085bc874
HADOOP-16052. Remove Subversion and Forrest from Dockerfile
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit bdbca0e53b)
2021-02-22 23:28:36 +09:00
Akira Ajisaka fa5c9a1886
HADOOP-16054. Update Dockerfile to use Bionic (#2713)
(cherry picked from commit 81d8b71534)

 Conflicts:
	dev-support/docker/Dockerfile
2021-02-22 17:08:25 +09:00
Akira Ajisaka 710a24b6cd
YARN-10036. Install yarnpkg and upgrade nodejs in Dockerfile (#1772)
(cherry picked from commit bc825b9628)
2021-02-04 14:28:25 +09:00
Akira Ajisaka c62f90b4c5
HADOOP-17354. Move Jenkinsfile outside of the root directory. (#2647)
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
(cherry picked from commit 84b154ebc0)
2021-02-01 18:53:17 +09:00
Akira Ajisaka 9cffa8c647
HADOOP-17352. Update PATCH_NAMING_RULE in the personality file. (#2433)
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
(cherry picked from commit 34e2abd811)
2020-11-10 14:01:03 +09:00
Akira Ajisaka 875219bc8e
Revert "HADOOP-17246. Fix build the hadoop-build Docker image failed (#2277)"
This reverts commit ffc101a27b.
2020-09-16 16:46:37 +09:00
Wanqiang Ji ffc101a27b
HADOOP-17246. Fix build the hadoop-build Docker image failed (#2277)
(cherry picked from commit ce86183691)

 Conflicts:
	dev-support/docker/Dockerfile_aarch64
2020-09-16 16:25:34 +09:00
Chao Sun 5858c74a38
HADOOP-17205. Move personality file from Yetus to Hadoop repository (#2226)
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit fefacf2578)
2020-08-18 12:11:57 +09:00
Masatake Iwasaki aeb3c4a362 HADOOP-17120. Fix failure of docker image creation due to pip2 install error. (#2130)
(cherry picked from commit 53cfe60904)
2020-07-09 02:48:33 +00:00
Akira Ajisaka 59e7275beb
HADOOP-17056. Addendum patch: Fix typo
(cherry picked from commit 5157118bd7)
2020-06-04 16:42:59 +09:00
Akira Ajisaka aa19a2af17
HADOOP-17056. shelldoc fails in hadoop-common. (#2045)
In the docker build image, skip GPG verification when downloading
Yetus tarball via yetus-wrapper.

(cherry picked from commit 9c290c08db)

 Conflicts:
	dev-support/docker/Dockerfile
	dev-support/docker/Dockerfile_aarch64
2020-06-04 16:40:34 +09:00
Akira Ajisaka 11aff6c269
HADOOP-16949. pylint fails in the build environment (#1926)
(cherry picked from commit e6455cc864)

Conflicts:
	dev-support/docker/Dockerfile_aarch64
2020-04-04 16:55:10 +09:00
Kevin Su 0f25cbbb25 HADOOP-16754. Fix docker failed to build yetus/hadoop.
Contributed by Kevin Su.

Change-Id: Ie9cf27b7a7ba5923405f24d39b95b0248f3718b7
2019-12-11 16:57:30 +00:00
Sammi Chen 6eb5fb596f HDFS-14356. Implement HDFS cache on SCM with native PMDK libs. Contributed by Feilong He.
(cherry picked from commit d1aad44490)
2019-10-28 10:40:46 +05:30
Akira Ajisaka 43b8396b77
HADOOP-16061. Upgrade Yetus to 0.10.0
This closes #1298

(cherry picked from commit 5e156b9dde)
2019-08-22 13:01:55 +09:00
Akira Ajisaka c1c080458b
HADOOP-16494. Add SHA-512 checksum to release artifact to comply with the release distribution policy.
This closes #1243

(cherry picked from commit 34dd9ee366)
2019-08-22 11:03:14 +09:00
Wanqiang Ji c076645e18
HADOOP-16334. Fix yetus-wrapper not working when HADOOP_YETUS_VERSION >= 0.9.0
This closes #864

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit d23e8e9232)
2019-05-30 15:12:38 +09:00
Akira Ajisaka a69423d28c
HADOOP-15925. The config and log of gpg-agent are removed in create-release script. Contributed by Dinesh Chitlangia.
(cherry picked from commit af5958f7b6)
2018-11-16 13:17:55 +09:00
Akira Ajisaka 9f3d42f106
HADOOP-15930. Exclude MD5 checksum files from release artifact.
(cherry picked from commit df5e863fee)
2018-11-15 10:47:13 +09:00
Akira Ajisaka 861105747b
HADOOP-15923. create-release script should set max-cache-ttl as well as default-cache-ttl for gpg-agent.
(cherry picked from commit 703b2860a4)
2018-11-13 13:41:42 +09:00
Akira Ajisaka 63396beab4
HADOOP-15822. zstd compressor can fail with a small output buffer. Contributed by Jason Lowe.
(cherry picked from commit 8f97d6f2cd)
2018-10-24 13:50:30 +09:00
Sunil G 2c392da8aa HADOOP-15791. Remove Ozone related sources from the 3.2 branch. Contributed by Elek, Marton. 2018-10-05 16:10:47 +05:30
Bharat Viswanadham 62f817d32e HDDS-447. Separate ozone-dist and hadoop-dist projects with real classpath separation. Contributed by Elek Marton. 2018-09-24 10:10:11 -07:00
Márton Elek b6ad84ebb1 HDDS-468. Add version number to datanode plugin and ozone file system jar. Contributed by Bharat Viswanadham.
(cherry picked from commit a71aea7323)
2018-09-18 11:01:52 +02:00
Bharat Viswanadham 8b2f5e60fa HDDS-352. Separate install and testing phases in acceptance tests. Contributed by Elek Marton. 2018-09-17 17:13:52 -07:00
Bharat Viswanadham 3d89c3e73e HDDS-463. Fix the release packaging of the ozone distribution. Contributed by Elek Marton. 2018-09-17 11:49:09 -07:00
Anu Engineer 8af8453589 HDDS-435. Enhance the existing ozone documentation.
Contributed by Elek, Marton.
2018-09-17 10:46:28 -07:00
Bharat Viswanadham b95aa56062 HDDS-446. Provide shaded artifact to start ozone service as a datanode plugin. Contributed by Elek Marton 2018-09-14 14:12:03 -07:00
Anu Engineer 7b5886bf78 HDDS-222. Remove hdfs command line from ozone distribution.
Contributed by Elek, Marton.
2018-09-11 10:19:50 -07:00
Allen Wittenauer 4b8c2b1c1c
HADOOP-14671. Upgrade Apache Yetus to 0.8.0
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-09-11 08:55:34 -07:00
Mukul Kumar Singh 692736f7cf HDDS-280. Support ozone dist-start-stitching on openbsd/osx. Contributed by Elek, Marton. 2018-08-30 02:21:24 +05:30
Anu Engineer af4b705b5f HDDS-342. Add example byteman script to print out hadoop rpc traffic.
Contributed by Elek, Marton.
2018-08-22 14:48:22 -07:00
Xiaoyu Yao 9dd5d5ba71 HDDS-218. add existing docker-compose files to the ozone release artifact. Contributed by Elek Marton. 2018-08-17 07:58:24 -07:00
Eric Yang ba1ab08fda HADOOP-15610. Fixed pylint version for Hadoop docker image.
Contributed by Jack Bearden
2018-07-18 20:09:43 -04:00
Arpit Agarwal 061b168529 HDDS-167. Rename KeySpaceManager to OzoneManager. Contributed by Arpit Agarwal. 2018-07-06 12:09:05 -07:00
Anu Engineer e16e5b307d HDDS-177. Create a releasable ozonefs artifact
Contributed by Marton, Elek.
2018-06-24 01:05:04 -07:00
Mukul Kumar Singh 63fc5873ce HDDS-84. The root directory of ozone.tar.gz should contain the version string. Contributed by Elek, Marton. 2018-05-23 21:07:37 +05:30
Anu Engineer 481bfdb94f HDDS-89. Create ozone specific inline documentation as part of the build.
Contributed by Elek, Marton.
2018-05-22 10:49:10 -07:00
Anu Engineer 4b4f24ad5f HDDS-40. Separating packaging of Ozone/HDDS from the main Hadoop.
Contributed by Elek, Marton.
2018-05-11 14:24:36 -07:00