241fb6b2a7
HADOOP-18251. Fix failure of extracting JIRA id from commit message in git_jira_fix_version_check.py. ( #4344 )
...
(cherry picked from commit 6b331dde31
2022-05-26 03:28:55 +00:00
8c492a1d65
HADOOP-18240. Upgrade Yetus to 0.14.0 ( #4328 )
...
Co-authored-by: Ashutosh Gupta <ashugpt@amazon.com>
Reviewed-by: Chris Nauroth <cnauroth@apache.org>
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 84b0455cf8
2022-05-25 17:32:19 +09:00
c2b2494d8b
HADOOP-18198. add -mvnargs option to create-release command line ( #4239 )
...
This allows for builds to be run with options like
--mvnargs="-Dhttp.keepAlive=false -Dmaven.wagon.http.pool=false"
Contributed by Ayush Saxena.
Change-Id: I0e3d421da13bf0bc32cbbfbfb2c428828bdbb84c
2022-05-03 14:07:15 +01:00
51a532a532
HADOOP-18202. create-release fails fatal: unsafe repository ( #4188 )
...
Since April 2022/CVE-2022-24765, git refuses to work in directories
whose owner != the current user, unless explicitly told to trust it.
This patches the create-release script to trust the /build/source
dir mounted from the hosting OS, whose userid is inevitably different
from that of the account in the container running git.
Contributed by: Steve Loughran, Ayush Saxena and the new git error messages
Change-Id: I855a105e6d0ab533468f9436578c8d4f81b0840b
2022-04-18 19:28:44 +01:00
d763c99707
HADOOP-18125. Utility to identify git commit / Jira fixVersion discrepancies for RC preparation ( #3991 )
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 697e5d4636
2022-02-22 11:01:35 +08:00
0cab54909a
HADOOP-18048. [branch-3.3] Dockerfile_aarch64 build fails with fatal error: Python.h: No such file or directory ( #3801 )
2021-12-14 17:56:58 -08:00
e392ce7a73
HADOOP-17988. Disable JIRA plugin for YETUS on Hadoop ( #3610 )
2021-11-09 22:05:10 +05:30
103ef9c711
HADOOP-17891. Fix compilation error under skipShade (ADDENDUM) ( #3441 )
2021-09-16 10:12:28 -07:00
b9715c2931
HADOOP-17891. Exclude snappy-java and lz4-java from relocation in shaded hadoop client libraries ( #3385 )
2021-09-14 11:21:41 -07:00
99cff01e38
HADOOP-17775. Remove JavaScript package from Docker environment. ( #3182 )
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2021-07-07 17:49:19 +09:00
10000f162d
HADOOP-17756. Increase precommit job timeout from 20 hours to 24 hours. ( #3090 )
...
Reviewed-by: Akira Ajisaka <aajisaka@apache.org>
Reviewed-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit ae9630f580
2021-06-14 10:21:30 +09:00
745a2f5ec3
HADOOP-17723. [build] fix the Dockerfile for ARM ( #3037 )
...
Reviewed-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 1576f81dfe
2021-05-24 18:20:49 +08:00
23ada04dac
HADOOP-17509. Parallelize building of dependencies ( #2669 )
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 6c891c0dd4
2021-05-22 01:32:37 +08:00
5e09d38b25
HADOOP-17718. Explicitly set locale in the Dockerfile. ( #3034 )
...
Reviewed-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit ad923ad564
2021-05-22 00:31:59 +08:00
932a16837a
HADOOP-17224. Install Intel ISA-L library in Dockerfile. ( #2537 )
...
(cherry picked from commit d09e3c929f
2021-05-19 20:27:22 +08:00
0df4743284
HADOOP-17703. checkcompatibility.py errors out when specifying annotations. ( #3017 )
...
Reviewed-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 110cda3de6
2021-05-18 11:36:13 +08:00
b59bde61f6
HDFS-15948. Fix test4tests for libhdfspp ( #2873 )
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 02b9506c5a
2021-04-07 19:58:03 +09:00
2d83369f6f
HDFS-15743. Fix -Pdist build failure of hadoop-hdfs-native-client. ( #2569 )
...
(cherry picked from commit 9aefe72ed6
2021-03-24 14:04:47 +08:00
d2723b21b9
HADOOP-17582. Replace GitHub App Token with GitHub OAuth token ( #2766 )
...
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
(cherry picked from commit 2b62b12d0d
2021-03-12 18:05:00 +09:00
0c1ba49c37
HADOOP-17570. Apply YETUS-1102 to re-enable GitHub comments ( #2745 )
...
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
(cherry picked from commit 9b78de2550
2021-03-11 23:26:36 +09:00
de2904f123
HADOOP-16870. Use spotbugs-maven-plugin instead of findbugs-maven-plugin ( #2753 )
...
Removed findbugs from the hadoop build images and added spotbugs instead.
Upgraded SpotBugs to 4.2.2 and spotbugs-maven-plugin to 4.2.0.
Reviewed-by: Masatake Iwasaki <iwasakims@apache.org>
(cherry picked from commit 23b343aed1
2021-03-11 14:57:03 +09:00
2da6a96821
HADOOP-17557. skip-dir option is not processed by Yetus. Contributed by Ahmed Hussein.
...
(cherry picked from commit 63aa142b77
2021-03-09 11:10:53 +09:00
ff8b79f890
HADOOP-16748. Migrate to Python 3 and upgrade Yetus to 0.13.0 (branch-3.3) ( #2709 )
...
- Upgrade Yetus to 0.13.0 to support Python 3 for the release scripts.
- Removed determine-flaky-tests-hadoop.py.
- Temporarily disabled shelldocs check due to YETUS-1099.
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
Reviewed-by: Mingliang Liu <liuml07@apache.org>
(cherry picked from commit b9b49ed956
2021-02-22 15:19:05 +09:00
c7bab342ee
HADOOP-17084 Update Dockerfile_aarch64 to use Bionic ( #2103 ). Contributed by zhaorenhai.
...
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
(cherry picked from commit 6c57be4897
2021-02-22 13:49:51 +09:00
118a5747f8
HADOOP-16054. Update Dockerfile to use Bionic ( #1966 )
...
(cherry picked from commit 81d8b71534
2021-02-22 13:49:29 +09:00
98104537b2
HADOOP-17354. Move Jenkinsfile outside of the root directory. ( #2647 )
...
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
(cherry picked from commit 84b154ebc0
2021-02-01 18:52:50 +09:00
3748c258f9
YARN-10560. Upgrade node.js to 10.23.1 and yarn to 1.22.5 in Web UI v2. ( #2592 )
...
(cherry picked from commit ae4945fb2c
2021-01-06 12:14:09 +09:00
aa3807ed1d
HADOOP-17352. Update PATCH_NAMING_RULE in the personality file. ( #2433 )
...
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
(cherry picked from commit 34e2abd811
2020-11-10 14:00:08 +09:00
8f60a90688
HADOOP-17125. Use snappy-java in SnappyCodec ( #2297 )
...
This switches the SnappyCodec to use the java-snappy codec, rather than the native one.
To use the codec, snappy-java.jar (from org.xerial.snappy) needs to be on the classpath.
This comesin as an avro dependency, so it is already on the hadoop-common classpath,
as well as in hadoop-common/lib.
The version used is now managed in the hadoop-project POM; initially 1.1.7.7
Contributed by DB Tsai and Liang-Chi Hsieh
Change-Id: Id52a404a0005480e68917cd17f0a27b7744aea4e
2020-10-06 17:15:17 +01:00
74c0764343
HADOOP-17246. Addendum patch for branch-3.3.
2020-09-16 16:45:20 +09:00
cda7d6ca85
HADOOP-17246. Fix build the hadoop-build Docker image failed ( #2277 )
...
(cherry picked from commit ce86183691
2020-09-16 16:24:44 +09:00
197219a305
HADOOP-17205. Move personality file from Yetus to Hadoop repository ( #2226 )
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit fefacf2578
2020-08-18 12:11:23 +09:00
9263b75b3c
YARN-10367. Failed to get nodejs 10.21.0 when building docker image ( #2171 )
...
(cherry picked from commit e277d338da
2020-07-27 00:53:24 +09:00
7522b44067
HADOOP-17120. Fix failure of docker image creation due to pip2 install error. ( #2130 )
...
(cherry picked from commit 53cfe60904
2020-07-09 03:19:18 +00:00
aa283fc2c2
YARN-10331. Upgrade node.js to 10.21.0. ( #2106 )
...
(cherry picked from commit cd188ea9f0
2020-06-30 16:54:59 +09:00
9cfc0e50fa
HADOOP-17056. Addendum patch: Fix typo
...
(cherry picked from commit 5157118bd7
2020-06-04 16:35:27 +09:00
c88bf7acc1
HADOOP-17056. shelldoc fails in hadoop-common. ( #2045 )
...
In the docker build image, skip GPG verification when downloading
Yetus tarball via yetus-wrapper.
(cherry picked from commit 9c290c08db
2020-06-03 18:03:03 +09:00
9b84a637b7
HADOOP-17055. Remove residual code of Ozone ( #2039 )
...
(cherry picked from commit d9838f2d42
2020-05-29 16:50:10 +09:00
b4ba9bed7c
HADOOP-16985. Handle release package related issues ( #1957 )
...
(cherry picked from commit 4d24d99e85
2020-04-15 23:09:41 +05:30
f537a51288
HADOOP-16949. pylint fails in the build environment ( #1926 )
...
(cherry picked from commit e6455cc864
2020-04-04 16:53:26 +09:00
4454c6d14b
Revert "HADOOP-16054. Update Dockerfile to use Bionic." ( #1911 )
...
This reverts commit 367833cf41
2020-03-24 22:05:33 +09:00
367833cf41
HADOOP-16054. Update Dockerfile to use Bionic.
...
Contributed by Akira Ajisaka.
2020-03-18 13:44:44 +00:00
52b360a928
HADOOP-16797. Add Dockerfile for ARM builds. Contributed by Vinayakumar B. ( #1801 )
2020-01-13 10:40:29 +05:30
c44943d1fc
YARN-10054. Upgrade yarn to 1.21.1 in Dockerfile. ( #1777 )
2019-12-23 14:08:14 +09:00
bc825b9628
YARN-10036. Install yarnpkg and upgrade nodejs in Dockerfile ( #1772 )
2019-12-23 10:30:26 +09:00
e573ea4908
HADOOP-16754. Fix docker failed to build yetus/hadoop.
...
Contributed by Kevin Su.
Change-Id: Ie9cf27b7a7ba5923405f24d39b95b0248f3718b7
2019-12-11 16:56:25 +00:00
ccca5f4a40
HADOOP-16441. if use -Dbundle.openssl=true, bundled with unnecessary libk5crypto.*. Contributed by KWON BYUNGCHANG.
2019-12-04 14:25:46 +09:00
104ccca916
HDFS-14900. Fix build failure of hadoop-hdfs-native-client. Contributed by Masatake Iwasaki.
2019-10-10 21:36:02 +05:30
1dde3efb91
HADOOP-16624. Upgrade hugo to the latest version in Dockerfile
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2019-10-04 10:01:07 +09:00
0e026cb0ce
HADOOP-16620. [pb-upgrade] Remove protocol buffers 3.7.1 from requirements in BUILDING.txt ( #1558 )
...
* Removed protobuf 3.7.1 from Dockerfile
2019-10-03 15:24:47 +09:00
Masatake Iwasaki
Ashutosh Gupta
Steve Loughran
Viraj Jasani
Siyao Meng
Gautham B A
Liang-Chi Hsieh
Takanobu Asanuma
Wei-Chiu Chuang
Akira Ajisaka
zhaorenhai
Wanqiang Ji
Chao Sun
Vinayakumar B
Kevin Su
Ayush Saxena