Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
24,041 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

239 Commits

Author SHA1 Message Date
Liang-Chi Hsieh 8f60a90688 HADOOP-17125. Use snappy-java in SnappyCodec (#2297) 
This switches the SnappyCodec to use the java-snappy codec, rather than the native one.

To use the codec, snappy-java.jar (from org.xerial.snappy) needs to be on the classpath.

This comesin as an avro dependency,  so it is already on the hadoop-common classpath,
as well as in hadoop-common/lib.
The version used is now managed in the hadoop-project POM; initially 1.1.7.7

Contributed by DB Tsai and Liang-Chi Hsieh

Change-Id: Id52a404a0005480e68917cd17f0a27b7744aea4e
 2020-10-06 17:15:17 +01:00
Akira Ajisaka 74c0764343
HADOOP-17246. Addendum patch for branch-3.3. 2020-09-16 16:45:20 +09:00
Wanqiang Ji cda7d6ca85
HADOOP-17246. Fix build the hadoop-build Docker image failed (#2277) 
(cherry picked from commit ce86183691)
 2020-09-16 16:24:44 +09:00
Chao Sun 197219a305
HADOOP-17205. Move personality file from Yetus to Hadoop repository (#2226) 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit fefacf2578)
 2020-08-18 12:11:23 +09:00
Akira Ajisaka 9263b75b3c
YARN-10367. Failed to get nodejs 10.21.0 when building docker image (#2171) 
(cherry picked from commit e277d338da)
 2020-07-27 00:53:24 +09:00
Masatake Iwasaki 7522b44067 HADOOP-17120. Fix failure of docker image creation due to pip2 install error. (#2130) 
(cherry picked from commit 53cfe60904)
 2020-07-09 03:19:18 +00:00
Akira Ajisaka aa283fc2c2
YARN-10331. Upgrade node.js to 10.21.0. (#2106) 
(cherry picked from commit cd188ea9f0)
 2020-06-30 16:54:59 +09:00
Akira Ajisaka 9cfc0e50fa
HADOOP-17056. Addendum patch: Fix typo 
(cherry picked from commit 5157118bd7)
 2020-06-04 16:35:27 +09:00
Akira Ajisaka c88bf7acc1
HADOOP-17056. shelldoc fails in hadoop-common. (#2045) 
In the docker build image, skip GPG verification when downloading
Yetus tarball via yetus-wrapper.

(cherry picked from commit 9c290c08db)
 2020-06-03 18:03:03 +09:00
Wanqiang Ji 9b84a637b7
HADOOP-17055. Remove residual code of Ozone (#2039) 
(cherry picked from commit d9838f2d42)
 2020-05-29 16:50:10 +09:00
Vinayakumar B b4ba9bed7c
HADOOP-16985. Handle release package related issues (#1957) 
(cherry picked from commit 4d24d99e85)
 2020-04-15 23:09:41 +05:30
Akira Ajisaka f537a51288
HADOOP-16949. pylint fails in the build environment (#1926) 
(cherry picked from commit e6455cc864)
 2020-04-04 16:53:26 +09:00
Akira Ajisaka 4454c6d14b
Revert "HADOOP-16054. Update Dockerfile to use Bionic." (#1911) 
This reverts commit 367833cf41.
 2020-03-24 22:05:33 +09:00
Akira Ajisaka 367833cf41
HADOOP-16054. Update Dockerfile to use Bionic. 
Contributed by Akira Ajisaka.
 2020-03-18 13:44:44 +00:00
Vinayakumar B 52b360a928
HADOOP-16797. Add Dockerfile for ARM builds. Contributed by Vinayakumar B. (#1801) 2020-01-13 10:40:29 +05:30
Akira Ajisaka c44943d1fc
YARN-10054. Upgrade yarn to 1.21.1 in Dockerfile. (#1777) 2019-12-23 14:08:14 +09:00
Akira Ajisaka bc825b9628
YARN-10036. Install yarnpkg and upgrade nodejs in Dockerfile (#1772) 2019-12-23 10:30:26 +09:00
Kevin Su e573ea4908
HADOOP-16754. Fix docker failed to build yetus/hadoop. 
Contributed by Kevin Su.

Change-Id: Ie9cf27b7a7ba5923405f24d39b95b0248f3718b7
 2019-12-11 16:56:25 +00:00
Masatake Iwasaki ccca5f4a40 HADOOP-16441. if use -Dbundle.openssl=true, bundled with unnecessary libk5crypto.*. Contributed by KWON BYUNGCHANG. 2019-12-04 14:25:46 +09:00
Ayush Saxena 104ccca916 HDFS-14900. Fix build failure of hadoop-hdfs-native-client. Contributed by Masatake Iwasaki. 2019-10-10 21:36:02 +05:30
pingsutw 1dde3efb91
HADOOP-16624. Upgrade hugo to the latest version in Dockerfile 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
 2019-10-04 10:01:07 +09:00
Akira Ajisaka 0e026cb0ce
HADOOP-16620. [pb-upgrade] Remove protocol buffers 3.7.1 from requirements in BUILDING.txt (#1558) 
* Removed protobuf 3.7.1 from Dockerfile
 2019-10-03 15:24:47 +09:00
Vinayakumar B efed4450bf
HADOOP-16589. [pb-upgrade] Update docker image to make 3.7.1 protoc as default (#1482). Contributed by Vinayakumar B. 2019-09-21 10:07:26 +05:30
Vinayakumar B 39e82acc48 HADOOP-16562. [pb-upgrade] Update docker image to have 3.7.1 protoc executable (#1429). 
Addendum patch. Moved protobuf-3.7.1 installation within YETUS marker.
 2019-09-13 16:50:16 +05:30
Vinayakumar B f4f9f0fe4f
HADOOP-16562. [pb-upgrade] Update docker image to have 3.7.1 protoc executable (#1429). Contributed by Vinayakumar B. 2019-09-12 16:47:54 +05:30
Akira Ajisaka 567091aa9b
HADOOP-15958. Revisiting LICENSE and NOTICE files. 
This closes #1307

Reviewed-by: Masatake Iwasaki <iwasakims@apache.org>
 2019-08-27 13:47:12 +09:00
Akira Ajisaka 5e156b9dde
HADOOP-16061. Upgrade Yetus to 0.10.0 
This closes #1298
 2019-08-22 13:01:11 +09:00
Akira Ajisaka 34dd9ee366
HADOOP-16494. Add SHA-512 checksum to release artifact to comply with the release distribution policy. 
This closes #1243
 2019-08-22 11:01:02 +09:00
Erik Krogen ab0b180ddb HDFS-12345 Add Dynamometer to hadoop-tools, a tool for scale testing the HDFS NameNode with real metadata and workloads. Contributed by Erik Krogen. 2019-06-25 08:07:39 -07:00
Sammi Chen d1aad44490 HDFS-14356. Implement HDFS cache on SCM with native PMDK libs. Contributed by Feilong He. 2019-06-05 21:33:00 +08:00
Wanqiang Ji d23e8e9232
HADOOP-16334. Fix yetus-wrapper not working when HADOOP_YETUS_VERSION >= 0.9.0 
This closes #864

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
 2019-05-30 15:11:05 +09:00
Xieming Li bdbca0e53b
HADOOP-16052. Remove Subversion and Forrest from Dockerfile 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
 2019-04-11 19:56:15 +09:00
Akira Ajisaka af5958f7b6
HADOOP-15925. The config and log of gpg-agent are removed in create-release script. Contributed by Dinesh Chitlangia. 2018-11-16 13:16:59 +09:00
Akira Ajisaka df5e863fee
HADOOP-15930. Exclude MD5 checksum files from release artifact. 2018-11-15 10:45:34 +09:00
Akira Ajisaka 703b2860a4
HADOOP-15923. create-release script should set max-cache-ttl as well as default-cache-ttl for gpg-agent. 2018-11-13 13:40:43 +09:00
Akira Ajisaka 8f97d6f2cd
HADOOP-15822. zstd compressor can fail with a small output buffer. Contributed by Jason Lowe. 2018-10-24 13:49:28 +09:00
Eric Yang e2a9fa8448 HADOOP-15821. Move YARN Registry to Hadoop Registry. 
Contributed by Íñigo Goiri
 2018-10-19 19:46:48 -04:00
Bharat Viswanadham 62f817d32e HDDS-447. Separate ozone-dist and hadoop-dist projects with real classpath separation. Contributed by Elek Marton. 2018-09-24 10:10:11 -07:00
Márton Elek b6ad84ebb1 HDDS-468. Add version number to datanode plugin and ozone file system jar. Contributed by Bharat Viswanadham. 
(cherry picked from commit a71aea7323)
 2018-09-18 11:01:52 +02:00
Bharat Viswanadham 8b2f5e60fa HDDS-352. Separate install and testing phases in acceptance tests. Contributed by Elek Marton. 2018-09-17 17:13:52 -07:00
Bharat Viswanadham 3d89c3e73e HDDS-463. Fix the release packaging of the ozone distribution. Contributed by Elek Marton. 2018-09-17 11:49:09 -07:00
Anu Engineer 8af8453589 HDDS-435. Enhance the existing ozone documentation. 
Contributed by Elek, Marton.
 2018-09-17 10:46:28 -07:00
Bharat Viswanadham b95aa56062 HDDS-446. Provide shaded artifact to start ozone service as a datanode plugin. Contributed by Elek Marton 2018-09-14 14:12:03 -07:00
Anu Engineer 7b5886bf78 HDDS-222. Remove hdfs command line from ozone distribution. 
Contributed by Elek, Marton.
 2018-09-11 10:19:50 -07:00
Allen Wittenauer 4b8c2b1c1c
HADOOP-14671. Upgrade Apache Yetus to 0.8.0 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
 2018-09-11 08:55:34 -07:00
Mukul Kumar Singh 692736f7cf HDDS-280. Support ozone dist-start-stitching on openbsd/osx. Contributed by Elek, Marton. 2018-08-30 02:21:24 +05:30
Anu Engineer af4b705b5f HDDS-342. Add example byteman script to print out hadoop rpc traffic. 
Contributed by Elek, Marton.
 2018-08-22 14:48:22 -07:00
Xiaoyu Yao 9dd5d5ba71 HDDS-218. add existing docker-compose files to the ozone release artifact. Contributed by Elek Marton. 2018-08-17 07:58:24 -07:00
Eric Yang ba1ab08fda HADOOP-15610. Fixed pylint version for Hadoop docker image. 
Contributed by Jack Bearden
 2018-07-18 20:09:43 -04:00
Arpit Agarwal 061b168529 HDDS-167. Rename KeySpaceManager to OzoneManager. Contributed by Arpit Agarwal. 2018-07-06 12:09:05 -07:00