Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
19 Commits 326 Branches 371 Tags 1.5 GiB
Java 92.7%
C++ 2.9%
C 1.9%
JavaScript 1.2%
Shell 0.5%
Other 0.5%
Go to file
Elek, Márton 3f6d7a6ce2 HDDS-1630. Copy default configuration files to the writeable directory (#888) 2019-06-11 11:07:12 -07:00
scripts HDDS-1630. Copy default configuration files to the writeable directory (#888) 2019-06-11 11:07:12 -07:00
.gitignore HADOOP-15083. Create base image for running hadoop in docker containers. Contributed by Elek, Marton. 2018-03-06 15:32:33 -08:00
Dockerfile HDDS-1632. Make the hadoop home word readable and avoid sudo in hadoop-runner. 2019-06-04 01:15:52 -05:00
LICENSE HADOOP-15083. Create base image for running hadoop in docker containers. Contributed by Elek, Marton. 2018-03-06 15:32:33 -08:00
README.md HDDS-189. Update HDDS to start OzoneManager. Contributed by Arpit Agarwal. 2018-06-25 09:17:29 -07:00
build.sh HDDS-1633. Update rat from 0.12 to 0.13 in hadoop-runner build script (#891) 2019-06-04 01:22:12 -05:00

README.md

Apache Hadoop base image

This is the definition of the Apache Hadoop base image. It doesn't use any Hadoop distribution just the scripts to run any Hadoop from source or from a prebuild package.

Build

To create a local version of this image use the following command:

docker build -t apache/hadoop-runner .

Usage

Do a full build on Apache Hadoop trunk with the hdds profile enabled.

mvn clean install package -DskipTests -Pdist,hdds -Dtar -Dmaven.javadoc.skip=true

Then start HDDS services with docker-compose.

cd hadoop-dist/target/compose/ozone
docker-compose up -d

Troubleshooting

If docker-compose fails to work, check that the hadoop-dist/target/compose/ozone/.env file exists and has a line like the following (the exact version number may be different):

    HDDS_VERSION=0.2.1-SNAPSHOT