hadoop

History

Gautham B A 0d06fd77de HADOOP-18134. Setup Jenkins nightly CI for Windows 10 (#5062 ) This PR gets Yetus to run on Windows 10 against the Hadoop codebase. It introduces the following changes to allow us to setup the nightly CI on Jenkins for Hadoop on Windows 10. * Hadoop personality changes for Yetus. Additional arguments have been passed, which are necessary to build and test Hadoop on Windows 10. * Docker image for building Hadoop on Windows 10. Installs the necessary tools that are needed to run Yetus. * dev-support/jenkins.sh file. Passing of some flags are handled here which are needed for the nightly CI.		2023-05-03 22:44:54 +05:30
..
bin	HADOOP-18134. Setup Jenkins nightly CI for Windows 10 (#5062 )	2023-05-03 22:44:54 +05:30
byteman	HDDS-342. Add example byteman script to print out hadoop rpc traffic.	2018-08-22 14:48:22 -07:00
code-formatter	HADOOP-17892. Add Hadoop code formatter in dev-support (#3387 )	2021-09-23 12:34:19 +08:00
docker	HADOOP-18134. Setup Jenkins nightly CI for Windows 10 (#5062 )	2023-05-03 22:44:54 +05:30
git-jira-validation	HADOOP-18251. Fix failure of extracting JIRA id from commit message in git_jira_fix_version_check.py. (#4344 )	2022-05-26 12:23:30 +09:00
Jenkinsfile	HADOOP-11867. Add a high-performance vectored read API. (#3904 )	2022-06-22 17:29:32 +01:00
README.md	HADOOP-12651. Replace dev-support with wrappers to Yetus (aw)	2016-01-21 13:03:34 -08:00
findHangingTest.sh	HADOOP-13963. /bin/bash is hard coded in some of the scripts. Contributed by Ajay Yadav.	2017-08-04 10:40:52 -07:00
hadoop-vote.sh	HADOOP-18228. Update hadoop-vote to use HADOOP_RC_VERSION dir (#4272 )	2022-05-16 07:34:39 -07:00
jenkins.sh	HADOOP-18134. Setup Jenkins nightly CI for Windows 10 (#5062 )	2023-05-03 22:44:54 +05:30
verify-xml.sh	HADOOP-13963. /bin/bash is hard coded in some of the scripts. Contributed by Ajay Yadav.	2017-08-04 10:40:52 -07:00
win-paths-eg.cmd	HADOOP-14667. Flexible Visual Studio support. Contributed by Allen Wittenauer	2018-03-19 16:05:55 -07:00

README.md

This directory contains tools to help in the development and release of Apache Hadoop.

bin
- releasedocmaker
  
  Build release notes for a given Hadoop project or subproject. This is called from Maven when -Preleasedocs is used. See BUILDING.txt for more information.
- shelldocs
  
  Create documentation for the Unix Shell API. This is called from Maven when -Pshelldocs is used.
- smart-apply-patch
  
  Intelligently apply a patch file to a source tree.
- test-patch
  
  Test a patch against a source tree.
create-release.sh

Helps REs create a release of Apache Hadoop for distribution.
determine-flaky-tests-hadoop.py

Given a jenkins test job, this script examines all runs of the job done within specified period of time (number of days prior to the execution time of this script), and reports all failed tests.
docker

Various helpers for the start-build-env.sh script, including the Dockerfile itself. See parent BUILDING.txt for more information.
findHangingTest.sh

Finds hanging test from Jenkins build output.

Previously, the scripts test-patch.sh, smart-apply-patch.sh, releasedocmaker.py, and shelldocs.py were in this directory. They have been moved to the Apache Yetus project (https://yetus.apache.org). These scripts have been replaced with wrapper scripts located in the bin directory. Command line options are generally different than the previous versions that shipped with older versions of Apache Hadoop.

The wrapper scripts will download, verify (if GPG is installed), and cache a local copy of Apache Yetus in the hadoop/patchprocess directory. The version that is used may be overridden by setting the HADOOP_YETUS_VERSION environment variable. The cache directory may be overwritten by setting the HADOOP_PATCHPROCESS directory. If a local version of Apache Yetus is already installed, it may be used instead by setting the YETUS_HOME environment variable to point to that directory.