hadoop

Go to file

HADOOP-17475. ABFS : add high performance listStatusIterator (#2548 )

The ABFS connector now implements listStatusIterator() with
asynchronous prefetching of the next page(s) of results.
For listing large directories this can provide tangible speedups.

If for any reason this needs to be disabled, set
fs.azure.enable.abfslistiterator to false.

Contributed by Bilahari T H.

2021-02-04 13:36:19 +00:00

.github

HADOOP-15184. Add GitHub pull request template. (#1419 )

2019-09-11 11:10:11 +09:00

dev-support

HADOOP-17509. Parallelize building of dependencies (#2669 )

2021-02-03 00:09:30 +09:00

hadoop-assemblies

HDFS-15346. FedBalance tool implementation. Contributed by Jinglun.

2020-06-18 13:33:25 +08:00

hadoop-build-tools

HADOOP-17319. Update the checkstyle config to ban some guava functions. (#2400 )

2020-10-23 04:28:17 +09:00

hadoop-client-modules

HADOOP-17424. Replace HTrace with No-Op tracer (#2645 )

2021-02-01 13:42:44 +09:00

hadoop-cloud-storage-project

HADOOP-16492. Support HuaweiCloud Object Storage as a Hadoop Backend File System. Contributed by zhongjun.

2021-01-11 18:12:12 +05:30

hadoop-common-project

HDFS-15624. fix the function of setting quota by storage type (#2377 )

2021-02-02 22:44:34 -08:00

hadoop-dist

Preparing for 3.4.0 development

2020-03-29 23:24:25 +05:30

hadoop-hdfs-project

HDFS-15779. EC: fix NPE caused by StripedWriter.clearBuffers during reconstruct block. Contributed by Hongbing Wang

2021-02-04 09:19:51 +08:00

hadoop-mapreduce-project

MAPREDUCE-7317. Add latency information in FileOutputCommitter.mergePaths. (#2624 )

2021-01-27 19:08:08 +00:00

hadoop-maven-plugins

HADOOP-17288. Use shaded guava from thirdparty. (#2342 ). Contributed by Ayush Saxena.

2020-10-17 12:01:18 +05:30

hadoop-minicluster

HDFS-15331. Remove invalid exclusions that minicluster dependency on HDFS (#1996 ). Contributed by Wanqiang Ji

2020-05-06 02:06:38 +05:30

hadoop-project

HADOOP-17424. Replace HTrace with No-Op tracer (#2645 )

2021-02-01 13:42:44 +09:00

hadoop-project-dist

Make upstream aware of 3.2.2 release.

2021-01-09 18:06:08 +08:00

hadoop-tools

HADOOP-17475. ABFS : add high performance listStatusIterator (#2548 )

2021-02-04 13:36:19 +00:00

hadoop-yarn-project

YARN-10612. Fix findbugs issue introduced in YARN-10585. Contributed by Gergely Pollak

2021-02-04 08:12:13 +01:00

licenses

HADOOP-17144. Update Hadoop's lz4 to v1.9.2. Contributed by Hemanth Boyina.

2020-10-18 18:37:46 +05:30

licenses-binary

HADOOP-15993. Upgrade Kafka to 2.4.0 in hadoop-kafka module. (#1796 )

2020-01-09 16:24:58 +09:00

.asf.yaml

HADOOP-17234. Add .asf.yaml to allow Github to Jira integration. (#2253 ). Contributed by Ayush Saxena.

2020-08-28 17:22:46 +05:30

.gitattributes

HADOOP-13598. Add eol=lf for unix format files in .gitattributes. Contributed by Yiqun Lin.

2016-09-14 11:14:31 +09:00

.gitignore

YARN-10407. Add phantomjsdriver.log to gitignore. (#2244 )

2020-09-01 10:44:55 +09:00

BUILDING.txt

HADOOP-17508. Simplify deps install instructions (#2664 )

2021-02-02 14:33:17 +09:00

LICENSE-binary

HADOOP-17343. Upgrade AWS SDK to 1.11.901 (#2468 )

2020-11-23 14:08:12 +00:00

LICENSE.txt

HADOOP-17283. Hadoop - Upgrade to jQuery 3.5.1 (#2330 )

2020-09-24 21:15:55 +09:00

NOTICE-binary

HADOOP-15958. Revisiting LICENSE and NOTICE files.

2019-08-27 13:47:12 +09:00

NOTICE.txt

HADOOP-15958. Revisiting LICENSE and NOTICE files.

2019-08-27 13:47:12 +09:00

pom.xml

upate the hadoop.version property in the root pom.xml and hadoop.assemblies.version in hadoop-project/pom.xml (see HADOOP-15369)

2020-03-29 23:44:20 +05:30

README.txt

HADOOP-15958. Revisiting LICENSE and NOTICE files.

2019-08-27 13:47:12 +09:00

start-build-env.sh

HADOOP-17298. Backslash in username causes build failure in the environment started by start-build-env.sh. (#2367 )

2020-10-20 10:09:03 +09:00

README.txt

For the latest information about Hadoop, please visit our website at:

   http://hadoop.apache.org/

and our wiki, at:

   https://cwiki.apache.org/confluence/display/HADOOP/

Languages

Java 92.7%

C++ 2.9%

C 1.9%

JavaScript 1.2%

Shell 0.5%

Other 0.5%