Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
24,152 Commits 326 Branches 371 Tags
Go to file
Clone
Open with VS Code Open with VSCodium Open with Intellij IDEA
Download ZIP Download TAR.GZ Download BUNDLE
Steve Loughran 240b25310e
HADOOP-17271. S3A connector to support IOStatistics. (#2580) 
S3A connector to support the IOStatistics API of HADOOP-16830,

This is a major rework of the S3A Statistics collection to

* Embrace the IOStatistics APIs
* Move from direct references of S3AInstrumention statistics
  collectors to interface/implementation classes in new packages.
* Ubiquitous support of IOStatistics, including:
  S3AFileSystem, input and output streams, RemoteIterator instances
  provided in list calls.
* Adoption of new statistic names from hadoop-common

Regarding statistic collection, as well as all existing
statistics, the connector now records min/max/mean durations
of HTTP GET and HEAD requests, and those of LIST operations.

Contributed by Steve Loughran.

Change-Id: I182d34b6ac39e017a8b4a221dad8e930882b39cf
2021-01-14 13:21:01 +00:00
.github
HADOOP-15184. Add GitHub pull request template. (#1419)
2019-09-11 11:10:11 +09:00
dev-support
YARN-10560. Upgrade node.js to 10.23.1 and yarn to 1.22.5 in Web UI v2. (#2592)
2021-01-06 12:14:09 +09:00
hadoop-assemblies
Preparing for 3.3.1 development
2020-04-30 13:33:42 +09:00
hadoop-build-tools
HADOOP-17100. Replace Guava Supplier with Java8+ Supplier in Hadoop. Contributed by Ahmed Hussein.
2020-07-22 18:21:14 +05:30
hadoop-client-modules
HADOOP-17371. Bump Jetty to the latest version 9.4.34. Contributed by Wei-Chiu Chuang. (#2453)
2021-01-04 11:28:26 -08:00
hadoop-cloud-storage-project
HADOOP-16080. hadoop-aws does not work with hadoop-client-api. Contributed by Chao Sun (#2522)
2020-12-12 09:37:13 -08:00
hadoop-common-project
HADOOP-17450. Add Public IOStatistics API. (#2577)
2021-01-14 13:20:17 +00:00
hadoop-dist
Preparing for 3.3.1 development
2020-04-30 13:33:42 +09:00
hadoop-hdfs-project
HDFS-15672. TestBalancerWithMultipleNameNodes#testBalancingBlockpoolsWithBlockPoolPolicy fails on trunk. (#2475)
2021-01-14 16:20:49 +09:00
hadoop-mapreduce-project
MAPREDUCE-7315. LocatedFileStatusFetcher to collect/publish IOStatistics. (#2579)
2021-01-14 13:20:38 +00:00
hadoop-maven-plugins
HADOOP-17288. Use shaded guava from thirdparty. Contributed by Ayush Saxena. #2505
2020-12-10 05:50:55 +05:30
hadoop-minicluster
Preparing for 3.3.1 development
2020-04-30 13:33:42 +09:00
hadoop-project
HADOOP-17371. Bump Jetty to the latest version 9.4.34. Contributed by Wei-Chiu Chuang. (#2453)
2021-01-04 11:28:26 -08:00
hadoop-project-dist
Make upstream aware of 3.2.2 release.
2021-01-09 18:07:10 +08:00
hadoop-tools
HADOOP-17271. S3A connector to support IOStatistics. (#2580)
2021-01-14 13:21:01 +00:00
hadoop-yarn-project
YARN-10562. Follow up changes for YARN-9833. Contributed by Jim Brennan.
2021-01-13 23:43:15 +00:00
licenses
HADOOP-15958. Revisiting LICENSE and NOTICE files.
2019-08-27 13:47:12 +09:00
licenses-binary
HADOOP-15993. Upgrade Kafka to 2.4.0 in hadoop-kafka module. (#1796)
2020-01-09 16:24:58 +09:00
.gitattributes
HADOOP-13598. Add eol=lf for unix format files in .gitattributes. Contributed by Yiqun Lin.
2016-09-14 11:14:31 +09:00
.gitignore
HADOOP-17055. Remove residual code of Ozone (#2039)
2020-05-29 16:50:10 +09:00
BUILDING.txt
HADOOP-17125. Use snappy-java in SnappyCodec (#2297)
2020-10-06 17:15:17 +01:00
Jenkinsfile
HADOOP-17438. Increase docker memory limit in Jenkins (#2560)
2021-01-12 15:35:59 +09:00
LICENSE-binary
HADOOP-17343. Upgrade AWS SDK to 1.11.901 (#2468)
2020-11-23 14:09:14 +00:00
LICENSE.txt
YARN-9561. Add C changes for the new RuncContainerRuntime. Contributed by Eric Badger
2019-12-09 01:25:10 +00:00
NOTICE-binary
HADOOP-15958. Revisiting LICENSE and NOTICE files.
2019-08-27 13:47:12 +09:00
NOTICE.txt
HADOOP-15958. Revisiting LICENSE and NOTICE files.
2019-08-27 13:47:12 +09:00
pom.xml
Preparing for 3.3.1 development
2020-04-30 13:33:42 +09:00
README.txt
HADOOP-15958. Revisiting LICENSE and NOTICE files.
2019-08-27 13:47:12 +09:00
start-build-env.sh
HADOOP-17298. Backslash in username causes build failure in the environment started by start-build-env.sh. (#2367)
2020-10-20 10:11:18 +09:00

README.txt 

For the latest information about Hadoop, please visit our website at:

   http://hadoop.apache.org/

and our wiki, at:

   https://cwiki.apache.org/confluence/display/HADOOP/
Description
No description provided
Readme 1.5 GiB
Languages
Java 92.7%
C++ 2.9%
C 1.9%
JavaScript 1.2%
Shell 0.5%
Other 0.5%