Go to file
Steve Loughran 088684ec60
HADOOP-18091. S3A auditing leaks memory through ThreadLocal references (#3930)
Adds a new map type WeakReferenceMap, which stores weak
references to values, and a WeakReferenceThreadMap subclass
to more closely resemble a thread local type, as it is a
map of threadId to value.

Construct it with a factory method and optional callback
for notification on loss and regeneration.

 WeakReferenceThreadMap<WrappingAuditSpan> activeSpan =
      new WeakReferenceThreadMap<>(
          (k) -> getUnbondedSpan(),
          this::noteSpanReferenceLost);

This is used in ActiveAuditManagerS3A for span tracking.

Relates to
* HADOOP-17511. Add an Audit plugin point for S3A
* HADOOP-18094. Disable S3A auditing by default.

Contributed by Steve Loughran.

Change-Id: Ibf7bb082fd47298f7ebf46d92f56e80ca9b2aaf8
2022-02-10 12:33:40 +00:00
.github HADOOP-15184. Add GitHub pull request template. (#1419) 2019-09-11 11:10:11 +09:00
dev-support HADOOP-18048. [branch-3.3] Dockerfile_aarch64 build fails with fatal error: Python.h: No such file or directory (#3801) 2021-12-14 17:56:58 -08:00
hadoop-assemblies Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
hadoop-build-tools Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
hadoop-client-modules HADOOP-18033. Upgrade fasterxml Jackson to 2.13.0 (#3764) 2021-12-13 13:52:44 +09:00
hadoop-cloud-storage-project Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
hadoop-common-project HADOOP-18091. S3A auditing leaks memory through ThreadLocal references (#3930) 2022-02-10 12:33:40 +00:00
hadoop-dist Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
hadoop-hdfs-project HDFS-16437 ReverseXML processor doesn't accept XML files without the … (#3926) 2022-02-06 13:36:57 +08:00
hadoop-mapreduce-project HADOOP-18033. Upgrade fasterxml Jackson to 2.13.0 (#3764) 2021-12-13 13:52:44 +09:00
hadoop-maven-plugins Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
hadoop-minicluster Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
hadoop-project YARN-10561. Upgrade node.js to 12.22.1 and yarn to 1.22.5 in YARN application catalog webapp (#2591) 2022-01-28 15:52:33 +09:00
hadoop-project-dist Make upstream aware of 3.3.1 release 2022-01-04 14:48:49 -08:00
hadoop-tools HADOOP-18091. S3A auditing leaks memory through ThreadLocal references (#3930) 2022-02-10 12:33:40 +00:00
hadoop-yarn-project YARN-10561. Upgrade node.js to 12.22.1 and yarn to 1.22.5 in YARN application catalog webapp (#2591) 2022-01-28 15:52:33 +09:00
licenses HADOOP-17666. Update LICENSE for 3.3.1 (#3011) 2021-05-21 18:15:48 -07:00
licenses-binary HADOOP-17666. Update LICENSE for 3.3.1 (#3011) 2021-05-21 18:15:48 -07:00
.gitattributes HADOOP-13598. Add eol=lf for unix format files in .gitattributes. Contributed by Yiqun Lin. 2016-09-14 11:14:31 +09:00
.gitignore YARN-10407. Add phantomjsdriver.log to gitignore. (#2244) 2021-02-17 10:28:17 +09:00
BUILDING.txt HADOOP-17925. BUILDING.txt should not encourage to activate docs profile on building binary artifacts. (#3509) 2021-10-11 08:57:07 +00:00
LICENSE-binary HADOOP-17946. Upgrade commons-lang to 3.12.0 (#3575) 2021-11-16 22:59:25 +08:00
LICENSE-binary-yarn-applications-catalog-webapp HADOOP-17666. Update LICENSE for 3.3.1 (#3011) 2021-05-21 18:15:48 -07:00
LICENSE-binary-yarn-ui HADOOP-17666. Update LICENSE for 3.3.1 (#3011) 2021-05-21 18:15:48 -07:00
LICENSE.txt HADOOP-17666. Update LICENSE for 3.3.1 (#3011) 2021-05-21 18:15:48 -07:00
NOTICE-binary HADOOP-18068. upgrade AWS SDK to 1.12.132 (#3864) 2022-01-18 12:20:12 +00:00
NOTICE.txt HADOOP-15958. Revisiting LICENSE and NOTICE files. 2019-08-27 13:47:12 +09:00
README.txt HADOOP-15958. Revisiting LICENSE and NOTICE files. 2019-08-27 13:47:12 +09:00
pom.xml Also update hadoop.version to 3.3.3-SNAPSHOT 2021-11-16 16:13:51 -08:00
start-build-env.sh HADOOP-18052. Support Apple Silicon in start-build-env.sh (#3817) 2021-12-23 18:14:16 +09:00

README.txt

For the latest information about Hadoop, please visit our website at:

   http://hadoop.apache.org/

and our wiki, at:

   https://cwiki.apache.org/confluence/display/HADOOP/