hadoop/hadoop-tools/hadoop-azure
Pranav Saxena 419a4d7969
HADOOP-18546. ABFS. disable purging list of in progress reads in abfs stream close() (#5176)
This addresses HADOOP-18521, "ABFS ReadBufferManager buffer sharing
across concurrent HTTP requests" by not trying to cancel
in progress reads.

It supercedes HADOOP-18528, which disables the prefetching.
If that patch is applied *after* this one, prefetching
will be disabled.

As well as changing the default value in the code,
core-default.xml is updated to set
fs.azure.enable.readahead = true

As a result, if Configuration.get("fs.azure.enable.readahead")
returns a non-null value, then it can be inferred that
it was set in or core-default.xml (the fix is present)
or in core-site.xml (someone asked for it).

Note: this commit contains the followup commit:
  HADOOP-18546. Followup: ITestReadBufferManager fix (#5198)
That is needed to avoid race conditions in the test.

Contributed by Pranav Saxena.
2022-12-09 13:52:36 +00:00
..
dev-support HADOOP-17770 WASB : Support disabling buffered reads in positional reads (#3233) 2021-10-22 11:45:42 +05:30
src HADOOP-18546. ABFS. disable purging list of in progress reads in abfs stream close() (#5176) 2022-12-09 13:52:36 +00:00
.gitignore HADOOP-17191. ABFS: Run the tests with various combinations of configurations and publish a consolidated results (#2597) 2021-03-10 18:25:41 +00:00
pom.xml HADOOP-18470. Release Hadoop 3.3.5 -pom updates 2022-11-30 15:42:33 +00:00