Go to file
Steve Loughran 1921e94292
HADOOP-16458. LocatedFileStatusFetcher.getFileStatuses failing intermittently with S3
Contributed by Steve Loughran.

Includes
-S3A glob scans don't bother trying to resolve symlinks
-stack traces don't get lost in getFileStatuses() when exceptions are wrapped
-debug level logging of what is up in Globber
-Contains HADOOP-13373. Add S3A implementation of FSMainOperationsBaseTest.
-ITestRestrictedReadAccess tests incomplete read access to files.

This adds a builder API for constructing globbers which other stores can use
so that they too can skip symlink resolution when not needed.

Change-Id: I23bcdb2783d6bd77cf168fdc165b1b4b334d91c7
2019-10-01 18:11:05 +01:00
.github HADOOP-15184. Add GitHub pull request template. (#1419) 2019-09-11 11:10:11 +09:00
dev-support HADOOP-16589. [pb-upgrade] Update docker image to make 3.7.1 protoc as default (#1482). Contributed by Vinayakumar B. 2019-09-21 10:07:26 +05:30
hadoop-assemblies HADOOP-16534. Exclude submarine from hadoop source build. (#1356) 2019-09-03 17:40:38 +05:30
hadoop-build-tools HADOOP-16331. Fix ASF License check in pom.xml 2019-05-29 17:25:13 +09:00
hadoop-client-modules HADOOP-16557. [pb-upgrade] Upgrade protobuf.version to 3.7.1 (#1432) 2019-09-20 16:08:30 +05:30
hadoop-cloud-storage-project HADOOP-15616. Incorporate Tencent Cloud COS File System Implementation. Contributed by Yang Yu. 2019-09-27 16:53:13 +08:00
hadoop-common-project HADOOP-16458. LocatedFileStatusFetcher.getFileStatuses failing intermittently with S3 2019-10-01 18:11:05 +01:00
hadoop-dist HDFS-14639. [Dynamometer] Remove unnecessary duplicate directory from the distribution. Contributed by Erik Krogen. 2019-07-29 13:50:14 -07:00
hadoop-hdds HDDS-2166. Some RPC metrics are missing from SCM prometheus endpoint 2019-10-01 18:01:51 +02:00
hadoop-hdfs-project HDFS-14492. Snapshot memory leak. Contributed by Wei-Chiu Chuang. (#1370) 2019-10-01 21:16:46 +05:30
hadoop-mapreduce-project HADOOP-16458. LocatedFileStatusFetcher.getFileStatuses failing intermittently with S3 2019-10-01 18:11:05 +01:00
hadoop-maven-plugins HADOOP-16331. Fix ASF License check in pom.xml 2019-05-29 17:25:13 +09:00
hadoop-minicluster HADOOP-16331. Fix ASF License check in pom.xml 2019-05-29 17:25:13 +09:00
hadoop-ozone HDDS-2205. checkstyle.sh reports wrong failure count 2019-09-30 16:32:38 -07:00
hadoop-project HADOOP-15616. Incorporate Tencent Cloud COS File System Implementation. Contributed by Yang Yu. 2019-09-27 16:53:13 +08:00
hadoop-project-dist Make upstream aware of 3.2.1 release. 2019-09-23 06:20:54 +00:00
hadoop-submarine SUBMARINE-45. Can't specify queue by using the parameter --queue. Contributed by Ayush Saxena, Zac Zhou. 2019-08-15 13:18:29 +08:00
hadoop-tools HADOOP-16458. LocatedFileStatusFetcher.getFileStatuses failing intermittently with S3 2019-10-01 18:11:05 +01:00
hadoop-yarn-project YARN-9801. SchedConfCli does not work wiwith https mode. Contributed by Prabhu Joseph 2019-10-01 20:06:21 +05:30
licenses HADOOP-15958. Revisiting LICENSE and NOTICE files. 2019-08-27 13:47:12 +09:00
licenses-binary HADOOP-15958. Revisiting LICENSE and NOTICE files. 2019-08-27 13:47:12 +09:00
.gitattributes HADOOP-13598. Add eol=lf for unix format files in .gitattributes. Contributed by Yiqun Lin. 2016-09-14 11:14:31 +09:00
.gitignore HDDS-1115. Provide ozone specific top-level pom.xml. 2019-02-24 14:40:52 -08:00
BUILDING.txt HADOOP-16557. [pb-upgrade] Upgrade protobuf.version to 3.7.1 (#1432) 2019-09-20 16:08:30 +05:30
Jenkinsfile HADOOP-16183. Use latest Yetus to support ozone specific build process 2019-05-02 16:48:30 +02:00
LICENSE-binary HADOOP-16555. Update commons-compress to 1.19. (#1425) Contributed by YiSheng Lien. 2019-09-14 02:11:04 +08:00
LICENSE.txt HADOOP-15958. Revisiting LICENSE and NOTICE files. 2019-08-27 13:47:12 +09:00
NOTICE-binary HADOOP-15958. Revisiting LICENSE and NOTICE files. 2019-08-27 13:47:12 +09:00
NOTICE.txt HADOOP-15958. Revisiting LICENSE and NOTICE files. 2019-08-27 13:47:12 +09:00
README.txt HADOOP-15958. Revisiting LICENSE and NOTICE files. 2019-08-27 13:47:12 +09:00
pom.ozone.xml HDDS-2149. Replace findbugs with spotbugs 2019-09-26 22:56:05 -07:00
pom.xml HADOOP-15184. Add GitHub pull request template. (#1419) 2019-09-11 11:10:11 +09:00
start-build-env.sh HADOOP-16240. start-build-env.sh can consume all disk space during image creation. 2019-04-10 08:48:11 -07:00

README.txt

For the latest information about Hadoop, please visit our website at:

   http://hadoop.apache.org/

and our wiki, at:

   https://cwiki.apache.org/confluence/display/HADOOP/