Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
24,693 Commits 326 Branches 371 Tags 1.5 GiB
Java 92.7%
C++ 2.9%
C 1.9%
JavaScript 1.2%
Shell 0.5%
Other 0.5%
Go to file
Steve Loughran e1267608ec
HADOOP-18002. ABFS rename idempotency broken -remove recovery (#3641) 
Cut modtime-based rename recovery as object modification time
is not updated during rename operation.
Applications will have to use etag API of HADOOP-17979
and implement it themselves.

Why not do the HEAD and etag recovery in ABFS client?
Cuts the IO capacity in half so kills job commit performance.
The manifest committer of MAPREDUCE-7341 will do this recovery
and act as the reference implementation of the algorithm.

Contributed by: Steve Loughran

Change-Id: I810054c9fd05041dac552f13d31fb15d7524721b
 		2021-11-17 11:53:34 +00:00
.github HADOOP-15184. Add GitHub pull request template. (#1419) 2019-09-11 11:10:11 +09:00
dev-support HADOOP-17988. Disable JIRA plugin for YETUS on Hadoop (#3610) 2021-11-09 22:05:10 +05:30
hadoop-assemblies Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
hadoop-build-tools Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
hadoop-client-modules Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
hadoop-cloud-storage-project Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
hadoop-common-project HADOOP-17999. No-op implementation of setWriteChecksum and setVerifyChecksum in ViewFileSystem. Contributed by Abhishek Das. (#3639) 2021-11-16 22:40:24 -08:00
hadoop-dist Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
hadoop-hdfs-project HDFS-16315. Add metrics related to Transfer and NativeCopy for DataNode (#3666) 2021-11-17 11:06:53 +09:00
hadoop-mapreduce-project Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
hadoop-maven-plugins Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
hadoop-minicluster Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
hadoop-project Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
hadoop-project-dist Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
hadoop-tools HADOOP-18002. ABFS rename idempotency broken -remove recovery (#3641) 2021-11-17 11:53:34 +00:00
hadoop-yarn-project Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
licenses HADOOP-17666. Update LICENSE for 3.3.1 (#3011) 2021-05-21 18:15:48 -07:00
licenses-binary HADOOP-17666. Update LICENSE for 3.3.1 (#3011) 2021-05-21 18:15:48 -07:00
.gitattributes HADOOP-13598. Add eol=lf for unix format files in .gitattributes. Contributed by Yiqun Lin. 2016-09-14 11:14:31 +09:00
.gitignore YARN-10407. Add phantomjsdriver.log to gitignore. (#2244) 2021-02-17 10:28:17 +09:00
BUILDING.txt HADOOP-17925. BUILDING.txt should not encourage to activate docs profile on building binary artifacts. (#3509) 2021-10-11 08:57:07 +00:00
LICENSE-binary HADOOP-17946. Upgrade commons-lang to 3.12.0 (#3575) 2021-11-16 22:59:25 +08:00
LICENSE-binary-yarn-applications-catalog-webapp HADOOP-17666. Update LICENSE for 3.3.1 (#3011) 2021-05-21 18:15:48 -07:00
LICENSE-binary-yarn-ui HADOOP-17666. Update LICENSE for 3.3.1 (#3011) 2021-05-21 18:15:48 -07:00
LICENSE.txt HADOOP-17666. Update LICENSE for 3.3.1 (#3011) 2021-05-21 18:15:48 -07:00
NOTICE-binary HADOOP-17666. Update LICENSE for 3.3.1 (#3011) 2021-05-21 18:15:48 -07:00
NOTICE.txt HADOOP-15958. Revisiting LICENSE and NOTICE files. 2019-08-27 13:47:12 +09:00
README.txt HADOOP-15958. Revisiting LICENSE and NOTICE files. 2019-08-27 13:47:12 +09:00
pom.xml Also update hadoop.version to 3.3.3-SNAPSHOT 2021-11-16 16:13:51 -08:00
start-build-env.sh HADOOP-17298. Backslash in username causes build failure in the environment started by start-build-env.sh. (#2367) 2020-10-20 10:11:18 +09:00

README.txt 

For the latest information about Hadoop, please visit our website at:

   http://hadoop.apache.org/

and our wiki, at:

   https://cwiki.apache.org/confluence/display/HADOOP/