From f98b5ae3bb8d4ecc0940a63ced9341f3d76148f1 Mon Sep 17 00:00:00 2001 From: Akira Ajisaka Date: Tue, 18 Aug 2015 23:31:52 +0900 Subject: [PATCH] HDFS-8852. HDFS architecture documentation of version 2.x is outdated about append write support. Contributed by Ajith S. (cherry picked from commit fc509f66d814e7a5ed81d5d73b23c400625d573b) (cherry picked from commit 38b344adfa7a0e57cad8931fb5c699ad4d48150f) --- hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt | 3 +++ .../hadoop-hdfs/src/site/markdown/HdfsDesign.md | 2 +- 2 files changed, 4 insertions(+), 1 deletion(-) diff --git a/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt b/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt index b35cc05661f..0f9d0c7f5b2 100644 --- a/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt +++ b/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt @@ -22,6 +22,9 @@ Release 2.7.2 - UNRELEASED HDFS-8806. Inconsistent metrics: number of missing blocks with replication factor 1 not properly cleared. (Zhe Zhang via aajisaka) + HDFS-8852. HDFS architecture documentation of version 2.x is outdated + about append write support. (Ajith S via aajisaka) + Release 2.7.1 - 2015-07-06 INCOMPATIBLE CHANGES diff --git a/hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HdfsDesign.md b/hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HdfsDesign.md index 87a9fcd1cef..30571c88a2b 100644 --- a/hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HdfsDesign.md +++ b/hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HdfsDesign.md @@ -73,7 +73,7 @@ Applications that run on HDFS have large data sets. A typical file in HDFS is gi ### Simple Coherency Model -HDFS applications need a write-once-read-many access model for files. A file once created, written, and closed need not be changed. This assumption simplifies data coherency issues and enables high throughput data access. A Map/Reduce application or a web crawler application fits perfectly with this model. There is a plan to support appending-writes to files in the future. +HDFS applications need a write-once-read-many access model for files. A file once created, written, and closed need not be changed except for appends and truncates. Appending the content to the end of the files is supported but cannot be updated at arbitrary point. This assumption simplifies data coherency issues and enables high throughput data access. A MapReduce application or a web crawler application fits perfectly with this model. ### "Moving Computation is Cheaper than Moving Data"