HADOOP-7789. Improvements to site navigation.

git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195876 13f79535-47bb-0310-9956-ffa450edef68
This commit is contained in:
Arun Murthy 2011-11-01 08:53:38 +00:00
parent 4e42044b1c
commit 1112a50ad3
4 changed files with 65 additions and 48 deletions

View File

@ -515,6 +515,8 @@ Release 0.23.0 - 2011-11-01
HADOOP-7782. Aggregate project javadocs. (tomwhite) HADOOP-7782. Aggregate project javadocs. (tomwhite)
HADOOP-7789. Improvements to site navigation. (acmurthy)
OPTIMIZATIONS OPTIMIZATIONS
HADOOP-7333. Performance improvement in PureJavaCrc32. (Eric Caspole HADOOP-7333. Performance improvement in PureJavaCrc32. (Eric Caspole

View File

@ -11,32 +11,12 @@
~~ limitations under the License. See accompanying LICENSE file. ~~ limitations under the License. See accompanying LICENSE file.
--- ---
Apache Hadoop 0.23 Apache Hadoop NextGen MapReduce
--- ---
--- ---
${maven.build.timestamp} ${maven.build.timestamp}
Apache Hadoop 0.23 MapReduce NextGen aka YARN aka MRv2
Apache Hadoop 0.23 consists of significant improvements over the previous
stable release (hadoop-0.20.205).
Here is a short overview of the improvments to both HDFS and MapReduce.
* {HDFS Federation}
In order to scale the name service horizontally, <federation> uses multiple
independent Namenodes/Namespaces. The Namenodes are federated, that is, the
Namenodes are independent and don't require coordination with each other.
The datanodes are used as common storage for blocks by all the Namenodes.
Each datanode registers with all the Namenodes in the cluster. Datanodes
send periodic heartbeats and block reports and handles commands from the
Namenodes.
More details are available in the {{{./Federation.html}HDFS Federation}}
document.
* {MapReduce NextGen aka YARN aka MRv2}
The new architecture introduced in hadoop-0.23, divides the two major The new architecture introduced in hadoop-0.23, divides the two major
functions of the JobTracker: resource management and job life-cycle management functions of the JobTracker: resource management and job life-cycle management
@ -59,23 +39,12 @@ Apache Hadoop 0.23
More details are available in the {{{./YARN.html}YARN}} More details are available in the {{{./YARN.html}YARN}}
document. document.
* Release Documentation * Documentation
* {{{./SingleCluster.html}Setting up a Single Node Cluster}}
* {{{./ClusterSetup.html}Setting up a full-fledged Hadoop Cluster}}
* {{{./CapacityScheduler.html}Capacity Scheduler}}
* {{{./Federation.html}HDFS Federation feature description, configuration and
management}}
* {{{./YARN.html}NextGen MapReduce}} * {{{./YARN.html}NextGen MapReduce}}
* User Documentation
* {{{./WritingYarnApplications.html}Writing Yarn Applications}} * {{{./WritingYarnApplications.html}Writing Yarn Applications}}
* {{{./apidocs/index.html}JavaDocs}} * {{{./CapacityScheduler.html}Capacity Scheduler}}

View File

@ -11,11 +11,55 @@
~~ limitations under the License. See accompanying LICENSE file. ~~ limitations under the License. See accompanying LICENSE file.
--- ---
Hadoop ${project.version} Apache Hadoop ${project.version}
--- ---
--- ---
${maven.build.timestamp} ${maven.build.timestamp}
Apache Hadoop 0.23
Apache Hadoop 0.23 consists of significant improvements over the previous
stable release (hadoop-0.20.205).
Here is a short overview of the improvments to both HDFS and MapReduce.
* {HDFS Federation}
In order to scale the name service horizontally, federation uses multiple
independent Namenodes/Namespaces. The Namenodes are federated, that is, the
Namenodes are independent and don't require coordination with each other.
The datanodes are used as common storage for blocks by all the Namenodes.
Each datanode registers with all the Namenodes in the cluster. Datanodes
send periodic heartbeats and block reports and handles commands from the
Namenodes.
More details are available in the
{{{./hadoop-yarn/hadoop-yarn-site/Federation.html}HDFS Federation}}
document.
* {MapReduce NextGen aka YARN aka MRv2}
The new architecture introduced in hadoop-0.23, divides the two major
functions of the JobTracker: resource management and job life-cycle management
into separate components.
The new ResourceManager manages the global assignment of compute resources to
applications and the per-application ApplicationMaster manages the
applicationÄôs scheduling and coordination.
An application is either a single job in the sense of classic MapReduce jobs
or a DAG of such jobs.
The ResourceManager and per-machine NodeManager daemon, which manages the
user processes on that machine, form the computation fabric.
The per-application ApplicationMaster is, in effect, a framework specific
library and is tasked with negotiating resources from the ResourceManager and
working with the NodeManager(s) to execute and monitor the tasks.
More details are available in the
{{{./hadoop-yarn/hadoop-yarn-site/YARN.html}YARN}}
document.
Getting Started Getting Started

View File

@ -46,14 +46,10 @@
<item name="Hadoop" href="http://hadoop.apache.org/"/> <item name="Hadoop" href="http://hadoop.apache.org/"/>
</breadcrumbs> </breadcrumbs>
<menu name="Auth" inherit="top">
<item name="Overview" href="hadoop-auth/index.html"/>
<item name="Examples" href="hadoop-auth/Examples.html"/>
<item name="Configuration" href="hadoop-auth/Configuration.html"/>
<item name="Building" href="hadoop-auth/BuildingIt.html"/>
</menu>
<menu name="Common" inherit="top"> <menu name="Common" inherit="top">
<item name="Overview" href="index.html"/>
<item name="Single Node Setup" href="hadoop-yarn/hadoop-yarn-site/SingleCluster.html"/>
<item name="Cluster Setup" href="hadoop-yarn/hadoop-yarn-site/ClusterSetup.html"/>
</menu> </menu>
<menu name="HDFS" inherit="top"> <menu name="HDFS" inherit="top">
@ -61,14 +57,20 @@
</menu> </menu>
<menu name="MapReduce" inherit="top"> <menu name="MapReduce" inherit="top">
<item name="Overview" href="hadoop-yarn/hadoop-yarn-site/index.html"/> <item name="YARN Architecture" href="hadoop-yarn/hadoop-yarn-site/YARN.html"/>
<item name="Single Node Setup" href="hadoop-yarn/hadoop-yarn-site/SingleCluster.html"/>
<item name="Cluster Setup" href="hadoop-yarn/hadoop-yarn-site/ClusterSetup.html"/>
<item name="Writing Yarn Applications" href="hadoop-yarn/hadoop-yarn-site/WritingYarnApplications.html"/> <item name="Writing Yarn Applications" href="hadoop-yarn/hadoop-yarn-site/WritingYarnApplications.html"/>
<item name="Capacity Scheduler" href="hadoop-yarn/hadoop-yarn-site/CapacityScheduler.html"/> <item name="Capacity Scheduler" href="hadoop-yarn/hadoop-yarn-site/CapacityScheduler.html"/>
</menu> </menu>
<menu name="Auth" inherit="top">
<item name="Overview" href="hadoop-auth/index.html"/>
<item name="Examples" href="hadoop-auth/Examples.html"/>
<item name="Configuration" href="hadoop-auth/Configuration.html"/>
<item name="Building" href="hadoop-auth/BuildingIt.html"/>
</menu>
<menu name="Reference" inherit="top"> <menu name="Reference" inherit="top">
<item name="Release Notes" href="hadoop-project-dist/hadoop-common/releasenotes.html"/>
<item name="API docs" href="api/index.html"/> <item name="API docs" href="api/index.html"/>
<item name="core-default.xml" href="hadoop-project-dist/hadoop-common/core-default.xml"/> <item name="core-default.xml" href="hadoop-project-dist/hadoop-common/core-default.xml"/>
<item name="hdfs-default.xml" href="hadoop-project-dist/hadoop-hdfs/hdfs-default.xml"/> <item name="hdfs-default.xml" href="hadoop-project-dist/hadoop-hdfs/hdfs-default.xml"/>