YARN-3169. Drop YARN's overview document. Contributed by Brahma Reddy Battula.
(cherry picked from commit b419c1b2ec
)
This commit is contained in:
parent
3ee1b50dad
commit
5ddc3adb0d
|
@ -113,7 +113,6 @@
|
||||||
</menu>
|
</menu>
|
||||||
|
|
||||||
<menu name="YARN" inherit="top">
|
<menu name="YARN" inherit="top">
|
||||||
<item name="Overview" href="hadoop-yarn/hadoop-yarn-site/index.html"/>
|
|
||||||
<item name="YARN Architecture" href="hadoop-yarn/hadoop-yarn-site/YARN.html"/>
|
<item name="YARN Architecture" href="hadoop-yarn/hadoop-yarn-site/YARN.html"/>
|
||||||
<item name="Capacity Scheduler" href="hadoop-yarn/hadoop-yarn-site/CapacityScheduler.html"/>
|
<item name="Capacity Scheduler" href="hadoop-yarn/hadoop-yarn-site/CapacityScheduler.html"/>
|
||||||
<item name="Fair Scheduler" href="hadoop-yarn/hadoop-yarn-site/FairScheduler.html"/>
|
<item name="Fair Scheduler" href="hadoop-yarn/hadoop-yarn-site/FairScheduler.html"/>
|
||||||
|
|
|
@ -144,6 +144,8 @@ Release 2.8.0 - UNRELEASED
|
||||||
YARN-3523. Cleanup ResourceManagerAdministrationProtocol interface audience.
|
YARN-3523. Cleanup ResourceManagerAdministrationProtocol interface audience.
|
||||||
(Naganarasimha G R via junping_du)
|
(Naganarasimha G R via junping_du)
|
||||||
|
|
||||||
|
YARN-3169. Drop YARN's overview document. (Brahma Reddy Battula via ozawa)
|
||||||
|
|
||||||
OPTIMIZATIONS
|
OPTIMIZATIONS
|
||||||
|
|
||||||
YARN-3339. TestDockerContainerExecutor should pull a single image and not
|
YARN-3339. TestDockerContainerExecutor should pull a single image and not
|
||||||
|
|
|
@ -1,75 +0,0 @@
|
||||||
<!---
|
|
||||||
Licensed under the Apache License, Version 2.0 (the "License");
|
|
||||||
you may not use this file except in compliance with the License.
|
|
||||||
You may obtain a copy of the License at
|
|
||||||
|
|
||||||
http://www.apache.org/licenses/LICENSE-2.0
|
|
||||||
|
|
||||||
Unless required by applicable law or agreed to in writing, software
|
|
||||||
distributed under the License is distributed on an "AS IS" BASIS,
|
|
||||||
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
|
|
||||||
See the License for the specific language governing permissions and
|
|
||||||
limitations under the License. See accompanying LICENSE file.
|
|
||||||
-->
|
|
||||||
|
|
||||||
MapReduce NextGen aka YARN aka MRv2
|
|
||||||
===================================
|
|
||||||
|
|
||||||
The new architecture introduced in hadoop-0.23, divides the two major functions of the JobTracker: resource management and job life-cycle management into separate components.
|
|
||||||
|
|
||||||
The new ResourceManager manages the global assignment of compute resources to applications and the per-application ApplicationMaster manages the application’s scheduling and coordination.
|
|
||||||
|
|
||||||
An application is either a single job in the sense of classic MapReduce jobs or a DAG of such jobs.
|
|
||||||
|
|
||||||
The ResourceManager and per-machine NodeManager daemon, which manages the user processes on that machine, form the computation fabric.
|
|
||||||
|
|
||||||
The per-application ApplicationMaster is, in effect, a framework specific library and is tasked with negotiating resources from the ResourceManager and working with the NodeManager(s) to execute and monitor the tasks.
|
|
||||||
|
|
||||||
More details are available in the [Architecture](./YARN.html) document.
|
|
||||||
|
|
||||||
Documentation Index
|
|
||||||
===================
|
|
||||||
|
|
||||||
YARN
|
|
||||||
----
|
|
||||||
|
|
||||||
* [YARN Architecture](./YARN.html)
|
|
||||||
|
|
||||||
* [Capacity Scheduler](./CapacityScheduler.html)
|
|
||||||
|
|
||||||
* [Fair Scheduler](./FairScheduler.html)
|
|
||||||
|
|
||||||
* [ResourceManager Restart](./ResourceManagerRestart.htaml)
|
|
||||||
|
|
||||||
* [ResourceManager HA](./ResourceManagerHA.html)
|
|
||||||
|
|
||||||
* [Web Application Proxy](./WebApplicationProxy.html)
|
|
||||||
|
|
||||||
* [YARN Timeline Server](./TimelineServer.html)
|
|
||||||
|
|
||||||
* [Writing YARN Applications](./WritingYarnApplications.html)
|
|
||||||
|
|
||||||
* [YARN Commands](./YarnCommands.html)
|
|
||||||
|
|
||||||
* [Scheduler Load Simulator](#hadoop-slsSchedulerLoadSimulator.html)
|
|
||||||
|
|
||||||
* [NodeManager Restart](./NodeManagerRestart.html)
|
|
||||||
|
|
||||||
* [DockerContainerExecutor](./DockerContainerExecutor.html)
|
|
||||||
|
|
||||||
* [Using CGroups](./NodeManagerCGroups.html)
|
|
||||||
|
|
||||||
* [Secure Containers](./SecureContainer.html)
|
|
||||||
|
|
||||||
* [Registry](./registry/index.html)
|
|
||||||
|
|
||||||
YARN REST APIs
|
|
||||||
--------------
|
|
||||||
|
|
||||||
* [Introduction](./WebServicesIntro.html)
|
|
||||||
|
|
||||||
* [Resource Manager](./ResourceManagerRest.html)
|
|
||||||
|
|
||||||
* [Node Manager](./NodeManagerRest.html)
|
|
||||||
|
|
||||||
|
|
Loading…
Reference in New Issue