HBASE-2382 Don't rely on fs.getDefaultReplication() to roll HLogs; committed the overview.html changes only
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@945364 13f79535-47bb-0310-9956-ffa450edef68
This commit is contained in:
parent
25580f47a7
commit
2bc0e1ed3a
|
@ -320,6 +320,10 @@ Release 0.21.0 - Unreleased
|
||||||
the merge of old 0.20 into TRUNK task) -- part 1.
|
the merge of old 0.20 into TRUNK task) -- part 1.
|
||||||
HBASE-2474 Bug in HBASE-2248 - mixed version reads (not allowed by spec)
|
HBASE-2474 Bug in HBASE-2248 - mixed version reads (not allowed by spec)
|
||||||
HBASE-2509 NPEs in various places, HRegion.get, HRS.close
|
HBASE-2509 NPEs in various places, HRegion.get, HRS.close
|
||||||
|
HBASE-2344 InfoServer and hence HBase Master doesn't fully start if you
|
||||||
|
have HADOOP-6151 patch (Kannan Muthukkaruppan via Stack)
|
||||||
|
HBASE-2382 Don't rely on fs.getDefaultReplication() to roll HLogs
|
||||||
|
(Nicolas Spiegelberg via Stack)
|
||||||
|
|
||||||
IMPROVEMENTS
|
IMPROVEMENTS
|
||||||
HBASE-1760 Cleanup TODOs in HTable
|
HBASE-1760 Cleanup TODOs in HTable
|
||||||
|
|
|
@ -150,14 +150,23 @@ requirements and instructions</a> for how to set up a DFS.</p>
|
||||||
|
|
||||||
<h4><a name="pseudo-distrib">Pseudo-distributed mode</a></h4>
|
<h4><a name="pseudo-distrib">Pseudo-distributed mode</a></h4>
|
||||||
<p>A pseudo-distributed mode is simply a distributed mode run on a single host.
|
<p>A pseudo-distributed mode is simply a distributed mode run on a single host.
|
||||||
Once you have confirmed your DFS setup, configuring HBase for use on one host requires modification of
|
Use this configuration testing and prototyping on hbase. Do not use this configuration
|
||||||
|
for production nor for evaluating HBase performance.
|
||||||
|
</p>
|
||||||
|
<p>Once you have confirmed your DFS setup, configuring HBase for use on one host requires modification of
|
||||||
<code>${HBASE_HOME}/conf/hbase-site.xml</code>, which needs to be pointed at the running Hadoop DFS instance.
|
<code>${HBASE_HOME}/conf/hbase-site.xml</code>, which needs to be pointed at the running Hadoop DFS instance.
|
||||||
Use <code>hbase-site.xml</code> to override the properties defined in
|
Use <code>hbase-site.xml</code> to override the properties defined in
|
||||||
<code>${HBASE_HOME}/conf/hbase-default.xml</code> (<code>hbase-default.xml</code> itself
|
<code>${HBASE_HOME}/conf/hbase-default.xml</code> (<code>hbase-default.xml</code> itself
|
||||||
should never be modified). At a minimum the <code>hbase.rootdir</code> property should be redefined
|
should never be modified) and for HDFS client configurations.
|
||||||
in <code>hbase-site.xml</code> to point HBase at the Hadoop filesystem to use. For example, adding the property
|
At a minimum, the <code>hbase.rootdir</code>,
|
||||||
below to your <code>hbase-site.xml</code> says that HBase should use the <code>/hbase</code> directory in the
|
which points HBase at the Hadoop filesystem to use,
|
||||||
HDFS whose namenode is at port 9000 on your local machine:</p>
|
and the <code>dfs.replication</code>, an hdfs client-side
|
||||||
|
configuration stipulating how many replicas to keep up,
|
||||||
|
should be redefined in <code>hbase-site.xml</code>. For example,
|
||||||
|
adding the properties below to your <code>hbase-site.xml</code> says that HBase
|
||||||
|
should use the <code>/hbase</code>
|
||||||
|
directory in the HDFS whose namenode is at port 9000 on your local machine, and that
|
||||||
|
it should run with one replica only (recommended for pseudo-distributed mode):</p>
|
||||||
<blockquote>
|
<blockquote>
|
||||||
<pre>
|
<pre>
|
||||||
<configuration>
|
<configuration>
|
||||||
|
@ -168,6 +177,12 @@ HDFS whose namenode is at port 9000 on your local machine:</p>
|
||||||
<description>The directory shared by region servers.
|
<description>The directory shared by region servers.
|
||||||
</description>
|
</description>
|
||||||
</property>
|
</property>
|
||||||
|
<property>
|
||||||
|
<name>dfs.replication</name>
|
||||||
|
<value>1</value>
|
||||||
|
<description>The replication count for HLog & HFile storage. Should not be greater than HDFS datanode count.
|
||||||
|
</description>
|
||||||
|
</property>
|
||||||
...
|
...
|
||||||
</configuration>
|
</configuration>
|
||||||
</pre>
|
</pre>
|
||||||
|
@ -203,7 +218,11 @@ configurations must be made <em>in addition</em> to those described in the
|
||||||
</blockquote>
|
</blockquote>
|
||||||
|
|
||||||
<p>In fully-distributed mode, you probably want to change your <code>hbase.rootdir</code>
|
<p>In fully-distributed mode, you probably want to change your <code>hbase.rootdir</code>
|
||||||
from localhost to the name of the node running the HDFS NameNode. In addition
|
from localhost to the name of the node running the HDFS NameNode and you should set
|
||||||
|
the dfs.replication to be the number of datanodes you have in your cluster or 3, which
|
||||||
|
ever is the smaller.
|
||||||
|
</p>
|
||||||
|
<p>In addition
|
||||||
to <code>hbase-site.xml</code> changes, a fully-distributed mode requires that you
|
to <code>hbase-site.xml</code> changes, a fully-distributed mode requires that you
|
||||||
modify <code>${HBASE_HOME}/conf/regionservers</code>.
|
modify <code>${HBASE_HOME}/conf/regionservers</code>.
|
||||||
The <code>regionserver</code> file lists all hosts running <code>HRegionServer</code>s, one host per line
|
The <code>regionserver</code> file lists all hosts running <code>HRegionServer</code>s, one host per line
|
||||||
|
|
Loading…
Reference in New Issue