Add note on how to enable shortcircuit reads
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1384458 13f79535-47bb-0310-9956-ffa450edef68
This commit is contained in:
parent
786a5213c9
commit
2ff946d7a0
|
@ -193,6 +193,36 @@
|
||||||
</para>
|
</para>
|
||||||
</section>
|
</section>
|
||||||
|
|
||||||
|
</section>
|
||||||
|
<section xml:id="perf.hdfs.configs">
|
||||||
|
<title>HDFS Configuration</title>
|
||||||
|
<section xml:id="perf.hdfs.configs.localread">
|
||||||
|
<title>Leveraging local data</title>
|
||||||
|
<para>Since Hadoop 1.0.0 (also 0.22.1, 0.23.1, CDH3u3 and HDP 1.0) via
|
||||||
|
<link xlink:href="https://issues.apache.org/jira/browse/HDFS-2246">HDFS-2246</link>,
|
||||||
|
it is possible for the DFSClient to take a shortcut and
|
||||||
|
read directly from disk instead of going through the DataNode when the
|
||||||
|
data is local. What this means for HBase is that the RegionServers can
|
||||||
|
read directly off their machine's disks instead of having to open a
|
||||||
|
socket to talk to the DataNode, the former being generally much
|
||||||
|
faster<footnote><para>See JD's <link xlink:href="http://files.meetup.com/1350427/hug_ebay_jdcryans.pdf">Performance Talk</link></para></footnote>.
|
||||||
|
</para>
|
||||||
|
<para>To enable "shortcircuit" reads, you must set two configurations.
|
||||||
|
First, the hdfs-site.xml needs to be amended. Set
|
||||||
|
the property <varname>dfs.block.local-path-access.user</varname>
|
||||||
|
to be the <emphasis>only</emphasis> user that can use the shortcut.
|
||||||
|
This has to be the user that started HBase. Then in hbase-site.xml,
|
||||||
|
set <varname>dfs.client.read.shortcircuit</varname> to be <varname>true</varname>
|
||||||
|
</para>
|
||||||
|
<para>
|
||||||
|
The DataNodes need to be restarted in order to pick up the new
|
||||||
|
configuration. Be aware that if a process started under another
|
||||||
|
username than the one configured here also has the shortcircuit
|
||||||
|
enabled, it will get an Exception regarding an unauthorized access but
|
||||||
|
the data will still be read.
|
||||||
|
</para>
|
||||||
|
</section>
|
||||||
|
|
||||||
</section>
|
</section>
|
||||||
<section xml:id="perf.zookeeper">
|
<section xml:id="perf.zookeeper">
|
||||||
<title>ZooKeeper</title>
|
<title>ZooKeeper</title>
|
||||||
|
|
Loading…
Reference in New Issue