Apache
/
hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

Document blockcache prefetch option (Misty Stanley-Jones)

This commit is contained in:
Nick Dimiduk 2014-08-20 11:23:46 -07:00
parent c308c37b23
commit 7f56783003
2 changed files with 39 additions and 6 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

14
src/main/docbkx/book.xml
View File

@ -2139,12 +2139,14 @@ rs.close();
<section xml:id="cache.configurations"> <section xml:id="cache.configurations">
<title>General Cache Configurations</title> <title>General Cache Configurations</title>
<para>Apart from the cache implementaiton itself, you can set some general <para>Apart from the cache implementaiton itself, you can set some general configuration
configuration options to control how the cache performs. options to control how the cache performs. See <link
See <link xlink:href="http://hbase.apache.org/devapidocs/org/apache/hadoop/hbase/io/hfile/CacheConfig.html"
xlink:href="http://hbase.apache.org/devapidocs/org/apache/hadoop/hbase/io/hfile/CacheConfig.html" />. />. After setting any of these options, restart or rolling restart your cluster for the
After setting any of these options, restart or rolling restart your cluster for the configuration to take effect. Check logs for errors or unexpected behavior.</para>
configuration to take effect. Check logs for errors or unexpected behavior.</para> <para>See also <xref linkend="blockcache.prefetch"/>, which discusses a new option
introduced in <link xlink:href="https://issues.apache.org/jira/browse/HBASE-9857"
>HBASE-9857</link>.</para>
</section> </section>
<section <section

31
src/main/docbkx/performance.xml
View File

@ -219,6 +219,37 @@
A memory setting for the RegionServer process. A memory setting for the RegionServer process.
</para> </para>
</section> </section>
<section xml:id="blockcache.prefetch">
<title>Prefetch Option for Blockcache</title>
<para><link xlink:href="https://issues.apache.org/jira/browse/HBASE-9857">HBASE-9857</link>
adds a new option to prefetch HFile contents when opening the blockcache, if a columnfamily
or regionserver property is set. This option is available for HBase 0.98.3 and later. The
purpose is to warm the blockcache as rapidly as possible after the cache is opened, using
in-memory table data, and not counting the prefetching as cache misses. This is great for
fast reads, but is not a good idea if the data to be preloaded will not fit into the
blockcache. It is useful for tuning the IO impact of prefetching versus the time before all
data blocks are in cache. </para>
<para>To enable prefetching on a given column family, you can use HBase Shell or use the
API.</para>
<example>
<title>Enable Prefetch Using HBase Shell</title>
<screen>hbase> create 'MyTable', { NAME => 'myCF', PREFETCH_BLOCKS_ON_OPEN => 'true' }</screen>
</example>
<example>
<title>Enable Prefetch Using the API</title>
<programlisting language="java">
// ...
HTableDescriptor tableDesc = new HTableDescriptor("myTable");
HColumnDescriptor cfDesc = new HColumnDescriptor("myCF");
cfDesc.setPrefetchBlocksOnOpen(true);
tableDesc.addFamily(cfDesc);
// ...
</programlisting>
</example>
<para>See the API documentation for <link
xlink:href="https://hbase.apache.org/apidocs/org/apache/hadoop/hbase/io/hfile/CacheConfig.html"
>CacheConfig</link>.</para>
</section>
<section xml:id="perf.rs.memstore.size"> <section xml:id="perf.rs.memstore.size">
<title><varname>hbase.regionserver.global.memstore.size</varname></title> <title><varname>hbase.regionserver.global.memstore.size</varname></title>
<para>See <xref linkend="hbase.regionserver.global.memstore.size"/>. <para>See <xref linkend="hbase.regionserver.global.memstore.size"/>.