Apache
/
hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

hbase-5367. book.xml - minor formatting in Arch/Region/Store compaction description 

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1242482 13f79535-47bb-0310-9956-ffa450edef68
This commit is contained in:
Doug Meil 2012-02-09 19:45:06 +00:00
parent e0fc9e1382
commit 25e0f67da7
1 changed files with 11 additions and 11 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

22
src/docbkx/book.xml
View File

@ -2165,15 +2165,15 @@ myHtd.setValue(HTableDescriptor.SPLIT_POLICY, MyCustomSplitPolicy.class.getName(
Important knobs: Important knobs:
<itemizedlist> <itemizedlist>
<listitem><code>hbase.store.compaction.ratio</code> Ratio used in compaction <listitem><code>hbase.store.compaction.ratio</code> Ratio used in compaction
file selection algorithm. (default 1.2F) </listitem> file selection algorithm (default 1.2f). </listitem>
<listitem><code>hbase.hstore.compaction.min</code> (.90 hbase.hstore.compactionThreshold) (files) Minimum number <listitem><code>hbase.hstore.compaction.min</code> (.90 hbase.hstore.compactionThreshold) (files) Minimum number
of StoreFiles per Store to be selected for a compaction to occur.</listitem> of StoreFiles per Store to be selected for a compaction to occur (default 2).</listitem>
<listitem><code>hbase.hstore.compaction.max</code> (files) Maximum number of StoreFiles to compact per minor compaction.</listitem> <listitem><code>hbase.hstore.compaction.max</code> (files) Maximum number of StoreFiles to compact per minor compaction (default 10).</listitem>
<listitem><code>hbase.hstore.compaction.min.size</code> (bytes) <listitem><code>hbase.hstore.compaction.min.size</code> (bytes)
Any StoreFile smaller than this setting with automatically be a candidate for compaction. Defaults to Any StoreFile smaller than this setting with automatically be a candidate for compaction. Defaults to
regions' memstore flush size (134 mb). </listitem> <code>hbase.hregion.memstore.flush.size</code> (64 mb). </listitem>
<listitem><code>hbase.hstore.compaction.max.size</code> (.92) (bytes) <listitem><code>hbase.hstore.compaction.max.size</code> (.92) (bytes)
Any StoreFile larger than this setting with automatically be excluded from compaction. </listitem> Any StoreFile larger than this setting with automatically be excluded from compaction (default Long.MAX_VALUE). </listitem>
</itemizedlist> </itemizedlist>
</para> </para>
<para>The minor compaction StoreFile selection logic is size based, and selects a file for compaction when the file <para>The minor compaction StoreFile selection logic is size based, and selects a file for compaction when the file
@ -2184,7 +2184,7 @@ myHtd.setValue(HTableDescriptor.SPLIT_POLICY, MyCustomSplitPolicy.class.getName(
<title>Minor Compaction File Selection - Example #1 (Basic Example)</title> <title>Minor Compaction File Selection - Example #1 (Basic Example)</title>
<para>This example mirrors an example from the unit test <code>TestCompactSelection</code>. <para>This example mirrors an example from the unit test <code>TestCompactSelection</code>.
<itemizedlist> <itemizedlist>
<listitem><code>hbase.store.compaction.ratio</code> = 1.0F </listitem> <listitem><code>hbase.store.compaction.ratio</code> = 1.0f </listitem>
<listitem><code>hbase.hstore.compaction.min</code> = 3 (files) </listitem>> <listitem><code>hbase.hstore.compaction.min</code> = 3 (files) </listitem>>
<listitem><code>hbase.hstore.compaction.max</code> = 5 (files) </listitem>> <listitem><code>hbase.hstore.compaction.max</code> = 5 (files) </listitem>>
<listitem><code>hbase.hstore.compaction.min.size</code> = 10 (bytes) </listitem>> <listitem><code>hbase.hstore.compaction.min.size</code> = 10 (bytes) </listitem>>
@ -2208,7 +2208,7 @@ myHtd.setValue(HTableDescriptor.SPLIT_POLICY, MyCustomSplitPolicy.class.getName(
<title>Minor Compaction File Selection - Example #2 (Not Enough Files To Compact)</title> <title>Minor Compaction File Selection - Example #2 (Not Enough Files To Compact)</title>
<para>This example mirrors an example from the unit test <code>TestCompactSelection</code>. <para>This example mirrors an example from the unit test <code>TestCompactSelection</code>.
<itemizedlist> <itemizedlist>
<listitem><code>hbase.store.compaction.ratio</code> = 1.0F </listitem> <listitem><code>hbase.store.compaction.ratio</code> = 1.0f </listitem>
<listitem><code>hbase.hstore.compaction.min</code> = 3 (files) </listitem>> <listitem><code>hbase.hstore.compaction.min</code> = 3 (files) </listitem>>
<listitem><code>hbase.hstore.compaction.max</code> = 5 (files) </listitem>> <listitem><code>hbase.hstore.compaction.max</code> = 5 (files) </listitem>>
<listitem><code>hbase.hstore.compaction.min.size</code> = 10 (bytes) </listitem>> <listitem><code>hbase.hstore.compaction.min.size</code> = 10 (bytes) </listitem>>
@ -2231,7 +2231,7 @@ myHtd.setValue(HTableDescriptor.SPLIT_POLICY, MyCustomSplitPolicy.class.getName(
<title>Minor Compaction File Selection - Example #3 (Limiting Files To Compact)</title> <title>Minor Compaction File Selection - Example #3 (Limiting Files To Compact)</title>
<para>This example mirrors an example from the unit test <code>TestCompactSelection</code>. <para>This example mirrors an example from the unit test <code>TestCompactSelection</code>.
<itemizedlist> <itemizedlist>
<listitem><code>hbase.store.compaction.ratio</code> = 1.0F </listitem> <listitem><code>hbase.store.compaction.ratio</code> = 1.0f </listitem>
<listitem><code>hbase.hstore.compaction.min</code> = 3 (files) </listitem>> <listitem><code>hbase.hstore.compaction.min</code> = 3 (files) </listitem>>
<listitem><code>hbase.hstore.compaction.max</code> = 5 (files) </listitem>> <listitem><code>hbase.hstore.compaction.max</code> = 5 (files) </listitem>>
<listitem><code>hbase.hstore.compaction.min.size</code> = 10 (bytes) </listitem>> <listitem><code>hbase.hstore.compaction.min.size</code> = 10 (bytes) </listitem>>
@ -2254,13 +2254,13 @@ myHtd.setValue(HTableDescriptor.SPLIT_POLICY, MyCustomSplitPolicy.class.getName(
</section> </section>
<section xml:id="compaction.config.impact"> <section xml:id="compaction.config.impact">
<title>Impact of Key Configuration Options</title> <title>Impact of Key Configuration Options</title>
<para><code>hbase.store.compaction.ratio</code>. A large ratio (e.g., 10F) will produce a single giant file. Conversely, a value of .25F will <para><code>hbase.store.compaction.ratio</code>. A large ratio (e.g., 10) will produce a single giant file. Conversely, a value of .25 will
produce behavior similar to the BigTable compaction algorithm - resulting in 4 StoreFiles. produce behavior similar to the BigTable compaction algorithm - resulting in 4 StoreFiles.
</para> </para>
<para><code>hbase.hstore.compaction.min.size</code>. This defaults to <code>hbase.hregion.memstore.flush.size</code> (134 mb). Because <para><code>hbase.hstore.compaction.min.size</code>. Because
this limit represents the "automatic include" limit for all StoreFiles smaller than this value, this value may need to this limit represents the "automatic include" limit for all StoreFiles smaller than this value, this value may need to
be adjusted downwards in write-heavy environments where many 1 or 2 mb StoreFiles are being flushed, because every file be adjusted downwards in write-heavy environments where many 1 or 2 mb StoreFiles are being flushed, because every file
will be targeted for compaction, and the resulting files may still be under the min-size and require further compaction, etc. will be targeted for compaction and the resulting files may still be under the min-size and require further compaction, etc.
</para> </para>
</section> </section>
</section> <!-- compaction --> </section> <!-- compaction -->