Pointed at oracle config. doc. for example of how other dbs have same issues we do w/ sys configs
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1089149 13f79535-47bb-0310-9956-ffa450edef68
This commit is contained in:
parent
66f9ba5bbc
commit
dd6dca4d94
|
@ -329,10 +329,10 @@ stopping hbase...............</programlisting></para>
|
||||||
</indexterm>
|
</indexterm>
|
||||||
</title>
|
</title>
|
||||||
|
|
||||||
<para>HBase is a database, it uses a lot of files all at the same time.
|
<para>HBase is a database. It uses a lot of files all at the same time.
|
||||||
The default ulimit -n -- i.e. user file limit -- of 1024 on *nix systems
|
The default ulimit -n -- i.e. user file limit -- of 1024 on most *nix systems
|
||||||
is insufficient. Any significant amount of loading will lead you to <link
|
is insufficient (On mac os x its 256). Any significant amount of loading will
|
||||||
xlink:href="http://wiki.apache.org/hadoop/Hbase/FAQ#A6">FAQ: Why do I
|
lead you to <link xlink:href="http://wiki.apache.org/hadoop/Hbase/FAQ#A6">FAQ: Why do I
|
||||||
see "java.io.IOException...(Too many open files)" in my logs?</link>.
|
see "java.io.IOException...(Too many open files)" in my logs?</link>.
|
||||||
You may also notice errors such as <programlisting>
|
You may also notice errors such as <programlisting>
|
||||||
2010-04-06 03:04:37,542 INFO org.apache.hadoop.hdfs.DFSClient: Exception increateBlockOutputStream java.io.EOFException
|
2010-04-06 03:04:37,542 INFO org.apache.hadoop.hdfs.DFSClient: Exception increateBlockOutputStream java.io.EOFException
|
||||||
|
@ -343,7 +343,12 @@ stopping hbase...............</programlisting></para>
|
||||||
<varname>nproc</varname> setting; under load, a low-nproc
|
<varname>nproc</varname> setting; under load, a low-nproc
|
||||||
setting could manifest as <classname>OutOfMemoryError</classname>
|
setting could manifest as <classname>OutOfMemoryError</classname>
|
||||||
<footnote><para>See Jack Levin's <link xlink:href="">major hdfs issues</link>
|
<footnote><para>See Jack Levin's <link xlink:href="">major hdfs issues</link>
|
||||||
note up on the user list.</para></footnote>.
|
note up on the user list.</para></footnote>
|
||||||
|
<footnote><para>The requirement that a database requires upping of system limits
|
||||||
|
is not peculiar to HBase. See for example the section
|
||||||
|
<emphasis>Setting Shell Limits for the Oracle User</emphasis> in
|
||||||
|
<link xlink:href="http://www.akadia.com/services/ora_linux_install_10g.html">
|
||||||
|
Short Guide to install Oracle 10 on Linux</link>.</para></footnote>.
|
||||||
</para>
|
</para>
|
||||||
|
|
||||||
<para>To be clear, upping the file descriptors and nproc for the user who is
|
<para>To be clear, upping the file descriptors and nproc for the user who is
|
||||||
|
|
Loading…
Reference in New Issue