git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@478406 13f79535-47bb-0310-9956-ffa450edef68
This commit is contained in:
Wolfgang Hoschek 2006-11-23 00:25:53 +00:00
parent 8ccee0c870
commit b8387ec241
1 changed files with 3 additions and 1 deletions

View File

@ -207,7 +207,9 @@ public class AnalyzerUtil {
* token stream, and delivers those cached tokens on subsequent matching calls to * token stream, and delivers those cached tokens on subsequent matching calls to
* <code>tokenStream(String fieldName, Reader reader)</code>. * <code>tokenStream(String fieldName, Reader reader)</code>.
* <p> * <p>
* This can help improve performance in the presence of expensive Analyzer / TokenFilter chains. * If Analyzer / TokenFilter chains are expensive in terms of I/O or CPU, such caching can
* help improve performance if the same document is added to multiple Lucene indexes,
* because the text analysis phase need not be performed more than once.
* <p> * <p>
* Caveats: * Caveats:
* 2) Caching the tokens of large Lucene documents can lead to out of memory exceptions. * 2) Caching the tokens of large Lucene documents can lead to out of memory exceptions.