2007-06-06 23:17:18 -04:00
<!DOCTYPE html PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN" "http://www.w3.org/TR/html4/loose.dtd">
2006-01-30 18:11:30 -05:00
< html >
< head >
< META http-equiv = "Content-Type" content = "text/html; charset=UTF-8" >
< meta content = "Apache Forrest" name = "Generator" >
2007-06-06 23:17:18 -04:00
< meta name = "Forrest-version" content = "0.8" >
2009-06-11 07:59:04 -04:00
< meta name = "Forrest-skin-name" content = "lucene" >
2010-07-09 22:50:51 -04:00
< title > Solr tutorial (version 3.0.0.2010.07.10.11.10.25)< / title >
2006-01-30 18:11:30 -05:00
< link type = "text/css" href = "skin/basic.css" rel = "stylesheet" >
< link media = "screen" type = "text/css" href = "skin/screen.css" rel = "stylesheet" >
< link media = "print" type = "text/css" href = "skin/print.css" rel = "stylesheet" >
< link type = "text/css" href = "skin/profile.css" rel = "stylesheet" >
< script src = "skin/getBlank.js" language = "javascript" type = "text/javascript" > < / script > < script src = "skin/getMenu.js" language = "javascript" type = "text/javascript" > < / script > < script src = "skin/fontsize.js" language = "javascript" type = "text/javascript" > < / script >
< link rel = "shortcut icon" href = "images/favicon.ico" >
< / head >
< body onload = "init()" >
< script type = "text/javascript" > ndeSetTextSize ( ) ; < / script >
< div id = "top" >
2007-06-06 23:17:18 -04:00
<!-- +
|breadtrail
+-->
2006-01-30 18:11:30 -05:00
< div class = "breadtrail" >
2007-01-18 11:27:03 -05:00
< a href = "http://www.apache.org/" > apache< / a > > < a href = "http://lucene.apache.org/" > lucene< / a > < script src = "skin/breadcrumbs.js" language = "JavaScript" type = "text/javascript" > < / script >
2006-01-30 18:11:30 -05:00
< / div >
2007-06-06 23:17:18 -04:00
<!-- +
|header
+-->
2006-01-30 18:11:30 -05:00
< div class = "header" >
2007-06-06 23:17:18 -04:00
<!-- +
|start group logo
+-->
2006-01-30 18:11:30 -05:00
< div class = "grouplogo" >
2007-01-18 00:10:35 -05:00
< a href = "http://lucene.apache.org/" > < img class = "logoImage" alt = "Lucene" src = "images/lucene_green_150.gif" title = "Apache Lucene" > < / a >
2006-01-30 18:11:30 -05:00
< / div >
2007-06-06 23:17:18 -04:00
<!-- +
|end group logo
+-->
<!-- +
|start Project Logo
+-->
2006-01-30 18:11:30 -05:00
< div class = "projectlogo" >
2009-08-25 18:04:37 -04:00
< a href = "http://lucene.apache.org/solr/" > < img class = "logoImage" alt = "Solr" src = "images/solr.jpg" title = "Solr Description" > < / a >
2006-01-30 18:11:30 -05:00
< / div >
2007-06-06 23:17:18 -04:00
<!-- +
|end Project Logo
+-->
<!-- +
|start Search
+-->
2006-01-30 18:11:30 -05:00
< div class = "searchbox" >
2009-06-11 07:59:04 -04:00
< form action = "http://search.lucidimagination.com/p:solr" method = "get" class = "roundtopsmall" >
< input onFocus = "getBlank (this, 'Search the site with Solr');" size = "25" name = "q" id = "query" type = "text" value = "Search the site with Solr" >
2007-06-06 23:17:18 -04:00
< input name = "Search" value = "Search" type = "submit" >
2006-01-30 18:11:30 -05:00
< / form >
2009-06-11 07:59:04 -04:00
< div style = "position: relative; top: -5px; left: -10px" > Powered by < a href = "http://www.lucidimagination.com" style = "color: #033268" > Lucid Imagination< / a >
< / div >
2006-01-30 18:11:30 -05:00
< / div >
2007-06-06 23:17:18 -04:00
<!-- +
|end search
+-->
<!-- +
|start Tabs
+-->
2006-01-30 18:11:30 -05:00
< ul id = "tabs" >
< li class = "current" >
2007-06-06 23:17:18 -04:00
< a class = "selected" href = "index.html" > Main< / a >
2006-01-30 18:11:30 -05:00
< / li >
< li >
2010-07-09 22:50:51 -04:00
< a class = "unselected" href = "http://wiki.apache.org/solr/FrontPage" > Wiki< / a >
2006-01-30 18:11:30 -05:00
< / li >
< / ul >
2007-06-06 23:17:18 -04:00
<!-- +
|end Tabs
+-->
2006-01-30 18:11:30 -05:00
< / div >
< / div >
< div id = "main" >
< div id = "publishedStrip" >
2007-06-06 23:17:18 -04:00
<!-- +
|start Subtabs
+-->
2006-01-30 18:11:30 -05:00
< div id = "level2tabs" > < / div >
2007-06-06 23:17:18 -04:00
<!-- +
|end Endtabs
+-->
2006-01-30 18:11:30 -05:00
< script type = "text/javascript" > < ! - -
2007-06-06 23:17:18 -04:00
document.write("Last Published: " + document.lastModified);
2006-01-30 18:11:30 -05:00
// -->< / script >
< / div >
2007-06-06 23:17:18 -04:00
<!-- +
|breadtrail
+-->
2006-01-30 18:11:30 -05:00
< div class = "breadtrail" >
2007-06-06 23:17:18 -04:00
2006-01-30 18:11:30 -05:00
< / div >
2007-06-06 23:17:18 -04:00
<!-- +
|start Menu, mainarea
+-->
<!-- +
|start Menu
+-->
2006-01-30 18:11:30 -05:00
< div id = "menu" >
< div onclick = "SwitchMenu('menu_1.1', 'skin/')" id = "menu_1.1Title" class = "menutitle" > About< / div >
< div id = "menu_1.1" class = "menuitemgroup" >
< div class = "menuitem" >
< a href = "index.html" title = "Welcome to Solr" > Welcome< / a >
< / div >
< div class = "menuitem" >
2010-03-26 11:37:10 -04:00
< a href = "http://lucene.apache.org/java/docs/whoweare.html" title = "Lucene/Solr Committers" > Who We Are< / a >
2006-01-30 18:11:30 -05:00
< / div >
< / div >
< div onclick = "SwitchMenu('menu_selected_1.2', 'skin/')" id = "menu_selected_1.2Title" class = "menutitle" style = "background-image: url('skin/images/chapter_open.gif');" > Documentation< / div >
< div id = "menu_selected_1.2" class = "selectedmenuitemgroup" style = "display: block;" >
< div class = "menuitem" >
2006-02-24 21:37:53 -05:00
< a href = "features.html" > Features< / a >
< / div >
2007-01-18 00:10:35 -05:00
< div class = "menupage" >
< div class = "menupagetitle" > Tutorial< / div >
2006-01-30 18:11:30 -05:00
< / div >
< div class = "menuitem" >
2010-07-09 22:50:51 -04:00
< a href = "http://wiki.apache.org/solr/FrontPage" > Docs (Wiki)< / a >
2006-01-30 18:11:30 -05:00
< / div >
2007-01-18 00:10:35 -05:00
< div class = "menuitem" >
< a href = "http://wiki.apache.org/solr/FAQ" > FAQ< / a >
2006-01-30 18:11:30 -05:00
< / div >
2006-02-21 09:40:39 -05:00
< div class = "menuitem" >
2008-08-25 08:07:42 -04:00
< a href = "api/index.html" > All Javadoc< / a >
< / div >
< div class = "menuitem" >
< a href = "api/solrj/index.html" > SolrJ Javadoc< / a >
2006-02-21 09:40:39 -05:00
< / div >
2006-01-30 18:11:30 -05:00
< / div >
< div onclick = "SwitchMenu('menu_1.3', 'skin/')" id = "menu_1.3Title" class = "menutitle" > Resources< / div >
< div id = "menu_1.3" class = "menuitemgroup" >
< div class = "menuitem" >
2007-01-18 00:10:35 -05:00
< a href = "http://www.apache.org/dyn/closer.cgi/lucene/solr/" > Download< / a >
2006-02-21 09:40:39 -05:00
< / div >
< div class = "menuitem" >
2006-01-30 18:11:30 -05:00
< a href = "mailing_lists.html" > Mailing Lists< / a >
< / div >
< div class = "menuitem" >
< a href = "issue_tracking.html" > Issue Tracking< / a >
< / div >
< div class = "menuitem" >
< a href = "version_control.html" > Version Control< / a >
< / div >
< / div >
< div onclick = "SwitchMenu('menu_1.4', 'skin/')" id = "menu_1.4Title" class = "menutitle" > Related Projects< / div >
< div id = "menu_1.4" class = "menuitemgroup" >
< div class = "menuitem" >
< a href = "http://lucene.apache.org/java/" > Lucene Java< / a >
< / div >
< div class = "menuitem" >
< a href = "http://lucene.apache.org/nutch/" > Nutch< / a >
< / div >
< / div >
2007-05-29 15:16:09 -04:00
< div id = "credit" >
< hr >
2010-07-09 22:50:51 -04:00
This document is for Apache Solr version 3.0.0.2010.07.10.11.10.25. If you are using a different version of Solr, please consult the documentation that was distributed with the version you are using.
2007-05-29 15:16:09 -04:00
< / div >
2006-01-30 18:11:30 -05:00
< div id = "roundbottom" >
< img style = "display: none" class = "corner" height = "15" width = "15" alt = "" src = "skin/images/rc-b-l-15-1body-2menu-3menu.png" > < / div >
2007-06-06 23:17:18 -04:00
<!-- +
|alternative credits
+-->
2009-08-25 15:29:33 -04:00
< div id = "credit2" >
2010-01-23 15:40:25 -05:00
< a href = "http://www.packtpub.com/solr-1-4-enterprise-search-server?utm_source=http%3A%2F%2Flucene.apache.org%2Fsolr%2F&utm_medium=spons&utm_content=pod&utm_campaign=mdb_000275" > < img border = "0" title = "Book: Solr 1.4 Enterprise Search Server" alt = "Book: Solr 1.4 Enterprise Search Server - logo" src = "images/solr-book-image.jpg" style = "width: 150px;height: 185px;" > < / a > < a href = "http://www.lucidimagination.com/Downloads/LucidWorks-for-Solr/Reference-Guide?sc=AP" > < img border = "0" title = "LucidWorks for Solr Certified Distribution Reference Guide" alt = "LucidWorks for Solr Certified Distribution Reference Guide - logo" src = "images/lucidworks_reference_guide.png" style = "width: 150px;height: 185px;" > < / a >
2009-08-25 15:29:33 -04:00
< / div >
2006-01-30 18:11:30 -05:00
< / div >
2007-06-06 23:17:18 -04:00
<!-- +
|end Menu
+-->
<!-- +
|start content
+-->
2006-01-30 18:11:30 -05:00
< div id = "content" >
< div title = "Portable Document Format" class = "pdflink" >
< a class = "dida" href = "tutorial.pdf" > < img alt = "PDF -icon" src = "skin/images/pdfdoc.gif" class = "skin" > < br >
PDF< / a >
< / div >
< h1 > Solr tutorial< / h1 >
2007-05-29 15:16:09 -04:00
< div id = "motd-area" >
2010-07-09 22:50:51 -04:00
This document is for Apache Solr version 3.0.0.2010.07.10.11.10.25. If you are using a different version of Solr, please consult the documentation that was distributed with the version you are using.
2007-05-29 15:16:09 -04:00
< / div >
2006-01-30 18:11:30 -05:00
< div id = "minitoc-area" >
< ul class = "minitoc" >
< li >
2006-02-28 14:24:54 -05:00
< a href = "#Overview" > Overview< / a >
< / li >
< li >
2006-01-30 18:11:30 -05:00
< a href = "#Requirements" > Requirements< / a >
< / li >
2006-02-28 14:24:54 -05:00
< li >
< a href = "#Getting+Started" > Getting Started< / a >
< / li >
< li >
< a href = "#Indexing+Data" > Indexing Data< / a >
< / li >
< li >
< a href = "#Updating+Data" > Updating Data< / a >
< ul class = "minitoc" >
< li >
< a href = "#Deleting+Data" > Deleting Data< / a >
< / li >
< / ul >
< / li >
< li >
< a href = "#Querying+Data" > Querying Data< / a >
< ul class = "minitoc" >
< li >
< a href = "#Sorting" > Sorting< / a >
< / li >
< / ul >
< / li >
< li >
2009-10-25 17:59:38 -04:00
< a href = "#Highlighting" > Highlighting< / a >
< / li >
< li >
< a href = "#Faceted+Search" > Faceted Search< / a >
< / li >
< li >
2006-02-28 14:24:54 -05:00
< a href = "#Text+Analysis" > Text Analysis< / a >
< ul class = "minitoc" >
< li >
< a href = "#Analysis+Debugging" > Analysis Debugging< / a >
< / li >
< / ul >
< / li >
2006-04-05 14:48:23 -04:00
< li >
< a href = "#Conclusion" > Conclusion< / a >
< / li >
2006-01-30 18:11:30 -05:00
< / ul >
< / div >
2006-11-10 19:47:14 -05:00
< a name = "N1000D" > < / a > < a name = "Overview" > < / a >
2006-02-28 14:24:54 -05:00
< h2 class = "boxed" > Overview< / h2 >
< div class = "section" >
< p >
This document covers the basics of running Solr using an example
schema, and some sample data.
< / p >
< / div >
2006-11-10 19:47:14 -05:00
< a name = "N10017" > < / a > < a name = "Requirements" > < / a >
2006-01-30 18:11:30 -05:00
< h2 class = "boxed" > Requirements< / h2 >
< div class = "section" >
2006-02-28 14:24:54 -05:00
< p >
To follow along with this tutorial, you will need...
< / p >
2006-01-30 18:11:30 -05:00
< ol >
2006-02-28 14:24:54 -05:00
< li > Java 1.5 or greater. Some places you can get it are from
2009-10-25 17:59:38 -04:00
< a href = "http://java.sun.com/j2se/downloads.html" > OpenJDK< / a > ,
2006-01-30 18:11:30 -05:00
< a href = "http://java.sun.com/j2se/downloads.html" > Sun< / a > ,
2009-10-25 17:59:38 -04:00
< a href = "http://www.ibm.com/developerworks/java/jdk/" > IBM< / a > , or
< a href = "http://www.oracle.com/technology/products/jrockit/index.html" > Oracle< / a > .
2007-02-20 03:22:27 -05:00
< br >
Running < span class = "codefrag" > java -version< / span > at the command line should indicate a version
2009-10-25 17:59:38 -04:00
number starting with 1.5. Gnu's GCJ is not supported and does not work with Solr.
2006-01-30 18:11:30 -05:00
< / li >
2007-01-18 00:10:35 -05:00
< li > A < a href = "http://www.apache.org/dyn/closer.cgi/lucene/solr/" > Solr release< / a > .
2006-02-28 14:24:54 -05:00
< / li >
2006-01-30 18:11:30 -05:00
< / ol >
< / div >
2009-10-25 17:59:38 -04:00
< a name = "N10043" > < / a > < a name = "Getting+Started" > < / a >
2006-02-28 14:24:54 -05:00
< h2 class = "boxed" > Getting Started< / h2 >
< div class = "section" >
< p >
2006-04-05 14:48:23 -04:00
< strong >
Please run the browser showing this tutorial and the Solr server on the same machine so tutorial links will correctly point to your Solr server.
< / strong >
< / p >
< p >
2006-03-01 14:50:03 -05:00
Begin by unziping the Solr release and changing your working directory
2009-10-25 17:59:38 -04:00
to be the "< span class = "codefrag" > example< / span > " directory. (Note that the base directory name may vary with the version of Solr downloaded.) For example, with a shell in UNIX, Cygwin, or MacOS:
2006-02-28 14:24:54 -05:00
< / p >
< pre class = "code" >
2009-10-25 17:59:38 -04:00
user:~solr$ < strong > ls< / strong >
2006-04-05 14:48:23 -04:00
solr-nightly.zip
2009-10-25 17:59:38 -04:00
user:~solr$ < strong > unzip -q solr-nightly.zip< / strong >
user:~solr$ < strong > cd solr-nightly/example/< / strong >
2006-02-28 14:24:54 -05:00
< / pre >
< p >
Solr can run in any Java Servlet Container of your choice, but to simplify
2009-10-25 17:59:38 -04:00
this tutorial, the example index includes a small installation of Jetty.
2006-02-28 14:24:54 -05:00
< / p >
< p >
To launch Jetty with the Solr WAR, and the example configs, just run the < span class = "codefrag" > start.jar< / span > ...
< / p >
< pre class = "code" >
2009-10-25 17:59:38 -04:00
user:~/solr/example$ < strong > java -jar start.jar< / strong >
2009-10-23 16:42:53.816::INFO: Logging to STDERR via org.mortbay.log.StdErrLog
2009-10-23 16:42:53.907::INFO: jetty-6.1.3
2006-02-28 14:24:54 -05:00
...
2009-10-25 17:59:38 -04:00
Oct 23, 2009 4:41:56 PM org.apache.solr.core.SolrCore registerSearcher
INFO: [] Registered new searcher Searcher@7c3885 main
2006-02-28 14:24:54 -05:00
< / pre >
< p >
This will start up the Jetty application server on port 8983, and use your terminal to display the logging information from Solr.
< / p >
< p >
You can see that the Solr is running by loading < a href = "http://localhost:8983/solr/admin/" > http://localhost:8983/solr/admin/< / a > in your web browser. This is the main starting point for Administering Solr.
< / p >
< / div >
2009-10-25 17:59:38 -04:00
< a name = "N1007B" > < / a > < a name = "Indexing+Data" > < / a >
2006-02-28 14:24:54 -05:00
< h2 class = "boxed" > Indexing Data< / h2 >
< div class = "section" >
< p >
2009-10-25 17:59:38 -04:00
Your Solr server is up and running, but it doesn't contain any data. You can
modify a Solr index by POSTing XML Documents containing instructions to add (or
update) documents, delete documents, commit pending adds and deletes, and
optimize your index.
2007-02-20 03:22:27 -05:00
< / p >
< p >
2009-10-25 17:59:38 -04:00
The < span class = "codefrag" > exampledocs< / span > directory contains samples of the types of
instructions Solr expects, as well as a java utility for posting them from the
command line (a < span class = "codefrag" > post.sh< / span > shell script is also available, but for
this tutorial we'll use the cross-platform Java client). < / p >
< p > To try this,
open a new terminal window, enter the exampledocs directory, and run
"< span class = "codefrag" > java -jar post.jar< / span > " on some of the XML files in that directory,
indicating the URL of the Solr server:
2006-02-28 14:24:54 -05:00
< / p >
< pre class = "code" >
2009-10-25 17:59:38 -04:00
user:~/solr/example/exampledocs$ < strong > java -jar post.jar solr.xml monitor.xml< / strong >
2007-05-23 15:44:03 -04:00
SimplePostTool: version 1.2
2007-02-20 03:22:27 -05:00
SimplePostTool: WARNING: Make sure your XML documents are encoded in UTF-8, other encodings are not currently supported
SimplePostTool: POSTing files to http://localhost:8983/solr/update..
SimplePostTool: POSTing file solr.xml
SimplePostTool: POSTing file monitor.xml
SimplePostTool: COMMITting Solr index changes..
2006-02-28 14:24:54 -05:00
< / pre >
< p >
2007-02-20 03:22:27 -05:00
You have now indexed two documents in Solr, and committed these changes.
You can now search for "solr" using the "Make a Query" interface on the Admin screen, and you should get one result.
Clicking the "Search" button should take you to the following URL...
2006-02-28 14:24:54 -05:00
< / p >
< p >
2009-10-25 17:59:38 -04:00
< a href = "http://localhost:8983/solr/select/?q=solr&version=2.2&start=0&rows=10&indent=on" > http://localhost:8983/solr/select/?q=solr& version=2.2& start=0& rows=10& indent=on< / a >
2006-02-28 14:24:54 -05:00
< / p >
< p >
2007-02-20 03:22:27 -05:00
You can index all of the sample data, using the following command (assuming your shell supports the *.xml notation):
2006-02-28 14:24:54 -05:00
< / p >
< pre class = "code" >
2009-10-25 17:59:38 -04:00
user:~/solr/example/exampledocs$ < strong > java -jar post.jar *.xml< / strong >
2007-05-23 15:44:03 -04:00
SimplePostTool: version 1.2
2007-02-20 03:22:27 -05:00
SimplePostTool: WARNING: Make sure your XML documents are encoded in UTF-8, other encodings are not currently supported
SimplePostTool: POSTing files to http://localhost:8983/solr/update..
SimplePostTool: POSTing file hd.xml
SimplePostTool: POSTing file ipod_other.xml
SimplePostTool: POSTing file ipod_video.xml
SimplePostTool: POSTing file mem.xml
SimplePostTool: POSTing file monitor.xml
SimplePostTool: POSTing file monitor2.xml
SimplePostTool: POSTing file mp500.xml
SimplePostTool: POSTing file sd500.xml
SimplePostTool: POSTing file solr.xml
2007-05-23 15:44:03 -04:00
SimplePostTool: POSTing file spellchecker.xml
2007-02-20 03:22:27 -05:00
SimplePostTool: POSTing file utf8-example.xml
SimplePostTool: POSTing file vidcard.xml
SimplePostTool: COMMITting Solr index changes..
2006-02-28 14:24:54 -05:00
< / pre >
< p >
2009-10-25 17:59:38 -04:00
...and now you can search for all sorts of things using the default < a href = "http://wiki.apache.org/solr/SolrQuerySyntax" > Solr Query Syntax< / a > (a superset of the Lucene query syntax)...
2006-02-28 14:24:54 -05:00
< / p >
< ul >
< li >
2009-10-25 17:59:38 -04:00
< a href = "http://localhost:8983/solr/select/?q=video" > video< / a >
2006-02-28 14:24:54 -05:00
< / li >
< li >
2009-10-25 17:59:38 -04:00
< a href = "http://localhost:8983/solr/select/?q=name:video" > name:video< / a >
2006-02-28 14:24:54 -05:00
< / li >
< li >
2009-10-25 17:59:38 -04:00
< a href = "http://localhost:8983/solr/select/?q=%2Bvideo+%2Bprice%3A[*+TO+400]" > +video +price:[* TO 400]< / a >
2006-02-28 14:24:54 -05:00
< / li >
2009-10-25 17:59:38 -04:00
< / ul >
< p > < / p >
< p >
There are many other different ways to import your data into Solr... one can
< / p >
< ul >
< li > Import records from a database using the
< a href = "http://wiki.apache.org/solr/DataImportHandler" > Data Import Handler (DIH)< / a > .
< / li >
< li >
< a href = "http://wiki.apache.org/solr/UpdateCSV" > Load a CSV file< / a > (comma separated values),
including those exported by Excel or MySQL.
< / li >
< li > Index binary documents such as Word and PDF with
< a href = "http://wiki.apache.org/solr/ExtractingRequestHandler" > Solr Cell< / a > (ExtractingRequestHandler).
< / li >
< li >
Use < a href = "http://wiki.apache.org/solr/Solrj" > SolrJ< / a > for Java or other Solr clients to
programatically create documents to send to Solr.
< / li >
2006-02-28 14:24:54 -05:00
< / ul >
< / div >
2009-10-25 17:59:38 -04:00
< a name = "N100EB" > < / a > < a name = "Updating+Data" > < / a >
2006-02-28 14:24:54 -05:00
< h2 class = "boxed" > Updating Data< / h2 >
< div class = "section" >
< p >
You may have noticed that even though the file < span class = "codefrag" > solr.xml< / span > has now
been POSTed to the server twice, you still only get 1 result when searching for
"solr". This is because the example schema.xml specifies a "uniqueKey" field
called "< span class = "codefrag" > id< / span > ". Whenever you POST instructions to Solr to add a
document with the same value for the uniqueKey as an existing document, it
2009-10-25 17:59:38 -04:00
automatically replaces it for you. You can see that that has happened by
2006-02-28 14:24:54 -05:00
looking at the values for < span class = "codefrag" > numDocs< / span > and < span class = "codefrag" > maxDoc< / span > in the
2009-10-25 17:59:38 -04:00
"CORE"/searcher section of the statistics page... < / p >
2006-02-28 14:24:54 -05:00
< p >
< a href = "http://localhost:8983/solr/admin/stats.jsp" > http://localhost:8983/solr/admin/stats.jsp< / a >
< / p >
< p >
2009-10-25 17:59:38 -04:00
< strong > numDocs< / strong > represents the number of searchable documents in the
index (and will be larger than the number of XML files since some files
contained more than one < span class = "codefrag" > < doc> < / span > ). < strong > maxDoc< / strong >
may be larger as the maxDoc count includes logically deleted documents that
have not yet been removed from the index. You can re-post the sample XML
files over and over again as much as you want and numDocs will never
increase,because the new documents will constantly be replacing the old.
2006-02-28 14:24:54 -05:00
< / p >
< p >
2009-10-25 17:59:38 -04:00
Go ahead and edit the existing XML files to change some of the data, and re-run
the < span class = "codefrag" > java -jar post.jar< / span > command, you'll see your changes reflected
in subsequent searches.
2006-02-28 14:24:54 -05:00
< / p >
2009-10-25 17:59:38 -04:00
< a name = "N10119" > < / a > < a name = "Deleting+Data" > < / a >
2006-02-28 14:24:54 -05:00
< h3 class = "boxed" > Deleting Data< / h3 >
< p > You can delete data by POSTing a delete command to the update URL and specifying the value
2007-02-20 03:22:27 -05:00
of the document's unique key field, or a query that matches multiple documents (be careful with that one!). Since these commands
2006-02-28 14:24:54 -05:00
are smaller, we will specify them right on the command line rather than reference an XML file.
< / p >
< p > Execute the following command to delete a document< / p >
2007-07-19 15:05:26 -04:00
< pre class = "code" > java -Ddata=args -Dcommit=no -jar post.jar "< delete> < id> SP2514N< /id> < /delete> "< / pre >
2006-02-28 14:24:54 -05:00
< p > Now if you go to the < a href = "http://localhost:8983/solr/admin/stats.jsp" > statistics< / a > page and scroll down
2009-10-25 17:59:38 -04:00
to the UPDATE_HANDLERS section and verify that "< span class = "codefrag" > deletesById : 1< / span > "< / p >
2006-02-28 14:24:54 -05:00
< p > If you search for < a href = "http://localhost:8983/solr/select?q=id:SP2514N" > id:SP2514N< / a > it will still be found,
2009-10-25 17:59:38 -04:00
because index changes are not visible until, and a new searcher is opened. To cause
2007-05-23 15:44:03 -04:00
this to happen, send a commit command to Solr (post.jar does this for you by default):< / p >
< pre class = "code" > java -jar post.jar< / pre >
2006-02-28 14:24:54 -05:00
< p > Now re-execute the previous search and verify that no matching documents are found. Also revisit the
statistics page and observe the changes in both the UPDATE_HANDLERS section and the CORE section.< / p >
< p > Here is an example of using delete-by-query to delete anything with
< a href = "http://localhost:8983/solr/select?q=name:DDR&fl=name" > DDR< / a > in the name:< / p >
2007-07-19 15:05:26 -04:00
< pre class = "code" > java -Ddata=args -jar post.jar "< delete> < query> name:DDR< /query> < /delete> "< / pre >
2009-10-25 17:59:38 -04:00
< p > Commit can be an expensive operation so it's best to make many changes to an index in a batch and
2006-02-28 14:24:54 -05:00
then send the commit command at the end. There is also an optimize command that does the same thing as commit,
in addition to merging all index segments into a single segment, making it faster to search and causing any
deleted documents to be removed. All of the update commands are documented < a href = "http://wiki.apache.org/solr/UpdateXmlMessages" > here< / a > .
< / p >
< p > To continue with the tutorial, re-add any documents you may have deleted by going to the < span class = "codefrag" > exampledocs< / span > directory and executing< / p >
2007-02-20 03:22:27 -05:00
< pre class = "code" > java -jar post.jar *.xml< / pre >
2006-02-28 14:24:54 -05:00
< / div >
2009-10-25 17:59:38 -04:00
< a name = "N1015F" > < / a > < a name = "Querying+Data" > < / a >
2006-02-28 14:24:54 -05:00
< h2 class = "boxed" > Querying Data< / h2 >
< div class = "section" >
< p >
Searches are done via HTTP GET on the select URL with the query string in the q parameter.
You can pass a number of optional < a href = "http://wiki.apache.org/solr/StandardRequestHandler" > request parameters< / a >
to the request handler to control what information is returned. For example, you can use the "fl" parameter
to control what stored fields are returned, and if the relevancy score is returned...
< / p >
< ul >
< li >
< a href = "http://localhost:8983/solr/select/?indent=on&q=video&fl=name,id" > q=video& fl=name,id< / a > (return only name and id fields) < / li >
< li >
< a href = "http://localhost:8983/solr/select/?indent=on&q=video&fl=name,id,score" > q=video& fl=name,id,score< / a > (return relevancy score as well) < / li >
< li >
< a href = "http://localhost:8983/solr/select/?indent=on&q=video&fl=*,score" > q=video& fl=*,score< / a > (return all stored fields, as well as relevancy score) < / li >
< li >
2009-10-25 17:59:38 -04:00
< a href = "http://localhost:8983/solr/select/?indent=on&q=video&sort=price desc&fl=name,id,price" > q=video& sort=price desc& fl=name,id,price< / a > (add sort specification: sort by price descending) < / li >
< li >
< a href = "http://localhost:8983/solr/select/?indent=on&q=video&wt=json" > q=video& wt=json< / a > (return response in JSON format) < / li >
2006-02-28 14:24:54 -05:00
< / ul >
< p >
Solr provides a < a href = "http://localhost:8983/solr/admin/form.jsp" > query form< / a > within the web admin interface
that allows setting the various request parameters and is useful when trying out or debugging queries.
< / p >
2010-03-26 15:59:59 -04:00
< a name = "N10194" > < / a > < a name = "Sorting" > < / a >
2006-02-28 14:24:54 -05:00
< h3 class = "boxed" > Sorting< / h3 >
< p >
2007-06-06 23:17:18 -04:00
Solr provides a simple method to sort on one or more indexed fields.
Use the 'sort' parameter to specify "field direction" pairs...
2006-02-28 14:24:54 -05:00
< / p >
< ul >
< li >
2007-06-06 23:17:18 -04:00
< a href = "http://localhost:8983/solr/select/?indent=on&q=video&sort=price+desc" > q=video& sort=price desc< / a >
2006-02-28 14:24:54 -05:00
< / li >
< li >
2007-06-06 23:17:18 -04:00
< a href = "http://localhost:8983/solr/select/?indent=on&q=video&sort=price+asc" > q=video& sort=price asc< / a >
2006-02-28 14:24:54 -05:00
< / li >
< li >
2007-06-06 23:17:18 -04:00
< a href = "http://localhost:8983/solr/select/?indent=on&q=video&sort=inStock+asc,price+desc" > q=video& sort=inStock asc, price desc< / a >
2006-02-28 14:24:54 -05:00
< / li >
< / ul >
< p >
"score" can also be used as a field name when specifying a sort...
< / p >
< ul >
< li >
2007-06-06 23:17:18 -04:00
< a href = "http://localhost:8983/solr/select/?indent=on&q=video&sort=score+desc" > q=video& sort=score desc< / a >
2006-02-28 14:24:54 -05:00
< / li >
< li >
2007-06-06 23:17:18 -04:00
< a href = "http://localhost:8983/solr/select/?indent=on&q=video&sort=inStock+asc,score+desc" > q=video& sort=inStock asc, score desc< / a >
2006-02-28 14:24:54 -05:00
< / li >
< / ul >
< p >
2009-10-25 17:59:38 -04:00
If no sort is specified, the default is < span class = "codefrag" > score desc< / span > to return the matches having the highest relevancy.
2006-02-28 14:24:54 -05:00
< / p >
< / div >
2009-10-25 17:59:38 -04:00
2010-03-26 15:59:59 -04:00
< a name = "N101C7" > < / a > < a name = "Highlighting" > < / a >
2009-10-25 17:59:38 -04:00
< h2 class = "boxed" > Highlighting< / h2 >
< div class = "section" >
< p >
Hit highlighting returns relevent snippets of each returned document, and highlights
keywords from the query within those context snippets.
< / p >
< p >
The following example searches for < span class = "codefrag" > video card< / span > and requests
highlighting on the fields < span class = "codefrag" > name,features< / span > . This causes a
< span class = "codefrag" > highlighting< / span > section to be added to the response with the
words to highlight surrounded with < span class = "codefrag" > < em> < / span > (for emphasis)
tags.
< / p >
< p >
2009-10-26 12:40:47 -04:00
< a href = "http://localhost:8983/solr/select/?wt=json&indent=on&q=video+card&fl=name,id&hl=true&hl.fl=name,features" > ...& q=video card& fl=name,id& hl=true& hl.fl=name,features< / a >
2009-10-25 17:59:38 -04:00
< / p >
< p >
More request parameters related to controlling highlighting may be found
< a href = "http://wiki.apache.org/solr/HighlightingParameters" > here< / a > .
< / p >
< / div > <!-- highlighting -->
2010-03-26 15:59:59 -04:00
< a name = "N101F0" > < / a > < a name = "Faceted+Search" > < / a >
2009-10-25 17:59:38 -04:00
< h2 class = "boxed" > Faceted Search< / h2 >
< div class = "section" >
< p >
Faceted search takes the documents matched by a query and generates counts for various
properties or categories. Links are usually provided that allows users to "drill down" or
refine their search results based on the returned categories.
< / p >
< p >
The following example searches for all documents (< span class = "codefrag" > *:*< / span > ) and
requests counts by the category field < span class = "codefrag" > cat< / span > .
< / p >
< p >
2009-10-26 12:40:47 -04:00
< a href = "http://localhost:8983/solr/select/?wt=json&indent=on&q=*:*&fl=name&facet=true&facet.field=cat" > ...& q=*:*& facet=true& facet.field=cat< / a >
2009-10-25 17:59:38 -04:00
< / p >
< p >
Notice that although only the first 10 documents are returned in the results list,
the facet counts generated are for the complete set of documents that match the query.
< / p >
< p >
2009-10-26 08:50:08 -04:00
We can facet multiple ways at the same time. The following example adds a facet on the
2009-10-25 17:59:38 -04:00
boolean < span class = "codefrag" > inStock< / span > field:
< / p >
< p >
2009-10-26 12:40:47 -04:00
< a href = "http://localhost:8983/solr/select/?wt=json&indent=on&q=*:*&fl=name&facet=true&facet.field=cat&facet.field=inStock" > ...& q=*:*& facet=true& facet.field=cat& facet.field=inStock< / a >
2009-10-25 17:59:38 -04:00
< / p >
< p >
Solr can also generate counts for arbitrary queries. The following example
queries for < span class = "codefrag" > ipod< / span > and shows prices below and above 100 by using
range queries on the price field.
< / p >
< p >
2009-10-26 12:40:47 -04:00
< a href = "http://localhost:8983/solr/select/?wt=json&indent=on&q=ipod&fl=name&facet=true&facet.query=price:[0+TO+100]&facet.query=price:[100+TO+*]" > ...& q=ipod& facet=true& facet.query=price:[0 TO 100]& facet.query=price:[100 TO *]< / a >
2009-10-25 17:59:38 -04:00
< / p >
< p >
One can even facet by date ranges. This example requests counts for the manufacture date (< span class = "codefrag" > manufacturedate_dt< / span > field) for each year between 2004 and 2010.
< / p >
< p >
2009-10-26 12:40:47 -04:00
< a href = "http://localhost:8983/solr/select/?wt=json&indent=on&q=*:*&fl=name,manufacturedate_dt&facet=true&facet.date=manufacturedate_dt&facet.date.start=2004-01-01T00:00:00Z&facet.date.end=2010-01-01T00:00:00Z&facet.date.gap=%2b1YEAR" > ...& q=*:*& facet=true& facet.date=manufacturedate_dt& facet.date.start=2004-01-01T00:00:00Z& facet.date.end=2010-01-01T00:00:00Z& facet.date.gap=+1YEAR< / a >
2009-10-25 17:59:38 -04:00
< / p >
< p >
More information on faceted search may be found on the
< a href = "http://wiki.apache.org/solr/SolrFacetingOverview" > faceting overview< / a >
and
< a href = "http://wiki.apache.org/solr/SimpleFacetParameters" > faceting parameters< / a >
pages.
< / p >
< / div > <!-- faceted search -->
2010-03-26 15:59:59 -04:00
< a name = "N10241" > < / a > < a name = "Text+Analysis" > < / a >
2006-02-28 14:24:54 -05:00
< h2 class = "boxed" > Text Analysis< / h2 >
< div class = "section" >
< p >
Text fields are typically indexed by breaking the field into words and applying various transformations such as
lowercasing, removing plurals, or stemming to increase relevancy. The same text transformations are normally
applied to any queries in order to match what is indexed.
< / p >
< p > Example queries demonstrating relevancy improving transformations:< / p >
< ul >
< li > A search for
< a href = "http://localhost:8983/solr/select/?indent=on&q=power-shot&fl=name" > power-shot< / a >
matches < span class = "codefrag" > PowerShot< / span > , and
< a href = "http://localhost:8983/solr/select/?indent=on&q=adata&fl=name" > adata< / a >
matches < span class = "codefrag" > A-DATA< / span > due to the use of WordDelimiterFilter and LowerCaseFilter.
< / li >
< li > A search for
< a href = "http://localhost:8983/solr/select/?indent=on&q=features:recharging&fl=name,features" > features:recharging< / a >
matches < span class = "codefrag" > Rechargeable< / span > due to stemming with the EnglishPorterFilter.
< / li >
< li > A search for
2009-10-25 17:59:38 -04:00
< a href = "http://localhost:8983/solr/select/?indent=on&q=%221 gigabyte%22&fl=name" > "1 gigabyte"< / a >
matches things with < span class = "codefrag" > GB< / span > , and the misspelled
2006-02-28 14:24:54 -05:00
< a href = "http://localhost:8983/solr/select/?indent=on&q=pixima&fl=name" > pixima< / a >
matches < span class = "codefrag" > Pixma< / span > due to use of a SynonymFilter.
< / li >
< / ul >
< p >
The < a href = "http://wiki.apache.org/solr/SchemaXml" > schema< / a > defines
the fields in the index and what type of analysis is applied to them. The current schema your server is using
may be accessed via the < span class = "codefrag" > [SCHEMA]< / span > link on the < a href = "http://localhost:8983/solr/admin/" > admin< / a > page.
< / p >
< p > A full description of the analysis components, Analyzers, Tokenizers, and TokenFilters
available for use is < a href = "http://wiki.apache.org/solr/AnalyzersTokenizersTokenFilters" > here< / a > .
< / p >
2010-03-26 15:59:59 -04:00
< a name = "N10291" > < / a > < a name = "Analysis+Debugging" > < / a >
2006-02-28 14:24:54 -05:00
< h3 class = "boxed" > Analysis Debugging< / h3 >
< p > There is a handy < a href = "http://localhost:8983/solr/admin/analysis.jsp" > analysis< / a >
debugging page where you can see how a text value is broken down into words,
and shows the resulting tokens after they pass through each filter in the chain.
< / p >
< p >
2009-10-25 17:59:38 -04:00
< a href = "http://localhost:8983/solr/admin/analysis.jsp?name=name&val=Canon+Power-Shot+SD500" > This< / a >
shows how "< span class = "codefrag" > Canon Power-Shot SD500< / span > " would be indexed as a value in the name field. Each row of
2006-02-28 14:24:54 -05:00
the table shows the resulting tokens after having passed through the next TokenFilter in the Analyzer for the < span class = "codefrag" > name< / span > field.
Notice how both < span class = "codefrag" > powershot< / span > and < span class = "codefrag" > power< / span > , < span class = "codefrag" > shot< / span > are indexed. Tokens generated at the same position
are shown in the same column, in this case < span class = "codefrag" > shot< / span > and < span class = "codefrag" > powershot< / span > .
< / p >
2009-10-25 17:59:38 -04:00
< p > Selecting < a href = "http://localhost:8983/solr/admin/analysis.jsp?name=name&verbose=on&val=Canon+Power-Shot+SD500" > verbose output< / a >
2006-02-28 14:24:54 -05:00
will show more details, such as the name of each analyzer component in the chain, token positions, and the start and end positions
of the token in the original text.
< / p >
2009-10-25 17:59:38 -04:00
< p > Selecting < a href = "http://localhost:8983/solr/admin/analysis.jsp?name=name&highlight=on&val=Canon+Power-Shot+SD500&qval=Powershot sd-500" > highlight matches< / a >
2006-02-28 14:24:54 -05:00
when both index and query values are provided will take the resulting terms from the query value and highlight
all matches in the index value analysis.
< / p >
< p >
< a href = "http://localhost:8983/solr/admin/analysis.jsp?name=text&highlight=on&val=Four+score+and+seven+years+ago+our+fathers+brought+forth+on+this+continent+a+new+nation%2C+conceived+in+liberty+and+dedicated+to+the+proposition+that+all+men+are+created+equal.+&qval=liberties+and+equality" > Here< / a >
is an example of stemming and stop-words at work.
< / p >
< / div >
2006-01-30 18:11:30 -05:00
2010-03-26 15:59:59 -04:00
< a name = "N102D0" > < / a > < a name = "Conclusion" > < / a >
2006-04-05 14:48:23 -04:00
< h2 class = "boxed" > Conclusion< / h2 >
< div class = "section" >
< p >
2009-10-25 17:59:38 -04:00
Congratulations! You successfully ran a small Solr instance, added some
documents, and made changes to the index. You learned about queries, text
analysis, and the Solr admin interface. You're ready to start using Solr on
your own project! Continue on with the following steps:
2006-04-05 14:48:23 -04:00
< / p >
< ul >
< li > Subscribe to the Solr < a href = "mailing_lists.html" > mailing lists< / a > !< / li >
< li > Make a copy of the Solr example directory as a template for your project.< / li >
< li > Customize the schema and other config in solr/conf/ to meet your needs.< / li >
< / ul >
2009-10-25 17:59:38 -04:00
< p >
Solr as a ton of other features that we haven't touched on here, including
< a href = "http://wiki.apache.org/solr/DistributedSearch" > distributed search< / a >
to handle huge document collections,
< a href = "http://wiki.apache.org/solr/FunctionQuery" > function queries< / a > ,
< a href = "http://wiki.apache.org/solr/StatsComponent" > numeric field statistics< / a > ,
and
< a href = "http://wiki.apache.org/solr/ClusteringComponent" > search results clustering< / a > .
2010-07-09 22:50:51 -04:00
Explore the < a href = "http://wiki.apache.org/solr/FrontPage" > Solr Wiki< / a > to find out
2009-10-25 17:59:38 -04:00
more details about Solr's many
< a href = "features.html" > features< / a > .
< / p >
2006-04-05 14:48:23 -04:00
< p >
Have Fun, and we'll see you on the Solr mailing lists!
< / p >
< / div >
2006-01-30 18:11:30 -05:00
< / div >
2007-06-06 23:17:18 -04:00
<!-- +
|end content
+-->
2006-01-30 18:11:30 -05:00
< div class = "clearboth" > < / div >
< / div >
< div id = "footer" >
2007-06-06 23:17:18 -04:00
<!-- +
|start bottomstrip
+-->
2006-01-30 18:11:30 -05:00
< div class = "lastmodified" >
< script type = "text/javascript" > < ! - -
2007-06-06 23:17:18 -04:00
document.write("Last Published: " + document.lastModified);
2006-01-30 18:11:30 -05:00
// -->< / script >
< / div >
< div class = "copyright" >
Copyright ©
2007-01-18 00:10:35 -05:00
2007 < a href = "http://www.apache.org/licenses/" > The Apache Software Foundation.< / a >
2006-01-30 18:11:30 -05:00
< / div >
2007-06-06 23:17:18 -04:00
<!-- +
|end bottomstrip
+-->
2006-01-30 18:11:30 -05:00
< / div >
< / body >
< / html >
