mirror of https://github.com/apache/lucene.git
71 lines
2.5 KiB
Plaintext
71 lines
2.5 KiB
Plaintext
|
We have a movie data set in JSON, Solr XML, and CSV formats.
|
||
|
|
All 3 formats contain the same data. You can use any one format to index documents to Solr.
|
||
|
|
|
||
|
|
The data is fetched from Freebase and the data license is present in the films-LICENSE.txt file.
|
||
|
|
|
||
|
|
This data consists of the following fields -
|
||
|
|
* "id" - unique identifier for the movie
|
||
|
|
* "name" - Name of the movie
|
||
|
|
* "directed_by" - The person(s) who directed the making of the film
|
||
|
|
* "initial_release_date" - The earliest official initial film screening date in any country
|
||
|
|
* "genre" - The genre(s) that the movie belongs to
|
||
|
|
|
||
|
|
Steps:
|
||
|
|
* Start Solr:
|
||
|
|
bin/solr start
|
||
|
|
|
||
|
|
* Create a "films" core
|
||
|
|
bin/solr create_core -n films -c data_driven_schema_configs
|
||
|
|
|
||
|
|
* Update the schema (by default it will guess the field types based on the date as it is indexed):
|
||
|
|
curl http://localhost:8983/solr/films/schema/fields -X POST -H 'Content-type:application/json' --data-binary '
|
||
|
|
[
|
||
|
|
{
|
||
|
|
"name":"genre",
|
||
|
|
"type":"string",
|
||
|
|
"stored":true,
|
||
|
|
"multiValued":true
|
||
|
|
},
|
||
|
|
{
|
||
|
|
"name":"directed_by",
|
||
|
|
"type":"string",
|
||
|
|
"stored":true,
|
||
|
|
"multiValued":true
|
||
|
|
},
|
||
|
|
{
|
||
|
|
"name":"name",
|
||
|
|
"type":"text_general",
|
||
|
|
"stored":true
|
||
|
|
},
|
||
|
|
{
|
||
|
|
"name":"initial_release_date",
|
||
|
|
"type":"tdate",
|
||
|
|
"stored":true
|
||
|
|
}
|
||
|
|
]'
|
||
|
|
|
||
|
|
* Now let's index the data. You could run either of the following commands from the example/exampledocs directory
|
||
|
|
|
||
|
|
For JSON -
|
||
|
|
curl 'http://localhost:8983/solr/films/update?commit=true' --data-binary @films.json -H 'Content-type:application/json'
|
||
|
|
|
||
|
|
For XML -
|
||
|
|
curl 'http://localhost:8983/solr/films/update?commit=true' --data-binary @films.xml -H 'Content-type:text/xml'
|
||
|
|
|
||
|
|
For CSV -
|
||
|
|
curl 'http://localhost:8983/solr/films/update?f.genre.split=true&f.directed_by.split=true&f.genre.separator=|&f.directed_by.separator=|&commit=true' --data-binary @films.csv -H 'Content-type:text/csv; charset=utf-8'
|
||
|
|
|
||
|
|
* Let's get searching.
|
||
|
|
- Search for 'Batman':
|
||
|
|
http://localhost:8983/solr/films/query?q=name:batman
|
||
|
|
|
||
|
|
- Show me all 'Super hero' movies:
|
||
|
|
http://localhost:8983/solr/films/query?q=*:*&fq=genre:%22Superhero%20movie%22
|
||
|
|
|
||
|
|
- Let's see the distribution of genres across all the movies. See the facet section for the counts:
|
||
|
|
http://localhost:8983/solr/films/query?q=*:*&facet=true&facet.field=genre
|
||
|
|
|
||
|
|
Exploring the data further -
|
||
|
|
|
||
|
|
* Increase the MAX_ITERATIONS value, put in your freebase API_KEY and run the exampledocs_generator.py script using Python 3.
|
||
|
|
Now re-index Solr with the new data.
|