Commit Graph

936 Commits

Author SHA1 Message Date
Christine Poerschke c8542b2bd0 SOLR-8542: techproducts example now includes (disabled) learning-to-rank support (enable via -Dsolr.ltr.enabled=true)
additional changes as follows:

* LTRFeatureLoggerTransformerFactory:
** feature values cache name configurable (instead of hard-coded value that needs to match solrconfig.xml configuration)
** javadocs (example and parameters)

* CSV FeatureLogger:
** removed delimiter and separator assumptions in tests
** changed delimiter and separator (from "key:val;key:val" to "key=val,key=val")
** configurable (key value) delimiter and (features) separator

* JSON FeatureLogger:
** defer support for this (removing MapFeatureLogger class)

* adds 'training libraries' to (Linear|MultipleAdditiveTrees)Model javadocs

(Diego Ceccarelli, Michael Nilsson, Christine Poerschke)
2016-12-19 16:22:50 +00:00
yonik c9522a3936 SOLR-9712: block when maxWarmingSearchers is exceeded instead of throwing exception, default to 1, remove from most configs 2016-12-16 11:46:48 -05:00
Christine Poerschke bfc3690d52 SOLR-8542: couple of tweaks (Michael Nilsson, Diego Ceccarelli, Christine Poerschke)
* removed code triplication in ManagedModelStore
* LTRScoringQuery.java tweaks
* FeatureLogger.makeFeatureVector(...) can now safely be called repeatedly (though that doesn't happen at present)
* make Feature.FeatureWeight.extractTerms a no-op; (OriginalScore|SolrFeature)Weight now implement extractTerms

* LTRThreadModule javadocs and README.md tweaks

* add TestFieldValueFeature.testBooleanValue test; replace "T"/"F" magic string use in FieldValueFeature
* add TestOriginalScoreScorer test; add OriginalScoreScorer.freq() method
* in TestMultipleAdditiveTreesModel revive dead explain test
2016-12-07 20:46:42 +00:00
Christine Poerschke d2ed42b847 removed two unused imports in TestPlainTextEntityProcessor.java 2016-12-07 18:39:04 +00:00
Noble Paul 3f6164c76e added an extra testcase 2016-12-07 18:42:07 +05:30
Tommaso Teofili 641294a967 SOLR-8871 - adjusted UIMA processor test, patch from Alessandro Benedetti 2016-11-28 09:20:02 +01:00
Tommaso Teofili 5ad741eef8 SOLR-8871 - various improvements to ClassificationURP 2016-11-24 23:43:57 +01:00
Shalin Shekhar Mangar ff6da66601 SOLR-8785: Use Dropwizard Metrics library for core metrics 2016-11-22 14:37:33 +05:30
Christine Poerschke 86a515789f SOLR-8542, SOLR-9746: prefix solr/contrib/ltr's search and response.transform packages with ltr 2016-11-11 19:18:00 +00:00
Michael Nilsson 2c752b04cb SOLR-8542: disallow reRankDocs<1 i.e. must rerank at least 1 document
(Michael Nilsson via Christine Poerschke)
2016-11-11 19:17:59 +00:00
Dawid Weiss 401d77485d SOLR-7539: Upgrade the clustering plugin to Carrot2 3.15.0. 2016-11-04 16:02:00 +01:00
Christine Poerschke 5a66b3bc08 SOLR-8542: Adds Solr Learning to Rank (LTR) plugin for reranking results with machine learning models. (Michael Nilsson, Diego Ceccarelli, Joshua Pantony, Jon Dorando, Naveen Santhapuri, Alessandro Benedetti, David Grohmann, Christine Poerschke) 2016-11-01 17:50:14 +00:00
David Smiley 2e21511cd3 SOLR-9621: Remove several Guava & Apache Commons calls in favor of java 8 alternatives. 2016-10-28 17:18:58 -04:00
Noble Paul 0feca1a974 general cleanup to use java 8 feautures 2016-10-27 15:05:07 +05:30
Noble Paul d6b6e74703 SOLR-2094: XPathEntityProcessor should reinitialize the XPathRecordReader instance if the 'forEach' or 'xpath' attributes are templates & it is not a root entity 2016-10-27 14:52:24 +05:30
Shalin Shekhar Mangar b8d9647307 SOLR-2039: Multivalued fields with dynamic names does not work properly with DIH 2016-10-26 11:02:10 +05:30
Noble Paul 127bf9f772 SOLR-9657: Use cache for templates 2016-10-20 20:06:21 +05:30
Noble Paul c2e031add3 SOLR-9657: New TemplateUpdateProcessorFactory added 2016-10-19 11:04:10 +05:30
Noble Paul 5c5c0c93ae SOLR-9576: Make FieldAnalysisRequestHandler, DocumentAnalysisRequestHandler & DumpRequestHandler implicit 2016-09-28 20:04:04 +05:30
Noble Paul 65439e261e SOLR-9558: DIH TemplateTransformerto to support multivalued fields 2016-09-26 12:20:44 +05:30
Mike McCandless f7aa200d40 LUCENE-7407: switch doc values usage to an iterator API, based on DocIdSetIterator, instead of random acces, freeing codecs for future improvements 2016-09-21 09:41:41 -04:00
Varun Thacker 5d6b7fffc3 SOLR-9522: Improve error handling in ZKPropertiesWriter 2016-09-16 18:47:06 +05:30
Varun Thacker ef3057e43b SOLR-9408: Fix TreeMergeOutputFormat to add timestamp metadata to commits 2016-09-13 10:49:27 +05:30
Noble Paul 1a61fb6858 SOLR-9127: Excel workbook (.xlsx) response writer. use 'wt=xlsx' 2016-09-06 13:22:18 +05:30
Uwe Schindler e99d970674 SOLR-9430: Fix locale lookup in DIH <propertyWriter/> to use BCP47 language tags to be consistent with other places in Solr. Language names still work for backwards compatibility 2016-08-27 08:38:42 +02:00
Robert Muir 105c7eae87 LUCENE-7413: move legacy numeric support to backwards module 2016-08-17 09:28:45 -04:00
Christine Poerschke 9d784a6693 SOLR-9385: Add QParser.getParser(String,SolrQueryRequest) variant. 2016-08-09 15:04:05 +01:00
Mikhail Khludnev 209bfcf021 SOLR-9209,SOLR-9256: extracting
JdbcDataSource.createResultSetIterator(), adding a test for
ResultSetIterator.hasNext()
2016-08-02 14:45:37 +03:00
Alan Woodward 78ebcd3cf5 SOLR-9346: Always close ZkStateReader 2016-07-27 16:45:59 +01:00
Steve Rowe 85a585c516 SOLR-9076: disable broken nightly tests MorphlineBasicMiniMRTest and MorphlineGoLiveMiniMRTest via @AwaitsFix 2016-07-22 14:26:32 -04:00
Christine Poerschke f9c9470641 SOLR-9306: give solr/contrib/analysis-extras's test classes access to lucene/analysis's test classes 2016-07-14 10:20:35 +01:00
Noble Paul 74de196565 SOLR-8995: Use Lamdas for Thread/Runnable 2016-07-11 19:29:15 +05:30
Erick Erickson db295440a6 SOLR-7903: Comment out trappy references to example docs in elevate.xml files 2016-07-06 14:50:43 -07:00
Alan Woodward c38cdedbf2 SOLR-9076: Fix ivy config to pass precommit 2016-07-01 16:13:30 +01:00
markrmiller 2c96c91dd8 SOLR-9076: Add some missing dependencies. 2016-07-01 09:06:15 -04:00
Gregory Chanan f273cb1b3a SOLR-9076: Update to Hadoop 2.7.2 2016-06-23 13:41:15 -07:00
markrmiller 740198f33d SOLR-9219: Make hdfs blockcache read buffer sizes configurable and improve cache concurrency. 2016-06-21 13:06:10 -04:00
Steve Rowe 2d96fe17d6 SOLR-9220: Disable failing tests 2016-06-18 16:10:37 -04:00
Uwe Schindler 19cb7404f5 SOLR-8981: Update TIKA to 1.13:
- This commit merges branch 'SOLR-8981' of https://github.com/tballison/lucene-solr
- Adds some modifications and reverts jackcess-encrypt addition (not yet working)
- Fixes order of ivy-versions.properties
- This closes #44
2016-06-18 12:23:28 +02:00
tballison dd09f0f42b SOLR-8981 add jackcess-encrypt 2016-06-17 15:32:19 -04:00
tballison 785bebbcbd SOLR-8981 remove "don't test with java-9" commands; fix bug introduced by TIKA-995 -- doubling of body elements in HTML tags; add copyright info for Jackcess. 2016-06-17 14:40:21 -04:00
tballison ba0e717034 SOLR-8981 upgrade to Tika 1.13 2016-06-16 12:56:45 -04:00
Mike McCandless 87016b5f0c LUCENE-7318: graduate StandardAnalyzer and make it the default for IndexWriterConfig 2016-06-14 16:38:04 -04:00
Christine Poerschke 52f5c50246 LUCENE-7319: remove unused imports 2016-06-13 09:59:14 +01:00
Mikhail Khludnev fce10ae109 SOLR-2199: DataImportHandler (DIH) JdbcDataSource supports multiple resultsets per query 2016-06-13 00:11:27 +03:00
Uwe Schindler 3c9e36b1e1 SOLR-8610: Fix temporary dir usage in DIH 2016-06-07 10:51:41 +02:00
Mikhail Khludnev a9dea9a983 SOLR-8445: fix line separator in log4j.properties files 2016-06-07 00:21:49 +03:00
Mikhail Khludnev c2aea1b803 SOLR-8610: Resolve variables in encryptKeyFile of DIH's JdbcDataSource 2016-06-06 23:41:02 +03:00
Mikhail Khludnev 24fa92959d SOLR-8612: closing JDBC Statement on exceptions from JdbcDataSource in DataImportHandler aka DIH (Kristine Jetzke via Mikhail Khludnev) 2016-06-06 21:40:56 +03:00
Mike McCandless baa5344e68 LUCENE-7283: move SlowCompositeReaderWrapper and uninverting to solr 2016-05-25 05:36:32 -04:00
David Smiley 4193e60b9f SOLR-9080 SOLR-9085: Fix date math before the year 1582.
note: DateMathParser no longer needs a Locale
2016-05-13 10:03:24 -04:00
Alan Woodward 927454b8a2 SOLR-9072: Move morphline-core zk tests to SolrCloudTestCase 2016-05-13 14:39:07 +01:00
Erick Erickson 5341918a0c SOLR-9083: Remove deprecated <types> and <fields> from schemas 2016-05-10 06:54:11 -07:00
Anshum Gupta b02b026b7d SOLR-8097: Implement builder pattern design for constructing SolrJ clients and deprecate direct construction of clients 2016-04-07 15:57:49 -07:00
Noble Paul 18fb9463de SOLR-8750: replace anonymous inner class for callable, Runnable etc 2016-04-05 22:45:36 +05:30
David Smiley 5e5fd66257 SOLR-8903: Move SolrJ DateUtil to contrib/extraction as ExtractionDateUtil.
And removed obsolete methods.
2016-03-30 15:00:29 -04:00
David Smiley 39932f5758 SOLR-8904: fix accidental move of DateUtil to ExtractingDateUtil (wrong patch file) 2016-03-30 14:31:26 -04:00
David Smiley 94c04237cc SOLR-8904: switch from SimpleDateFormat to Instant.parse and format.
[value] and ms() and contrib/analytics now call DateMathParser to parse.  DateFormatUtil is now removed.
2016-03-30 13:42:42 -04:00
Uwe Schindler 91424ae963 SOLR-8874, SOLR-8876: Disable more Hadoop tests with Java 9 2016-03-20 10:41:05 +01:00
Uwe Schindler f93f90ca1b SOLR-8874: Make Solr tests work with Java 9 Jigsaw 2016-03-19 14:53:59 +01:00
Noble Paul faa0586b31 SOLR-8842: security rules made more foolproof by asking the requesthandler about the well known
permission name.
  The APIs are also modified to ue 'index' as the unique identifier instead of name.
  Name is an optional attribute
  now and only to be used when specifying well-known permissions
2016-03-17 23:34:50 +05:30
Noble Paul e70c638bcf SOLR-8766: deprecated <admin> tag in solrconfig.xml is removed 2016-03-08 18:53:59 +05:30
Shalin Shekhar Mangar 093a8ce57c SOLR-8745: Deprecate costly ZkStateReader.updateClusterState(), replace with a narrow forceUpdateCollection(collection) 2016-03-07 15:03:03 +05:30
Robert Muir 3ffeccab7e LUCENE-7063: add tests/docs for numericutils, rename confusing methods, remove overlap with LegacyNumericUtils 2016-03-03 21:52:12 -05:00
Steve Rowe 9427b7402d SOLR-8764: Remove deprecated methods and classes 2016-03-02 09:22:20 -05:00
Tomás Fernández Löbbe 20b7453cc8 SOLR-8713: new UI and example solrconfig files point to Reference Guide for Solr Query Syntax instead of the wiki.
This closes #12
2016-02-29 08:22:25 -08:00
Dawid Weiss 4c9dca8d90 SOLR-8711: follow-up removal of dependencies no longer used. (applying
again, with changes to the sources).

This reverts commit 594fb908f6.
2016-02-24 09:27:06 +01:00
Dawid Weiss 594fb908f6 Revert "SOLR-8711: follow-up removal of dependencies no longer used."
This reverts commit a77d67a926.
2016-02-24 09:08:18 +01:00
Dawid Weiss a77d67a926 SOLR-8711: follow-up removal of dependencies no longer used. 2016-02-23 10:49:23 +01:00
Christine Poerschke b14fb50b7f SOLR-8674: solr.tests.mergePolicy[Factory] tests now randomly choose between <mergePolicy> and <mergePolicyFactory>
* This increases <mergePolicy> vs. <mergePolicyFactory> test coverage.
* This temporarily also adds a little test setup complexity but when SOLR-8668 removes support for <mergePolicy> then test setup will return to its original complexity.
2016-02-22 15:22:55 +00:00
Christine Poerschke 588e3ff084 SOLR-8621: fix mergePolicyFacory vs. mergePolicyFactory typos in comments in solr/contrib and solr/example solrconfig.xml files. 2016-02-10 21:22:17 +00:00
Shai Erera a5accccbfc SOLR-8621: fix solrconfig.xml under contrib and example 2016-02-10 16:33:01 +02:00
Uwe Schindler 0f43705788 LUCENE-7013: Revert changes to package-info.java files (adds newline after license header and before javadocs back) 2016-02-04 23:02:50 +01:00
Shai Erera 813ca77250 LUCENE-7013: Move license header to top of file 2016-02-04 15:51:19 +02:00
Noble Paul 13c9912b3c SOLR-8618 refactored a couple of methods out as protected 2016-01-31 18:44:39 +05:30
Uwe Schindler 4efccce1f1 LUCENE-6978: Fix usage of Locale#toString in DIH
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1726311 13f79535-47bb-0310-9956-ffa450edef68
2016-01-22 21:05:40 +00:00
Uwe Schindler 7213e7cfc0 LUCENE-6978: Fix Morphlines locale parsing with empty string / null: use ROOT
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1726118 13f79535-47bb-0310-9956-ffa450edef68
2016-01-21 22:16:55 +00:00
Michael McCandless 24c46305bd LUCENE-6971: remove StorableField, StoredDocument
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1725117 13f79535-47bb-0310-9956-ffa450edef68
2016-01-17 19:54:50 +00:00
Uwe Schindler f5b0e537b4 LUCENE-6978: Refactor several code places that lookup locales by string name to use BCP47 locale tag instead
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1724891 13f79535-47bb-0310-9956-ffa450edef68
2016-01-15 22:41:57 +00:00
Tommaso Teofili 8a7a142efb SOLR-6622 - using all field values in UIMAUpdateRequestProcessor
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1723982 13f79535-47bb-0310-9956-ffa450edef68
2016-01-11 08:12:37 +00:00
Christine Poerschke 2580956b8b SOLR-8505: core/DirectoryFactory.LOCK_TYPE_HDFS - add & use it instead of String literals
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1723751 13f79535-47bb-0310-9956-ffa450edef68
2016-01-08 15:59:36 +00:00
Shalin Shekhar Mangar 7bfb2a2949 SOLR-8220: Read field from DocValues for non stored fields
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1721795 13f79535-47bb-0310-9956-ffa450edef68
2015-12-27 10:27:00 +00:00
Christine Poerschke c4db8d57a4 SOLR-8317: use responseHeader and response accessors to SolrQueryResponse
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1721170 13f79535-47bb-0310-9956-ffa450edef68
2015-12-21 14:39:21 +00:00
Michael McCandless 7da175b0b6 LUCENE-6917: rename/deprecate numeric classes in favor of dimensional values
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1719562 13f79535-47bb-0310-9956-ffa450edef68
2015-12-11 21:13:41 +00:00
Uwe Schindler 80d07524ee PDFBOX-3155: Disable tests that fail with new Java 9 version number scheme
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1718439 13f79535-47bb-0310-9956-ffa450edef68
2015-12-07 18:46:10 +00:00
Varun Thacker 695870d7a2 SOLR-8131: fix test solrconfig.xml files for the contrib modules
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1718307 13f79535-47bb-0310-9956-ffa450edef68
2015-12-07 11:18:31 +00:00
Varun Thacker 0e886c19fa SOLR-8131: Make ManagedIndexSchemaFactory the default schemaFactory when luceneMatchVersion >= 6
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1718258 13f79535-47bb-0310-9956-ffa450edef68
2015-12-07 07:32:41 +00:00
Anshum Gupta 6caaa0c454 SOLR-8330: Standardize and fix logger creation and usage so that they aren't shared across source files.
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1717590 13f79535-47bb-0310-9956-ffa450edef68
2015-12-02 09:22:22 +00:00
David Wayne Smiley ce0363c0ad SOLR-8180: jcl-over-slf4j is officially a solrj/solr dependency now; not marked optional in a POM.
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1717481 13f79535-47bb-0310-9956-ffa450edef68
2015-12-01 18:12:00 +00:00
Alan Woodward e5be9136a6 SOLR-8336: CoreDescriptor takes a Path for its instance dir, rather than a String
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1717254 13f79535-47bb-0310-9956-ffa450edef68
2015-11-30 14:02:45 +00:00
Erik Hatcher 255ff56d4e SOLR-8307: move EmptyEntityResolver to another package to avoid conflict with solr-core and javadoc generation
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1716007 13f79535-47bb-0310-9956-ffa450edef68
2015-11-24 01:25:00 +00:00
Alan Woodward 0f3aecfdff SOLR-8302: SolrResourceLoader takes a Path for its instance directory
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1715342 13f79535-47bb-0310-9956-ffa450edef68
2015-11-20 12:12:05 +00:00
Gregory Chanan b916bbc50a SOLR-8286: Remove instances of solr.hdfs.blockcache.write.enabled from tests and docs
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1714278 13f79535-47bb-0310-9956-ffa450edef68
2015-11-13 23:45:44 +00:00
Alan Woodward f43daa0163 SOLR-8260: Remove morphlines test setup with wrongly configured core discovery roots
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1713563 13f79535-47bb-0310-9956-ffa450edef68
2015-11-09 22:36:31 +00:00
Chris M. Hostetter ecf410f413 SOLR-8239: Added ClassicSimilarityFactory, marked DefaultSimilarityFactory as deprecated
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1712979 13f79535-47bb-0310-9956-ffa450edef68
2015-11-06 15:45:50 +00:00
Chris M. Hostetter d207e8c39a SOLR-8239: reverting r1712840 from trunk -- backport to 5x was more complicated then I expected because aparently DefaultSimilarity deprecation with ClassicSimilarity was never backported? want to clarify/resolve that before moving forward here
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1712845 13f79535-47bb-0310-9956-ffa450edef68
2015-11-05 18:44:13 +00:00
Chris M. Hostetter 2a24085bcd SOLR-8239: Added ClassicSimilarityFactory, marked DefaultSimilarityFactory as deprecated
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1712840 13f79535-47bb-0310-9956-ffa450edef68
2015-11-05 18:19:54 +00:00
Christine Poerschke 4d1a16ff3c SOLR-8147: contrib/analytics FieldFacetAccumulator now throws IOException instead of SolrException
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1712751 13f79535-47bb-0310-9956-ffa450edef68
2015-11-05 12:13:34 +00:00
Alan Woodward 43cd1639f5 LUCENE-6884: Analyzer.tokenStream() and Tokenizer.setReader() don't need to throw IOException
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1712731 13f79535-47bb-0310-9956-ffa450edef68
2015-11-05 10:00:11 +00:00
Uwe Schindler 74f354a5a1 SOLR-8166: Add some null checks
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1712677 13f79535-47bb-0310-9956-ffa450edef68
2015-11-04 22:32:00 +00:00