Commit Graph

14737 Commits

Author SHA1 Message Date
David Smiley 021de9f45f
SOLR-14915: Prometheus-exporter should not depend on Solr-core (#1972)
* Reduced dependencies from Solr server down to just SolrJ.  Don't add WEB-INF/lib.
* Was missing some dependencies in lib/; now has all except SolrJ & logging.
* Can run via gradle, "gradlew run"
* Has own log4j2.xml now

Has own CHANGES.md now.
2020-11-27 15:08:33 -05:00
David Smiley 1e0ae2fb74
SOLR-15001 Docker: require init_var_solr.sh (#2083)
The Dockerfile should not initialize /var/solr's contents because this is confusing and redundant with init_var_solr.sh.
No need for init_var_solr.sh to echo what it does; VERBOSE can be used to accomplish that.

Separate CHANGES.md for Docker and contrib modules.
2020-11-27 14:59:54 -05:00
Jan Høydahl 99c38eee49
SOLR-14851 Http2SolrClient doesn't handle keystore type (#2098)
Signed-off-by: Jan Høydahl <janhoy@apache.org>
Co-authored-by: Andras Salamon <andras.salamon@melda.info>
2020-11-27 16:11:29 +01:00
Alessandro Benedetti ca040402d9 SOLR-15015: added support to parametric Interleaving algorithm (#2096) 2020-11-24 10:14:38 +00:00
Erick Erickson 77a205387f SOLR-14993: Unable to download zookeeper files of 1byte in size 2020-11-22 09:23:44 -05:00
Christine Poerschke c4d4767bca SOLR-14035: Remove deprecated preferLocalShards=true support in favour of the shards.preference=replica.location:local alternative.
(Alex Bulygin via Christine Poerschke)
2020-11-19 17:57:47 +00:00
Alessandro Benedetti af0455ac83
SOLR-14560: Interleaving for Learning To Rank (#1571)
SOLR-14560: Add interleaving support in Learning To Rank
2020-11-18 18:15:24 +00:00
Cassandra Targett ea4dd0580f SOLR-14792: remove leftover /browse UI screenshot from ref guide docs 2020-11-17 15:00:38 -06:00
Cassandra Targett 2b5b0f999c SOLR-14683: move "Missing Metrics" section down to config section; add short blurb to intro text 2020-11-17 11:58:09 -06:00
Marcus b9a93cf695
LUCENE-8626: Standardize Lucene test file naming Part 2 (#2053) 2020-11-17 08:13:13 -05:00
Nazerke Seidan 2d583eaba7
SOLR-14998: logging: info->debug in CollectionsHandler (#2079)
Because it's almost always redundant with HttpSolrCall's admin request log.
Co-authored-by: Nazerke Seidan <nseidan@salesforce.com>
2020-11-16 16:59:31 -05:00
Noble Paul 73d5e7ae77
SOLR-14977 : ContainerPlugins should be configurable (#2065) 2020-11-17 00:19:50 +11:00
Erick Erickson 93ecd0fa0a SOLR-14986: Add warning to ref guide that using 'properties.name' is an expert option 2020-11-14 09:04:59 -05:00
Adrien Grand 06877b2c6e
LUCENE-9378: Make it possible to configure how to trade speed for compression on doc values. (#2069)
This adds a switch to `Lucene80DocValuesFormat` which allows to
configure whether to prioritize retrieval speed over compression ratio
or the other way around. When prioritizing retrieval speed, binary doc
values are written using the exact same format as before more aggressive
compression got introduced.
2020-11-12 16:10:00 +01:00
Christine Poerschke 2f02040a4c SOLR-14983: Fix response returning original score instead of reranked score due to query and filter combining.
(Krishan Goyal, Jason Baik, Christine Poerschke)
2020-11-12 12:51:21 +00:00
Mike Drob 66e285e7ae
SOLR-14995 Update Jetty to latest version 2020-11-11 13:27:49 -08:00
Jason Gerlowski a7197ac0ce
SOLR-14971: Handle atomic-removes on uncommitted docs (#2056)
Docs fetched from the update log via RTG look different than docs
fetched from commits in the index: the types of
field-values may be different between the two, etc.

This is a problem for atomic add/remove of field values, where matching
existing values has historically been done by object equals() calls (via
Collection operations).  This relies on equality checks which don't have
flexible enough semantics to match values across these different types.
(For example, `new Long(1).equals(new Integer(1))` returns `false`).
This was causing some add-distinct and remove operations on
uncommitted values to silently fail to remove field values.

This commit patches over this by converting between types in the more
common cases before using the fallback behavior.
2020-11-11 12:28:11 -05:00
Bruno Roustant 91ee53d418
SOLR-14975: Add entry in CHANGES.txt 2020-11-11 11:52:30 +01:00
Bruno Roustant 67f9245ce3
SOLR-14975: Optimize CoreContainer.getAllCoreNames and getLoadedCoreNames.
Also optimize getCoreDescriptors.
2020-11-11 11:37:45 +01:00
Houston Putman d65041359e
SOLR-14949: Adding githubUrl option for docker build. (#2074) 2020-11-10 13:31:33 -05:00
Andrzej Bialecki 863a388fe7 SOLR-14683: Move the CHANGES.txt entry to the right place. Fix wrong type of null value. 2020-11-10 17:58:45 +01:00
Houston Putman 212b0f8657
SOLR-14949: Ability to customize Solr Docker build (#2020)
Also added a gradlew helpDocker page.
2020-11-10 10:42:38 -05:00
Tomoko Uchida d1110394e9
LUCENE-9600: Clean up package name conflicts between misc and core modules (#2064) 2020-11-10 22:24:48 +09:00
Andrzej Bialecki 7ec17376be SOLR-14683: Metrics API should ensure consistent placeholders for missing values. 2020-11-10 11:48:59 +01:00
Adrien Grand bac4309326 SOLR-14749: Use h2 instead of h3 so that the javadoc tool doesn't complain about out-or-sequence headers. 2020-11-10 09:22:34 +01:00
Adrien Grand fd98f677b9 Remove unused imports. 2020-11-10 09:22:34 +01:00
Adrien Grand 514c363f1d LUCENE-9322: Move Solr to Lucene90Codec.
And drop configurability of Lucene87Codec since it shouldn't be used for writing anymore.
2020-11-10 09:22:34 +01:00
Erick Erickson be19432b75 SOLR-14969: Prevent creating multiple cores with the same name which leads to instabilities (race condition) changed error code 2020-11-09 08:16:43 -05:00
Andrzej Bialecki 0bfa2a6908 SOLR-14749: Restructure the docs + add some examples. 2020-11-05 13:54:46 +01:00
Andrzej Bialecki bdc6e8247f SOLR-14749: Provide a clean API for cluster-level event processing. 2020-11-05 12:18:05 +01:00
Mike Drob 7c1ff288b7
SOLR-14978 OOM Killer in Foreground (#2055)
Combine Docker and bin/solr OOM handling scripts, move OOM handling to foreground Solr as well.

Co-authored-by: Houston Putman <houstonputman@gmail.com>
2020-11-04 17:20:16 -06:00
Dawid Weiss f7779339d5 Correct sandbox class name. 2020-11-03 17:41:22 +01:00
Dawid Weiss 22296f28a2
SOLR-14912: Unify solr-contrib-extraction with the artifact it produces (#2060) 2020-11-03 14:15:26 +01:00
Dawid Weiss 0f871b2c56
SOLR-14926: Modernize and clean up search results clustering contrib. 2020-11-03 09:31:53 +01:00
Tomoko Uchida 6a7131ee24
LUCENE-9319: Clean up package name conflicts for sandbox module (#2023) 2020-11-03 12:01:02 +09:00
Michael Aleythe e7f0294d85 SOLR-14961 ZkMaintenanceUtils.clean doesn't remove zk nodes with same length
fixes #2042
2020-11-02 16:54:00 -06:00
Houston Putman 5091e75c9d
SOLR-14907: Adding V2 API for ConfigSet Upload. (#1996) 2020-11-02 14:06:45 -05:00
Christine Poerschke 0729746d77
Rename TestSolrTestCaseJ4 to SolrTestCaseJ4DeleteCoreTest. (#2032) 2020-11-02 16:13:01 +00:00
Christine Poerschke da0004875b
SOLR-14865: 'Index Merge Metrics' documentation correction (#1870) 2020-11-02 15:25:14 +00:00
Jan Høydahl 0c3f2f4ac8
SOLR-14972: Change default port of prometheus exporter to 8989 (#2046) 2020-11-02 14:06:34 +01:00
Erick Erickson 2c49c4a27d SOLR-14969: Prevent creating multiple cores with the same name which leads to instabilities (race condition) 2020-10-31 19:34:09 -04:00
Houston Putman e1698bda95
SOLR-14955: Add env var options to Prometheus Export scripts. (#2038) 2020-10-30 11:15:33 -04:00
S N Munendra f3fdd9b90b
SOLR-14946: fix responseHeader returned in resp with omitHeader=true (#2029)
* This occurs when BinaryResponseWriter#getParsedResponse is called as
  it doesn't check for omitHeader.
2020-10-30 18:50:18 +05:30
Eric Pugh d0ba0f38a9
Enhance Javadocs for ExternalFileField on how to return values as part of document fields. SOLR-14968
* add helpful documentation on returning the field value

* wordsmith
2020-10-29 12:38:41 -04:00
Anver Sotnikov 6d00843d97 SOLR-14940: Fix ReplicationHandler memory leak through SolrCore.closeHooks
* Added ability to remove SolrCore.closeHooks
* Keep references to CloseHooks in ReplicationHandler and remove them on ReplicationHandler.shutdown()

closes #1997
2020-10-27 16:03:43 -05:00
Erick Erickson 521ca54802 SOLR-14844: Upgrade Jetty to 9.4.32.v20200930 2020-10-26 19:03:10 -04:00
Houston Putman 4fe4f37131
SOLR-14957: Add Prometheus Exporter to docker PATH. Fix classpath issues. (#2017) 2020-10-26 14:15:30 -04:00
Ilan Ginzburg b649f3f40d
SOLR-14964: remove Autoscaling related withCollection and COLOCATED_WITH (#2034)
Part of SOLR-14656 (remove Autoscalin)
2020-10-26 19:10:49 +01:00
Erick Erickson c29b0083d7 SOLR-14954: Heavily edit reindexing.adoc 2020-10-26 13:22:16 -04:00
Tomas Fernandez Lobbe 38f02869b4
Remove sleeps from SolrZkClientTest.testWrappingWatches (#1936)
Only sleep when tests are nightly
2020-10-26 10:11:11 -07:00
Christine Poerschke 4bf254158a
Rename ConfigSetsAPITest to TestConfigSetsAPIShareSchema (#1890) 2020-10-26 09:45:13 +00:00
Christine Poerschke 7a09cc1d49
SOLR-14937: Correct client.queryDefaults().set(...) calls in some JSON facet tests. (#1987) 2020-10-26 09:43:56 +00:00
David Smiley 2d3a221dcf
.gitignore clean up (#1993)
* Reorganized
* Removed outdated entries
* Moved some rules from the repo root to Solr
2020-10-24 11:09:55 -04:00
Shalin Shekhar Mangar 706f284c46
SOLR-14942: Reduce leader election time on node shutdown (#2004)
The shutdown process waits for all replicas/cores to be closed before removing the election node of the leader. This can take some time due to index flush or merge activities on the leader cores and delays new leaders from being elected. Moreover, jetty stops accepting new requests on receiving SIGTERM which means that even though a leader technically exists, no new indexing requests can be processed by the node. This commit waits for all in-flight indexing requests to complete, removes election nodes (thus triggering leader election) and then closes all replicas.

Co-authored-by: Cao Manh Dat <datcm@apache.org>
2020-10-24 17:39:00 +05:30
Michael Sokolov 840a353bc7
LUCENE-9582: rename VectorValues.ScoreFunction to SearchStrategy (#2018)
Co-authored-by: Julie Tibshirani
2020-10-23 17:39:34 -04:00
Houston Putman 3bfe9d8ac9
SOLR-14947: Print out image info after gradle docker task. (#2007) 2020-10-22 11:30:43 -04:00
Andrzej Bialecki c680a6e061 Move upgrade notes from CHANGES.txt to the Ref Guide. 2020-10-22 17:28:13 +02:00
Christine Poerschke 43c087f91b SOLR-14956: correct (socket|conn)Timeout casing in 'Configuring the ShardHandlerFactory' example
(Yevhen Tienkaiev via Christine Poerschke)
2020-10-22 16:26:15 +01:00
Houston Putman 62de8f9f46
Add example for ConfigSet create with properties map. (#2005) 2020-10-22 11:20:33 -04:00
Noble Paul 052efd62ae Revert "refactor method names"
This reverts commit e826b1f344.

accidental commite reverted
2020-10-22 15:25:31 +11:00
Noble Paul e826b1f344 refactor method names 2020-10-22 12:35:47 +11:00
Andrzej Bialecki 67ecd8ff9a SOLR-14749: Improve support for arbitrary container-level plugins. Add ClusterSingleton
support for plugins that require only one active instance in the cluster.
2020-10-21 17:22:44 +02:00
Kevin Risden 6ac5747d76
SOLR-14549: Fix listing of Files in a Directory on Solr Admin UI
* Ensure that jstree can update data behind the scenes
* Fix file jstree object to represent open/closed correctly
* Upgrade jstree to 3.3.10 for compatibility with JQuery 3.5.x

Closes #1989
2020-10-19 09:41:36 -04:00
Jan Høydahl 3bc873e6d4
SOLR-14936: Fixed Grafana dashboard filters for collection, shard, replica and core (#1986) 2020-10-19 14:49:02 +02:00
Tomoko Uchida 44c1bd42c5
LUCENE-9318: Clean up package name conflicts for backward-codecs (#2000) 2020-10-19 21:32:06 +09:00
Eric Pugh 43edf379c3
SOLR-14943 Rework Monitoring Solr with Prometheus and Grafana ref guide page to be clearer (#1999)
* fix some errors in the doc to match reality

* bit more introductory text, and fix the embedded zk port

* add sample image and a tip on directly importing from grafana.com

* per discussion on github issue, this is no longer experimental contrib
2020-10-19 07:59:18 -04:00
Christine Poerschke b47ccbc618 Fix a highlight in query-settings-in-solrconfig.adoc file. 2020-10-19 12:54:37 +01:00
Christine Poerschke 6e2572882f Fix 'an[d]' typo in three solrconfig.xml comments. 2020-10-19 12:54:37 +01:00
Andrzej Bialecki 9ab9d208c7 SOLR-14944: Remove the "spins" metrics. 2020-10-19 11:50:08 +02:00
Robert Muir 4c42cbc5c9
LUCENE-9576: give solr back its getFileStoreAttributes permission
Solr apparently needs this for its IndexFetcher.
2020-10-18 12:30:47 -04:00
Michael Sokolov c02f07f2d5 LUCENE-9322: Add Lucene90 codec, including VectorFormat
This commit adds support for dense floating point VectorFields.
The new VectorValues class provides access to the indexed vectors.
2020-10-18 07:49:36 -04:00
Robert Muir 85b58c262a
LUCENE-9576: nuke SSD detection, modernize CMS defaults 2020-10-17 10:55:35 -04:00
Atri Sharma 72a554184b Update CHANGES.txt to align with release versions 2020-10-16 22:45:51 +05:30
Sayan Das 744934c826
SOLR-14933: Ability to add T and P type replica from admin UI (#1991)
* added UI and js changes

* track which committer convoyed in the change

Co-authored-by: epugh <epugh@opensourceconnections.com>
2020-10-16 11:01:48 -04:00
David Smiley 6a330e6304 SOLR-14651: improve metrics history docs
When the MHH is disabled, it is *not* possible to retrieve history.
2020-10-16 08:23:06 -04:00
Eric Pugh d7e58ede0e
SOLR-14483 (#1988)
* fixed broken select box

* converted tabs to spaces :sigh:

* Fix the refreshing of the scope

* track fix

Co-authored-by: sayan.das <sayan.das@gdn-commerce.com>
2020-10-15 14:36:31 -04:00
Munendra S N 0bd2f314b7 SOLR-14930: fix precommit 2020-10-15 18:19:14 +05:30
Andrzej Bialecki 737cf9854a SOLR-14924: Some ReplicationHandler metrics are reported using incorrect types. 2020-10-15 14:27:51 +02:00
Noble Paul 321b4fa0de
SOLR-14930: Deprecate rulebased replica placement strategy (remove in 9.0) (#1980) 2020-10-15 19:53:43 +11:00
Andrzej Bialecki 2a3da99e2d SOLR-14914: Add option to disable metrics collection. 2020-10-15 10:14:16 +02:00
Mike Drob 9805b125dc
LUCENE-9579 Update to JUnit 4.13.1 (#1981) 2020-10-14 12:51:50 -05:00
S N Munendra b43c389386
Include missing commands in package tool help section (#1975)
* feat(package/tool): include uninstall command usage in help

* feat(package/tool): include add-key usage in help

* feat(package/tool): display options for package tool
2020-10-14 22:11:54 +05:30
Noble Paul a7a6757aff SOLR-14654: ref guide error 2020-10-15 00:40:54 +11:00
Bar Rotstein fa3e1ad71f SOLR-14869: ChildDocTransformer should have omitted deleted child documents.
Closes #1970
2020-10-14 08:25:52 -04:00
Noble Paul 2f651b156c SOLR-14654: remove all references of runtime lib 2020-10-14 11:13:38 +11:00
Noble Paul 03fe8e5260 SOLR-14654: remove ref guide refernces 2020-10-14 11:02:42 +11:00
gezapeti cf6e831394
SOLR-14887 Upgrade JQuery to 3.5.1 (#1947) 2020-10-13 19:41:57 -04:00
Houston Putman bcd9cbec95
SOLR-14907: Support single file upload/overwrite in configSet API (#1977) 2020-10-13 16:51:21 -04:00
Cao Manh Dat 9594ab3ac0
SOLR-14776: Precompute the fingerprint during PeerSync (#1814)
After heavy indexing, the call to compute fingerprint takes awhile and slows the leader election. This commit computes the fingerprint in parallel with fetching the fingerprint from the other replicas.

Co-authored-by: Shalin Shekhar Mangar <shalin@apache.org>
2020-10-13 16:35:33 +05:30
Chris Hostetter b4f0442193 SOLR-14870: refactor ref-guide build.gradle logic to re-enable guide->javadoc link checking
fix 'broken' javadoc links in ref-guide to match new documentation path structures for 9.x
2020-10-12 08:39:45 -07:00
Dawid Weiss e444df1435
SOLR-14922: Include solr-ref-guide tasks in sourceSets for IntelliJ (#1973) 2020-10-12 12:25:13 +02:00
David Smiley ab83b3b7c3
SOLR-14917: Move DOMUtil and PropertiesUtil to SolrJ (#1953) 2020-10-10 08:52:10 -04:00
Cassandra Targett 7d37150457 Ref Guide: fix typos, formatting issues, etc. 2020-10-09 10:42:44 -05:00
Cassandra Targett 7b1663e97a Ref Guide: update for 8.7 release notes; bring notes from 8.6.1 forward to keep branch_8x and master at least sort of in sync 2020-10-09 10:42:44 -05:00
Jason Gerlowski 5504f379b0 Sync CHANGES for 8.6.3 2020-10-09 10:56:01 -04:00
Jason Gerlowski 76a8cc3c3e Add bugfix version 8.6.3 2020-10-09 10:27:42 -04:00
Uwe Schindler 2329423e5c
LUCENE-9577: Move Lucene/Solr Documentation assembly to subproject (#1967) 2020-10-09 14:56:44 +02:00
Mike Drob 08e38d3452
LUCENE-9488 Create Release Artifacts with Gradle (#1905)
* Build Lucene binary distribution using Gradle
* Generate SHA-512 checksums for all release artifacts
* Update documentation artifacts included in binaries
* Delete some additional Ant relics

Co-authored-by: Dawid Weiss <dawid.weiss@carrotsearch.com>
Co-authored-by: Uwe Schindler <uschindler@apache.org>
2020-10-08 14:25:51 -05:00
Noble Paul 8c41418c0f
SOLR-14576 : Do not use SolrCore as keys in a WeakHashMap (#1586) 2020-10-08 22:08:48 +11:00
Timothy Potter 2813b1278b SOLR-14659: Fix changes to indicate SOLR-14659 fixed in 8.7 vs. 9 2020-10-07 14:24:45 -06:00