Commit Graph

5771 Commits

Author SHA1 Message Date
Bruno Roustant 5e21e3f380
SOLR-15061: Fix NPE in SearchHandler when shards.info and no QueryComponent configured 2021-01-05 15:15:48 +01:00
Andrzej Bialecki 2695624a9f SOLR-15019: Replica placement API needs a way to fetch existing replica metrics. 2021-01-04 15:24:25 +01:00
noblepaul 3e852b00dd SOLR-15062: /api/cluster/zk/ls should give the stat of the current node 2021-01-04 14:10:28 +11:00
Tim Dillon 17adcc7aa4
SOLR-14034: remove deprecated min_rf references (#2152) 2020-12-31 15:59:48 +00:00
John Gallagher 70f461ee45
SOLR-14413 allow timeAllowed and cursorMark parameters
closes #1436
2020-12-23 13:01:44 -06:00
Pieter van Boxtel 98f12f4aeb
SOLR-15031 Prevent null being wrapped in a QueryValueSource
closes #2118
2020-12-22 15:34:18 -06:00
Kevin Risden f0b73fdc6d
SOLR-14951: Upgrade Angular JS 1.7.9 to 1.8.0
Closes PR #2008
2020-12-22 11:18:44 -06:00
Jason Gerlowski 8b272a0960
SOLR-15049: Add TopLevelJoinQuery optimization for 'self-joins' (#2146) 2020-12-22 08:32:52 -05:00
Christine Poerschke fa41ea51d4
Add two solr/CHANGES.txt entries for SOLR-14981 and SOLR-15046. (#2149)
So that 8.8.0 sections match on master and branch_8x branches.
2020-12-17 12:40:05 +00:00
Christine Poerschke 0b5003cfed
SOLR-14939: JSON range faceting to support cache=false parameter (#1992) 2020-12-16 17:42:24 +00:00
Noble Paul a95ce0d422
SOLR-14827: Refactor schema loading to not use XPath (#1963) 2020-12-11 15:27:47 +11:00
Timothy Potter 30e5e38336
SOLR-14987: Reuse HttpSolrClient per node vs. one per Solr core when using CloudSolrStream (#2067) 2020-12-07 09:03:03 -07:00
Tim Owen 510f96c69c
SOLR-8673: Enable custom aggregate functions by opening up FacetContext
Prior to this change, it was not feasible to write a custom aggregate function in plugin code
because the FacetContext class did not expose its fields for access outside its package. Also
some of the useful abstract classes for SlotAcc were package-private too
2020-12-06 22:45:09 -08:00
Andrzej Bialecki cced5078ea SOLR-15016: Replica placement plugins should use container plugins API / configs. 2020-12-06 14:51:10 +01:00
David Smiley 21b8890f58
SOLR: Remove CHANGES.md; use solr/CHANGES.txt
For now, any way.  See dev list discussion.
2020-12-04 17:59:07 -05:00
saatchibhalla 19ed903377
SOLR-14965: add overseer queue size metrics (#2040)
Adds two metrics to the SolrCloud Overseer: solr_metrics_overseer_stateUpdateQueueSize and solr_metrics_overseer_collectionWorkQueueSize with corresponding entries in the the Prometheus exporter's default/stock configuration.

Co-authored-by: Saatchi Bhalla <s.bhalla@salesforce.com>
2020-12-04 16:47:35 -05:00
Timothy Potter 4c100a0175
SOLR-12182: Fix Changes.txt in master (#2116) 2020-12-02 17:28:19 -07:00
Chris Hostetter 5208d47e1a SOLR-14934: Remove redundent deprecated "solr.solr.home" logic 2020-12-02 17:18:58 -07:00
Chris Hostetter 2e6a02394e SOLR-14934: Refactored duplicate "Solr Home" logic into a single place to eliminate risk of tests using divergent values for a single solr node. 2020-12-02 10:24:36 -07:00
Thomas Mortagne feb897a962
SOLR-15017: Core's lib/ dir was ignored sometimes (#2107)
A core's lib/ folder was ignored when the core's configuration did not define any <lib> element.  This is a regression introduced in 8.6 by SOLR-14197.
2020-12-01 15:40:21 -05:00
Timothy Potter a0492840ee
SOLR-12182: Don't persist base_url in ZK as the scheme is variable, compute from node_name instead (#2010) 2020-11-30 12:05:48 -07:00
Mike Drob cb5ba42bd7
SOLR-15009 Propogate IOException from DF.exists 2020-11-30 10:27:23 -08:00
Chris Hostetter 37a61635e1 SOLR-14958: Refactor zkHost config logic to make testing easier and reduce risk of incorrect value being used 2020-11-30 10:43:08 -07:00
David Smiley 021de9f45f
SOLR-14915: Prometheus-exporter should not depend on Solr-core (#1972)
* Reduced dependencies from Solr server down to just SolrJ.  Don't add WEB-INF/lib.
* Was missing some dependencies in lib/; now has all except SolrJ & logging.
* Can run via gradle, "gradlew run"
* Has own log4j2.xml now

Has own CHANGES.md now.
2020-11-27 15:08:33 -05:00
David Smiley 1e0ae2fb74
SOLR-15001 Docker: require init_var_solr.sh (#2083)
The Dockerfile should not initialize /var/solr's contents because this is confusing and redundant with init_var_solr.sh.
No need for init_var_solr.sh to echo what it does; VERBOSE can be used to accomplish that.

Separate CHANGES.md for Docker and contrib modules.
2020-11-27 14:59:54 -05:00
Jan Høydahl 99c38eee49
SOLR-14851 Http2SolrClient doesn't handle keystore type (#2098)
Signed-off-by: Jan Høydahl <janhoy@apache.org>
Co-authored-by: Andras Salamon <andras.salamon@melda.info>
2020-11-27 16:11:29 +01:00
Alessandro Benedetti ca040402d9 SOLR-15015: added support to parametric Interleaving algorithm (#2096) 2020-11-24 10:14:38 +00:00
Erick Erickson 77a205387f SOLR-14993: Unable to download zookeeper files of 1byte in size 2020-11-22 09:23:44 -05:00
Christine Poerschke c4d4767bca SOLR-14035: Remove deprecated preferLocalShards=true support in favour of the shards.preference=replica.location:local alternative.
(Alex Bulygin via Christine Poerschke)
2020-11-19 17:57:47 +00:00
Alessandro Benedetti af0455ac83
SOLR-14560: Interleaving for Learning To Rank (#1571)
SOLR-14560: Add interleaving support in Learning To Rank
2020-11-18 18:15:24 +00:00
Noble Paul 73d5e7ae77
SOLR-14977 : ContainerPlugins should be configurable (#2065) 2020-11-17 00:19:50 +11:00
Christine Poerschke 2f02040a4c SOLR-14983: Fix response returning original score instead of reranked score due to query and filter combining.
(Krishan Goyal, Jason Baik, Christine Poerschke)
2020-11-12 12:51:21 +00:00
Mike Drob 66e285e7ae
SOLR-14995 Update Jetty to latest version 2020-11-11 13:27:49 -08:00
Jason Gerlowski a7197ac0ce
SOLR-14971: Handle atomic-removes on uncommitted docs (#2056)
Docs fetched from the update log via RTG look different than docs
fetched from commits in the index: the types of
field-values may be different between the two, etc.

This is a problem for atomic add/remove of field values, where matching
existing values has historically been done by object equals() calls (via
Collection operations).  This relies on equality checks which don't have
flexible enough semantics to match values across these different types.
(For example, `new Long(1).equals(new Integer(1))` returns `false`).
This was causing some add-distinct and remove operations on
uncommitted values to silently fail to remove field values.

This commit patches over this by converting between types in the more
common cases before using the fallback behavior.
2020-11-11 12:28:11 -05:00
Bruno Roustant 91ee53d418
SOLR-14975: Add entry in CHANGES.txt 2020-11-11 11:52:30 +01:00
Andrzej Bialecki 863a388fe7 SOLR-14683: Move the CHANGES.txt entry to the right place. Fix wrong type of null value. 2020-11-10 17:58:45 +01:00
Houston Putman 212b0f8657
SOLR-14949: Ability to customize Solr Docker build (#2020)
Also added a gradlew helpDocker page.
2020-11-10 10:42:38 -05:00
Andrzej Bialecki 7ec17376be SOLR-14683: Metrics API should ensure consistent placeholders for missing values. 2020-11-10 11:48:59 +01:00
Andrzej Bialecki bdc6e8247f SOLR-14749: Provide a clean API for cluster-level event processing. 2020-11-05 12:18:05 +01:00
Mike Drob 7c1ff288b7
SOLR-14978 OOM Killer in Foreground (#2055)
Combine Docker and bin/solr OOM handling scripts, move OOM handling to foreground Solr as well.

Co-authored-by: Houston Putman <houstonputman@gmail.com>
2020-11-04 17:20:16 -06:00
Dawid Weiss 22296f28a2
SOLR-14912: Unify solr-contrib-extraction with the artifact it produces (#2060) 2020-11-03 14:15:26 +01:00
Dawid Weiss 0f871b2c56
SOLR-14926: Modernize and clean up search results clustering contrib. 2020-11-03 09:31:53 +01:00
Michael Aleythe e7f0294d85 SOLR-14961 ZkMaintenanceUtils.clean doesn't remove zk nodes with same length
fixes #2042
2020-11-02 16:54:00 -06:00
Houston Putman 5091e75c9d
SOLR-14907: Adding V2 API for ConfigSet Upload. (#1996) 2020-11-02 14:06:45 -05:00
Jan Høydahl 0c3f2f4ac8
SOLR-14972: Change default port of prometheus exporter to 8989 (#2046) 2020-11-02 14:06:34 +01:00
Erick Erickson 2c49c4a27d SOLR-14969: Prevent creating multiple cores with the same name which leads to instabilities (race condition) 2020-10-31 19:34:09 -04:00
Houston Putman e1698bda95
SOLR-14955: Add env var options to Prometheus Export scripts. (#2038) 2020-10-30 11:15:33 -04:00
S N Munendra f3fdd9b90b
SOLR-14946: fix responseHeader returned in resp with omitHeader=true (#2029)
* This occurs when BinaryResponseWriter#getParsedResponse is called as
  it doesn't check for omitHeader.
2020-10-30 18:50:18 +05:30
Anver Sotnikov 6d00843d97 SOLR-14940: Fix ReplicationHandler memory leak through SolrCore.closeHooks
* Added ability to remove SolrCore.closeHooks
* Keep references to CloseHooks in ReplicationHandler and remove them on ReplicationHandler.shutdown()

closes #1997
2020-10-27 16:03:43 -05:00
Erick Erickson 521ca54802 SOLR-14844: Upgrade Jetty to 9.4.32.v20200930 2020-10-26 19:03:10 -04:00
Houston Putman 4fe4f37131
SOLR-14957: Add Prometheus Exporter to docker PATH. Fix classpath issues. (#2017) 2020-10-26 14:15:30 -04:00
Shalin Shekhar Mangar 706f284c46
SOLR-14942: Reduce leader election time on node shutdown (#2004)
The shutdown process waits for all replicas/cores to be closed before removing the election node of the leader. This can take some time due to index flush or merge activities on the leader cores and delays new leaders from being elected. Moreover, jetty stops accepting new requests on receiving SIGTERM which means that even though a leader technically exists, no new indexing requests can be processed by the node. This commit waits for all in-flight indexing requests to complete, removes election nodes (thus triggering leader election) and then closes all replicas.

Co-authored-by: Cao Manh Dat <datcm@apache.org>
2020-10-24 17:39:00 +05:30
Andrzej Bialecki 67ecd8ff9a SOLR-14749: Improve support for arbitrary container-level plugins. Add ClusterSingleton
support for plugins that require only one active instance in the cluster.
2020-10-21 17:22:44 +02:00
Kevin Risden 6ac5747d76
SOLR-14549: Fix listing of Files in a Directory on Solr Admin UI
* Ensure that jstree can update data behind the scenes
* Fix file jstree object to represent open/closed correctly
* Upgrade jstree to 3.3.10 for compatibility with JQuery 3.5.x

Closes #1989
2020-10-19 09:41:36 -04:00
Jan Høydahl 3bc873e6d4
SOLR-14936: Fixed Grafana dashboard filters for collection, shard, replica and core (#1986) 2020-10-19 14:49:02 +02:00
Andrzej Bialecki 9ab9d208c7 SOLR-14944: Remove the "spins" metrics. 2020-10-19 11:50:08 +02:00
Atri Sharma 72a554184b Update CHANGES.txt to align with release versions 2020-10-16 22:45:51 +05:30
Sayan Das 744934c826
SOLR-14933: Ability to add T and P type replica from admin UI (#1991)
* added UI and js changes

* track which committer convoyed in the change

Co-authored-by: epugh <epugh@opensourceconnections.com>
2020-10-16 11:01:48 -04:00
Eric Pugh d7e58ede0e
SOLR-14483 (#1988)
* fixed broken select box

* converted tabs to spaces :sigh:

* Fix the refreshing of the scope

* track fix

Co-authored-by: sayan.das <sayan.das@gdn-commerce.com>
2020-10-15 14:36:31 -04:00
Andrzej Bialecki 737cf9854a SOLR-14924: Some ReplicationHandler metrics are reported using incorrect types. 2020-10-15 14:27:51 +02:00
Noble Paul 321b4fa0de
SOLR-14930: Deprecate rulebased replica placement strategy (remove in 9.0) (#1980) 2020-10-15 19:53:43 +11:00
Andrzej Bialecki 2a3da99e2d SOLR-14914: Add option to disable metrics collection. 2020-10-15 10:14:16 +02:00
Bar Rotstein fa3e1ad71f SOLR-14869: ChildDocTransformer should have omitted deleted child documents.
Closes #1970
2020-10-14 08:25:52 -04:00
Houston Putman bcd9cbec95
SOLR-14907: Support single file upload/overwrite in configSet API (#1977) 2020-10-13 16:51:21 -04:00
Cao Manh Dat 9594ab3ac0
SOLR-14776: Precompute the fingerprint during PeerSync (#1814)
After heavy indexing, the call to compute fingerprint takes awhile and slows the leader election. This commit computes the fingerprint in parallel with fetching the fingerprint from the other replicas.

Co-authored-by: Shalin Shekhar Mangar <shalin@apache.org>
2020-10-13 16:35:33 +05:30
Jason Gerlowski 5504f379b0 Sync CHANGES for 8.6.3 2020-10-09 10:56:01 -04:00
Jason Gerlowski 76a8cc3c3e Add bugfix version 8.6.3 2020-10-09 10:27:42 -04:00
Noble Paul 8c41418c0f
SOLR-14576 : Do not use SolrCore as keys in a WeakHashMap (#1586) 2020-10-08 22:08:48 +11:00
Timothy Potter 2813b1278b SOLR-14659: Fix changes to indicate SOLR-14659 fixed in 8.7 vs. 9 2020-10-07 14:24:45 -06:00
Timothy Potter 7a5219c62e Revert "Fix changes to indicate SOLR-14659 fixed in 8.7 vs. 9"
This reverts commit 01e1a7b356.
2020-10-07 14:22:30 -06:00
Timothy Potter 01e1a7b356 Fix changes to indicate SOLR-14659 fixed in 8.7 vs. 9 2020-10-07 14:21:14 -06:00
Andrzej Bialecki 43b1a2fdc7 SOLR-14691: Metrics reporting should avoid creating objects. 2020-10-07 17:52:55 +02:00
Cao Manh Dat 2d4a51b23d SOLR-10370: ReplicationHandler should fetch index at fixed delay instead of fixed rate 2020-10-07 20:22:17 +07:00
Alexandre Rafalovitch 247cea1011
SOLR-14829: Improve documentation for Request Handlers in RefGuide and solrconfig.xml (#1921)
Restructured documentation page, fixed cross-linked, and cleanup of relevant sections of example configuration files
2020-10-06 20:35:47 -04:00
Timothy Potter e879a52291
SOLR-14659: Remove restlet as dependency for the ManagedResource API (#1938)
Co-authored-by: noblepaul <noble.paul@gmail.com>
2020-10-04 11:21:49 -06:00
Erick Erickson f6c4f8a755 SOLR-14910: Use in-line tags for logger declarations in Gradle ValidateLogCalls that are non-standard, change //logok to //nowarn 2020-10-03 09:47:37 -04:00
Tomas Fernandez Lobbe 8f2f80bbb3 SOLR-14663: Copy ConfigSet root data from base ConfigSet when using CREATE command 2020-10-01 14:13:40 -07:00
David Smiley 9cadbf04b6
SOLR-12987: Deprecated plugins are logged once and with log category org.apache.solr.DEPRECATED (#1927) 2020-10-01 08:31:39 -04:00
Bruno Roustant 167c3050df
SOLR-14905: Upgrade commons-io version to 2.8.0.
Closes #1934
2020-10-01 10:07:42 +02:00
Munendra S N 274a3d69d2 Revert "SOLR-14767 : Fix NumberFormatException when int/long field value is floating num"
This reverts commit 63f0b6b706.
2020-09-29 23:53:13 +05:30
Chris Hostetter 8c7502dfeb SOLR-14898: Stop returning duplicate HTTP response headers when requests are forward to another node 2020-09-29 09:19:03 -07:00
Munendra S N 3dcb19f886 SOLR-14897: limit no of forwarding for given request
* Irrespective of active or down replicas, restrict no of forwarding of request.
  Previously, this restriction was applied only if active is not found
2020-09-29 19:48:12 +05:30
Apoorv Bhawsar 63f0b6b706
SOLR-14767 : Fix NumberFormatException when int/long field value is floating num (#1775) 2020-09-29 19:23:33 +05:30
Guna Sekhar Dora Kovvuru 1dba76c0d3
SOLR-14333: Implement toString in Collapse filter (#1371) 2020-09-29 19:19:49 +05:30
Andrzej Bialecki 8b329a09c2 SOLR-14850: Correct the spelling in contributor's name. 2020-09-29 10:11:17 +02:00
Andrzej Bialecki 32041c8d9b SOLR-14850: Fix ExactStatsCache NullPointerException when shards.tolerant=true. 2020-09-28 14:04:48 +02:00
Munendra S N ddd10725b0 SOLR-14503: use specified waitForZk val as conn timeout for zk
* Also, consume SOLR_WAIT_FOR_ZK in bin/solr.cmd
2020-09-24 22:28:04 +05:30
S N Munendra ac58472310
SOLR-14036: Remove explicit distrib=false from /terms handler (#1900)
* Remove distrib=false from /terms handler so that terms are returned from across all shards instead of a single local shard.
* cleanup shards parameter handling in TermsComponent. This is handled in HttpShardHandler
* Remove redundant tests for shard whitelist
* remove redundant terms params from ScoreNodeStream
2020-09-24 22:12:24 +05:30
S N Munendra 7be262ee5a
move 9x upgrade notes out of changes.txt (#1914) 2020-09-24 21:44:29 +05:30
Christine Poerschke ea77d24237
SOLR-11167: Avoid $SOLR_STOP_WAIT use during 'bin/solr start' if $SOLR_START_WAIT is supplied. (#1913) 2020-09-24 17:08:30 +01:00
David Smiley 7b53671920
SOLR-14768: Fix multipart POST to Solr. (#1838)
Regression from 8.6
Multipart POST would fail due to a NoClassDefFoundError of Jetty MultiPart.  Solr cannot access many Jetty classes, which is not noticeable in our tests.
2020-09-22 17:42:18 -04:00
David Smiley 2197776be6
SOLR-13181: param macro expansion could throw (#1877)
...StringIndexOutOfBoundsException on bad syntax
* failOnMissingParams: should have been returning null (failing) on bad syntax cases

Co-authored-by: Christine Poerschke <cpoerschke@apache.org>
2020-09-22 15:46:59 -04:00
Tomas Fernandez Lobbe 7b7a5a16ce
SOLR-10391: Add overwrite option to UPLOAD ConfigSet action (#1861)
When set to true, Solr will overwrite an existing configset in ZooKeeper in an UPLOAD.
A new cleanup parameter can also be passed to let Solr know what to do with the files that existed in the old configset, but no longer exist in the new configset (remove or keep)
2020-09-22 10:36:59 -07:00
Alexandre Rafalovitch 1611586417
SOLR-14880: Support coreRootDirectory setting when create new cores from command line, in standalone mode
Update to match latest code with shorter name
2020-09-22 09:02:14 -04:00
Jason Gerlowski 9a6ca2dcd0 SOLR-14859: Set fieldType defaults for DateRangeField
AbstractSpatialPrefixTreeFieldType (and its children) create index
fields based on a prototype with options frozen in PrefixTreeStrategy,
regardless of options specified in the schema.  This works fine most of
the time, but causes problems when QParsers or other query optimization
logic makes decisions based on these options (which are potentially out
of sync with the underlying index data).  Most commonly this causes
issues with "exists" (e.g. [* TO *]) queries.

This commit enforces fieldType defaults that line up with the 'hardcoded'
FieldType used by PrefixTreeStrategy.  Options on either the fieldType
or the field itself which contradict these defaults will result in
exceptions at schema load/modification time.
2020-09-21 12:57:08 -04:00
Alexandre Rafalovitch da2714cb86
SOLR-9607: Finalize move of Terms component and request handler into the implicit definitions (#1897)
* Updated implicit definition with terms=true, distrib=false
* Commented out terms handler with notice, as this is the config used in tests
* Remove spurious mentions cluttering other test configs
* Remove implicit terms=true param
* Remove definitions from shipped configsets
* Improve documentation
* Add CHANGES record
2020-09-21 09:05:37 -04:00
Tom Edge fa756b1c31
SOLR-14802: geodist: Support most spatial field types as an arg
FunctionQParser: overload parseValueSourceList with flags
2020-09-20 23:19:48 -04:00
Alexandre Rafalovitch f6e8bc8c31
SOLR-14878: Expose solr.xml's coreRootDirectory property via the System Settings API (#1894) 2020-09-19 22:07:03 -04:00
Erick Erickson ab3f1f0d1d SOLR-14876: Upgrade to zookeeper 3.6.2 2020-09-18 22:37:29 -04:00
Dawid Weiss 5ec2bac91c
LUCENE-9531: Consolidate duplicated generated classes CharStream and FastCharStream (#1886) 2020-09-18 08:53:30 +02:00