Commit Graph

14466 Commits

Author SHA1 Message Date
Dawid Weiss 5375a2d2ad
LUCENE-9454: upgrade hamcrest to version 2.2. (#1738) 2020-08-11 11:55:52 +02:00
Noble Paul 15ae014c59
SOLR-14680: Provide simple interfaces to our cloud classes (only API) (#1694) 2020-08-11 15:05:14 +10:00
Cassandra Targett 424a9a6cfc SOLR-13528: fix heading levels 2020-08-10 16:36:40 -05:00
Cao Manh Dat 9b1aeb3c62 SOLR-14641: Update CHANGES.txt 2020-08-10 15:35:55 +07:00
Cao Manh Dat 57b0160659
SOLR-14641: PeerSync, remove canHandleVersionRanges check (#1663) 2020-08-10 15:04:34 +07:00
Eric Pugh 35771c3cfe
SOLR-14581 Document the way auto commits work in SolrCloud (#1692)
* provide some detail on eventually consistent code

* small tweak to language

* respond to comments and word smithing
2020-08-09 08:35:00 -04:00
Tomas Fernandez Lobbe bd1dd6bdfb SOLR-14582: Fix TestConfig 2020-08-07 16:01:11 -07:00
Gus Heck f827286a2c
SOLR-14582 - Broken test needs fix (#1727)
AwaitsFix for ConfigTest#testDefaults()
2020-08-07 18:49:04 -04:00
Atri Sharma a074418da0
SOLR-13528: Implement Request Rate Limiters (#1686)
This commit introduces two functionalities: request rate limiting and ability to identify requests based on type (indexing, search, admin). The default rate limiter rate limits query requests based on configurable parameters which can be set in web.xml. Note that this rate limiting works at a JVM level, not a core/collection level.
2020-08-08 01:36:06 +05:30
Tomas Fernandez Lobbe e6275d9970
SOLR-14582: Expose IWC.setMaxCommitMergeWaitMillis in Solr's index config (#1602) 2020-08-07 10:54:36 -07:00
Tomas Fernandez Lobbe 2bf092b8dd
SOLR-14702: Add Upgrade Notes and CHANGES entry (#1718) 2020-08-07 10:09:40 -07:00
Cassandra Targett 35bf1785ec SOLR-14654: actually fix the Ref Guide build failure 2020-08-06 10:15:06 -05:00
noblepaul ddbe9495fc SOLR-14654: ref-guide build failure 2020-08-06 23:30:05 +10:00
noblepaul 321c4bbe1f SOLR-14654: clean up ref guide, CHANGES.txt 2020-08-06 16:46:12 +10:00
Noble Paul 6f2f1c3de2
SOLR-14654 Remove plugin loading from .system collection (for 9.0) (#1677) 2020-08-06 16:32:32 +10:00
Tomas Fernandez Lobbe 6752111be8 SOLR-14702: doFetch reads legacy parameters too 2020-08-05 14:53:50 -07:00
Marcus 7110118ad4
SOLR-14702: Remove oppressive language (part1) (#1711)
Replace references to "master" and "slave" with "leader" and "follower"
2020-08-05 14:52:48 -07:00
Ishan Chattopadhyaya bd21da6eca SOLR-14604: Add the ability to uninstall a package from with the Package CLI (#1710)
Co-authored-by: Marcus <marcuseagan@gmail.com>
2020-08-04 14:53:25 +05:30
Chris Hostetter a6c058a260 SOLR-14657: Improve error handling in IndexReader realted metrics that were causing scary ERROR logging if metrics were requested while Solr was in the process of closing/re-opening a new IndexReader 2020-08-03 09:58:16 -07:00
Munendra S N 07a89e7bf6 SOLR-14516: fix NPE is resp writer while writing docvalue only field
This issue occurs only while fetching uncommitted doc through /get.
Instead of directly calling stringValue() on IndexableField use
FieldType's toExtern() or toObject() to get the writable value for the field.
2020-07-31 20:05:41 +05:30
Munendra S N 80c6251651 SOLR-11262: reword changes entry 2020-07-31 19:52:04 +05:30
Noble Paul 44865c5220
moved SOLR-14681 from 9.0section to 8.7 2020-07-31 18:45:01 +10:00
Marcus f443edebd2
SOLR-14681: Introduce ability to delete .jar stored in the Package Store (#1702) 2020-07-31 18:23:18 +10:00
Christine Poerschke 2f155aa0c3 SOLR-14489: remove ReplicationHandler's deprecated "master.commitReserveDuration" use (in favour of "commitReserveDuration") 2020-07-29 10:23:17 +01:00
Jan Høydahl ebb5219b1b
SOLR-14671: Parsing dynamic ZK config sometimes cause NuberFormatException (#1701) 2020-07-29 10:33:02 +02:00
David Smiley a3624029ad
SOLR-14651: Metrics History could disable better (#1672)
* SolrRrdBackendFactory should not be created if history is disabled
* Disable MetricsHistoryHandler by default in tests
* Await shutdown of all executors
2020-07-28 16:46:27 -04:00
Erick Erickson 6bf5f4a87f SOLR-11868: CloudSolrClient.setIdField is confusing, it's really the routing field. Should be deprecated. 2020-07-26 18:18:05 -04:00
David Smiley 5295007022
SOLR-14652: SolrCore should hold its own CoreDescriptor (#1675)
(minor refactoring)
Also:
* SolrCore's constructors don't need a "name" since it's guaranteed to always be the name in the coreDescriptor.  I checked.
* SolrCore's constructor shouldn't call coreContainer.solrCores.addCoreDescriptor(cd); because it's the container's responsibility to manage such things.  I made SolrCores.putCore ensure the descriptor is added, and this is called by CoreContainer.registerCore which is called after new SolrCore instances are created.
* solrCore.setName should only be called when we expect the name to change.  Furthermore that shouldn't ever happen in SolrCloud so I added checks.
* solrCore.setName calls coreMetricManager.afterCoreSetName() which is something that is really only related to a rename, not name initialization (from the constructor).  I renamed that method and further only call it if the name did change from non-null.
2020-07-25 01:08:23 -04:00
Erick Erickson 4b2e90b3aa SOLR-11656: TLOG replication doesn't work properly after rebalancing leaders. 2020-07-24 13:10:35 -04:00
Atri Sharma ec007c4bf2
Use FileSystem.newInstance instead of FileSystem.get in HDFSBackupRepository (#1682)
FileSystem.get can cause FileSystem closed exceptions, especially with S3.
2020-07-24 09:57:58 +05:30
Eric Pugh 80b6dcecfe
SOLR-14435: Update collection management docs on RESTORE (#1683)
* include missing RESTORE parameters

* small grammer fix

* remove duplication of describing the parameters in favour of the pattern of pointing to the CREATE command documentation.
2020-07-23 17:52:56 -04:00
Erick Erickson 67da34ac3b SOLR-14676: Update commons-collections to 4.4 and use it in Solr 2020-07-23 17:09:15 -04:00
Jason Gerlowski 48e92ba9c7 SOLR-13205: Improve empty-string handling in SolrQueryParserBase
Contributed-By: pramodkumar9
2020-07-20 09:51:28 -04:00
Ishan Chattopadhyaya b46321e19e SOLR-14656: Adding back REPLACENODE documentation that was omitted by mistake 2020-07-20 18:50:19 +05:30
Ishan Chattopadhyaya cc0c111949 SOLR-14656: Removing Autoscaling Framework
The following were removed:
 *  Autoscaling policy, triggers etc.
 *  withCollection handling
 *  UTILIZENODE command
 *  Sim framework
 *  Suggestions tab in UI
 *  Reference guide pages for autoscaling
 *  autoAddReplicas feature
 *  UTILIZENODE
2020-07-20 17:47:01 +05:30
Erick Erickson 1a7db1c9f5 SOLR-14653: Replace usages of org.apache.hadoop.fs.Path that are used to construct Zookeeper paths 2020-07-17 16:18:21 -04:00
Ishan Chattopadhyaya db4516bc66 SOLR-13391: Removing unused imports 2020-07-17 04:14:41 +05:30
Noble Paul 03d658a7bc
SOLR-14151 Make schema components load from packages (#1669) 2020-07-16 16:05:24 +10:00
Erick Erickson 9c2e7819ee SOLR-13939: Extract any non-gradle related patches (deprecations, URL fixes, etc.) from gradle effort. Attmept to fix Windows disk full issues 2020-07-15 21:03:01 -04:00
Cassandra Targett c57a54bba5 SOLR-14646: Add STEM notation support for the Ref Guide 2020-07-15 11:24:07 -05:00
Bruno Roustant efb936b787
Sync CHANGES for 8.6.0 2020-07-15 16:09:41 +02:00
Erick Erickson f3de646560 SOLR-13939: Extract any non-gradle related patches (deprecations, URL fixes, etc.) from gradle effort (thread leaks) 2020-07-15 09:23:27 -04:00
Eric Pugh 1d5a0ad8a3
SOLR-14637 update CloudSolrClient examples to remove deprecated .Builder() method (#1670)
* update CloudSolrClient examples to remove deprecated .Builder() method

* remove extra method lines that arent specific to what we are explaining.
2020-07-14 10:23:18 -04:00
Andrzej Bialecki a0488c1cf1 SOLR-14244: Remove ReplicaInfo. 2020-07-14 15:01:23 +02:00
Chris Hostetter e3c2a93edb SOLR-14635: re-enable test with better gatekeeping of expected 'ownership threads' and (nightly only) polling of 'locked/waiting threads' before making asserts 2020-07-13 12:29:04 -07:00
Cassandra Targett e9e2ff9b12 Ref Guide: fix aliases.adoc TIP for proper conversion 2020-07-13 09:27:01 -05:00
Atri Sharma a73dbdd877
Harden TestBuildingUpMemoryPressure (#1662)
Add better error message checking and finer mocks along with temporary logging which will be removed.
2020-07-13 15:02:59 +05:30
Erick Erickson c346881ad6 SOLR-13939: https://issues.apache.org/jira/browse/SOLR-13939 2020-07-12 22:41:08 -04:00
S N Munendra 8c9c0640cf
SOLR-11262: XML writer implements writeMap and writeIterator (#1665) 2020-07-13 11:21:14 +10:00
Munendra S N e355c616b3 Ref Guide: fix documentation for forceElevation param 2020-07-11 13:56:20 +05:30
Cassandra Targett 1862171e06 Ref Guide: move allowPaths note into Security section for 8.6 2020-07-10 13:35:02 -05:00
Cassandra Targett c1ea964847 Ref Guide: fix template to put list items inside a <p> element for consistent styling 2020-07-10 13:09:37 -05:00
Chris Hostetter c20501a504 SOLR-13132: fix some small package visibility and javadoc glitches that were caught on backport by the java8/branch_8x precommit but slipped past the java11/master precommit 2020-07-09 21:05:13 -07:00
Michael Gibney 40e2122b5a SOLR-13132: JSON Facet perf improvements to support "sweeping" collection of "relatedness()"
This adds a lot of "under the covers" improvements to how JSON Faceting FacetField processors work, to enable
"sweeping" support when the SlotAcc used for sorting support it (currently just "relatedness()")

This is a squash commit of all changes on https://github.com/magibney/lucene-solr/tree/SOLR-13132
Up to and including ca7a8e0b39840d00af9022c048346a7d84bf280d.

Co-authored-by: Chris Hostetter <hossman@apache.org>
Co-authored-by: Michael Gibney <michael@michaelgibney.net>
2020-07-09 18:42:37 -07:00
Chris Hostetter 5a422db60e SOLR-14635: disable test that has silly concurrency assumptions 2020-07-09 18:23:22 -07:00
Chris Hostetter 5c6314a970 SOLR-14635: ThreadDumpHandler has been enhanced to show lock ownership 2020-07-09 12:13:02 -07:00
Mike Drob 2341c220ce
SOLR-11390 Trie* field javadocs to @see *Point (#1612)
Co-authored-by: Christine Poerschke <cpoerschke@apache.org>
2020-07-09 12:20:56 -05:00
noblepaul 4ae976bdf0 SOLR-14610: CHANGES.txt 2020-07-09 18:55:02 +10:00
noblepaul 2155258974 SOLR-14610 : Use Methodhandles instead of VarHandle. Works with java8 as well 2020-07-09 18:08:22 +10:00
Joel Bernstein 3b8ae56b39 Ref Guide: Add Streaming Expression documentation for 8.6 release 2020-07-08 14:19:16 -04:00
Cassandra Targett 7bf2153c9d Ref Guide: add more context to HDFS, CDCR, DIH deprecations; put CDCR notice on all CDCR pages 2020-07-08 12:53:33 -05:00
Andrzej Bialecki cf742f4596 SOLR-12847: Remove support for maxShardsPerNode. 2020-07-08 17:57:24 +02:00
Mike Drob fc5887181b
SOLR-10814 changes entry 2020-07-08 10:24:15 -05:00
Jason Gerlowski 00203c292f SOLR-14566: Correct CHANGES.txt entry 2020-07-08 08:51:21 -04:00
Jason Gerlowski 80f8ab717c
SOLR-14566: Add request-ID to all distrib-search requests (#1574) 2020-07-08 08:38:23 -04:00
Mike Drob d3f4b21deb
SOLR-10814 Add short-name feature to RuleBasedAuthz plugin
Additional-Author: Hrishikesh Gadre <hgadre@cloudera.com>
2020-07-07 11:37:50 -05:00
Ilan Ginzburg 06b1f3e866
SOLR-14462: adjust test so less sessions are used even if test runs slowly. fix synchronization issue. (#1656) 2020-07-07 17:13:22 +02:00
Andrzej Bialecki f19057f5e5 SOLR-14537: Fix inner class visibility, reduce diffs with branch_8x. 2020-07-07 16:46:39 +02:00
Noble Paul 5154b6008f
SOLR-14634: Limit the HTTP security headers to "/solr" end point (#1655) 2020-07-07 23:16:32 +10:00
Ishan Chattopadhyaya a88a333d54 SOLR-14599: Some more ref guide updates 2020-07-07 08:32:18 +05:30
Cao Manh Dat a80eb84d56
SOLR-14354: HttpShardHandler send requests in async (#1470) 2020-07-07 09:17:26 +07:00
Ishan Chattopadhyaya 5fc12745ca SOLR-14599: Ref guide updates and some error handling fixes
* Ref guide section for types of plugins (that now includes a cluster level plugins section)
* Ref guide updates for deploying, undeploying, updating cluster level plugins
* Better error handling for cluster level plugin deployments
2020-07-07 07:39:45 +05:30
Eric Pugh 45573b9f1d
SOLR-14422 progressive render load main admin page (#1654)
* hide error message template until angular app has loaded
2020-07-06 14:56:13 -04:00
David Smiley 31e7ad9ee2
SOLR-14628: hl.fragsizeIsMinimum now defaults to true (#1651)
Fragments size like <= Solr 8.4 and addresses a significant performance regression
2020-07-06 09:31:37 -04:00
Eric Pugh 4e20986f89
update the name of the deletegation method in docs to be correct method name (#1652) 2020-07-06 06:35:36 -04:00
Chris Hostetter fea6c1b9da SOLR-14595: add AwaitsFix test to TestJsonFacetRefinement demonstrating problem, and work around to randomized testing in TestCloudJSONFacetSKGEquiv 2020-07-05 13:28:08 -07:00
noble 3642aa3d4e SOLR-14404: update was not working 2020-07-05 16:28:35 +10:00
Ishan Chattopadhyaya c3d6a8bf7a SOLR-14021: Deprecate HDFS support 2020-07-04 18:29:45 +05:30
Ishan Chattopadhyaya 04d9b52b3f SOLR-14603: Update CHANGES.txt 2020-07-04 14:58:16 +05:30
Ishan Chattopadhyaya df3bc4288c SOLR-14603: Upgrade Restlet to 2.4.3 2020-07-04 14:53:00 +05:30
Ishan Chattopadhyaya 35b5eea147 SOLR-14537: Fix gradle precommit failures 2020-07-04 14:31:23 +05:30
Noble Paul 05324e7b18
SOLR-14610: ReflectMapWriter to use VarHandle instead of old legacy reflection (#1635) 2020-07-03 15:25:58 +10:00
Erick Erickson e9568c3473 SOLR-10742: SolrCores.getNamesForCore is quite inefficient and blocks other core operations 2020-07-02 23:56:17 -04:00
Eric Pugh 2005c43667
fix link and wordsmith a bit (#1642) 2020-07-02 16:36:44 -04:00
Eric Pugh b50dd0c9c7
SOLR-14358 respond to feedback on URLClassifyProcessorFactory (#1632)
* Add an example explaining how to use

* fix up JavaDoc formatting

* Respond to feedback from @janhoy

Co-authored-by: ohtwadi <harinder.hanjan@gmail.com>
2020-07-02 15:16:24 -04:00
Andrzej Bialecki 1b8fb70216 SOLR-14537: Improve performance of ExportWriter. 2020-07-02 17:34:50 +02:00
Jan Høydahl 257a185107 SOLR-14561: Fix silly mistake in refguide link 2020-07-02 17:08:31 +02:00
Jan Høydahl cc9df5af05
SOLR-14561: Adding upgrade notes for allowPaths (#1641) 2020-07-02 15:37:53 +02:00
Ishan Chattopadhyaya dd6d1c90c8 SOLR-14066: Deprecate DIH 2020-07-02 16:38:31 +05:30
Ishan Chattopadhyaya 7c593b1940 SOLR-14022: Deprecate CDCR 2020-07-02 16:29:29 +05:30
Atri Sharma 3f9cc227f1
SOLR-14588: Implement Circuit Breakers (#1626)
* SOLR-14588: Implement Circuit Breakers

This commit consists of two parts: add circuit breakers infrastructure and a "real" JVM heap memory based
circuit breaker which monitors incoming search requests and rejects them with SERVICE_TOO_BUSY error
if the defined threshold is breached, thus giving headroom to existing indexing and search requests
to complete.
2020-07-02 12:43:48 +05:30
Atri Sharma ccdfee2cf0 Remove Redundant Import in TestContainerPlugin 2020-07-02 12:24:05 +05:30
noblepaul 2e60e1fbbd SOLR-14404: Unregister was not working for plugins with $path-prefix 2020-07-02 15:44:16 +10:00
Erick Erickson d0864a19c7 SOLR-14523: Enhance gradle logging calls validation: eliminate getMessage() 2020-07-01 22:07:59 -04:00
Erick Erickson 76e1d901cb SOLR-14592: Upgrade Zookeeper to 3.6.1 2020-07-01 19:47:16 -04:00
Mikhail Khludnev 1f6de31db8 SOLR-14539 Ref Guide update {!bool excludeTags} 2020-07-01 15:06:55 +03:00
Tomas Fernandez Lobbe 6eb7bc3b7b
SOLR-14590 : Add support for Lucene's FeatureField in Solr (#1620)
Add a new RankField type that internally creates a FeatureField
Add a new RankQParser that can create queries on the FeatureField
2020-06-30 11:15:36 -07:00
Atri Sharma d1c29ae8a9 SOLR-14609: Fix Unused Imports in TestJsonFacetsWithNestedObjects 2020-06-30 23:09:52 +05:30
Atri Sharma ccbdb77344 Remove Unused Import in BoolQParserPlugin 2020-06-30 22:17:48 +05:30
Mikhail Khludnev f647400e31 SOLR-14539: Introducing {!bool excludeTags=foo,bar} 2020-06-30 18:55:07 +03:00