b0728ceca6
SOLR-14128: Improve distributed locking around managed schema upgrade process.
2020-03-25 22:19:38 +01:00
8d937c1dc3
SOLR-14274 Do not register multiple sets of JVM metrics ( #1299 )
2020-03-25 13:48:17 -05:00
2c7a710945
LUCENE-9281: Retire SPIClassIterator from master because Java 9+ uses different mechanism to load services when module system is used ( #1360 )
...
LUCENE-9281: Use java.util.ServiceLoader to load codec components and analysis factories to be compatible with Java Module System
2020-03-25 18:03:36 +01:00
aad814ba63
SOLR-14340: Remove unnecessary configset verification checks
...
Improves CLUSTERSTATUS times for massive clusters.
Closes #1373
2020-03-24 15:34:20 -04:00
68e4304453
SOLR-14347: Autoscaling placement wrong when concurrent replica placements are calculated.
2020-03-23 18:21:40 +01:00
7f460faffb
fix typos in subquery doc transformer
2020-03-23 19:57:46 +05:30
06fd70fc0f
SOLR-14348: split TestJsonFacets to multiple test classes
...
* TestJsonFacet split into 3 classes, TestsJsonFacets, TestJsonFacetErrors
and TestJsonRangeFacet
* TestJsonFacets contains mainly terms faceting and stats
* range facet covers distributed cases too
2020-03-23 19:50:58 +05:30
5fd55d77e9
SOLR-12353: SolrDispatchFilter expensive non-conditional debug line degrades performance
2020-03-19 15:26:44 -04:00
78e670f19e
SOLR-14012: return long from unique and hll even for standalone
2020-03-19 19:21:57 +05:30
e9d6c24fb7
SOLR-11725: use corrected sample formula to calc stdDev in JSON facets
...
* Both stdDev and variance uses corrected sample formula to compute
the values. This is similar to StatsComponent
2020-03-19 19:21:57 +05:30
4fd96bedc2
SOLR-14256: replaced EMPTY with empty() to fix deadlock
2020-03-18 08:31:29 -04:00
7f37a55a8c
SOLR-13944: remove redundant checks in SpellCheckCollator
...
* After SOLR-14073, these checks become redundant and add
additional tests for spellcheck with collapse
2020-03-18 10:51:50 +05:30
0b063fd2b7
SOLR-10157: improve error message in case of unknown aggregations
2020-03-18 10:46:57 +05:30
6a59d443bc
LUCENE-8908: return def val from objectVal when exists returns false
...
* This behavior is similar to floatVal in QueryValueSource
2020-03-18 10:41:13 +05:30
2b327e5deb
SOLR-13199: Fix NPE in ChildDocTransformer when parenFilter is invalid
...
* Return proper error message and error code
2020-03-18 10:32:28 +05:30
fda935482b
SOLR-8306: Optimize expand.rows=0 to compute only total hits ( #1334 )
...
* When expand.rows=0, expand documents are not returned. So, computing them could be avoided and only total hits need to be computed
2020-03-18 09:23:04 +05:30
adb829cf35
[logging] log actual size of transient core cache
2020-03-13 15:45:52 -05:00
74721fa4c6
SOLR-14289 Skip ZkChroot check when not necessary ( #1298 )
2020-03-13 13:56:17 -05:00
0f10b5f042
SOLR-13264: IndexSizeTrigger aboveOp / belowOp properties not in valid properties.
2020-03-13 12:30:17 +01:00
732348ec7f
SOLR-14197: SolrResourceLoader refactorings to reduce API
...
* Remove SRL.listConfigDir (unused)
* Remove SRL.getDataDir
* Remove SRL.getCoreName
* Remove SRL.getCoreProperties
XmlConfigFile needs to be passed in the substitutableProperties
IndexSchema needs to be passed in the substitutableProperties
Remove redundant Properties from CoreContainer constructors
* Remove SRL.newAdminHandlerInstance (unused)
* Remove SRL.openSchema and openConfig
* Avoid SRL.getConfigDir
Also harmonized similar initialization logic between DIH Tika processor & ExtractingRequestHandler.
* Ensure SRL.addToClassLoader and reloadLuceneSPI are called at most once
Don't auto-load "lib" in constructor; wrong place for this logic.
* Avoid SRL.getInstancePath
Added SolrCore.getInstancePath instead
Use CoreContainer.getSolrHome instead
NodeConfig should track solrHome separate from SolrResourceLoader
* Simplify some SolrCore constructors
* Move locateSolrHome to new SolrPaths
* Move "User Files" stuff to SolrPaths
2020-03-11 09:20:28 -04:00
01688cd8f1
SOLR-14073: Fix segment look ahead NPE in CollapsingQParserPlugin
2020-03-08 20:26:04 -04:00
4cf37ade35
Revert "SOLR-13942: /api/cluster/zk/* to fetch raw ZK data"
...
This reverts commit bc6fa3b650
2020-03-06 23:08:34 +11:00
8a88dd02c6
Remove SimpleFSDirectory in favor of NIOFSDirectory
2020-03-06 00:04:25 +01:00
2cabeb924d
Add try-with-resources to CloudManager in tests ( #1315 )
2020-03-04 13:32:44 -08:00
dd9b9f2f7f
SOLR-14223 Fix tests for windows
2020-03-04 10:50:00 -08:00
4d2d052b7d
Fix resource leak in TestPolicyCloud ( #1312 )
2020-03-03 11:42:20 -08:00
bc6fa3b650
SOLR-13942: /api/cluster/zk/* to fetch raw ZK data
2020-03-03 22:36:17 +11:00
17c576a36f
SOLR-14299 IndexFetcher doesn't reset count to 0 after the last packet is received
2020-03-02 16:26:25 -08:00
4897a64713
SOLR-13996: Rename LegacyReplicaSource to StandaloneReplicaSource
2020-03-01 07:00:51 +05:30
62f5bd50cd
SOLR-14281: Make sharedLib configurable through SysProp ( #1288 )
2020-02-27 14:16:33 +01:00
c6bf8b6cec
SOLR-14252: NullPointerException in AggregateMetric.
2020-02-27 13:00:43 +01:00
3befb8be94
SOLR-13411: reject incremental update for route.field, uniqueKey and
...
_version_.
2020-02-27 14:51:34 +03:00
edefcf156b
SOLR-14270: fix incorrect date format
2020-02-27 17:28:31 +11:00
fc24fa9506
SOLR-14267: complete <query><HashDocSet> solrconfig.xml removal
2020-02-26 17:47:25 +00:00
b4f3efbf94
SOLR-13965: In GraphHandler, support <expressible> configuration and deprecate <streamFunctions> configuration.
...
(Eric Pugh via Christine Poerschke)
Closes #1033 pull request.
2020-02-26 17:36:33 +00:00
98dafe2e10
LUCENE-9207: Don't build span queries in QueryBuilder ( #1239 )
...
QueryBuilder currently has special logic for graph phrase queries with no slop,
constructing a spanquery that attempts to follow all paths using a combination of
OR and NEAR queries. However, this type of query has known bugs(LUCENE-7398).
This commit removes this logic and just builds a disjunction of phrase queries, one
phrase per path.
2020-02-26 14:32:34 +00:00
852f02b4b7
Some additional testing to prove 'defered function computation' in a syntax variant i was recently asked about
2020-02-25 13:21:13 -07:00
50a7075862
SOLR-14256: Remove HashDocSet; add DocSet.getBits.
...
* DocSet is now fixed at two implementations, read-only and doc ordered.
* DocSetBase removed; not needed anymore. DocSet is now an abstract class.
2020-02-25 09:48:20 -05:00
25892271e8
SOLR-14258: DocList should not extend DocSet
2020-02-25 09:39:43 -05:00
1770797387
SOLR-14223 Create RSAKeyPair from disk ( #1217 )
...
* Create properties for PublicKeyHandler to read existing keys from disk
* Move pregenerated keys from core/test-files to test-framework
* Update tests to use existing keys instead of new keys each run
2020-02-24 12:07:10 -08:00
7ba9d4d756
SOLR-14272: Remove autoReplicaFailoverBadNodeExpiration and autoReplicaFailoverWorkLoopDelay for 9.0 as it was deprecated in 7.1 ( #1269 )
...
* SOLR-14272: Remove autoReplicaFailoverBadNodeExpiration and autoReplicaFailoverWorkLoopDelay for 9.0 as it was deprecated in 7.1
2020-02-24 09:46:05 -08:00
663611c99c
[SOLR-12238] Synonym Queries boost ( #357 )
...
SOLR-12238: Handle boosts in QueryBuilder
QueryBuilder now detects per-term boosts supplied by a BoostAttribute when
building queries using a TokenStream. This commit also adds a DelimitedBoostTokenFilter
that parses boosts from tokens using a delimiter token, and exposes this in Solr
2020-02-24 10:29:41 +00:00
57c7139ea3
SOLR-14114: Add WARN to Solr log that embedded ZK is not supported in production ( #1273 )
2020-02-24 09:59:33 +01:00
bc41f25cc9
SOLR-14271: Delete CollectionsAPIAsyncDistributedZkTest.testAsyncIdBackCompat as that is no longer required ( #1275 )
2020-02-21 09:53:10 -08:00
292bed0c42
SOLR-11035: (at least) 2 distinct failures possible when clients attempt searches during SolrCore reload
2020-02-21 10:57:16 -05:00
89b13377a1
SOLR-14250: Do not log error when trying to consume non-existing input stream due to Expect: 100-continue ( #1250 )
2020-02-21 10:30:10 +01:00
9f3f7244ac
SOLR-14270 export command to have an option to write to a zip file ( #1266 )
2020-02-21 13:41:50 +11:00
79966132fc
SOLR-14264 Set minimum gzip size for responses
2020-02-20 17:14:21 -06:00
cea4226367
SOLR-14271: Remove duplicate async id check meant for pre Solr 8 versions ( #1268 )
...
* SOLR-14271: Remove duplicate async id check meant for pre Solr 8 versions
2020-02-20 15:13:05 -08:00
f23def6b72
SOLR-13965: s/StreamHandler/GraphHandler fix GraphHandler.getDescription()
...
(Eric Pugh via Christine Poerschke)
2020-02-18 14:32:52 +00:00
5d32c04096
SOLR-13965: StreamHandler class-level javadoc edits
...
(Eric Pugh via Christine Poerschke)
2020-02-18 14:31:44 +00:00
f549ee3535
SOLR-13794: Replace redundent test only copy of '_default' configset with SolrTestCase logic to correctly set 'solr.default.confdir' system property
...
This change allows us to remove kludgy test only code from ZkController
2020-02-14 11:36:53 -07:00
0767a9d4d7
Code comment only change
2020-02-11 19:32:54 -05:00
c3e44e1fec
SOLR-14058: fix peersync bounds check iterating over versions
2020-02-11 10:43:21 -08:00
9a4f7661e9
SOLR-14194: Highlighters now supports docValues for the uniqueKey
...
and the original highlighter can highlight docValues.
2020-02-11 02:18:08 -05:00
71b869381e
SOLR-14247 Remove unneeded sleeps ( #1244 )
2020-02-10 21:13:56 -06:00
c65b97665c
SOLR-13996: Refactor HttpShardHandler.prepDistributed method ( #1220 )
...
SOLR-13996: Refactor HttpShardHandler.prepDistributed method into smaller pieces
This commit introduces an interface named ReplicaSource which is marked as experimental. It has two sub-classes named CloudReplicaSource (for solr cloud) and LegacyReplicaSource for non-cloud clusters. The prepDistributed method now calls out to these sub-classes depending on whether the cluster is running on cloud mode or not.
2020-02-10 19:57:05 +05:30
c4a8a77d23
SOLR-14209: Upgrade JQuery to 3.4.1
...
* JQuery 2.1.3 to 3.4.1
* jstree 1.0-rc1 to v3.3.8
Closes #1209
Signed-off-by: Kevin Risden <krisden@apache.org>
2020-02-08 11:57:56 -06:00
f41eabdc5f
LUCENE-8279: fix javadocs wrong header levels and accessibility issues
...
Java 13 adds a new doclint check under "accessibility" that the html
header nesting level isn't crazy.
Many are incorrect because the html4-style javadocs had horrible
font-sizes, so developers used the wrong header level to work around it.
This is no issue in trunk (always html5).
Java recommends against using such structured tags at all in javadocs,
but that is a more involved change: this just "shifts" header levels
in documents to be correct.
2020-02-08 10:00:00 -05:00
f5c132be6d
SOLR-14248: Improve ClusterStateMockUtil and make its methods public
2020-02-08 11:59:27 +05:30
206a70e7b7
LUCENE-9149: Increase data dimension limit in BKD
2020-02-07 16:08:14 -06:00
9a19093586
SOLR-14245: Validate Replica / ReplicaInfo on creation.
2020-02-07 17:56:39 +01:00
0d339043e3
LUCENE-9209: fix javadocs to be html5, enable doclint html checks, remove jtidy
...
Current javadocs declare an HTML5 doctype: !DOCTYPE HTML. Some HTML5
features are used, but unfortunately also some constructs that do not
exist in HTML5 are used as well.
Because of this, we have no checking of any html syntax. jtidy is
disabled because it works with html4. doclint is disabled because it
works with html5. our docs are neither.
javadoc "doclint" feature can efficiently check that the html isn't
crazy. we just have to fix really ancient removed/deprecated stuff
(such as use of tt tag).
This enables the html checking in both ant and gradle. The docs are
fixed via straightforward transformations.
One exception is table cellpadding, for this some helper CSS classes
were added to make the transition easier (since it must apply padding
to inner th/td, not possible inline). I added TODOs, we should clean
this up. Most problems look like they may have been generated from a
GUI or similar and not a human.
2020-02-06 22:30:52 -05:00
fe349ddcf2
SOLR-14242: HdfsDirectory#createTempOutput. ( #1240 )
2020-02-05 16:38:53 +01:00
2d8428ec2e
SOLR-14238: Fix HdfsDirectory to no longer overwrite existing files. ( #1237 )
2020-02-04 19:35:15 +01:00
bb90569f1d
SOLR-14219: Revert changes in OverseerSolrRespose and move serialization ( #1227 )
...
SOLR-14095 Introduced an issue for rolling restarts (Incompatible Java serialization). This change fixes the compatibility issue while keeping the functionality in SOLR-14095
2020-02-04 10:26:57 -08:00
c91dd9d0e4
SOLR-14090: fix delete-copy-field when source is dynamic field
2020-02-04 21:33:31 +05:30
4eff9c9b5e
SOLR-10567: add support for DateRangeField in JSON facet range
2020-02-04 21:26:40 +05:30
b0bb299dc4
LUCENE-9134: Port ant-regenerate tasks to Gradle build ( #1230 )
...
LUCENE-9134: Port ant-regenerate tasks to Gradle build (Solr javacc)
2020-02-04 09:16:38 -05:00
d3ac1329a3
LUCENE-8656: Deprecations in FuzzyQuery ( #1229 )
...
LUCENE-8656: Deprecations in FuzzyQuery
Closes #1229
2020-02-03 08:52:33 -05:00
d8bc9bcfcf
SOLR-12325: uniqueBlock(\{!v=foo:bar})
2020-02-02 15:15:35 +03:00
719b38c8d8
SOLR-13892: Add 'top-level' docValues Join implementation ( #1171 )
2020-01-31 11:21:01 -05:00
7941d109bd
SOLR-13897: Fix precommit.
2020-01-28 20:11:47 +01:00
975df9ddd3
LUCENE-9182: add apache license headers to all .gradle files and enforce in rat task
2020-01-27 12:05:34 -05:00
776631254f
SOLR-13897: Fix unsafe publication of Terms object in ZkShardTerms that can cause visibility issues and race conditions under contention
2020-01-27 12:08:20 +05:30
efd0e8f3e8
SOLR-14189 switch from String.trim() to StringUtils.isBlank() ( #1172 )
2020-01-26 12:03:39 +01:00
eaa3dbe440
SOLR-14162 TestInjection can leak Timer objects ( #1137 )
2020-01-24 14:04:22 -06:00
b150202c85
SOLR-11554: Support handling OPTIONS request for Hadoop authentication filter
...
Signed-off-by: Kevin Risden <krisden@apache.org>
2020-01-23 13:45:54 -05:00
434f90265b
SOLR-14211: Fix a bug introduced in SOLR-14192.
2020-01-23 19:33:12 +01:00
3c0146196a
SOLR-14206: Annotate HttpSolrCall as thread-safe ( #1203 )
...
* SOLR-14206: Annotate HttpSolrCall and V2HttpCall as thread-safe
2020-01-23 08:37:03 -08:00
e744f7977e
SOLR-14196: AdminUI login not working for JWTAuth when blockUnknown=false ( #1190 )
2020-01-23 14:51:36 +01:00
84270dc6cf
SOLR-14172: Collection metadata remains in zookeeper if too many shards are requested.
...
This also fixes a bug where an inability to assign a node based on existing autoscaling policy resulted in a server error instead of a bad request.
This closes #1152 .
2020-01-23 15:19:53 +05:30
04193d5252
SOLR-14207: Fix logging statements with less or more arguments than placeholders
2020-01-23 14:00:08 +05:30
ffba54a827
SOLR-11746: Adding existence queries for PointFields
...
* DocValuesFieldExistsQuery and NormsFieldExistsQuery are used for existence queries when possible.
* Added documentation on the difference between field:* and field:[* TO *]
2020-01-22 18:00:55 -05:00
6b3e7feba1
SOLR-14159: Eliminate some 'spin loops' in tests that may be contributing factors to odd test failures
2020-01-22 14:44:56 -07:00
75c64089a1
SOLR-14198: Nullpointer exception in AuditEvent with AuthorizationContext ( #1192 )
2020-01-22 21:39:43 +01:00
f1db918e20
SOLR-14040: restore legacy Collection auto-creation
2020-01-22 15:26:37 -05:00
95dfddc7d4
SOLR-12859: Fixed DocExpirationUpdateProcessorFactory to work with BasicAuth and other auth plugins that delegate to PKI for server initiated node-to-node communication.
2020-01-22 09:32:25 -07:00
1af171e47f
SOLR-13965: Factor out public static StreamHandler.addExpressiblePlugins method.
2020-01-21 18:33:26 +00:00
ab924fd4ea
SOLR-14040: shareSchema support for SolrCloud
...
* Use Caffeine impl and weak values (to the schema). Previously the cache never evicted!
* now populating the configSet name from ZK into CloudDescriptor when CloudDescriptor is loaded
* actual schema name needs to be deterministic now; fallback from non-existent managed-schema to schema.xml will thwart this cache
* a test conf/core.properties wasn't actually used and became a problem in it's weird location after I refactored some logic
2020-01-21 13:18:37 -05:00
6244b7150e
SOLR-14192: Race condition between SchemaManager and ZkIndexSchemaReader.
2020-01-20 17:11:47 +01:00
338d386ae0
LUCENE-9145 First pass addressing static analysis ( #1181 )
...
Fixed a bunch of the smaller warnings found by error-prone compiler
plugin, while ignoring a lot of the bigger ones.
2020-01-17 13:30:39 -06:00
5f2d7c4855
SOLR-14184: Internal 'test' variable DirectUpdateHandler2.commitOnClose has been removed and replaced with TestInjection.skipIndexWriterCommitOnClose
2020-01-16 11:47:06 -07:00
94ee211366
Fix 'Restar[t]ing' typo in RecoveryStrategy INFO log message.
2020-01-16 18:13:47 +00:00
35d8e3de6d
SOLR-14130: Continue to improve log parsing logic
2020-01-16 11:36:11 -05:00
424ace6f5d
SOLR-14186: Enforce CRLF in Windows files with .gitattributes ( #1163 )
2020-01-16 08:30:39 -05:00
7ea7ed72ac
LUCENE-9068: Solr query handling code catches FuzzyTermsException
2020-01-16 09:52:18 +00:00
543505470c
SOLR-14128: Tentative fix: put replicas on other nodes than overseer, wait for
...
all replicas to complete the reload.
2020-01-16 10:42:26 +01:00
4c473db99d
SOLR-14130: Add parsing instructions for different types of query records
2020-01-15 15:01:28 -05:00
3008dd9526
Merge remote-tracking branch 'origin/master' into gradle-master
2020-01-13 17:55:53 +01:00
5a73ad0178
Two minor Javadoc cleanups ( #1002 )
2020-01-13 09:22:04 -05:00
6e4756fd48
SOLR-13890: Add "top-level" DV "terms" implementation ( #1151 )
...
{!terms} queries have a docValues-based implementation that uses per-segment DV structures. This does well with a small to moderate (a few hundred) number of query terms, but doesn't well scale beyond that due to repetitive seeks done on each segment.
This commit introduces an implementation that uses a "top-level" docValues structure, which scales much better to very large {!terms} queries (many hundreds, thousands of terms).
2020-01-13 06:43:21 -05:00
f9dde4de52
Merge remote-tracking branch 'origin/master' into gradle-master
2020-01-13 08:37:15 +01:00
9a2497f637
SOLR-13486: Fix trivial test bug in TestTlogReplayVsRecovery
...
Add TODOs for future test improvements once underlying race condition is fixed in core code
2020-01-11 16:48:05 -07:00
0b072ecedb
SOLR-6613: TextField.analyzeMultiTerm does not throw an exception when Analyzer returns no terms. (Bruno Roustant)
...
Closes #1146
2020-01-10 15:47:00 +01:00
d68f3e1a44
SOLR-14130: Improve robustness of the logs parser
2020-01-10 08:39:00 -05:00
5e2396d9fe
Merge remote-tracking branch 'origin/master' into gradle-master
2020-01-10 13:00:38 +01:00
6fb085943c
SOLR-14158: Package manager to read keys from package store, not ZK
2020-01-10 10:25:44 +05:30
0674fada65
Merge remote-tracking branch 'origin/master' into gradle-master
2020-01-09 11:56:02 +01:00
08b64aab8f
Revert "SOLR-11746: Existence query support for numeric point fields"
...
This reverts commit f5ab3ca688
2020-01-08 18:33:15 -05:00
405d227c55
Merge remote-tracking branch 'origin/master' into gradle-master
2020-01-07 08:45:12 +01:00
f5ab3ca688
SOLR-11746: Existence query support for numeric point fields
2020-01-06 12:12:22 -05:00
0fac7c1a26
SOLR-13486: Text improvements
...
* force a hard commit of all docs in TestCloudConsistency to work around bug in that test
* add new AwaitsFix'ed TestTlogReplayVsRecovery that more explicitly demonstrates the bug via TestInjection.updateLogReplayRandomPause
2020-01-03 15:12:23 -07:00
8fba8eba13
SOLR-12490: Introducing json.queries to define many named queries in Query DSL.
2020-01-03 23:28:11 +03:00
8df304d12e
SOLR-14130: Harden parsing logic
2020-01-03 08:47:19 -05:00
8784d7c787
SOLR-14130: Fix precommit
2020-01-03 08:47:19 -05:00
29c00d4fe7
SOLR-14130: Add postlogs command line tool for indexing Solr logs
2020-01-03 08:47:19 -05:00
985af95732
SOLR-13778: Solrj client will retry requests on SSLException with a suppressed SocketException (very likely a hard-closed socket connection)
2020-01-03 14:12:23 +01:00
f789e053d2
Solrj client will retry requests on SSLException with a suppressed SocketException (very likely a hard-closed socket connection)
2020-01-03 14:09:37 +01:00
2bab5ea442
Merge remote-tracking branch 'origin/master' into gradle-master
2020-01-03 11:02:55 +01:00
7d0cf0df32
SOLR-13817: Clean up config files to remove the default 'class=' attribute in
...
standard caches.
2020-01-02 20:58:47 +01:00
15d5e6662c
SOLR-14122: add unit test.
2020-01-02 14:02:54 +01:00
38b9af21f1
SOLR-14122: SimUtils converts v2 to v1 request params incorrectly.
2020-01-02 13:54:45 +01:00
1a690d95ad
Merge remote-tracking branch 'origin/master' into gradle-master
2020-01-02 10:49:19 +01:00
4c9cc2cefd
LUCENE-9093: UnifiedHighlighter LengthGoalBreakIterator frag align
...
Matches in passages should be centered better on average.
Closes #1123
2020-01-01 00:57:00 -05:00
a40b3e755b
Merge remote-tracking branch 'origin/master' into gradle-master
2019-12-31 10:08:07 +01:00
c4993bc99c
SOLR-14129: Reuse Jackson ObjectMapper in AuditLoggerPlugin ( #1104 )
2019-12-30 17:40:32 +01:00
d79b678b39
Merge remote-tracking branch 'origin/master' into gradle-master
2019-12-30 09:24:46 +01:00
3ae1a0b3ba
SOLR-13808: remove redundant @Repeat
2019-12-28 23:43:37 +03:00
3f29fe0b80
SOLR-13808: caching {!bool filter=..} by default.
2019-12-28 21:48:11 +03:00
23f3fd2d48
Merge remote-tracking branch 'origin/master' into gradle-master
2019-12-25 13:14:57 +01:00
27840562a6
SOLR-14131: Add maxQueryLength option to DirectSolrSpellchecker.
...
Closes #1113
2019-12-24 15:05:00 +01:00
1be5b68964
LUCENE-9091: UnifiedHighlighter HTML escaping should only
...
escape essentials
2019-12-23 17:20:48 -05:00
ef15ae9805
SOLR-14125 : Streaming expressions to be loadable from packages ( #1108 )
...
SOLR-14125: Make <expressible> plugins work with packages
2019-12-23 15:20:26 +11:00
c4f68bdab9
SOLR-14095: Let the overseer use javabin to store responses in ZooKeeper ( #1095 )
...
The Overseer used java serialization to store command responses in ZooKeeper. This commit changes the code to use Javabin instead, while allowing Java serialization with a System property in case it's needed for compatibility
2019-12-20 14:55:01 -08:00
5897b78572
Merge remote-tracking branch 'origin/master' into gradle-master
2019-12-20 17:35:40 +01:00
aab3c5faa3
SOLR-14106: Cleanup Jetty SslContextFactory usage
...
Jetty 9.4.16.v20190411 and up introduced separate
client and server SslContextFactory implementations.
This split requires the proper use of of
SslContextFactory in clients and server configs.
This fixes the following
* SSL with SOLR_SSL_NEED_CLIENT_AUTH not working since v8.2.0
* Http2SolrClient SSL not working in branch_8x
Signed-off-by: Kevin Risden <krisden@apache.org>
2019-12-19 23:05:47 -05:00
bc2770ebb8
SOLR-14128: SystemCollectionCompatTest - increase logging to aid in debuging future (jenkins) failures
2019-12-19 17:14:56 -07:00
93585ba1d3
SOLR-13190 Surface Fuzzy term errors in Solr
...
Use newly added exceptions in Lucene for too complex fuzzy terms to
provide better error reporting for Solr queries.
2019-12-19 10:58:28 -06:00
cbfa781fe3
SOLR-14108: Handle missing verify commands or missing default params in Package Manager
2019-12-19 10:38:34 +05:30
1e5100d5a5
SOLR-14091: Removing deprecated configuration of Jetty's soLingerTime option
...
Signed-off-by: Kevin Risden <krisden@apache.org>
2019-12-18 17:24:43 -05:00
206d62b9d5
Merge remote-tracking branch 'origin/master' into gradle-master
2019-12-18 15:10:04 +01:00
56839f6ace
SOLR-13983: remove or replace process execution in SystemInfoHandler
2019-12-18 09:03:07 -05:00
612cba38ca
SOLR-14110: sandbox javax.script usage in tests
2019-12-18 06:30:24 -05:00
28b19c2af2
Merge with master.
2019-12-18 09:32:35 +01:00
71a5714e29
SOLR-14103: remove extra unused dependencies (jersey-core, jersey-server, netty-all).
2019-12-18 09:18:32 +01:00
b0e532b7f3
SOLR-14051: removing Block Join Facet Component in favor of uniqueBlock(\_root_).
2019-12-18 11:16:53 +03:00
46e5e13728
SOLR-13749 Cross collection join filter (XCJF)
...
Squashed commit of the following: commit ffa68a8adb9c5dc16578ab26f731da247533c980
2019-12-18 03:01:24 -05:00
cc4262a8ec
SOLR-14099: Fixed @LogLevel annotation in test-framework to correctly 'unset' Loggers after test
2019-12-17 14:58:45 -07:00
279a391cf3
SOLR-14054 -- upgrade to Tika 1.23 (and its dependencies) ( #1092 )
...
* SOLR-14054 -- upgrade to Tika 1.23 (and its dependencies)
* fix CHANGES.txt file
2019-12-17 16:09:08 -05:00
8493cf18cb
Harden (Cloud)ExitableDirectoryReaderTest
...
Thread.sleep() is "subject to the precision and accuracy of system timers and schedulers."
But tests using DelayingSearchComponent need to ensure that it sleeps *at least* as long as they request, in order to trigger the timeAllowed constraint
2019-12-17 13:54:33 -07:00
33e44b2fd6
SOLR-13696: AwaitsFix RoutedAliasUpdateProcessorTest (and subclasses)
...
The helper method RoutedAliasUpdateProcessorTest.addDocsAndCommit doesn't garuntee docs have been committed when it returns, causing threading/timing bugs in tests that use it as a gate for making subsequent assertions -- causing a steady stream of jenkins test failures
2019-12-17 11:00:03 -07:00
4b7bb7cf29
SOLR-14103: remove unused dependencies and their checksums, licenses.
2019-12-17 15:52:12 +01:00
4c94a13e69
Merge remote-tracking branch 'origin/master' into gradle-master
2019-12-17 13:38:14 +01:00
db11e9e9a2
SOLR-14081: re-implement FullSolrCloudDistribCmdsTest to extend SolrCloudTestCase
2019-12-16 15:58:06 -07:00
e6b5da5c12
SOLR-14099: work around @LogLevel bug in LoggingHandlerTest
2019-12-16 12:13:03 -07:00
dc35e5752b
LUCENE-9094: Ban ObjectInputStream and ObjectOutputStream in forbidden-apis
2019-12-16 13:31:11 -05:00
b5a2cfba4f
SOLR-14094: Enable this test again in master.
2019-12-16 15:54:04 +01:00
ee0b066ab6
SOLR-14096: Stopping -Denable.packages=true from leaking to other tests
2019-12-16 20:20:07 +05:30
83800c03df
Fix an occasional test error caused by the maintenance trigger generating events.
2019-12-16 13:54:36 +01:00
7dfea5fe33
SOLR-14087: Changing the filestore dir name back to filestore from .filestore
2019-12-16 18:18:53 +05:30
b660bcd0a2
SOLR-14094: Bad-apple TestSolrCachePerf.
2019-12-16 13:46:33 +01:00
bc539fc0fd
Merge remote-tracking branch 'origin/master' into gradle-master
2019-12-16 11:20:45 +01:00
479db61df8
SOLR-14087: changed the filestore location to .filestore instead of $filestore
2019-12-16 15:51:36 +11:00
d64c5c20b6
SOLR-14087: disable package store API if -Denable.packages not set to true
2019-12-16 08:04:33 +11:00
2f051a4bfe
SOLR-14086: Tika ClassNotFound error due to commons-compress in solr-core dependency
...
Introduced in SOLR-14033 by including
commons-compress as a compile time
dependency in Solr core instead of as
as test only dependency.
Signed-off-by: Kevin Risden <krisden@apache.org>
2019-12-15 13:39:52 -05:00
640ff96522
SOLR-13662: Fixes to package manager
...
* Better logging and error reporting
* Fixing deploy command to handle previously undeployed packages
* Test now uses @LogLevel annotation
* Deploy command had a hard coded collection name by mistake, fix it
2019-12-15 10:44:02 +05:30
49c34028ab
SOLR-13884: Ignore ConcurrentCreateCollectionTest
2019-12-14 09:31:13 -05:00
7a9a6ef79e
SOLR-14077: Hadoop shouldn't need to look for metrics config in user home
...
Signed-off-by: Kevin Risden <krisden@apache.org>
2019-12-13 22:08:48 -05:00
5f8e65c58f
SOLR-14079: fix SPLITSHARD splitByPrefix in async mode
2019-12-13 17:55:05 -05:00
db65c82c39
SOLR-13884: detect multiple replicas on single node
2019-12-13 17:37:44 -05:00
73c535261c
SOLR-13884: use policies, preferences
2019-12-13 17:37:44 -05:00
fae6aebc74
SOLR-13884: add ConcurrentCreateCollectionTest test
2019-12-13 17:37:44 -05:00
8278886966
SOLR-14026: Upgrade Jetty to 9.4.24.v20191120 and dropwizard to 4.1.2
2019-12-13 10:01:37 -05:00
16466d5256
Add dependency on log4j-1.2 api for solr core tests.
2019-12-13 15:32:59 +01:00
4500f0e327
Consolidating versions between gradle and ant.
2019-12-13 13:31:23 +01:00
035cede6b8
Merge remote-tracking branch 'origin/master' into gradle-master
2019-12-13 10:51:14 +01:00
f083f40b28
SOLR-14076: clean up static fields leak in nightly-only test
2019-12-13 04:06:07 -05:00
3ba005465a
SOLR-14048: Improve Hadoop test sanity checks
...
Signed-off-by: Kevin Risden <krisden@apache.org>
2019-12-12 21:27:38 -05:00
4cee6c68c7
Merge remote-tracking branch 'origin/master' into gradle-master
2019-12-12 17:27:28 +01:00
322ed8ce4d
SOLR-14047: Make sure tests don't pickup other Hadoop installs
...
Signed-off-by: Kevin Risden <krisden@apache.org>
2019-12-12 10:23:29 -05:00
6094d4dd13
Merge remote-tracking branch 'origin/master' into gradle-master
2019-12-12 14:16:48 +01:00
b35f1debe3
SOLR-14013: javabin performance regressions
2019-12-12 23:26:37 +11:00
7097e9c41a
SOLR-13978: Removed LTR from default configset
2019-12-12 15:09:21 +05:30
fa1ad006b6
SOLR-14071: Untrusted configsets shouldn't be allowed to use <lib> directive
2019-12-12 15:00:09 +05:30
dce36c10e9
SOLR-13978: Remove non-essential components from default configset
...
The default configset no longer has the following:
- Library inclusions (<lib ../>) for extraction, solr-cell libs, clustering, velocity and language identifier
- /browse, /tvrh and /update/extract handlers
- TermVector component (if someone wants it, can be added using config APIs)
- XSLT response writer
- Velocity response writer
If you want to use them in your collections, please add them to your configset manually or through the Config APIs.
2019-12-12 10:43:31 +05:30
88b5b5a7cd
SOLR-13970: disallow using collapse/expand with grouping
...
* Using collapse with grouping would cause inconsistent behavior.
This is because grouping calls the same postfilter twice without
resetting the internal state of the DocValues cache
* Using expand with grouping would cause NPE
2019-12-12 10:21:20 +05:30
f681d433ae
SOLR-14062: Split IndexSizeTriggerTest into three
2019-12-12 10:12:17 +05:30
8db8ab3be2
SOLR-13945: SPLITSHARD can cause data loss due to rollback when final commit fails
2019-12-12 08:58:34 +05:30
861c77cb17
SOLR-14053: Fix HDFS tests to be ignored if Native I/O isn't available (remove tests.disableHdfs)
...
Signed-off-by: Kevin Risden <krisden@apache.org>
2019-12-11 22:02:07 -05:00
f01b3e97d1
SOLR-13904: Make Analytics component sensitive to timeAllowed.
2019-12-11 23:48:17 +03:00
dc031ea382
SOLR-14050: clean up tests use of network addresses
...
Solr tests now have a similar policy to Lucene, loopback use only. If a
test tries to resolve or connect to the internet, it will get SecurityException.
Some solr tests explicitly try to talk to dead nodes with real
networking. This is not good and asking for trouble, but use low loopback port numbers instead of
multicast addresses. The idea is that it fails faster. Move these to
constants so that stuff isn't copy-pasted everywhere, in case we have to
do something different later.
2019-12-11 12:51:45 -05:00
5cbbdae793
SOLR-14055: LegacyCloudClusterPropTest fails on Windows (requires SuppressSSL).
2019-12-11 16:40:31 +01:00
77a5dd6926
SOLR-14055: LegacyCloudClusterPropTest fails on Windows (requires SuppressSSL).
2019-12-11 16:39:54 +01:00
16019344cb
Merge remote-tracking branch 'origin/master' into gradle-master
2019-12-11 15:03:46 +01:00
9e236a4835
SOLR-14053: Don't start hdfs when native libraries can't be loaded. Remove tests.disableHdfs. ( #1072 )
2019-12-11 15:01:24 +01:00
d8aa04575f
SOLR-13972: Warn about insecure settings on startup ( #1058 )
2019-12-11 07:16:09 -05:00
87104a155a
Correct commons-compress dependency.
2019-12-11 09:44:16 +01:00
9fad7b67b0
Follow-up to changes on master.
2019-12-11 09:01:37 +01:00
27d5509644
Merge remote-tracking branch 'origin/master' into gradle-master
2019-12-11 08:57:18 +01:00
34f11c9f57
SOLR-13822: Fix Eclipse project
2019-12-11 05:55:30 +05:30
9e84da95a2
SOLR-13966: forgot to test empty list
2019-12-10 16:29:19 -05:00
48775ea18e
SOLR-14033: Fix Hadoop tests with security manager
...
This removes the Solr security manager hacks
for Hadoop. It does so by:
* Using a fake group mapping class instead of ShellGroupMapping
* Copies a few Hadoop classes and modifies them for tests with no Shell
* Nulls out some of the static variables in the tests
The Hadoop files were copied from Apache Hadoop 3.2.0
and copied to the test package to be only picked up
during tests. They were modified to remove the need to
shell out for access. The assumption is that these
HDFS integration tests only run on Unix based systems
and therefore Windows compatibility was removed in some
of the modified classes. The long term goal is to remove
these custom Hadoop classes. All the copied classes are
in the org.apache.hadoop package.
Signed-off-by: Kevin Risden <krisden@apache.org>
2019-12-10 16:15:24 -05:00
c4f0c33638
SOLR-13975, SOLR-13896: ConcurrentUpdateSolrClient connection stall prevention.
2019-12-10 21:45:43 +01:00
20eaaa012d
Merge remote-tracking branch 'origin/master' into gradle-master
2019-12-10 14:52:30 +01:00
fed199df7b
SOLR-13563: SPLITSHARD using LINK method fails on disk usage checks.
2019-12-10 14:21:37 +01:00
b97afd79ca
Fix 5 javac warnings: 'yield' may become a restricted identifier in a future release.
2019-12-10 12:32:34 +00:00
e250f3e82c
SOLR-13966: LatLonPointSpatialField fix for RealTimeGetComponent
...
used in atomic/partial updates.
Closes #1035
2019-12-09 22:51:18 -05:00
1c78d2c637
SOLR-12217: Support shards.preference in SolrJ for individual shard requests ( #984 )
2019-12-09 17:11:58 -05:00
f853d994ec
Merge remote-tracking branch 'origin/master' into gradle-master
2019-12-09 16:48:21 +01:00
86cab79730
SOLR-13979: Expose separate metrics for distributed and non-distributed requests.
2019-12-09 13:46:33 +01:00
a6d7017f2e
Merge remote-tracking branch 'origin/master' into gradle-master
2019-12-09 10:55:54 +01:00
df508ffe01
SOLR-11706: fix for multivalued trie date in min/max and more tests
...
* selecting single value for multivalued trie date field is not
supported.
* add additional tests for variance, unique, hll aggregations
2019-12-08 10:49:37 +05:30
8e9876f516
SOLR-7798: robust support for expand when used w/o collapsing ( #325 )
...
There are applications of ExpandComponent that intentionally do not
involve prior collapsing of results on the expand field, which can lead
to an NPE in expand component when expand.field (for matched docs) has
fewer unique values than the number of matched docs.
This commit refines the approach taken in SOLR-13877, which addressed
the same underlying issue.
2019-12-08 09:59:33 +05:30
7c8635d600
SOLR-14028: Fix test permissions for TestSolrCLIRunExample
...
Signed-off-by: Kevin Risden <krisden@apache.org>
2019-12-07 16:32:11 -05:00
c3bb81f032
Merge remote-tracking branch 'origin/master' into gradle-master
2019-12-07 10:53:34 +01:00
78575f0a2c
Revert "Adding woodstox temporarily so that tests pass."
...
This reverts commit de8a37ee72
2019-12-07 10:51:00 +01:00
a1e51cd777
SOLR-11706: minor refactors
...
* rename stdDev, variance methods to reflect the functionality
* add util functions to compute corrected stdDev and variance
* use DocValuesIterator#advanceExact to check if values exists for the doc
2019-12-07 11:16:25 +05:30
7d5d44a3c4
SOLR-13988: Harden CreateCollectionCleanupTest. Incorporate Dawid Weiss' suggestion for windows
2019-12-06 19:10:27 -05:00
155ab116a2
Revert "SOLR-13990: Switch out woodstox-core-asl with aalto-xml and upgrade woodstox stax-2 API ( #1050 )" ( #1063 )
...
This reverts commit 2387bb9d60
2019-12-06 17:08:40 -06:00
0d18581225
Merge remote-tracking branch 'origin/master' into gradle-master
2019-12-06 19:02:26 +01:00
106b9d6866
SOLR-13988: Harden CreateCollectionCleanupTest
2019-12-06 11:59:53 -05:00
de8a37ee72
Adding woodstox temporarily so that tests pass.
2019-12-06 13:37:48 +01:00
f371df327f
Merge remote-tracking branch 'origin/master' into gradle-master
2019-12-06 11:57:29 +01:00
d2b01ef28f
SOLR-13831: Context property _loop_iter_ should be a string in order to support
...
variable expansion.
2019-12-05 18:27:12 +01:00
2387bb9d60
SOLR-13990: Switch out woodstox-core-asl with aalto-xml and upgrade woodstox stax-2 API ( #1050 )
2019-12-05 18:37:53 +05:30
1a24ccb4ee
Merge remote-tracking branch 'origin/master' into gradle-master
2019-12-05 11:17:34 +01:00
12e8cca644
SOLR-11706: add support for aggregation on multivalued fields
...
* min, max, sum, sumsq, avg, stddev, variance, percentile aggregations
in JSON facets now supports multivalued fields
2019-12-05 10:48:22 +05:30
c4126ef858
SOLR-14015: remove blanket filesystem read access from solr-tests.policy
...
Restrict this to only minimal paths like lucene. It is the defense for directory traversal attacks.
It will also help find bad bugs where things are reading filesystem in the wrong locations.
2019-12-04 23:16:19 -05:00
becc16fb28
SOLR-14002: fix another static leak in test
2019-12-03 22:43:11 -05:00
165529767b
SOLR-14000: clean up more static field leaks in tests
...
On windows, these objects can't be inspected due to security restrictions. So the test runner fails the tests since it does not know how big the leak is.
2019-12-03 18:51:00 -05:00
7c26c6de02
Merge remote-tracking branch 'origin/master' into gradle-master
2019-12-03 18:45:12 +01:00
49bab132b1
Applying two forbidden api check violations (applied to master).
2019-12-03 14:26:02 +01:00
0f61aa9516
Forbidden APIs: add missing root locale.
2019-12-03 13:07:23 +01:00
a51c7b89f2
SOLR-13995: Move ZkShardTerms.Terms to SolrJ
2019-12-03 15:16:34 +11:00
d8f9f47ca0
SOLR-13992: Refactor code to have collection, shard name in Replica,Slice ( #1051 )
...
* SOLR-13992: Refactor code to have collection name shard name in Replica,Slice
2019-12-03 13:10:19 +11:00
d4a9842375
Initial gradle build layer.
2019-12-02 15:34:57 +01:00
5a697344ed
SOLR-13805: NPE when calling /solr/admin/info/health on standalone solr
2019-11-30 10:04:00 +05:30
6a72b81ed3
SOLR-13971: Revert changes to the default configset.
...
* clarified these are Java system properties
* trivial dead code change; Boolean.getBoolean returns a primitive
2019-11-28 10:45:58 -05:00
b4cc3c6ad2
SOLR-13968: Support postingsFormat and docValuesFormat in schema fields.
...
Closes #1039
2019-11-28 16:13:10 +01:00
9f78482295
SOLR-13969: Clean up and document AuditEvent API ( #1041 )
2019-11-28 09:55:11 +01:00
50e8cea918
SOLR-13971: Removing velocity from _default and disabling custom template support by default
2019-11-28 07:52:43 +05:30
6c7a095f33
SOLR-13963: JavaBinCodec has concurrent modification of CharArr resulting in corrupt internode updates
2019-11-26 08:12:23 +11:00
063c82ebd6
SOLR-13952: reverting Erick's commit (with permission).
2019-11-25 17:56:20 +01:00
b5fd6d7b22
SOLR-13961: Allow null/empty for removal of child doc in atomic update
...
Closes #1030
2019-11-25 09:57:07 -05:00
4b34d726ab
SOLR-13952: Separate out Gradle-specific code from other (mostly test) changes and commit separately
2019-11-24 13:24:40 -05:00
592ea19eff
SOLR-12193: reverting one line back to trace
2019-11-24 00:06:07 +01:00
d809bc27f1
SOLR-12193: Move some log messages to TRACE level, remove some dead code
2019-11-23 23:57:59 +01:00
312431b182
SOLR-13465 CoreContainer.auditloggerPlugin should be volatile ( #672 )
2019-11-23 01:21:47 +01:00
e45c5ce9b9
SOLR-13905 Make findRequestType in AuditEvent more robust ( #1014 )
2019-11-22 23:34:20 +01:00
Andrzej Bialecki
Mike
Uwe Schindler
mariemat
Munendra S N
Erick Erickson
David Smiley
ameliahenderson
Mike Drob
Joel Bernstein
noble
Yannick Welsch
Tomas Fernandez Lobbe
Mike Drob
Noble Paul
Pushkar Raste
Shalin Shekhar Mangar
Jan Høydahl
Mikhail Khludnev
Christine Poerschke
Eric Pugh
Alan Woodward
Chris Hostetter
Anshum Gupta
Alessandro Benedetti
yonik
Kevin Risden
Robert Muir
Nicholas Knize
Adrien Grand
Jason Gerlowski
andywebb1975
Houston Putman
Dawid Weiss
0xflotus
Bruno Roustant
Ishan Chattopadhyaya
Houston Putman
Nándor Mátravölgyi
Dawid Weiss
Matthias Krueger
Gus Heck
Tim Allison
Thomas Wöckinger
Houston Putman
Michael Gibney
David Smiley
Jan Høydahl