Commit Graph

14018 Commits

Author SHA1 Message Date
Cao Manh Dat d9c43d9fa3 SOLR-14286: Fix gradle precommit 2020-02-27 18:24:39 +07:00
Cao Manh Dat 043a3cf849 SOLR-14286: Move entry in CHANGES.txt to 8.5.0 2020-02-27 15:13:22 +07:00
Cao Manh Dat e059455004 SOLR-14286: Update sha files 2020-02-27 15:07:03 +07:00
Cao Manh Dat 666bd493c8 SOLR-14286: Upgrade Jaegar to 1.1.0 2020-02-27 14:51:45 +07:00
noble edefcf156b SOLR-14270: fix incorrect date format 2020-02-27 17:28:31 +11:00
Christine Poerschke fc24fa9506 SOLR-14267: complete <query><HashDocSet> solrconfig.xml removal 2020-02-26 17:47:25 +00:00
Eric Pugh b4f3efbf94 SOLR-13965: In GraphHandler, support <expressible> configuration and deprecate <streamFunctions> configuration.
(Eric Pugh via Christine Poerschke)

Closes #1033 pull request.
2020-02-26 17:36:33 +00:00
Alan Woodward 98dafe2e10
LUCENE-9207: Don't build span queries in QueryBuilder (#1239)
QueryBuilder currently has special logic for graph phrase queries with no slop,
constructing a spanquery that attempts to follow all paths using a combination of
OR and NEAR queries. However, this type of query has known bugs(LUCENE-7398).
This commit removes this logic and just builds a disjunction of phrase queries, one 
phrase per path.
2020-02-26 14:32:34 +00:00
Chris Hostetter 852f02b4b7 Some additional testing to prove 'defered function computation' in a syntax variant i was recently asked about 2020-02-25 13:21:13 -07:00
David Smiley 50a7075862
SOLR-14256: Remove HashDocSet; add DocSet.getBits.
* DocSet is now fixed at two implementations, read-only and doc ordered.
* DocSetBase removed; not needed anymore.  DocSet is now an abstract class.
2020-02-25 09:48:20 -05:00
David Smiley 25892271e8
SOLR-14258: DocList should not extend DocSet 2020-02-25 09:39:43 -05:00
Mike 1770797387
SOLR-14223 Create RSAKeyPair from disk (#1217)
* Create properties for PublicKeyHandler to read existing keys from disk
* Move pregenerated keys from core/test-files to test-framework
* Update tests to use existing keys instead of new keys each run
2020-02-24 12:07:10 -08:00
Anshum Gupta 7ba9d4d756
SOLR-14272: Remove autoReplicaFailoverBadNodeExpiration and autoReplicaFailoverWorkLoopDelay for 9.0 as it was deprecated in 7.1 (#1269)
* SOLR-14272: Remove autoReplicaFailoverBadNodeExpiration and autoReplicaFailoverWorkLoopDelay for 9.0 as it was deprecated in 7.1
2020-02-24 09:46:05 -08:00
Alessandro Benedetti 663611c99c
[SOLR-12238] Synonym Queries boost (#357)
SOLR-12238: Handle boosts in QueryBuilder

QueryBuilder now detects per-term boosts supplied by a BoostAttribute when
building queries using a TokenStream.  This commit also adds a DelimitedBoostTokenFilter
that parses boosts from tokens using a delimiter token, and exposes this in Solr
2020-02-24 10:29:41 +00:00
Jan Høydahl 57c7139ea3
SOLR-14114: Add WARN to Solr log that embedded ZK is not supported in production (#1273) 2020-02-24 09:59:33 +01:00
Jan Høydahl 8b98befe93
SOLR-10306: Document in Reference Guide how to disable or reduce swapping (#1256) 2020-02-24 09:50:01 +01:00
Anshum Gupta bc41f25cc9
SOLR-14271: Delete CollectionsAPIAsyncDistributedZkTest.testAsyncIdBackCompat as that is no longer required (#1275) 2020-02-21 09:53:10 -08:00
Erick Erickson 292bed0c42 SOLR-11035: (at least) 2 distinct failures possible when clients attempt searches during SolrCore reload 2020-02-21 10:57:16 -05:00
Jan Høydahl 89b13377a1
SOLR-14250: Do not log error when trying to consume non-existing input stream due to Expect: 100-continue (#1250) 2020-02-21 10:30:10 +01:00
Noble Paul 9f3f7244ac
SOLR-14270 export command to have an option to write to a zip file (#1266) 2020-02-21 13:41:50 +11:00
Mike Drob 79966132fc SOLR-14264 Set minimum gzip size for responses 2020-02-20 17:14:21 -06:00
Anshum Gupta cea4226367
SOLR-14271: Remove duplicate async id check meant for pre Solr 8 versions (#1268)
* SOLR-14271: Remove duplicate async id check meant for pre Solr 8 versions
2020-02-20 15:13:05 -08:00
Shalin Shekhar Mangar 2fdd3b02bb SOLR-12550: Adding entry to CHANGES.txt 2020-02-20 04:33:53 -08:00
Marc A. Morissette 051133c13f
SOLR-12550: ConcurrentUpdateSolrClient doesn't respect timeouts for commits and optimize (#417)
ConcurrentUpdateSolrClient now propagates its connection and read timeouts to the private HttpSolrClient used to commit and optimize.
2020-02-20 04:29:20 -08:00
Mikhail Khludnev 001a35cc06 SOLR-14263: stripping .adoc to fix build. 2020-02-19 13:53:12 +03:00
Jan Høydahl 8389b87e39 LUCENE-9229: Fix some broken links
Change some wiki -> cwiki links

Signed-off-by: Jan Høydahl <janhoy@apache.org>
2020-02-19 10:33:26 +01:00
Erick Erickson aa130c4259 SOLR-14263: Update jvm-settings.adoc 2020-02-18 16:44:51 -05:00
Dawid Weiss 2a88aa9d0f LUCENE-9219: Port ECJ-based linter to gradle
Co-authored-by: Tomoko Uchida <tomoko@apache.org>
2020-02-19 02:43:47 +09:00
Christine Poerschke 003303a9cc SOLR-13041: Add hashCode for autoscaling.Condition to accompany the already present equals.
(Zsolt Gyulavari via Christine Poerschke)
2020-02-18 14:47:44 +00:00
Eric Pugh f23def6b72 SOLR-13965: s/StreamHandler/GraphHandler fix GraphHandler.getDescription()
(Eric Pugh via Christine Poerschke)
2020-02-18 14:32:52 +00:00
Eric Pugh 5d32c04096 SOLR-13965: StreamHandler class-level javadoc edits
(Eric Pugh via Christine Poerschke)
2020-02-18 14:31:44 +00:00
Robert Muir 0203815ab2
LUCENE-9220: regenerate all stemmers/stopwords/test data from snowball 2.0 (#1262)
Previous situation:

* The snowball base classes (Among, SnowballProgram, etc) had accumulated local performance-related changes. There was a task that would also "patch" generated classes (e.g. GermanStemmer) after-the-fact.
* Snowball classes had many "non-changes" from the original such as removal of tabs addition of javadocs, license headers, etc.
* Snowball test data (inputs and expected stems) was incorporated into lucene testing, but this was maintained manually. Also files had become large, making the test too slow (Nightly).
* Snowball stopwords lists from their website were manually maintained. In some cases encoding fixes were manually applied.
* Some generated stemmers (such as Estonian and Armenian) exist in lucene, but have no corresponding `.sbl` file in snowball sources at all.

Besides this mess, snowball project is "moving along" and acquiring new languages, adding non-BSD-licensed test data, huge test data, and other complexity. So it is time to automate the integration better.

New situation:

* Lucene has a `gradle snowball` regeneration task. It works on Linux or Mac only. It checks out their repos, applies the `snowball.patch` in our repository, compiles snowball stemmers, regenerates all java code, applies any adjustments so that our build is happy.
* Tests data is automatically regenerated from the commit hash of the snowball test data repository. Not all languages are tested from their data: only where the license is simple BSD. Test data is also (deterministically) sampled, so that we don't have huge files. We just want to make sure our integration works.
* Randomized tests are still set to test every language with generated fake words. The regeneration task ensures all languages get tested (it writes a simple text file list of them).
* Stopword files are automatically regenerated from the commit hash of the snowball website repository.
* The regeneration procedure is idempotent. This way when stuff does change, you know exactly what happened. For example if test data changes to a different license, you may see a git deletion. Or if a new language/stopwords/test data gets added, you will see git additions.
2020-02-17 12:38:01 -05:00
Claire Pollard 188f620208
Update README.txt (#1090)
Update the analysis-extras README to include reference to including solr-analysis-extras jar.
2020-02-15 22:57:46 +01:00
Maxim Antonov cbf0eba176 Fixes #124 in bin/solr for 'cdpath' users
Signed-off-by: Jan Høydahl <janhoy@apache.org>
2020-02-15 18:10:14 +01:00
Chris Hostetter f549ee3535 SOLR-13794: Replace redundent test only copy of '_default' configset with SolrTestCase logic to correctly set 'solr.default.confdir' system property
This change allows us to remove kludgy test only code from ZkController
2020-02-14 11:36:53 -07:00
Erick Erickson f52676cd82 LUCENE-9224: (ant) RAT report complains about ... solr/webapp rat-report.xml (from gradle) 2020-02-14 10:46:44 -05:00
Chris Hostetter f1fc3e7ba2 SOLR-14247: Revert SolrTestCase Logger removal 2020-02-12 11:51:36 -07:00
Chris Hostetter 49e20dbee4 SOLR-14245: Fix ReplicaListTransformerTest
Previous changes to this issue 'fixed' the way the test was creating mock Replica instances,
to ensure all properties were specified -- but these changes tickled a bug in the existing test
scaffolding that caused it's "expecations" to be based on a regex check against only the base "url"
even though the test logic itself looked at the entire "core url"

The result is that there were reproducible failures if/when the randomly generated regex matched
".*1.*" because the existing test logic did not expect that to match the url or a Replica with
a core name of "core1" because it only considered the base url
2020-02-12 11:10:26 -07:00
Erick Erickson 0767a9d4d7 Code comment only change 2020-02-11 19:32:54 -05:00
yonik c3e44e1fec SOLR-14058: fix peersync bounds check iterating over versions 2020-02-11 10:43:21 -08:00
David Smiley 9a4f7661e9
SOLR-14194: Highlighters now supports docValues for the uniqueKey
and the original highlighter can highlight docValues.
2020-02-11 02:18:08 -05:00
Mike 71b869381e
SOLR-14247 Remove unneeded sleeps (#1244) 2020-02-10 21:13:56 -06:00
Shalin Shekhar Mangar c65b97665c
SOLR-13996: Refactor HttpShardHandler.prepDistributed method (#1220)
SOLR-13996: Refactor HttpShardHandler.prepDistributed method into smaller pieces

This commit introduces an interface named ReplicaSource which is marked as experimental. It has two sub-classes named CloudReplicaSource (for solr cloud) and LegacyReplicaSource for non-cloud clusters. The prepDistributed method now calls out to these sub-classes depending on whether the cluster is running on cloud mode or not.
2020-02-10 19:57:05 +05:30
David Smiley 46c0945614 SOLR-14149: CHANGES.txt Remove off-topic stuff
* No Introduction (to Solr) header.  Point at solr-upgrade-notes.adoc instead
* No Getting Started header
* No Versions of Major Components header
* No "Upgrade Notes" for subsequent releases.  See solr-upgrade-notes.adoc
Closes #1202
2020-02-08 22:52:38 -05:00
Kevin Risden 3885a81aa4
SOLR-14038: Admin UI display for "state.json" should be in a scollable region
Signed-off-by: Kevin Risden <krisden@apache.org>
2020-02-08 12:02:23 -06:00
Kevin Risden c4a8a77d23
SOLR-14209: Upgrade JQuery to 3.4.1
* JQuery 2.1.3 to 3.4.1
* jstree 1.0-rc1 to v3.3.8

Closes #1209

Signed-off-by: Kevin Risden <krisden@apache.org>
2020-02-08 11:57:56 -06:00
Robert Muir f41eabdc5f
LUCENE-8279: fix javadocs wrong header levels and accessibility issues
Java 13 adds a new doclint check under "accessibility" that the html
header nesting level isn't crazy.

Many are incorrect because the html4-style javadocs had horrible
font-sizes, so developers used the wrong header level to work around it.
This is no issue in trunk (always html5).

Java recommends against using such structured tags at all in javadocs,
but that is a more involved change: this just "shifts" header levels
in documents to be correct.
2020-02-08 10:00:00 -05:00
Shalin Shekhar Mangar f5c132be6d SOLR-14248: Improve ClusterStateMockUtil and make its methods public 2020-02-08 11:59:27 +05:30
Nicholas Knize 206a70e7b7 LUCENE-9149: Increase data dimension limit in BKD 2020-02-07 16:08:14 -06:00
Andrzej Bialecki 9a19093586 SOLR-14245: Validate Replica / ReplicaInfo on creation. 2020-02-07 17:56:39 +01:00
Robert Muir 0d339043e3
LUCENE-9209: fix javadocs to be html5, enable doclint html checks, remove jtidy
Current javadocs declare an HTML5 doctype: !DOCTYPE HTML. Some HTML5
features are used, but unfortunately also some constructs that do not
exist in HTML5 are used as well.

Because of this, we have no checking of any html syntax. jtidy is
disabled because it works with html4. doclint is disabled because it
works with html5. our docs are neither.

javadoc "doclint" feature can efficiently check that the html isn't
crazy. we just have to fix really ancient removed/deprecated stuff
(such as use of tt tag).

This enables the html checking in both ant and gradle. The docs are
fixed via straightforward transformations.

One exception is table cellpadding, for this some helper CSS classes
were added to make the transition easier (since it must apply padding
to inner th/td, not possible inline). I added TODOs, we should clean
this up. Most problems look like they may have been generated from a
GUI or similar and not a human.
2020-02-06 22:30:52 -05:00
Robert Muir 63be99bf12
SOLR-14118: default embedded zookeeper port to localhost 2020-02-05 21:33:37 -05:00
Marcus bc5f837344
SOLR-14147 change the Security manager to default to true. (#1141)
* change the Security manager to default.
* update the ref-guide.
* uncomment init scripts update changes.
* changed the ref guide and re-commented file.
* remove added comment.
* modified shell script.
* removed comment in windows file.

Signed-off-by: marcussorealheis <marcuseagan@gmail.com>

* bashism and fix windows
* remove space

Signed-off-by: marcussorealheis <marcuseagan@gmail.com>
2020-02-05 19:17:55 -05:00
Houston Putman 80ed8c281b
SOLR-13887: Use the default idleTimeout instead of 0 for HTTP2 (#991) 2020-02-05 11:15:37 -08:00
Chris Hostetter c5d0391df9 SOLR-14241: New delete() Stream Decorator 2020-02-05 10:49:24 -07:00
Adrien Grand fe349ddcf2
SOLR-14242: HdfsDirectory#createTempOutput. (#1240) 2020-02-05 16:38:53 +01:00
Adrien Grand 2d8428ec2e
SOLR-14238: Fix HdfsDirectory to no longer overwrite existing files. (#1237) 2020-02-04 19:35:15 +01:00
Tomas Fernandez Lobbe bb90569f1d
SOLR-14219: Revert changes in OverseerSolrRespose and move serialization (#1227)
SOLR-14095 Introduced an issue for rolling restarts (Incompatible Java serialization). This change fixes the compatibility issue while keeping the functionality in SOLR-14095
2020-02-04 10:26:57 -08:00
Munendra S N c91dd9d0e4 SOLR-14090: fix delete-copy-field when source is dynamic field 2020-02-04 21:33:31 +05:30
Munendra S N 4eff9c9b5e SOLR-10567: add support for DateRangeField in JSON facet range 2020-02-04 21:26:40 +05:30
Erick Erickson b0bb299dc4
LUCENE-9134: Port ant-regenerate tasks to Gradle build (#1230)
LUCENE-9134: Port ant-regenerate tasks to Gradle build (Solr javacc)
2020-02-04 09:16:38 -05:00
Erick Erickson d3ac1329a3
LUCENE-8656: Deprecations in FuzzyQuery (#1229)
LUCENE-8656: Deprecations in FuzzyQuery

Closes #1229
2020-02-03 08:52:33 -05:00
Mikhail Khludnev d8bc9bcfcf SOLR-12325: uniqueBlock(\{!v=foo:bar}) 2020-02-02 15:15:35 +03:00
Jan Høydahl 16b8d50284
SOLR-14221: Upgrade restlet to version 2.4.0 (#1211) 2020-02-02 11:35:14 +01:00
Munendra S N a2c53dad72 fix typo in schema-api documentation 2020-02-01 10:21:52 +05:30
Joel Bernstein db78f6cd00 SOLR-14139: Support backtick phrase queries in Streaming Expressions 2020-01-31 11:54:14 -05:00
Jason Gerlowski 719b38c8d8
SOLR-13892: Add 'top-level' docValues Join implementation (#1171) 2020-01-31 11:21:01 -05:00
Chris Hostetter 517438e356 New /stream test cases showing authn+authz edge cases in cloud mode
This triggers various places in the Streaming Expressions code that use background threads
to confirm that the expected credentails (or lack of) are propogarded along.

Test currently has comments + workarounds for 2 known client issues:
 - SOLR-14226: SolrStream reports AuthN/AuthZ failures (401|403) as IOException w/o details
 - SOLR-14222: CloudSolrClient converts (update) 403 error to 500 error
2020-01-30 10:01:03 -07:00
Adrien Grand 7941d109bd SOLR-13897: Fix precommit. 2020-01-28 20:11:47 +01:00
Cassandra Targett 1a14c67426 Ref Guide: Remove outdated or invalid links to Solr Wiki; update URL of those that remain 2020-01-27 16:38:31 -06:00
Cassandra Targett b2f51f1941 Ref Guide: fix undefined substitution error caused by formatting of variables in paths 2020-01-27 16:38:30 -06:00
Robert Muir 975df9ddd3
LUCENE-9182: add apache license headers to all .gradle files and enforce in rat task 2020-01-27 12:05:34 -05:00
Robert Muir 8e357b167b
LUCENE-9180: dos2unix files that don't need dos line endings 2020-01-27 11:29:59 -05:00
Robert Muir 5f964eeef2
SOLR-14217: tests respect tests.workDir correctly (prevent SSD destruction) 2020-01-27 06:07:48 -05:00
Shalin Shekhar Mangar 776631254f SOLR-13897: Fix unsafe publication of Terms object in ZkShardTerms that can cause visibility issues and race conditions under contention 2020-01-27 12:08:20 +05:30
Uwe Schindler fd49c903b8 SOLR-14189: Add changes entry 2020-01-26 12:06:13 +01:00
andywebb1975 efd0e8f3e8 SOLR-14189 switch from String.trim() to StringUtils.isBlank() (#1172) 2020-01-26 12:03:39 +01:00
Gus Heck 127ce3e360 SOLR-13749 adjust changes to reflect backport to 8.5 2020-01-25 00:53:27 -05:00
Cassandra Targett ba77a5f2eb SOLR-14214: Clean up client lists and references 2020-01-24 15:46:30 -06:00
Mike eaa3dbe440
SOLR-14162 TestInjection can leak Timer objects (#1137) 2020-01-24 14:04:22 -06:00
Mikhail Khludnev 16e537db7e SOLR-12045: Know how Analytic Component deployment. 2020-01-23 23:22:32 +03:00
Cassandra Targett 64cb1c8fe8
SOLR-12930: Create developer docs directories in source repo (#1164) 2020-01-23 14:00:23 -06:00
Kevin Risden b150202c85
SOLR-11554: Support handling OPTIONS request for Hadoop authentication filter
Signed-off-by: Kevin Risden <krisden@apache.org>
2020-01-23 13:45:54 -05:00
Andrzej Bialecki 434f90265b SOLR-14211: Fix a bug introduced in SOLR-14192. 2020-01-23 19:33:12 +01:00
Anshum Gupta 3c0146196a
SOLR-14206: Annotate HttpSolrCall as thread-safe (#1203)
* SOLR-14206: Annotate HttpSolrCall and V2HttpCall as thread-safe
2020-01-23 08:37:03 -08:00
Nick Vercammen 60a2926546
SOLR-14205 Do not fail when given timeout to connectionImpl.isValid() = 0
Closes #1204

Signed-off-by: Kevin Risden <krisden@apache.org>
2020-01-23 10:12:43 -05:00
Kevin Risden 9b6fc1b9fc
SOLR-14132: Upgrade Angular JS 1.3.8 to 1.7.9
* Upgrade Angular JS 1.3.8 to 1.7.9
* Upgrade Angular Chosen v1.3.0 and Chosen to v1.8.7
* Remove older jquery 1.7.2 version
* Remove non minified Angular JS files

Closes #1196

Signed-off-by: Kevin Risden <krisden@apache.org>
2020-01-23 09:20:12 -05:00
Jan Høydahl e744f7977e
SOLR-14196: AdminUI login not working for JWTAuth when blockUnknown=false (#1190) 2020-01-23 14:51:36 +01:00
Shalin Shekhar Mangar 84270dc6cf SOLR-14172: Collection metadata remains in zookeeper if too many shards are requested.
This also fixes a bug where an inability to assign a node based on existing autoscaling policy resulted in a server error instead of a bad request.

This closes #1152.
2020-01-23 15:19:53 +05:30
Shalin Shekhar Mangar 04193d5252 SOLR-14207: Fix logging statements with less or more arguments than placeholders 2020-01-23 14:00:08 +05:30
Houston Putman c53cbb12f4 SOLR-11746: Adding CHANGES.txt entry 2020-01-22 23:44:25 -05:00
Houston Putman ffba54a827 SOLR-11746: Adding existence queries for PointFields
* DocValuesFieldExistsQuery and NormsFieldExistsQuery are used for existence queries when possible.
* Added documentation on the difference between field:* and field:[* TO *]
2020-01-22 18:00:55 -05:00
Chris Hostetter 6b3e7feba1 SOLR-14159: Eliminate some 'spin loops' in tests that may be contributing factors to odd test failures 2020-01-22 14:44:56 -07:00
Jan Høydahl 75c64089a1
SOLR-14198: Nullpointer exception in AuditEvent with AuthorizationContext (#1192) 2020-01-22 21:39:43 +01:00
David Smiley f1db918e20
SOLR-14040: restore legacy Collection auto-creation 2020-01-22 15:26:37 -05:00
Chris Hostetter 95dfddc7d4 SOLR-12859: Fixed DocExpirationUpdateProcessorFactory to work with BasicAuth and other auth plugins that delegate to PKI for server initiated node-to-node communication. 2020-01-22 09:32:25 -07:00
Joel Bernstein 25ba52d1a0 SOLR-14130: Update CHANGES.txt 2020-01-22 09:52:20 -05:00
Ishan Chattopadhyaya cc9c494a34 Synchronizing 8.4.1 changes 2020-01-22 11:31:12 +05:30
Ishan Chattopadhyaya f6ca662f33 Synchronizing 8.4.1 changes 2020-01-22 11:21:53 +05:30
Christine Poerschke 1af171e47f SOLR-13965: Factor out public static StreamHandler.addExpressiblePlugins method. 2020-01-21 18:33:26 +00:00