Apache
/
lucene
mirror of https://github.com/apache/lucene.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
33,743 Commits 29 Branches 469 Tags 740 MiB
Commit Graph

8357 Commits

Author SHA1 Message Date
Adrien Grand 2d8428ec2e
SOLR-14238: Fix HdfsDirectory to no longer overwrite existing files. (#1237) 2020-02-04 19:35:15 +01:00
Tomas Fernandez Lobbe bb90569f1d
SOLR-14219: Revert changes in OverseerSolrRespose and move serialization (#1227) 
SOLR-14095 Introduced an issue for rolling restarts (Incompatible Java serialization). This change fixes the compatibility issue while keeping the functionality in SOLR-14095
 2020-02-04 10:26:57 -08:00
Munendra S N c91dd9d0e4 SOLR-14090: fix delete-copy-field when source is dynamic field 2020-02-04 21:33:31 +05:30
Munendra S N 4eff9c9b5e SOLR-10567: add support for DateRangeField in JSON facet range 2020-02-04 21:26:40 +05:30
Erick Erickson b0bb299dc4
LUCENE-9134: Port ant-regenerate tasks to Gradle build (#1230) 
LUCENE-9134: Port ant-regenerate tasks to Gradle build (Solr javacc)
 2020-02-04 09:16:38 -05:00
Erick Erickson d3ac1329a3
LUCENE-8656: Deprecations in FuzzyQuery (#1229) 
LUCENE-8656: Deprecations in FuzzyQuery

Closes #1229
 2020-02-03 08:52:33 -05:00
Mikhail Khludnev d8bc9bcfcf SOLR-12325: uniqueBlock(\{!v=foo:bar}) 2020-02-02 15:15:35 +03:00
Jason Gerlowski 719b38c8d8
SOLR-13892: Add 'top-level' docValues Join implementation (#1171) 2020-01-31 11:21:01 -05:00
Adrien Grand 7941d109bd SOLR-13897: Fix precommit. 2020-01-28 20:11:47 +01:00
Robert Muir 975df9ddd3
LUCENE-9182: add apache license headers to all .gradle files and enforce in rat task 2020-01-27 12:05:34 -05:00
Shalin Shekhar Mangar 776631254f SOLR-13897: Fix unsafe publication of Terms object in ZkShardTerms that can cause visibility issues and race conditions under contention 2020-01-27 12:08:20 +05:30
andywebb1975 efd0e8f3e8 SOLR-14189 switch from String.trim() to StringUtils.isBlank() (#1172) 2020-01-26 12:03:39 +01:00
Mike eaa3dbe440
SOLR-14162 TestInjection can leak Timer objects (#1137) 2020-01-24 14:04:22 -06:00
Kevin Risden b150202c85
SOLR-11554: Support handling OPTIONS request for Hadoop authentication filter 
Signed-off-by: Kevin Risden <krisden@apache.org>
 2020-01-23 13:45:54 -05:00
Andrzej Bialecki 434f90265b SOLR-14211: Fix a bug introduced in SOLR-14192. 2020-01-23 19:33:12 +01:00
Anshum Gupta 3c0146196a
SOLR-14206: Annotate HttpSolrCall as thread-safe (#1203) 
* SOLR-14206: Annotate HttpSolrCall and V2HttpCall as thread-safe
 2020-01-23 08:37:03 -08:00
Jan Høydahl e744f7977e
SOLR-14196: AdminUI login not working for JWTAuth when blockUnknown=false (#1190) 2020-01-23 14:51:36 +01:00
Shalin Shekhar Mangar 84270dc6cf SOLR-14172: Collection metadata remains in zookeeper if too many shards are requested. 
This also fixes a bug where an inability to assign a node based on existing autoscaling policy resulted in a server error instead of a bad request.

This closes #1152.
 2020-01-23 15:19:53 +05:30
Shalin Shekhar Mangar 04193d5252 SOLR-14207: Fix logging statements with less or more arguments than placeholders 2020-01-23 14:00:08 +05:30
Houston Putman ffba54a827 SOLR-11746: Adding existence queries for PointFields 
* DocValuesFieldExistsQuery and NormsFieldExistsQuery are used for existence queries when possible.
* Added documentation on the difference between field:* and field:[* TO *]
 2020-01-22 18:00:55 -05:00
Chris Hostetter 6b3e7feba1 SOLR-14159: Eliminate some 'spin loops' in tests that may be contributing factors to odd test failures 2020-01-22 14:44:56 -07:00
Jan Høydahl 75c64089a1
SOLR-14198: Nullpointer exception in AuditEvent with AuthorizationContext (#1192) 2020-01-22 21:39:43 +01:00
David Smiley f1db918e20
SOLR-14040: restore legacy Collection auto-creation 2020-01-22 15:26:37 -05:00
Chris Hostetter 95dfddc7d4 SOLR-12859: Fixed DocExpirationUpdateProcessorFactory to work with BasicAuth and other auth plugins that delegate to PKI for server initiated node-to-node communication. 2020-01-22 09:32:25 -07:00
Christine Poerschke 1af171e47f SOLR-13965: Factor out public static StreamHandler.addExpressiblePlugins method. 2020-01-21 18:33:26 +00:00
David Smiley ab924fd4ea
SOLR-14040: shareSchema support for SolrCloud 
* Use Caffeine impl and weak values (to the schema). Previously the cache never evicted!
* now populating the configSet name from ZK into CloudDescriptor when CloudDescriptor is loaded
* actual schema name needs to be deterministic now; fallback from non-existent managed-schema to schema.xml will thwart this cache
* a test conf/core.properties wasn't actually used and became a problem in it's weird location after I refactored some logic
 2020-01-21 13:18:37 -05:00
Andrzej Bialecki 6244b7150e SOLR-14192: Race condition between SchemaManager and ZkIndexSchemaReader. 2020-01-20 17:11:47 +01:00
Mike 338d386ae0
LUCENE-9145 First pass addressing static analysis (#1181) 
Fixed a bunch of the smaller warnings found by error-prone compiler
plugin, while ignoring a lot of the bigger ones.
 2020-01-17 13:30:39 -06:00
Chris Hostetter 5f2d7c4855 SOLR-14184: Internal 'test' variable DirectUpdateHandler2.commitOnClose has been removed and replaced with TestInjection.skipIndexWriterCommitOnClose 2020-01-16 11:47:06 -07:00
Christine Poerschke 94ee211366 Fix 'Restar[t]ing' typo in RecoveryStrategy INFO log message. 2020-01-16 18:13:47 +00:00
Joel Bernstein 35d8e3de6d SOLR-14130: Continue to improve log parsing logic 2020-01-16 11:36:11 -05:00
Jason Gerlowski 424ace6f5d
SOLR-14186: Enforce CRLF in Windows files with .gitattributes (#1163) 2020-01-16 08:30:39 -05:00
Alan Woodward 7ea7ed72ac LUCENE-9068: Solr query handling code catches FuzzyTermsException 2020-01-16 09:52:18 +00:00
Andrzej Bialecki 543505470c SOLR-14128: Tentative fix: put replicas on other nodes than overseer, wait for 
all replicas to complete the reload.
 2020-01-16 10:42:26 +01:00
Joel Bernstein 4c473db99d SOLR-14130: Add parsing instructions for different types of query records 2020-01-15 15:01:28 -05:00
Dawid Weiss 3008dd9526 Merge remote-tracking branch 'origin/master' into gradle-master 2020-01-13 17:55:53 +01:00
0xflotus 5a73ad0178 Two minor Javadoc cleanups (#1002) 2020-01-13 09:22:04 -05:00
Jason Gerlowski 6e4756fd48
SOLR-13890: Add "top-level" DV "terms" implementation (#1151) 
{!terms} queries have a docValues-based implementation that uses per-segment DV structures.  This does well with a small to moderate (a few hundred) number of query terms, but doesn't well scale beyond that due to repetitive seeks done on each segment.

This commit introduces an implementation that uses a "top-level" docValues structure, which scales much better to very large {!terms} queries (many hundreds, thousands of terms).
 2020-01-13 06:43:21 -05:00
Dawid Weiss f9dde4de52 Merge remote-tracking branch 'origin/master' into gradle-master 2020-01-13 08:37:15 +01:00
Chris Hostetter 9a2497f637 SOLR-13486: Fix trivial test bug in TestTlogReplayVsRecovery 
Add TODOs for future test improvements once underlying race condition is fixed in core code
 2020-01-11 16:48:05 -07:00
Bruno Roustant 0b072ecedb
SOLR-6613: TextField.analyzeMultiTerm does not throw an exception when Analyzer returns no terms. (Bruno Roustant) 
Closes #1146
 2020-01-10 15:47:00 +01:00
Joel Bernstein d68f3e1a44 SOLR-14130: Improve robustness of the logs parser 2020-01-10 08:39:00 -05:00
Dawid Weiss 5e2396d9fe Merge remote-tracking branch 'origin/master' into gradle-master 2020-01-10 13:00:38 +01:00
Ishan Chattopadhyaya 6fb085943c SOLR-14158: Package manager to read keys from package store, not ZK 2020-01-10 10:25:44 +05:30
Dawid Weiss 0674fada65 Merge remote-tracking branch 'origin/master' into gradle-master 2020-01-09 11:56:02 +01:00
Houston Putman 08b64aab8f Revert "SOLR-11746: Existence query support for numeric point fields" 
This reverts commit f5ab3ca688.
 2020-01-08 18:33:15 -05:00
Dawid Weiss 405d227c55 Merge remote-tracking branch 'origin/master' into gradle-master 2020-01-07 08:45:12 +01:00
Houston Putman f5ab3ca688 SOLR-11746: Existence query support for numeric point fields 2020-01-06 12:12:22 -05:00
Chris Hostetter 0fac7c1a26 SOLR-13486: Text improvements 
* force a hard commit of all docs in TestCloudConsistency to work around bug in that test

 * add new AwaitsFix'ed TestTlogReplayVsRecovery that more explicitly demonstrates the bug via TestInjection.updateLogReplayRandomPause
 2020-01-03 15:12:23 -07:00
Mikhail Khludnev 8fba8eba13 SOLR-12490: Introducing json.queries to define many named queries in Query DSL. 2020-01-03 23:28:11 +03:00
Joel Bernstein 8df304d12e SOLR-14130: Harden parsing logic 2020-01-03 08:47:19 -05:00
Joel Bernstein 8784d7c787 SOLR-14130: Fix precommit 2020-01-03 08:47:19 -05:00
Joel Bernstein 29c00d4fe7 SOLR-14130: Add postlogs command line tool for indexing Solr logs 2020-01-03 08:47:19 -05:00
Dawid Weiss 985af95732 SOLR-13778: Solrj client will retry requests on SSLException with a suppressed SocketException (very likely a hard-closed socket connection) 2020-01-03 14:12:23 +01:00
Dawid Weiss f789e053d2 Solrj client will retry requests on SSLException with a suppressed SocketException (very likely a hard-closed socket connection) 2020-01-03 14:09:37 +01:00
Dawid Weiss 2bab5ea442 Merge remote-tracking branch 'origin/master' into gradle-master 2020-01-03 11:02:55 +01:00
Andrzej Bialecki 7d0cf0df32 SOLR-13817: Clean up config files to remove the default 'class=' attribute in 
standard caches.
 2020-01-02 20:58:47 +01:00
Andrzej Bialecki 15d5e6662c SOLR-14122: add unit test. 2020-01-02 14:02:54 +01:00
Andrzej Bialecki 38b9af21f1 SOLR-14122: SimUtils converts v2 to v1 request params incorrectly. 2020-01-02 13:54:45 +01:00
Dawid Weiss 1a690d95ad Merge remote-tracking branch 'origin/master' into gradle-master 2020-01-02 10:49:19 +01:00
Nándor Mátravölgyi 4c9cc2cefd LUCENE-9093: UnifiedHighlighter LengthGoalBreakIterator frag align 
Matches in passages should be centered better on average.
 Closes #1123
 2020-01-01 00:57:00 -05:00
Dawid Weiss a40b3e755b Merge remote-tracking branch 'origin/master' into gradle-master 2019-12-31 10:08:07 +01:00
Jan Høydahl c4993bc99c
SOLR-14129: Reuse Jackson ObjectMapper in AuditLoggerPlugin (#1104) 2019-12-30 17:40:32 +01:00
Dawid Weiss d79b678b39 Merge remote-tracking branch 'origin/master' into gradle-master 2019-12-30 09:24:46 +01:00
Mikhail Khludnev 3ae1a0b3ba SOLR-13808: remove redundant @Repeat 2019-12-28 23:43:37 +03:00
Mikhail Khludnev 3f29fe0b80 SOLR-13808: caching {!bool filter=..} by default. 2019-12-28 21:48:11 +03:00
Dawid Weiss 23f3fd2d48 Merge remote-tracking branch 'origin/master' into gradle-master 2019-12-25 13:14:57 +01:00
Bruno Roustant 27840562a6
SOLR-14131: Add maxQueryLength option to DirectSolrSpellchecker. 
Closes #1113
 2019-12-24 15:05:00 +01:00
Nándor Mátravölgyi 1be5b68964 LUCENE-9091: UnifiedHighlighter HTML escaping should only 
escape essentials
 2019-12-23 17:20:48 -05:00
Noble Paul ef15ae9805
SOLR-14125 : Streaming expressions to be loadable from packages (#1108) 
SOLR-14125: Make <expressible> plugins work with packages
 2019-12-23 15:20:26 +11:00
Tomas Fernandez Lobbe c4f68bdab9
SOLR-14095: Let the overseer use javabin to store responses in ZooKeeper (#1095) 
The Overseer used java serialization to store command responses in ZooKeeper. This commit changes the code to use Javabin instead, while allowing Java serialization with a System property in case it's needed for compatibility
 2019-12-20 14:55:01 -08:00
Dawid Weiss 5897b78572 Merge remote-tracking branch 'origin/master' into gradle-master 2019-12-20 17:35:40 +01:00
Kevin Risden aab3c5faa3
SOLR-14106: Cleanup Jetty SslContextFactory usage 
Jetty 9.4.16.v20190411 and up introduced separate
client and server SslContextFactory implementations.
This split requires the proper use of of
SslContextFactory in clients and server configs.

This fixes the following
* SSL with SOLR_SSL_NEED_CLIENT_AUTH not working since v8.2.0
* Http2SolrClient SSL not working in branch_8x

Signed-off-by: Kevin Risden <krisden@apache.org>
 2019-12-19 23:05:47 -05:00
Chris Hostetter bc2770ebb8 SOLR-14128: SystemCollectionCompatTest - increase logging to aid in debuging future (jenkins) failures 2019-12-19 17:14:56 -07:00
Mike Drob 93585ba1d3 SOLR-13190 Surface Fuzzy term errors in Solr 
Use newly added exceptions in Lucene for too complex fuzzy terms to
provide better error reporting for Solr queries.
 2019-12-19 10:58:28 -06:00
Ishan Chattopadhyaya cbfa781fe3 SOLR-14108: Handle missing verify commands or missing default params in Package Manager 2019-12-19 10:38:34 +05:30
Matthias Krueger 1e5100d5a5
SOLR-14091: Removing deprecated configuration of Jetty's soLingerTime option 
Signed-off-by: Kevin Risden <krisden@apache.org>
 2019-12-18 17:24:43 -05:00
Dawid Weiss 206d62b9d5 Merge remote-tracking branch 'origin/master' into gradle-master 2019-12-18 15:10:04 +01:00
Robert Muir 56839f6ace SOLR-13983: remove or replace process execution in SystemInfoHandler 2019-12-18 09:03:07 -05:00
Robert Muir 612cba38ca SOLR-14110: sandbox javax.script usage in tests 2019-12-18 06:30:24 -05:00
Dawid Weiss 28b19c2af2 Merge with master. 2019-12-18 09:32:35 +01:00
Dawid Weiss 71a5714e29 SOLR-14103: remove extra unused dependencies (jersey-core, jersey-server, netty-all). 2019-12-18 09:18:32 +01:00
Mikhail Khludnev b0e532b7f3 SOLR-14051: removing Block Join Facet Component in favor of uniqueBlock(\_root_). 2019-12-18 11:16:53 +03:00
Gus Heck 46e5e13728 SOLR-13749 Cross collection join filter (XCJF) 
Squashed commit of the following:  commit ffa68a8adb9c5dc16578ab26f731da247533c980
 2019-12-18 03:01:24 -05:00
Chris Hostetter cc4262a8ec SOLR-14099: Fixed @LogLevel annotation in test-framework to correctly 'unset' Loggers after test 2019-12-17 14:58:45 -07:00
Tim Allison 279a391cf3
SOLR-14054 -- upgrade to Tika 1.23 (and its dependencies) (#1092) 
* SOLR-14054 -- upgrade to Tika 1.23 (and its dependencies)

* fix CHANGES.txt file
 2019-12-17 16:09:08 -05:00
Chris Hostetter 8493cf18cb Harden (Cloud)ExitableDirectoryReaderTest 
Thread.sleep() is "subject to the precision and accuracy of system timers and schedulers."

But tests using DelayingSearchComponent need to ensure that it sleeps *at least* as long as they request, in order to trigger the timeAllowed constraint
 2019-12-17 13:54:33 -07:00
Chris Hostetter 33e44b2fd6 SOLR-13696: AwaitsFix RoutedAliasUpdateProcessorTest (and subclasses) 
The helper method RoutedAliasUpdateProcessorTest.addDocsAndCommit doesn't garuntee docs have been committed when it returns, causing threading/timing bugs in tests that use it as a gate for making subsequent assertions -- causing a steady stream of jenkins test failures
 2019-12-17 11:00:03 -07:00
Dawid Weiss 4b7bb7cf29 SOLR-14103: remove unused dependencies and their checksums, licenses. 2019-12-17 15:52:12 +01:00
Dawid Weiss 4c94a13e69 Merge remote-tracking branch 'origin/master' into gradle-master 2019-12-17 13:38:14 +01:00
Chris Hostetter db11e9e9a2 SOLR-14081: re-implement FullSolrCloudDistribCmdsTest to extend SolrCloudTestCase 2019-12-16 15:58:06 -07:00
Chris Hostetter e6b5da5c12 SOLR-14099: work around @LogLevel bug in LoggingHandlerTest 2019-12-16 12:13:03 -07:00
Robert Muir dc35e5752b LUCENE-9094: Ban ObjectInputStream and ObjectOutputStream in forbidden-apis 2019-12-16 13:31:11 -05:00
Andrzej Bialecki b5a2cfba4f SOLR-14094: Enable this test again in master. 2019-12-16 15:54:04 +01:00
Ishan Chattopadhyaya ee0b066ab6 SOLR-14096: Stopping -Denable.packages=true from leaking to other tests 2019-12-16 20:20:07 +05:30
Andrzej Bialecki 83800c03df Fix an occasional test error caused by the maintenance trigger generating events. 2019-12-16 13:54:36 +01:00
Ishan Chattopadhyaya 7dfea5fe33 SOLR-14087: Changing the filestore dir name back to filestore from .filestore 2019-12-16 18:18:53 +05:30
Adrien Grand b660bcd0a2 SOLR-14094: Bad-apple TestSolrCachePerf. 2019-12-16 13:46:33 +01:00
Dawid Weiss bc539fc0fd Merge remote-tracking branch 'origin/master' into gradle-master 2019-12-16 11:20:45 +01:00
noble 479db61df8 SOLR-14087: changed the filestore location to .filestore instead of $filestore 2019-12-16 15:51:36 +11:00
Noble Paul d64c5c20b6
SOLR-14087: disable package store API if -Denable.packages not set to true 2019-12-16 08:04:33 +11:00
Kevin Risden 2f051a4bfe
SOLR-14086: Tika ClassNotFound error due to commons-compress in solr-core dependency 
Introduced in SOLR-14033 by including
commons-compress as a compile time
dependency in Solr core instead of as
as test only dependency.

Signed-off-by: Kevin Risden <krisden@apache.org>
 2019-12-15 13:39:52 -05:00
Ishan Chattopadhyaya 640ff96522 SOLR-13662: Fixes to package manager 
* Better logging and error reporting
* Fixing deploy command to handle previously undeployed packages
* Test now uses @LogLevel annotation
* Deploy command had a hard coded collection name by mistake, fix it
 2019-12-15 10:44:02 +05:30
yonik 49c34028ab SOLR-13884: Ignore ConcurrentCreateCollectionTest 2019-12-14 09:31:13 -05:00
Kevin Risden 7a9a6ef79e
SOLR-14077: Hadoop shouldn't need to look for metrics config in user home 
Signed-off-by: Kevin Risden <krisden@apache.org>
 2019-12-13 22:08:48 -05:00
yonik 5f8e65c58f SOLR-14079: fix SPLITSHARD splitByPrefix in async mode 2019-12-13 17:55:05 -05:00
yonik db65c82c39 SOLR-13884: detect multiple replicas on single node 2019-12-13 17:37:44 -05:00
yonik 73c535261c SOLR-13884: use policies, preferences 2019-12-13 17:37:44 -05:00
yonik fae6aebc74 SOLR-13884: add ConcurrentCreateCollectionTest test 2019-12-13 17:37:44 -05:00
erick 8278886966 SOLR-14026: Upgrade Jetty to 9.4.24.v20191120 and dropwizard to 4.1.2 2019-12-13 10:01:37 -05:00
Dawid Weiss 16466d5256 Add dependency on log4j-1.2 api for solr core tests. 2019-12-13 15:32:59 +01:00
Dawid Weiss 4500f0e327 Consolidating versions between gradle and ant. 2019-12-13 13:31:23 +01:00
Dawid Weiss 035cede6b8 Merge remote-tracking branch 'origin/master' into gradle-master 2019-12-13 10:51:14 +01:00
Robert Muir f083f40b28 SOLR-14076: clean up static fields leak in nightly-only test 2019-12-13 04:06:07 -05:00
Kevin Risden 3ba005465a
SOLR-14048: Improve Hadoop test sanity checks 
Signed-off-by: Kevin Risden <krisden@apache.org>
 2019-12-12 21:27:38 -05:00
Dawid Weiss 4cee6c68c7 Merge remote-tracking branch 'origin/master' into gradle-master 2019-12-12 17:27:28 +01:00
Kevin Risden 322ed8ce4d
SOLR-14047: Make sure tests don't pickup other Hadoop installs 
Signed-off-by: Kevin Risden <krisden@apache.org>
 2019-12-12 10:23:29 -05:00
Dawid Weiss 6094d4dd13 Merge remote-tracking branch 'origin/master' into gradle-master 2019-12-12 14:16:48 +01:00
noble b35f1debe3 SOLR-14013: javabin performance regressions 2019-12-12 23:26:37 +11:00
Ishan Chattopadhyaya 7097e9c41a SOLR-13978: Removed LTR from default configset 2019-12-12 15:09:21 +05:30
Ishan Chattopadhyaya fa1ad006b6 SOLR-14071: Untrusted configsets shouldn't be allowed to use <lib> directive 2019-12-12 15:00:09 +05:30
Ishan Chattopadhyaya dce36c10e9 SOLR-13978: Remove non-essential components from default configset 
The default configset no longer has the following:
   - Library inclusions (<lib ../>) for extraction, solr-cell libs, clustering, velocity and language identifier
   - /browse, /tvrh and /update/extract handlers
   - TermVector component (if someone wants it, can be added using config APIs)
   - XSLT response writer
   - Velocity response writer
If you want to use them in your collections, please add them to your configset manually or through the Config APIs.
 2019-12-12 10:43:31 +05:30
Munendra S N 88b5b5a7cd SOLR-13970: disallow using collapse/expand with grouping 
* Using collapse with grouping would cause inconsistent behavior.
  This is because grouping calls the same postfilter twice without
  resetting the internal state of the DocValues cache
* Using expand with grouping would cause NPE
 2019-12-12 10:21:20 +05:30
Ishan Chattopadhyaya f681d433ae SOLR-14062: Split IndexSizeTriggerTest into three 2019-12-12 10:12:17 +05:30
Ishan Chattopadhyaya 8db8ab3be2 SOLR-13945: SPLITSHARD can cause data loss due to rollback when final commit fails 2019-12-12 08:58:34 +05:30
Kevin Risden 861c77cb17
SOLR-14053: Fix HDFS tests to be ignored if Native I/O isn't available (remove tests.disableHdfs) 
Signed-off-by: Kevin Risden <krisden@apache.org>
 2019-12-11 22:02:07 -05:00
Mikhail Khludnev f01b3e97d1 SOLR-13904: Make Analytics component sensitive to timeAllowed. 2019-12-11 23:48:17 +03:00
Robert Muir dc031ea382 SOLR-14050: clean up tests use of network addresses 
Solr tests now have a similar policy to Lucene, loopback use only. If a
test tries to resolve or connect to the internet, it will get SecurityException.

Some solr tests explicitly try to talk to dead nodes with real
networking. This is not good and asking for trouble, but use low loopback port numbers instead of
multicast addresses. The idea is that it fails faster. Move these to
constants so that stuff isn't copy-pasted everywhere, in case we have to
do something different later.
 2019-12-11 12:51:45 -05:00
Dawid Weiss 5cbbdae793 SOLR-14055: LegacyCloudClusterPropTest fails on Windows (requires SuppressSSL). 2019-12-11 16:40:31 +01:00
Dawid Weiss 77a5dd6926 SOLR-14055: LegacyCloudClusterPropTest fails on Windows (requires SuppressSSL). 2019-12-11 16:39:54 +01:00
Dawid Weiss 16019344cb Merge remote-tracking branch 'origin/master' into gradle-master 2019-12-11 15:03:46 +01:00
Dawid Weiss 9e236a4835
SOLR-14053: Don't start hdfs when native libraries can't be loaded. Remove tests.disableHdfs. (#1072) 2019-12-11 15:01:24 +01:00
Jason Gerlowski d8aa04575f
SOLR-13972: Warn about insecure settings on startup (#1058) 2019-12-11 07:16:09 -05:00
Dawid Weiss 87104a155a Correct commons-compress dependency. 2019-12-11 09:44:16 +01:00
Dawid Weiss 9fad7b67b0 Follow-up to changes on master. 2019-12-11 09:01:37 +01:00
Dawid Weiss 27d5509644 Merge remote-tracking branch 'origin/master' into gradle-master 2019-12-11 08:57:18 +01:00
Ishan Chattopadhyaya 34f11c9f57 SOLR-13822: Fix Eclipse project 2019-12-11 05:55:30 +05:30
Thomas Wöckinger 9e84da95a2 SOLR-13966: forgot to test empty list 2019-12-10 16:29:19 -05:00
Kevin Risden 48775ea18e
SOLR-14033: Fix Hadoop tests with security manager 
This removes the Solr security manager hacks
for Hadoop. It does so by:
* Using a fake group mapping class instead of ShellGroupMapping
* Copies a few Hadoop classes and modifies them for tests with no Shell
* Nulls out some of the static variables in the tests

The Hadoop files were copied from Apache Hadoop 3.2.0
and copied to the test package to be only picked up
during tests. They were modified to remove the need to
shell out for access. The assumption is that these
HDFS integration tests only run on Unix based systems
and therefore Windows compatibility was removed in some
of the modified classes. The long term goal is to remove
these custom Hadoop classes. All the copied classes are
in the org.apache.hadoop package.

Signed-off-by: Kevin Risden <krisden@apache.org>
 2019-12-10 16:15:24 -05:00
Andrzej Bialecki c4f0c33638 SOLR-13975, SOLR-13896: ConcurrentUpdateSolrClient connection stall prevention. 2019-12-10 21:45:43 +01:00
Dawid Weiss 20eaaa012d Merge remote-tracking branch 'origin/master' into gradle-master 2019-12-10 14:52:30 +01:00
Andrzej Bialecki fed199df7b SOLR-13563: SPLITSHARD using LINK method fails on disk usage checks. 2019-12-10 14:21:37 +01:00
Christine Poerschke b97afd79ca Fix 5 javac warnings: 'yield' may become a restricted identifier in a future release. 2019-12-10 12:32:34 +00:00
Thomas Wöckinger e250f3e82c SOLR-13966: LatLonPointSpatialField fix for RealTimeGetComponent 
used in atomic/partial updates.
Closes #1035
 2019-12-09 22:51:18 -05:00
Houston Putman 1c78d2c637
SOLR-12217: Support shards.preference in SolrJ for individual shard requests (#984) 2019-12-09 17:11:58 -05:00
Dawid Weiss f853d994ec Merge remote-tracking branch 'origin/master' into gradle-master 2019-12-09 16:48:21 +01:00
Andrzej Bialecki 86cab79730 SOLR-13979: Expose separate metrics for distributed and non-distributed requests. 2019-12-09 13:46:33 +01:00
Dawid Weiss a6d7017f2e Merge remote-tracking branch 'origin/master' into gradle-master 2019-12-09 10:55:54 +01:00
Munendra S N df508ffe01 SOLR-11706: fix for multivalued trie date in min/max and more tests 
* selecting single value for multivalued trie date field is not
  supported.
* add additional tests for variance, unique, hll aggregations
 2019-12-08 10:49:37 +05:30
Michael Gibney 8e9876f516 SOLR-7798: robust support for expand when used w/o collapsing (#325) 
There are applications of ExpandComponent that intentionally do not
involve prior collapsing of results on the expand field, which can lead
to an NPE in expand component when expand.field (for matched docs) has
fewer unique values than the number of matched docs.

This commit refines the approach taken in SOLR-13877, which addressed
the same underlying issue.
 2019-12-08 09:59:33 +05:30
Kevin Risden 7c8635d600
SOLR-14028: Fix test permissions for TestSolrCLIRunExample 
Signed-off-by: Kevin Risden <krisden@apache.org>
 2019-12-07 16:32:11 -05:00
Dawid Weiss c3bb81f032 Merge remote-tracking branch 'origin/master' into gradle-master 2019-12-07 10:53:34 +01:00
Dawid Weiss 78575f0a2c Revert "Adding woodstox temporarily so that tests pass." 
This reverts commit de8a37ee72.
 2019-12-07 10:51:00 +01:00
Munendra S N a1e51cd777 SOLR-11706: minor refactors 
* rename stdDev, variance methods to reflect the functionality
* add util functions to compute corrected stdDev and variance
* use DocValuesIterator#advanceExact to check if values exists for the doc
 2019-12-07 11:16:25 +05:30
Erick Erickson 7d5d44a3c4 SOLR-13988: Harden CreateCollectionCleanupTest. Incorporate Dawid Weiss' suggestion for windows 2019-12-06 19:10:27 -05:00
Mike 155ab116a2
Revert "SOLR-13990: Switch out woodstox-core-asl with aalto-xml and upgrade woodstox stax-2 API (#1050)" (#1063) 
This reverts commit 2387bb9d60.
 2019-12-06 17:08:40 -06:00
Dawid Weiss 0d18581225 Merge remote-tracking branch 'origin/master' into gradle-master 2019-12-06 19:02:26 +01:00
Erick Erickson 106b9d6866 SOLR-13988: Harden CreateCollectionCleanupTest 2019-12-06 11:59:53 -05:00
Dawid Weiss de8a37ee72 Adding woodstox temporarily so that tests pass. 2019-12-06 13:37:48 +01:00
Dawid Weiss f371df327f Merge remote-tracking branch 'origin/master' into gradle-master 2019-12-06 11:57:29 +01:00
Andrzej Bialecki d2b01ef28f SOLR-13831: Context property _loop_iter_ should be a string in order to support 
variable expansion.
 2019-12-05 18:27:12 +01:00
Anshum Gupta 2387bb9d60
SOLR-13990: Switch out woodstox-core-asl with aalto-xml and upgrade woodstox stax-2 API (#1050) 2019-12-05 18:37:53 +05:30
Dawid Weiss 1a24ccb4ee Merge remote-tracking branch 'origin/master' into gradle-master 2019-12-05 11:17:34 +01:00
Munendra S N 12e8cca644 SOLR-11706: add support for aggregation on multivalued fields 
* min, max, sum, sumsq, avg, stddev, variance, percentile aggregations
  in JSON facets now supports multivalued fields
 2019-12-05 10:48:22 +05:30
Robert Muir c4126ef858 SOLR-14015: remove blanket filesystem read access from solr-tests.policy 
Restrict this to only minimal paths like lucene. It is the defense for directory traversal attacks.
It will also help find bad bugs where things are reading filesystem in the wrong locations.
 2019-12-04 23:16:19 -05:00
Robert Muir becc16fb28 SOLR-14002: fix another static leak in test 2019-12-03 22:43:11 -05:00
Robert Muir 165529767b SOLR-14000: clean up more static field leaks in tests 
On windows, these objects can't be inspected due to security restrictions. So the test runner fails the tests since it does not know how big the leak is.
 2019-12-03 18:51:00 -05:00
Dawid Weiss 7c26c6de02 Merge remote-tracking branch 'origin/master' into gradle-master 2019-12-03 18:45:12 +01:00
Dawid Weiss 49bab132b1 Applying two forbidden api check violations (applied to master). 2019-12-03 14:26:02 +01:00
Dawid Weiss 0f61aa9516 Forbidden APIs: add missing root locale. 2019-12-03 13:07:23 +01:00
noble a51c7b89f2 SOLR-13995: Move ZkShardTerms.Terms to SolrJ 2019-12-03 15:16:34 +11:00
Noble Paul d8f9f47ca0
SOLR-13992: Refactor code to have collection, shard name in Replica,Slice (#1051) 
* SOLR-13992: Refactor code to have collection name shard name in Replica,Slice
 2019-12-03 13:10:19 +11:00
Dawid Weiss d4a9842375 Initial gradle build layer. 2019-12-02 15:34:57 +01:00
Shalin Shekhar Mangar 5a697344ed SOLR-13805: NPE when calling /solr/admin/info/health on standalone solr 2019-11-30 10:04:00 +05:30
David Smiley 6a72b81ed3 SOLR-13971: Revert changes to the default configset. 
* clarified these are Java system properties
* trivial dead code change; Boolean.getBoolean returns a primitive
 2019-11-28 10:45:58 -05:00
Bruno Roustant b4cc3c6ad2
SOLR-13968: Support postingsFormat and docValuesFormat in schema fields. 
Closes #1039
 2019-11-28 16:13:10 +01:00
Jan Høydahl 9f78482295
SOLR-13969: Clean up and document AuditEvent API (#1041) 2019-11-28 09:55:11 +01:00
Ishan Chattopadhyaya 50e8cea918 SOLR-13971: Removing velocity from _default and disabling custom template support by default 2019-11-28 07:52:43 +05:30
noble 6c7a095f33 SOLR-13963: JavaBinCodec has concurrent modification of CharArr resulting in corrupt internode updates 2019-11-26 08:12:23 +11:00
Dawid Weiss 063c82ebd6 SOLR-13952: reverting Erick's commit (with permission). 2019-11-25 17:56:20 +01:00
Thomas Wöckinger b5fd6d7b22 SOLR-13961: Allow null/empty for removal of child doc in atomic update 
Closes #1030
 2019-11-25 09:57:07 -05:00
Erick Erickson 4b34d726ab SOLR-13952: Separate out Gradle-specific code from other (mostly test) changes and commit separately 2019-11-24 13:24:40 -05:00
Jan Høydahl 592ea19eff SOLR-12193: reverting one line back to trace 2019-11-24 00:06:07 +01:00
Jan Høydahl d809bc27f1 SOLR-12193: Move some log messages to TRACE level, remove some dead code 2019-11-23 23:57:59 +01:00
Jan Høydahl 312431b182
SOLR-13465 CoreContainer.auditloggerPlugin should be volatile (#672) 2019-11-23 01:21:47 +01:00
Jan Høydahl e45c5ce9b9
SOLR-13905 Make findRequestType in AuditEvent more robust (#1014) 2019-11-22 23:34:20 +01:00
Eric Pugh 537862d5bb Document how to load your own streaming plugins (#1025) 2019-11-22 11:16:57 -08:00
Munendra S N 2740d90dee SOLR-13912: add support for countvals aggregation in JSON facet module 
* This aggregation is equivalent to StatsComponent's count
 2019-11-22 18:16:20 +05:30
Chris Hostetter 8f30f6436c SOLR-13946: Fix SpellCheckCollatorTest.testEstimatedHitCounts lower/upper bounds to match computable values based on random merge policies 2019-11-21 11:46:35 -07:00
noble f98555854c SOLR-13822: Bug fixs and tests for URP loading 2019-11-21 11:25:16 +11:00
Jan Høydahl f00bcd5609
SOLR-13941: Configure JettySolrRunner same as in web.xml (#1018) 2019-11-20 10:20:54 +01:00
noble a593d3050c Revert "SOLR-13942: /api/cluster/zk/* to fetch raw ZK data" 
This reverts commit 935a2987f8.

this was accidentally pushed to master.
 2019-11-20 06:08:06 +11:00
noble 935a2987f8 SOLR-13942: /api/cluster/zk/* to fetch raw ZK data 2019-11-19 18:05:18 +11:00
Chris Hostetter 59465c20c4 SOLR-13943: AwaitsFix TimeRoutedAliasUpdateProcessorTest.testDateMathInStart 2019-11-18 16:32:21 -07:00
Mikhail Khludnev 51b1c5a023 LUCENE-9036: ExitableDirectoryReader checks timeout on DocValues access. 2019-11-18 23:34:43 +03:00
Chris Hostetter 1411aaee94 HdfsRecoveryZkTest & HdfsNNFailoverTest: Remove @BadApple anotation 
These tests were originally anotated @BadApple in early 2018 as pat of SOLR-12028.

Neither test has failed since 2018-12-28.

Since we no longer have logs from those older jenkins builds, it's hard to be certain how/why this
test was failing, or why exactly it stopped failing – but it's possible the underlying issues were
addressed by general hardening of SolrCloud and the associated base test classes around the same time.
 2019-11-18 12:22:12 -07:00
Adrien Grand 7755cdf03f
LUCENE-9027: Use SIMD instructions to decode postings. (#973) 2019-11-18 19:08:32 +01:00
Chris Hostetter f9076d85cf SOLR-13924: AwaitsFix: MoveReplicaHDFSTest 2019-11-18 09:58:00 -07:00
Ishan Chattopadhyaya 0857bb60d3 SOLR-13662, SOLR-13822: Fixing bug with refresh API, un-ignoring the test and new reference guide on Package Management 2019-11-18 04:00:00 +05:30
Ishan Chattopadhyaya 5200ee0ef9 SOLR-13662: Ignoring the PackageManagerCLITest until further investigation of failures 2019-11-17 06:06:02 +05:30
Munendra S N 0602956a44 SOLR-13911: add support for missing aggregation in JSON facet module 
* This missing aggregation is equivalent to StatsComponent's missing
 2019-11-16 12:12:11 +05:30
Chris Hostetter 3fb39b2960 TestDistributedStatsComponentCardinality: Remove @BadApple anotation 
This test was originally anotated @BadApple ~2018-10-14 as pat of SOLR-12028.

So far in 2019, it has failed in 62 jenkins-BadApple builds, but all prior to 2019-06-14.

Since we no longer have logs from those older jenkins builds, it's hard to be certain how/why
this test was failing, or why exactly it *stopped* failing -- but a likely suspect is that
the root cause of the problem may have been fixed as part of the Jetty upgrade in SOLR-13541.
 2019-11-15 22:25:39 -07:00
Andrzej Bialecki 66e78ba7c5 SOLR-13898: Allow inexact double comparison. Close resources. 2019-11-15 20:38:20 +01:00
Chris Hostetter 805305c410 SOLR-13909: ReplicationHandler testing: Replace the completely broken CheckBackupStatus with a new BackupStatusChecker helper class 2019-11-15 10:17:26 -07:00
Tomas Fernandez Lobbe 4931c0989d SOLR-13860: Ignore testKillTlogReplica 2019-11-14 15:16:35 -08:00
Ishan Chattopadhyaya e59563f189 SOLR-13662: Renaming the test jars to .tmp to avoid precommit failures. Adding timeout for test failure fix. 2019-11-15 00:55:44 +02:00
Andrzej Bialecki b4fe911cc8 SOLR-13817: Remove legacy SolrCache implementations. 2019-11-14 21:21:44 +01:00
Ishan Chattopadhyaya d9f41f8a5a SOLR-13662: Package manager (CLI) 2019-11-14 18:21:35 +05:30
Istvan Farkas 21a54c4bc7
SOLR-13921: Processing UpdateRequest with delegation token throws NullPointerException 
Signed-off-by: Kevin Risden <krisden@apache.org>
 2019-11-13 11:11:45 -05:00
Chris Hostetter 30e55e2b6e SOLR-13872: Fixed Backup failures due to race conditions in saving/reserving commit points 2019-11-13 08:58:52 -07:00
Andrzej Bialecki 0c3233877b SOLR-13898: Non-atomic use of SolrCache get / put. 2019-11-13 14:43:09 +01:00
noble 59cc299c7e SOLR-13821: Return the size of the file 2019-11-13 18:58:34 +11:00
noble 550c7296b6 SOLR-13822: Added a testcase and a bug fix 2019-11-13 17:42:37 +11:00
noble 11fd8d630a SOLR-13841: Added 'JsonProperty' to forbidden APIs 2019-11-13 15:51:49 +11:00
Chris Hostetter 367fe2f341 SOLR-13870: SolrJmxReporterTest no longer depends on (buggy) getNextAvailablePort() 2019-11-12 09:42:05 -07:00
Noble Paul 40661489cd
SOLR-13822: Ref guide and error handling 
SOLR-13822: Ref guide and error handling for package loader, package store
 2019-11-12 16:45:04 +11:00
noble 7a207a9353 SOLR-13822: Missing package-info files 2019-11-08 14:46:53 +11:00
Houston Putman 5c7215fabf SOLR-13844: Fixing tests related to ShardTerms recovery removal (#995) 2019-11-06 17:24:55 +00:00
Andrzej Bialecki 720fb94113 SOLR-13882: Collections API COLSTATUS does not check live_nodes when reporting replica's status. 2019-11-05 14:06:05 +01:00
Andrzej Bialecki e58a90f18d SOLR-13858: Clean up SolrInfoBean / SolrMetricProducer API. 2019-11-04 15:31:43 +01:00
Jason Gerlowski de28c67627 SOLR-13762: Allow BinaryField use with non-binary wt's. 
Closes #883
 2019-11-04 08:43:04 -05:00
Noble Paul b5f5b0f2bc
SOLR-13841: removed jackson dependencies from SolrJ and provided a mapping to our annotation (#992) 
Provide mappings for jackson annotation @JsonProperty to use Jackson deserializer
 2019-11-04 16:38:21 +11:00
Tomas Fernandez Lobbe 5c6a299eff SOLR-13207: Fix tests 2019-11-01 15:53:38 -07:00
Chris Hennick b17d630e50 SOLR-13207: Handle query errors in calculateMinShouldMatch (#978) 
Traps error that arises when the < operator is used at the end of a query field.
Also handles NumberFormatException when the operand isn't a number.
 2019-11-01 10:40:56 -07:00
Houston Putman 6e1ecd1218 SOLR-13844: Remove replica recovery terms with the replica term (#951) 2019-11-01 14:34:53 +00:00
noble 53b002f59d SOLR-13822: FIle leakes fixed 2019-11-01 16:33:20 +11:00
noble 22b681755c SOLR-13822: Disbaled on windows till further investigation 2019-10-30 08:27:23 +11:00
Munendra S N 24134cf9b1 SOLR-13823: fix ClassCastEx in group.query when score is requested 
* This makes sures score computed for standalone and distributed
  is same for group.query. This is done by using mainQuery to compute
  scores
 2019-10-29 13:56:03 +05:30
Munendra S N 0a4f6c566e SOLR-13877: fix NPE in expand component 
* This could happen when expand component is not used with collapse
  and matched docs have fewer unique values
 2019-10-29 13:56:03 +05:30
Munendra S N b82b7725e1 SOLR-13783: fix failing tests due to NamedList.toString() change 2019-10-29 13:35:31 +05:30
Houston Putman fa27e476f7 SOLR-13865: Migrate replica routing code to SolrJ (#974) 
* [SOLR-13865] Migrate replica routing code to  solrJ

* Added a CommonTestInjection class.

* Fixing imports.

* Reverted extraneous streaming changes.

* Fix precommit errors.

* Changing name of the RLTManager.

* Splitting up existing tests.

* Updated documentation.

* Added solr/CHANGES.txt entry
 2019-10-28 15:49:21 -07:00
noble 3af4e6adc6 SOLR-13822: Adressing Windows test failures 2019-10-29 06:12:52 +11:00
Chris Hostetter b17a4cb5a9 SOLR-13822: AwaitsFix this test until the file leaks are addressed 2019-10-25 14:44:25 -07:00
Munendra S N 3ef54e4516 SOLR-12393:fix score not returned if expanded docs sorted by non-score 2019-10-24 19:41:14 +05:30
Munendra S N f71e4b210d SOLR-13403: test terms component with point fields on empty index 2019-10-24 10:06:16 +05:30
Tomas Fernandez Lobbe dc9dbd266b
SOLR-13866: Override getSolrMetricsContext in DirectUpdateHandler2 (#971) 2019-10-23 16:13:26 -07:00
Noble Paul 98f08d39aa
SOLR-13822: Isolated Classloading from packages (#957) 
SOLR-13822: A Package management system with the following features. A packages.json in ZK to store
  the configuration, APIs to read/edit them and isolated classloaders to load the classes from
  those packages if the 'class' attribute is prefixed with `<package-name>:`
 2019-10-24 08:55:11 +11:00
David Smiley 3ae8204248 SOLR-13855: DistributedZkUpdateProcessor needs to propagate URP.finish() 
Important since Run URP finish() propagates to updateLog to fsync()!
Closes #969
 2019-10-23 17:49:01 -04:00
Andrzej Bialecki c1174dc0d6 SOLR-13831: Support defining arbitrary autoscaling simulation scenarios. 2019-10-23 20:48:10 +02:00
Tomas Fernandez Lobbe 98cdac82a1
SOLR-13860: Enable back TestTlogReplica (#965) 
* Wait for leader in testBasicLeaderElection

It can take some time (>4 seconds) to elect a new leader, and if the update is attempted immediately it'll fail. Need to either wait for the leader or retry the udpate in case of failure (which is what clients would do)

* Wait for leader to be active in testKillTlogReplica

* Add hack to prevent unrelated failure

* Reduce the time wait time for replica state change

* A more robust attempt to add replicas in the tests

* Wait for replication for 2 times the replication time
 2019-10-23 10:46:36 -07:00
Andrzej Bialecki 1d7cd61575 SOLR-13854: Remove deprecated SolrMetricProducer.initializeMetrics API. 2019-10-22 21:23:48 +02:00
Munendra S N 597241a412 SOLR-13403: disable distrib test for point fields in terms 2019-10-22 10:40:38 +05:30
Mikhail Khludnev afdb80069c SOLR-13824: reject prematurely closed curly bracket in JSON. 2019-10-21 23:25:06 +03:00
Munendra S N 80bca5040a SOLR-9802: fix grouping failure for date fields in solrcloud 
Closes #221
 2019-10-20 15:57:19 +05:30
Noble Paul 831f90fa36
SOLR-13841: Add jackson databind annotations to SolrJ classpath 
SOLR-13841: Add jackson databind annotations to SolrJ classpath
 2019-10-20 10:00:13 +11:00
Munendra S N cabc125eef SOLR-13403: fix NPE in terms for DatePointField 
* This fixes NPE and adds support for DatePointField in terms
  component
 2019-10-18 23:45:57 +05:30
Munendra S N dce0c5953c SOLR-13827: fail on unknown operation in Request Parameters API 2019-10-18 21:08:33 +05:30
Andrzej Bialecki f07998fc23 SOLR-13677: All Metrics Gauges should be unregistered by components that registered them. 2019-10-18 17:15:04 +02:00
Shalin Shekhar Mangar 86a40c1cd5 SOLR-13843: The MOVEREPLICA API ignores replica type and always adds 'nrt' replicas 2019-10-18 14:48:37 +05:30
Chris Hostetter 63e9bcf5d1 SOLR-13741: Harden AuditLoggerIntegrationTest 2019-10-16 16:56:34 -07:00