Commit Graph

7841 Commits

Author SHA1 Message Date
Jan Høydahl 64884be044
SOLR-13672: Zk Status page now parses response from Zookeeper 3.5.5 correctly (#818)
* SOLR-13672: Cloud -> Zk Status page now parses response from Zookeeper 3.5.5 correctly
2019-08-07 09:10:37 +02:00
Chris Hostetter 878d332a0b Harden BasicAuthIntegrationTest w/work around for SOLR-13464 2019-08-06 15:08:26 -07:00
yonik 19ddcfd282 SOLR-13399: ability to use id field for compositeId histogram 2019-08-06 14:10:20 -04:00
Jan Høydahl 7ab12b405d Skip mocking for simple tests 2019-08-06 15:39:21 +02:00
Jan Høydahl 79c13d62d3 Added check for explicit empty line response from Zookeeper 2019-08-06 15:33:08 +02:00
Jan Høydahl 8d0506e962 Add spaces 2019-08-06 15:19:30 +02:00
Jan Høydahl 5ff709d4bd Merge remote-tracking branch 'origin/master' into solr13672-zk
# Conflicts:
#	solr/CHANGES.txt
2019-08-06 15:14:55 +02:00
Chris Hostetter 9e250f7219 Fix incorrect assertions in RulesTest.doIntegrationTest
my previous commit added waitForState calls to doIntegrationTest that forgot to take into account initial repFactor when createShard was called

as a result, the test could only pass if wather was called after a initial leader went live, before other replicas became live

this commit fixes this mistake, and hardens the assertions about the location of those replicas given the rule in use

also adds new expecation that trying to add additional replicas that would violate rule will cause request ot fail
2019-08-05 17:08:28 -07:00
Chris Hostetter a052fb5436 SOLR-13678: Harden CollectionPropsTest.testReadWriteCached to work around removeCollectionPropsWatcher() deadlock bug 2019-08-05 11:49:32 -07:00
Bruno Roustant d97912529d SOLR-11866: QueryElevationComponent match="subset" feature
Closes #780
2019-08-05 11:23:47 +02:00
Munendra S N 84a62a5d87 SOLR-13679:Fix default style of [explain] registered in solrconfig.xml 2019-08-05 10:04:15 +05:30
Diego 751e64651c SOLR-13676: Reduce log verbosity in TestDistributedGrouping (#819)
* SOLR-13676: Reduce log verbosity in TestDistributedGrouping using ignoreException

* Code review

* Remove Assert
2019-08-05 09:27:44 +05:30
yonik b6c26f6c16 SOLR-13399: fix splitByPrefix test 2019-08-03 12:52:35 -04:00
Munendra S N 8c4fde94fe SOLR-12555: use expectThrows() to verify the ex thrown in tests 2019-08-03 13:00:49 +05:30
Chris Hostetter e8418adedb Harden CollectionPropsTest:
These fixes all relate to testWatcher + testMultipleWatchers:
* add additional asserts to the test methods to assert the expected property values are found
* mark Watcher.props volatile to prevent stale read by test thread
* add some randomization to Watcher.props to either come from the onStateChanged() input or
  from an explicit call to ZkStateReader.getCollectionProperties
  - previuosly, for reasons i don't understand, the test only consulted
    ZkStateReader.getCollectionProperties inside the Watcher, and ignored the onStateChanged()
    input
  - now the test validates both
* move all Watcher.triggered access into the existing synchronization blocks to prevent
  waitForTrigger() from returning prematurely due to gaining synch lock _after_
  Watcher.triggered was incremented in onStateChanged(), but _before_ onStateChanged() updated
  Watcher.props
* add detailed logging to provide additional info to help debug any additional jenkins failures
  that might pop up in the future if these fixes aren't sufficient
2019-08-02 17:02:17 -07:00
Boris Pasko 901f381c61
SOLR-6305: Replication from filesysem defaults, not from server defaults
Signed-off-by: Kevin Risden <krisden@apache.org>
2019-08-02 18:43:26 -04:00
Jan Høydahl be7e9df57d Unused import 2019-08-02 15:42:05 +02:00
Jan Høydahl 9548481c8c Fix precommit
Remove errors from each host detail map
Display secureClientPort and server.1, server.2, server.3...
Added test for various failure responses and expected result from multiple nodes
2019-08-02 15:03:40 +02:00
Jan Høydahl 1123afae94 SOLR-13672: Cloud -> Zk Status page now parses response from Zookeeper 3.5.5 correctly 2019-08-02 13:01:20 +02:00
Chris Hostetter ab470a6564 SOLR-13664: Fixed SolrTestCaseJ4.deleteCore() to properly reset the dataDir used by initCore() 2019-08-01 09:15:18 -07:00
noble 15c2fd673a SOLR-13659: Refactor Cache config to lazily load the the class 2019-07-31 19:14:17 +10:00
Noble Paul 4cf6bbefcc
SOLR-13659: Refactor Cache config to lazily load the the class (#813) 2019-07-31 03:50:17 -04:00
Munendra S N cb94eeb491 SOLR-11266: remove content-type override from _default configSet 2019-07-30 10:06:56 +05:30
Munendra S N 9f74cb10d3 SOLR-13643:add Getter/Setter in ResponseBuilder to handle analytic res 2019-07-29 09:48:31 +05:30
Munendra S N 501a91763b SOLR-13656: fix bad mergePolicyFactory test in SolrIndexConfigTest
* use expectThrows to verify the exception and ex message
* remove unused DummyMergePolicy
2019-07-29 09:30:25 +05:30
Chris Hostetter 4050ddc59b Harden RulesTest
* ensure all collections/replicas are active

* use waitForState or waitForActiveCollection before checking rules/snitch to prevent false failures on stale state

* ensure cluster policy is cleared after each test method

Some of these changes should also help ensure we don't get (more) spurious failures due to SOLR-13616
2019-07-26 18:41:06 -07:00
Ishan Chattopadhyaya c20988907f SOLR-13637: Using google common's ImmutableMap instead of carrot's 2019-07-25 19:09:37 -04:00
Jason Gerlowski dc8e9afff9 SOLR-13622: Add fileStream stream-source 2019-07-25 09:13:00 -04:00
noble 100c160017 SOLR-13637: BasicAuthIntegrationTest failures fixed 2019-07-25 04:30:48 -04:00
yonik c0da27173c SOLR-13399: annotate flaky test 2019-07-24 21:58:50 -04:00
noble 85814e262c SOLR-13637: addressing test failures take 2 2019-07-23 12:17:49 -04:00
Andrzej Bialecki d92159b896 SOLR-13558: Allow dynamic resizing of SolrCache-s. 2019-07-23 12:21:21 +02:00
noble 7f04604d56 SOLR-13637: reject duplicate jar updates 2019-07-22 16:23:44 -04:00
noble 2ef0ba3dce SOLR-13637: addressing test failures 2019-07-22 08:33:02 -07:00
Noble Paul 631edee1cb
SOLR-13637 Enable loading of plugins from the corecontainer memclassloader 2019-07-21 12:21:56 -07:00
noble 7d716f1107 SOLR-13565: Precommit errors 2019-07-22 03:31:39 +10:00
Mikhail Khludnev c173c2e863 SOLR-11556: fixing multiple backup repository support. 2019-07-21 13:04:48 +03:00
Munendra S N 96d400f511 SOLR-12870: use StandardCharsets instead of String values
Fixes #469
2019-07-20 10:10:32 +05:30
Noble Paul bd30c3701e
SOLR-13565, SOLR-13553 (#774)
* SOLR-13565: initial commit

* SOLR-13565: updated with testcase

* SOLR-13565: removed unused methods

* SOLR-13565: better logging

* SOLR-13565: disable SSL

* SOLR-13565: more tests

* SOLR-13565: syncing with master

* SOLR-13565: fixing tests

* SOLR-13565: fixing tests

* SOLR-13534: Fix test

Remove buggy 'port roulette' code that can easily fail if OS gives the selected port to a different process just before creating the server

Use jetty's built in support for listining on an OS selected port instead

Also increase timeouts to better account for slow/heavily loaded (ie:jenkins) VMs where SolrCore reloading may take longer then 10 seconds

* SOLR-13565: set proper permission name

* SOLR-13565: syncing with master

* SOLR-13565: syncing with master

* SOLR-13565: removed accidental change

* SOLR-13565: removed accidental change

* SOLR-13565: removed accidental change

* SOLR-13565: more tests

* SOLR-13565: Tests with key signing tests

* SOLR-13565: fixing concurrency issues in tests

* SOLR-13565: add tests with 512 bit RSA

* SOLR-13565: fixing concurrency issues

* SOLR-13565: remove unused code
2019-07-20 14:20:32 +10:00
yonik c5cabf1e03 SOLR-13399: SPLITSHARD splitByPrefix for compositeId 2019-07-19 11:35:01 -04:00
Gus Heck a7435d9e6e SOLR-13375 - fix test. Can't shuffle the to random collections at
this point in the test since the collections available are changing due
to deletions and we might try to communicate with a collection
that was (correctly) deleted.
2019-07-19 10:00:53 -04:00
Christine Poerschke 5e3947091a SOLR-13585: Factor out SearchGroupsResultTransformer.[de]serializeOneSearchGroup methods. (Christine Poerschke, Diego Ceccarelli) 2019-07-18 14:23:32 +01:00
Munendra S N 1fc416404c SOLR-13206: Fix AIOOBE when group.facet is specified with group.query
group.facet is supported only for group.field. When group.facet is
used with group.query, then return proper error code
2019-07-18 11:08:17 +05:30
Munendra S N 4b75776f5a SOLR-13634:move ResponseBuilderTest to same package as ResponseBuilder 2019-07-17 22:38:35 +05:30
Munendra S N 1ecd02deb5 SOLR-12368: inplace update for field that doesn't yet exist in any doc
If the field is non-stored, non-indexed and docvalue enabled numeric field
then inplace update can be done. previously, lucene didn't support
docvalue update for field that is not yet present in indexWriter but
LUCENE-8316 added support for this.
This adds support to update field which satisfies inplace conditions
but which doesn't yet exist in any docs
2019-07-17 21:45:15 +05:30
Chris Hostetter 19c78ddf98 SOLR-13534: Fix test
Remove buggy 'port roulette' code that can easily fail if OS gives the selected port to a different process just before creating the server

Use jetty's built in support for listining on an OS selected port instead

Also increase timeouts to better account for slow/heavily loaded (ie:jenkins) VMs where SolrCore reloading may take longer then 10 seconds
2019-07-16 14:34:23 -07:00
noble 2d357c960c SOLR-13534: Make the test more robust 2019-07-16 11:53:13 +10:00
Gus Heck c97551cc36 SOLR-13375 - 2 dimensional routed aliases 2019-07-15 09:57:13 -04:00
Ishan Chattopadhyaya 26ede632e6 SOLR-13619: Kerberos plugin to forward original user principal 2019-07-15 15:10:07 +05:30
Ishan Chattopadhyaya 7e0af71c1e SOLR-13472: Forwarded requests should skip authorization on receiving nodes 2019-07-15 14:43:41 +05:30
Chris Hostetter 7ddba3b712 Harden DeleteReplicaTest
* tighten assertions related to type of watcher that should be removed

* use waitForActiveCollection before deleting collections to work around SOLR-13616 and/or SOLR-13627
2019-07-13 08:02:49 -07:00
Chris Hostetter f85a78c441 SOLR-13532: Fix http timeout and error logging bugs in RecoveryStrategy 2019-07-11 14:04:46 -07:00
Chris Hostetter 8a277cab7d Harden TestPolicyCloud
- ensure all collections/replicas are active

- tighten assertions around expected replica locations

- eliminate some redundent code

These changes should also help ensure we don't get (more) spurious failures due to SOLR-13616
2019-07-10 17:16:59 -07:00
Munendra S N 8322ea55f4 SOLR-11263: add test for payload func with undefined field
Payload func with undefined used to throw NPE. In SOLR-11610, this
was fixed to return proper error but there are no tests to verify
changed the behavior.
This add simple test to verify error code and error message
2019-07-10 10:17:55 +05:30
Christine Poerschke bf9a7e2626 Fix two 'against' typos. 2019-07-09 10:56:49 +01:00
Andrzej Bialecki dd4813d5b8 SOLR-13583: Return 400 Bad Request instead of 500 Server Error when a complex
alias is found but a simple alias was expected.
2019-07-05 09:19:32 +02:00
S N Munendra 5f1d342a96 SOLR-13538: Fix classcastEx in TrieDateField for atomic updates (#764)
SOLR-13538: toNativeType () TrieDate & EnumField do not handle CharSequence properly
2019-07-05 14:43:12 +10:00
Anshum Gupta b7090d9c25
SOLR-13507: Remove support for addr parameter from the /solr/admin/zookeeper endpoint. (#759) 2019-07-03 10:50:01 -07:00
Munendra S N 96860eb181 SOLR-13596: remove deprecated groupSpec methods 2019-07-03 20:55:56 +05:30
Tomoko Uchida 2e3e6c5944 SOLR-13602: Update _default schema for unittests. 2019-07-04 00:08:13 +09:00
Andrzej Bialecki 5897787291 SOLR-13003: Query Result Cache does not honour maxRamBytes parameter. 2019-07-03 17:03:43 +02:00
Munendra S N e3d247f288 SOLR-13603: remove deprecated groupSpec methods usage
This is precursor to removing deprecated methods
2019-07-03 19:33:08 +05:30
Andrzej Bialecki 717afb11fc SOLR-13583: Impossible to delete a collection with the same name as an existing alias. 2019-07-03 15:52:36 +02:00
David Smiley 325824cd39 SOLR-13158: DIH: Add System property toggle for use of dataConfig param 2019-07-02 23:59:39 -04:00
Chris Hostetter b4a602f6b2 SOLR-13599: additional 'checkpoint' logging to try and help diagnose strange failures 2019-07-02 14:52:13 -07:00
Atri Sharma f686167e71 LUCENE-8857: Introduce Custom Tiebreakers in TopDocs#merge (#757)
This commit introduces custom tiebreakers which allows users to
specify custom tiebreakers when ordering hits to return. A
default tiebreaker is introduced for tie breaking on shard index
first and then docID.
2019-07-02 20:35:18 +02:00
Munendra S N 48b026d5ee SOLR-13404: Fix NPE when group=true and no group.field is present
* This was introduced in SOLR-12249
2019-07-02 10:27:54 +05:30
Munendra S N cfd22cd493 SOLR-13404: support group.query in multishard env with group.main=true
group.query after execution forms QueryCommandResult. In case of
group.main=true or group.format=simple, QueryCommandResult was not
consumed in EndResultTransformer. Also, MainEndResultTransformer assumed
that always group.field would be specified. When group.field not specified
it failed with AIOOBE. After adding suppport for QueryCommandResult in
EndResultTransformers and handling AIOOBE, group.query started giving results

Working on tests exposed few other issues. Results differed b/w standalone
& distributed mode.
* One of the reason is that TopGroupShardResponseProcessor doesn't consider correct
  limit and offset when group format is simple. In case of simple, start and rows should be used
  as limit and offset instead of group.limit and group.offset.
* Secondly, In distributed second phase grouping, computing docsToCollect didn't consider
  group response format. This issue is again similar to above issue
* offset(group.offset or start) not being considered during TopDocs#merge caused
  different results. The fix was to use to offset in merge process
* group.offset doesn't support negative values but there is no checks on the value.
  In case of negative values AIOOBE. Now, checks are added for negative values and
  returns proper error message(this change is for both standalone and distrbuted).
  Validation is done only in case of group.format=grouped as that is only case when
  group.offset is consumed.

Fixing above issues resolved the differences b/w standalone and distributed mode.
2019-07-02 08:11:13 +05:30
Munendra S N 0e877aac34 SOLR-12554: Expose IndexWriterConfig's ramPerThreadHardLimitMB
* When ramPerThreadHardLimitMB is not specified, then Lucene's
  default value 1945 is used. The specified value should be
  greater than 0 and less than 2048MB
2019-07-01 22:42:19 +05:30
Jason Gerlowski 8242e6ce1d SOLR-13539: Fix mv update of UUID, enum, bool and binary fields
Co-Authored-By: Thomas Wockinger
2019-07-01 08:53:54 -04:00
Mikhail Khludnev 2fdb4dd7d4 SOLR-13577: wait jetty to stop as @hossman advised. 2019-06-30 09:45:35 +03:00
Munendra S N cfd6e1adfa SOLR-12364: add test cases for edismax boost
* This adds tests for bf and boosts
* Use expectThrows in edismax tests to verify exception
2019-06-29 22:18:02 +05:30
Munendra S N 9228cefbc8 SOLR-9409: improve error message on unsupported types in collapsing
* Improve error message when collapsing is not supported on given
  fieldtype
* Return 400 error code when unsupported value are passed for max,min
  or in case of syntax error
2019-06-29 21:37:09 +05:30
Chris Hostetter 8b72e91df7 SOLR-13580: update test to account for different versions of java using different locale specific numeric formatting characters 2019-06-28 12:10:54 -07:00
Christine Poerschke a49ddbaf11 SOLR-13576: Factor out a TopGroupsShardResponseProcessor.fillResultIds method. (Christine Poerschke, Diego Ceccarelli) 2019-06-28 18:38:41 +01:00
Christine Poerschke 5d2569eab1 SOLR-13280: Strengthen ScheduledTrigger's preferredOperation parameter validation. 2019-06-28 18:35:34 +01:00
Christine Poerschke 993c051a0e SOLR-13279: Clarify ScheduledTrigger's "every parameter missing" error response. 2019-06-28 18:32:25 +01:00
Mikhail Khludnev d54555c757 SOLR-13577: spin until slave got a replication failure while master is down. 2019-06-28 17:28:48 +03:00
Chris Hostetter aaf20aefa4 SOLR-12988: SSLTestConfig has been changed to throw AssumptionViolatedException when tests/seeds request SSL but the JVM appears to be an OpenJDK version known to have SSL bugs
SOLR-13574: Add CHANGES entry that was overlooked
2019-06-27 15:51:20 -07:00
Chris Hostetter 7e57d3a9d9 SOLR-13574: Fix many test and test-framework classes to not fail on After/AfterClass cleanup if assumptions fail in Before/BeforeClass setup 2019-06-27 10:28:06 -07:00
Mikhail Khludnev 48fb45e614 SOLR-13577: retrying TestReplicationHandler.doTestIndexFetchOnMasterRestart. 2019-06-26 14:16:22 +03:00
Jan Høydahl b54126169b SOLR-13569: AdminUI visual indication of prod/test/dev environment 2019-06-26 12:09:02 +02:00
Alan Woodward 53f56fb7ad LUCENE-8811: Move max clause checks to IndexSearcher 2019-06-26 10:55:55 +01:00
Chris Hostetter 583c219183 SOLR-13580: add assumeThat calls to ParsingFieldUpdateProcessorsTest to skip test methods impacted by java 13-ea bug in NumberFormat.parse() 2019-06-25 16:26:03 -07:00
Andrzej Bialecki 4d1058db6e SOLR-13566: REINDEXCOLLECTION does not work with (basic) authentication. 2019-06-25 16:54:27 +02:00
Noble Paul 742c80550c reformatting 2019-06-25 17:02:17 +10:00
Mikhail Khludnev 4589bbe47b SOLR-12866: Turn TestHdfsCloudBackupRestore ON. No changes yet. 2019-06-25 08:49:26 +03:00
Munendra S N e0e5296abc SOLR-12979: fail fast when collapse field is non-docValued & non-uninvertible
* Improve error message when collapse field is non-docValued & non-uninvertible.
  Return error code 400 instead of 500 in the above case
2019-06-25 09:50:41 +05:30
David Smiley 85ec39d931 SOLR-13367: Range queries will now highlight in hl.method=unified mode.
Lucene MatchesUtils.disjunction method for disjunction over
 BytesRefIterator terms.
2019-06-25 00:10:08 -04:00
Chris Hostetter 689fa583a0 Revert "SOLR-12988: SSLTestConfig has been changed to throw AssumptionViolatedException when tests/seeds request SSL but the JVM appears to be an OpenJDK version known to have SSL bugs"
This reverts commit 6d6f14d391.

Reason for revert: after doing more testing I realized there are tests I overlooked which can (with randomized SSL usage) trigger NullPointerException
(or other related failures) in After/AfterClass due assumptions about cleanup that isn't actaully neccessary due to the AssumptionFailure
that may occur during Before/BeforeClass
2019-06-24 15:42:23 -07:00
Chris Hostetter 6d6f14d391 SOLR-12988: SSLTestConfig has been changed to throw AssumptionViolatedException when tests/seeds request SSL but the JVM appears to be an OpenJDK version known to have SSL bugs 2019-06-24 15:02:18 -07:00
Munendra S N 9cfba4a728 SOLR-13187: Fix NPE when invalid qParser is specified
* When non-existent qParser is specified return 400 error code
* SOLR-13197: Fix NPE when createQParser is called in StatsField
2019-06-24 22:38:39 +05:30
Munendra S N 54aff4ac7d SOLR-12127: set op with null or empty list val should be atomic update
* Inplace update supports set and inc operation but when null or
  empty list is specified with set op, then it should always be treated
  as atomic update since this case is equivalent to removing field
  from the document
2019-06-24 14:50:51 +05:30
Tomoko Uchida 98c85a0e1a LUCENE-8778: Define analyzer SPI names as static final fields and document the names in all analysis components. This also changes SPI loader to detect service names via the static NAME fields instead of class names. 2019-06-22 10:46:37 +09:00
David Smiley 54cc70127b LUCENE-8848 LUCENE-7757 LUCENE-8492: UnifiedHighlighter.hasUnrecognizedQuery
The UH now detects that parts of the query are not understood by it.
When found, it highlights more safely/reliably.
Fixes compatibility with complex and surround query parsers.
2019-06-21 17:05:56 -04:00
David Smiley 54c5b8a7f1 SOLR-13523: Fix Atomic Updates when _nest_path_ is declared.
Change the most common test schema to include this field so we better
test our code paths.
2019-06-20 11:59:22 -04:00
Gus Heck 5d47875184 SOLR-13419 - Better infix for TRA collection names 2019-06-20 09:47:52 -04:00
Cao Manh Dat e3752e87d0 SOLR-12988: Revert changes 2019-06-19 21:07:38 +01:00
Cao Manh Dat 91944a468e SOLR-12988: Skip running tests with SSL on Java 11 to 11.0.2 2019-06-19 10:43:17 +01:00
Noble Paul ed42d36c7b SOLR-13329: changed the put:on-each to put: on-each-node 2019-06-19 00:16:57 +10:00