Commit Graph

13260 Commits

Author SHA1 Message Date
Chris Hostetter 12495ac26c Harden StreamDecoratorTest
remove flakey dependency on sleep (to wait for cache expiration) w/explicit instruction to ignore cache

sleep is not garunteed to sleep the exact amount (based on limitations of the system clock)

(cherry picked from commit 24b94b8dac)
2019-07-18 19:40:47 -07:00
Christine Poerschke eb75a60857 SOLR-13585: Factor out SearchGroupsResultTransformer.[de]serializeOneSearchGroup methods. (Christine Poerschke, Diego Ceccarelli) 2019-07-18 14:37:10 +01:00
Munendra S N 241c44a82d SOLR-13206: Fix AIOOBE when group.facet is specified with group.query
group.facet is supported only for group.field. When group.facet is
used with group.query, then return proper error code
2019-07-18 11:10:08 +05:30
Munendra S N 6899e0520e SOLR-13634:move ResponseBuilderTest to same package as ResponseBuilder 2019-07-17 22:53:08 +05:30
Munendra S N 4c11633c03 SOLR-12368: inplace update for field that doesn't yet exist in any doc
If the field is non-stored, non-indexed and docvalue enabled numeric field
then inplace update can be done. previously, lucene didn't support
docvalue update for field that is not yet present in indexWriter but
LUCENE-8316 added support for this.
This adds support to update field which satisfies inplace conditions
but which doesn't yet exist in any docs
2019-07-17 21:48:11 +05:30
Chris Hostetter 4ccef38d48 SOLR-13534: Fix test
Remove buggy 'port roulette' code that can easily fail if OS gives the selected port to a different process just before creating the server

Use jetty's built in support for listining on an OS selected port instead

Also increase timeouts to better account for slow/heavily loaded (ie:jenkins) VMs where SolrCore reloading may take longer then 10 seconds

(cherry picked from commit 19c78ddf98)
2019-07-16 14:34:55 -07:00
Tomoko Uchida b5e8dc3af4
LUCENE-8911: Backport LUCENE-8778 (improved analysis SPI name handling) to 8.x (#782)
This also keeps old names for backwards compatibility on 8.x
2019-07-16 18:22:50 +09:00
noble 2f3451c3b6 SOLR-13534: Make the test more robust 2019-07-16 11:54:12 +10:00
Gus Heck 081e2ef2c0 SOLR-13375 2 dimensional routed aliases 2019-07-15 11:11:24 -04:00
Adrien Grand 2885a11578 LUCENE-8811: Revert on 8.x. 2019-07-15 13:52:43 +02:00
Ishan Chattopadhyaya ee4495f33b SOLR-13619: Kerberos plugin to forward original user principal 2019-07-15 15:13:13 +05:30
Ishan Chattopadhyaya a7a3fab8c8 SOLR-13472: Forwarded requests should skip authorization on receiving nodes 2019-07-15 15:13:04 +05:30
Tomoko Uchida 6504babebd Update solr/CHANGES.txt for SOLR-13588 and SOLR-13602. 2019-07-14 14:52:42 +09:00
Chris Hostetter d91900a4a2 Harden DeleteReplicaTest
* tighten assertions related to type of watcher that should be removed

* use waitForActiveCollection before deleting collections to work around SOLR-13616 and/or SOLR-13627

(cherry picked from commit 7ddba3b712)
2019-07-13 08:03:47 -07:00
Chris Hostetter 4f2d7c2ecd SOLR-13532: Fix http timeout and error logging bugs in RecoveryStrategy
(cherry picked from commit f85a78c441)
2019-07-11 14:05:16 -07:00
Tomoko Uchida 59c7eb92cf LUCENE-8907: Revert LUCENE-8778 and succeeding commits. 2019-07-11 23:19:13 +09:00
iverase 51f4340796 Add next minor version 8.3.0 2019-07-11 12:47:34 +02:00
Christine Poerschke 72d38364f1 Fix couple of solr-ref-guide typos. 2019-07-11 11:30:28 +01:00
David Smiley fb2c513a4c CHANGES.txt: separate improvements to dedicated section 2019-07-10 22:47:57 -04:00
Chris Hostetter 81b2e06ffe Harden TestPolicyCloud
- ensure all collections/replicas are active

- tighten assertions around expected replica locations

- eliminate some redundent code

These changes should also help ensure we don't get (more) spurious failures due to SOLR-13616

(cherry picked from commit 8a277cab7d)
2019-07-10 17:17:28 -07:00
Munendra S N 0752c07c1c SOLR-11263: add test for payload func with undefined field
Payload func with undefined used to throw NPE. In SOLR-11610, this
was fixed to return proper error but there are no tests to verify
changed the behavior.
This add simple test to verify error code and error message
2019-07-10 10:42:56 +05:30
Christine Poerschke 439d43056c Fix two 'against' typos. 2019-07-09 11:14:59 +01:00
Chris Hostetter 4fd1850d2e SOLR-13599: additional 'checkpoint' logging to try and help diagnose strange failures
(cherry picked from commit b4a602f6b2)
2019-07-08 08:42:07 -07:00
Anshum Gupta 5d3a84fcd0
SOLR-13507: Remove support for addr parameter from the /solr/admin/zookeeper endpoint. (#759) (#766) 2019-07-05 10:15:13 -07:00
Andrzej Bialecki e616ed49a6 SOLR-13583: Return 400 Bad Request instead of 500 Server Error when a complex
alias is found but a simple alias was expected.
2019-07-05 09:22:00 +02:00
Noble Paul cb1b86b80a SOLR-13538: toNativeType () TrieDate & EnumField do not handle CharSequence properly 2019-07-05 14:50:13 +10:00
S N Munendra 7ce347c573 SOLR-13538: Fix classcastEx in TrieDateField for atomic updates (#764)
SOLR-13538: toNativeType () TrieDate & EnumField do not handle CharSequence properly
2019-07-05 14:49:59 +10:00
Andrzej Bialecki bf1d14539c SOLR-13003: Fix WrapperModel method delegation. 2019-07-03 20:18:27 +02:00
Andrzej Bialecki 9d52e5be3b SOLR-13003: Query Result Cache does not honour maxRamBytes parameter. 2019-07-03 18:27:21 +02:00
Tomoko Uchida a471ece05b SOLR-13602: Update _default schema for unittests. 2019-07-04 00:10:30 +09:00
Munendra S N fd93b43cf9 SOLR-13603: remove deprecated groupSpec methods usage
This is precursor to removing deprecated methods
2019-07-03 19:34:11 +05:30
Tomoko Uchida d586c44a33 SOLR-13588: Document Estonian analyzer in Solr Ref Guide 2019-07-03 22:04:47 +09:00
Tomoko Uchida bb074f6a8a SOLR-13602: Add a field type for Estonian language to default managed_schema 2019-07-03 21:00:43 +09:00
Andrzej Bialecki 30a5b2cd87 SOLR-13583: Impossible to delete a collection with the same name as an existing alias. 2019-07-03 13:36:01 +02:00
David Smiley 1c1d77a791 SOLR-13158: DIH: Add System property toggle for use of dataConfig param
(cherry picked from commit 325824cd39)
2019-07-03 00:03:29 -04:00
Joel Bernstein 240a94a3e3 SOLR-13589: Update CHANGES.txt 2019-07-02 08:56:55 -04:00
Munendra S N 00d931aaa7 SOLR-13404: Fix NPE when group=true and no group.field is present
* This was introduced in SOLR-12249
2019-07-02 10:31:32 +05:30
Munendra S N d811f86342 SOLR-13404: support group.query in multishard env with group.main=true
group.query after execution forms QueryCommandResult. In case of
group.main=true or group.format=simple, QueryCommandResult was not
consumed in EndResultTransformer. Also, MainEndResultTransformer assumed
that always group.field would be specified. When group.field not specified
it failed with AIOOBE. After adding suppport for QueryCommandResult in
EndResultTransformers and handling AIOOBE, group.query started giving results

Working on tests exposed few other issues. Results differed b/w standalone
& distributed mode.
* One of the reason is that TopGroupShardResponseProcessor doesn't consider correct
  limit and offset when group format is simple. In case of simple, start and rows should be used
  as limit and offset instead of group.limit and group.offset.
* Secondly, In distributed second phase grouping, computing docsToCollect didn't consider
  group response format. This issue is again similar to above issue
* offset(group.offset or start) not being considered during TopDocs#merge caused
  different results. The fix was to use to offset in merge process
* group.offset doesn't support negative values but there is no checks on the value.
  In case of negative values AIOOBE. Now, checks are added for negative values and
  returns proper error message(this change is for both standalone and distrbuted).
  Validation is done only in case of group.format=grouped as that is only case when
  group.offset is consumed.

Fixing above issues resolved the differences b/w standalone and distributed mode.
2019-07-02 08:24:00 +05:30
Joel Bernstein 36ac878ea7 SOLR-13589: Fix precommit 2019-07-01 21:57:25 -04:00
Joel Bernstein 7e0df16220 SOLR-13589: Add zplot cluster test case 2019-07-01 21:57:09 -04:00
Joel Bernstein c6cc2fd9fd SOLR-13589: Allow zplot to visualize clusters and convex hulls 2019-07-01 21:56:47 -04:00
Munendra S N fc15cd79f7 SOLR-12554: Expose IndexWriterConfig's ramPerThreadHardLimitMB
* When ramPerThreadHardLimitMB is not specified, then Lucene's
  default value 1945 is used. The specified value should be
  greater than 0 and less than 2048MB
2019-07-01 23:47:26 +05:30
Jason Gerlowski 5abafaa4a3 SOLR-13539: Fix mv update of UUID, enum, bool and binary fields
Co-Authored-By: Thomas Wockinger
2019-07-01 08:54:45 -04:00
Jason Gerlowski 60ec073b27 Add missing predefined RBAP perms to ref-guide 2019-06-30 07:29:09 -04:00
Mikhail Khludnev 9b515deb64 SOLR-13577: wait jetty to stop as @hossman advised. 2019-06-30 09:46:46 +03:00
Munendra S N 9e40748486 SOLR-12364: add test cases for edismax boost
* This adds tests for bf and boosts
* Use expectThrows in edismax tests to verify exception
2019-06-29 22:34:03 +05:30
Munendra S N 6c83e39dcc SOLR-9409: improve error message on unsupported types in collapsing
* Improve error message when collapsing is not supported on given
  fieldtype
* Return 400 error code when unsupported value are passed for max,min
  or in case of syntax error
2019-06-29 21:53:43 +05:30
Chris Hostetter 881aabe28a SOLR-13580: update test to account for different versions of java using different locale specific numeric formatting characters
(cherry picked from commit 8b72e91df7)
2019-06-28 12:11:22 -07:00
Christine Poerschke 328db38d71 SOLR-13576: Factor out a TopGroupsShardResponseProcessor.fillResultIds method. (Christine Poerschke, Diego Ceccarelli) 2019-06-28 19:00:08 +01:00
Christine Poerschke 07cf48816f SOLR-13280: Strengthen ScheduledTrigger's preferredOperation parameter validation. 2019-06-28 19:00:08 +01:00
Christine Poerschke 785937d987 SOLR-13279: Clarify ScheduledTrigger's "every parameter missing" error response. 2019-06-28 19:00:08 +01:00
Mikhail Khludnev d2acaff578 SOLR-13577: spin until slave got a replication failure while master is down. 2019-06-28 17:54:03 +03:00
Chris Hostetter 01b303c2e5 SOLR-12988: SSLTestConfig has been changed to throw AssumptionViolatedException when tests/seeds request SSL but the JVM appears to be an OpenJDK version known to have SSL bugs
SOLR-13574: Add CHANGES entry that was overlooked
(cherry picked from commit aaf20aefa4)
2019-06-27 15:52:22 -07:00
Chris Hostetter 8db2fdfa91 SOLR-13574: Fix many test and test-framework classes to not fail on After/AfterClass cleanup if assumptions fail in Before/BeforeClass setup
(cherry picked from commit 7e57d3a9d9)

Conflicts:
	solr/core/src/test/org/apache/solr/cloud/CleanupOldIndexTest.java
2019-06-27 10:39:24 -07:00
Mikhail Khludnev f9e8b8cd0b SOLR-13577: retrying TestReplicationHandler.doTestIndexFetchOnMasterRestart. 2019-06-26 14:17:53 +03:00
Jan Høydahl 2ef43ce78a SOLR-13569: AdminUI visual indication of prod/test/dev environment
(cherry picked from commit b54126169b)
2019-06-26 12:10:39 +02:00
Alan Woodward fa3bf88783 LUCENE-8811: Move max clause checks to IndexSearcher 2019-06-26 10:56:00 +01:00
Chris Hostetter eeed1827d8 SOLR-13580: add assumeThat calls to ParsingFieldUpdateProcessorsTest to skip test methods impacted by java 13-ea bug in NumberFormat.parse()
(cherry picked from commit 583c219183)
2019-06-25 16:26:24 -07:00
Andrzej Bialecki da6e6fd559 SOLR-13566: REINDEXCOLLECTION does not work with (basic) authentication. 2019-06-25 16:54:56 +02:00
Christine Poerschke ff14a17711 Fix op[t]ional typo in json-facet-api.adoc file. 2019-06-25 11:29:10 +01:00
Noble Paul 8199ad48b5 reformatting 2019-06-25 17:07:17 +10:00
Mikhail Khludnev e7fea2899d SOLR-12866: Turn TestHdfsCloudBackupRestore ON. No changes yet. 2019-06-25 08:55:15 +03:00
Munendra S N 438364ab94 SOLR-12979: fail fast when collapse field is non-docValued & non-uninvertible
* Improve error message when collapse field is non-docValued & non-uninvertible.
  Return error code 400 instead of 500 in the above case
2019-06-25 10:04:11 +05:30
David Smiley 5259e964b5 SOLR-13367: Range queries will now highlight in hl.method=unified mode.
Lucene MatchesUtils.disjunction method for disjunction over
 BytesRefIterator terms.
2019-06-25 00:11:12 -04:00
Munendra S N 3ef5c0ee74 SOLR-13187: Fix NPE when invalid qParser is specified
* When non-existent qParser is specified return 400 error code
* SOLR-13197: Fix NPE when createQParser is called in StatsField
2019-06-24 22:58:58 +05:30
Munendra S N cf6c81c26b SOLR-12127: set op with null or empty list val should be atomic update
* Inplace update supports set and inc operation but when null or
  empty list is specified with set op, then it should always be treated
  as atomic update since this case is equivalent to removing field
  from the document
2019-06-24 14:54:48 +05:30
Tomoko Uchida 12e3451fb8 LUCENE-8778: Define analyzer SPI names as static final fields and document the names in all analysis components. This also changes SPI loader to detect service names via the static NAME fields instead of class names. 2019-06-22 20:37:09 +09:00
David Smiley 2d60b69636 SOLR-13545: Fix for Java 8 (no var) 2019-06-21 18:12:21 -04:00
David Smiley df4ebaf030 LUCENE-8848 LUCENE-7757 LUCENE-8492: UnifiedHighlighter.hasUnrecognizedQuery
The UH now detects that parts of the query are not understood by it.
When found, it highlights more safely/reliably.
Fixes compatibility with complex and surround query parsers.

(cherry picked from commit 54cc70127b)
2019-06-21 17:12:50 -04:00
Mikhail Khludnev fbb64cf16a SOLR-13545: ContentStreamUpdateRequest to close file. 2019-06-21 23:40:26 +03:00
epugh 759770c9ab highlight select * not supported 2019-06-21 07:24:46 -04:00
Chris Hostetter 456bc4dbf9 SOLR-12988: Fix Revert
an (erroneous) assigment to useSsl was left in the constructor after the (intended) conditional assigment, rendering the conditional logic useless

(cherry picked from commit c8c2f2f25b)
2019-06-20 16:05:11 -07:00
Gus Heck 45b000e7ae SOLR-13419 - Better infix for TRA collection names 2019-06-20 14:32:14 -04:00
David Smiley 0d51dd06ee SOLR-13523: Fix Atomic Updates when _nest_path_ is declared.
Change the most common test schema to include this field so we better
test our code paths.
2019-06-20 12:00:55 -04:00
Joel Bernstein 1c27c47355 SOLR-10291: Updates CHANGES.txt 2019-06-19 20:58:45 -04:00
Joel Bernstein f5a39b5d08 SOLR-10291: Add match Stream Evaluator to support regex matching 2019-06-19 19:46:34 -04:00
Cao Manh Dat 150e4f9863 SOLR-12988: Revert changes 2019-06-19 21:08:01 +01:00
Joel Bernstein cf8ac4dbcf SOLR-13560: Update CHANGES.txt 2019-06-19 09:58:39 -04:00
Cao Manh Dat 64e3cc1789 SOLR-12988: Skip running tests with SSL on Java 11 to 11.0.2 2019-06-19 10:44:43 +01:00
Joel Bernstein d82fe011bf SOLR-13560: Fix precommit 2019-06-18 22:35:32 -04:00
Joel Bernstein ecd702bf4a SOLR-13560: Add isNull and notNull Stream Evaluators 2019-06-18 22:35:17 -04:00
Noble Paul 61292c90ed syntax error 2019-06-19 12:31:47 +10:00
Noble Paul d12a800467 typo 2019-06-19 12:31:33 +10:00
Noble Paul 0623e1275e typo 2019-06-19 12:31:14 +10:00
Noble Paul 545b61ca23 SOLR-13329: changed the put:on-each to put: on-each-node 2019-06-19 01:03:32 +10:00
Cao Manh Dat 968830a2be SOLR-12988: Avoid using TLSv1.3 for HttpClient 2019-06-18 13:17:51 +01:00
Daniel Collins 07023aea1a SOLR-13434: Fix opentracing mock dependency for Solr core tests 2019-06-18 11:42:42 +01:00
Chris Hostetter 29e060c6f9 eliminate CPU hogging spin-loops in OverseerTest
this test already uses waitForState (frequently via verifyReplicaStatus) so there is no reason to include CPU/network/ZK intensive infinite loop checks looking for udpated cluster state

(cherry picked from commit 3030ea9d94)
2019-06-17 15:55:20 -07:00
Chris Hostetter 592d10d7ce SOLR-13490: fix TestWaitForStateWithJettyShutdowns to use correct (randomized) JettyConfig
(cherry picked from commit 7eb8703df6)
2019-06-17 15:34:24 -07:00
Chris Hostetter 2f2333a781 SOLR-13490: Fix CollectionStateWatcher/CollectionStatePredicate based APIs in ZkStateReader and CloudSolrClient to be triggered on liveNode changes.
Also add Predicate<DocCollection> equivilents for callers that don't care about liveNodes.

(cherry picked from commit 5a974860fa)
2019-06-17 10:00:05 -07:00
Noble Paul a7af74f0c4 SOLR-13347: moved to "New Features" 2019-06-17 17:01:24 +10:00
Noble Paul 0c529cb968 SOLR-13534 : Dynamic loading to support loading jars from a URL 2019-06-17 17:00:38 +10:00
Noble Paul 562c462ee3 SOLR-13534: Dynamic loading of jars from a remote url (#712)
* SOLR-13534 : Dynamic loading to support loading jars from a URL
2019-06-17 17:00:26 +10:00
Ishan Chattopadhyaya 4c11ef3367 SOLR-13434: Fixing documentation regarding samplePercentage clusterprop 2019-06-16 22:53:08 +05:30
Joel Bernstein d58b8b7590 SOLR-13552: Update CHANGES.txt 2019-06-15 14:32:42 -04:00
Joel Bernstein 57c22defb7 SOLR-13552: Add recNum Stream Evaluator 2019-06-15 13:55:37 -04:00
Joel Bernstein 3bc719cfec SOLR-13550: Update CHANGES.txt 2019-06-14 19:29:02 -04:00
Gus Heck 6cf6ecc44f SOLR-13551 Minor fix in aliases.adoc
(cherry picked from commit 4ba4444154)
2019-06-14 18:12:00 -04:00
Joel Bernstein 28bfe7903e SOLR-13550: Allow zplot to automatically create the x axis 2019-06-14 17:51:18 -04:00
Gus Heck 2009c81374 SOLR-13420 Routed Aliases now use collection properties instead of core properties 2019-06-14 15:44:36 -04:00