Commit Graph

12499 Commits

Author SHA1 Message Date
Noble Paul eb359ca079 SOLR-12023: Autoscaling policy engine shuffles replicas needlessly 2018-11-04 19:23:56 +11:00
Jason Gerlowski f669a1fb0e SOLR-12555: Use `expectThrows` for expected exceptions
This commit replaces the `try { doX(); fail(); }` pattern with the
`expectThrows` test helper, which was created for this purpose.

This commit makes these changes in the core package: `o.a.solr.search`.

Closes #464
2018-11-03 10:48:16 -04:00
Chris Hostetter c5ff4a4444 SOLR-12954: fix facet.pivot refinement bugs when using facet.sort=index and facet.mincount>1 2018-11-02 20:32:32 -07:00
Chris Hostetter 1e0e8d45e5 SOLR-7804: remove problematic assertions on lossy stats.field values that aren't fundemental to the purpose of the test anyway 2018-11-01 22:03:20 -07:00
Gus Heck 23595e5cc4 Supress an IDE warning with an annotation, and verify my commit karma 2018-11-01 21:27:16 -04:00
Tim Underwood cf445ba549 SOLR-12882: Eliminate excessive lambda allocation in json facet FacetFieldProcessorByHashDV.collectValFirstPhase 2018-11-01 15:05:16 -04:00
Chris Hostetter 05f72a77ef SOLR-12946: tighten up request/expectations in test
This should prevent some non-reproducible failures where (i think) the problem was inconsistnet background merges between collections being compared, resulting in facet counts (of 0) for terms that weren't in equivilent (merged) indexes.

since the purpose of the test has nothing to do with mincount, force facet.mincount=0 and be more exact about how many terms we expect (in case the root problem lies somewhere else, be more assertive about finding it)
2018-10-31 15:33:39 -07:00
Andrzej Bialecki 3ed64375ef SOLR-12942: Add an option in IndexSizeTrigger to select the split shard method. 2018-10-31 18:47:34 +01:00
Joel Bernstein 914c431987 SOLR-12913: Add recip and expand percentile docs 2018-10-31 08:48:04 -04:00
Joel Bernstein 856e28d8cf SOLR-11572: Add recip Stream Evaluator to support reciprocal transformations 2018-10-30 09:42:24 -04:00
Mikhail Khludnev 5aa8ad5b14 SOLR-12875: AIOOBE fix when unique()/uniqueBlock() is used with DVHASH method in json.facet 2018-10-30 10:56:34 +03:00
Joel Bernstein ac1925045d SOLR-12936: Allow percentiles Stream Evaluator to accept an array of percentiles to calculate 2018-10-29 16:29:04 -04:00
Joel Bernstein e618e831d3 SOLR-12935: Suppress SSL for StreamExpressionTest and StreamDecoratorTest 2018-10-29 13:49:31 -04:00
Steve Rowe c7c7b00ff9 SOLR-12861: In the upgrade note, specify the Solr version in which RAMDirectory will be removed. 2018-10-29 08:44:59 -04:00
Steve Rowe d362439e27 SOLR-12861: Add Solr factory for new ByteBuffersDirectory 2018-10-29 08:23:14 -04:00
Joel Bernstein 5fc4d516b1 SOLR-12862: Update CHANGES.txt 2018-10-28 17:08:26 -04:00
Joel Bernstein 416cc163ba SOLR-12840: Update CHANGES.txt 2018-10-28 14:26:57 -04:00
Joel Bernstein f8ffc1afd6 SOLR-12811: Update CHANGES.txt 2018-10-28 13:47:12 -04:00
Joel Bernstein 7a63e13a3b SOLR-11907: Update CHANGES.txt 2018-10-28 13:42:29 -04:00
Joel Bernstein 1abc38b40e SOLR-12828: Update CHANGES.txt 2018-10-28 13:30:43 -04:00
Noble Paul a298802516 SOLR-12868: test was making wrong assumption 2018-10-27 11:11:54 +11:00
Joel Bernstein 0c8675dccc SOLR-12913: RefGuide formatting 2018-10-26 13:41:09 -04:00
Joel Bernstein 4821b30598 SOLR-12913: RefGuide revisions 2018-10-26 13:31:53 -04:00
Marvin Bredal Lillehaug 6c419454a2 SOLR-7557: Fix parsing of child documents using queryAndStreamResponse 2018-10-26 14:59:31 +02:00
Noble Paul f33be7a172 SOLR-12868: Request forwarding for v2 API is broken 2018-10-26 12:50:45 +11:00
Cassandra Targett 8d10939349 SOLR-12423: fix Tika version in CHANGES 2018-10-25 11:56:19 -05:00
Cassandra Targett 93ccdce57c SOLR-5004: put param names and values in monospace 2018-10-25 11:06:25 -05:00
Joel Bernstein 7952cec99a SOLR-12913: Streaming Expressions / Math Expressions docs for 7.6 release 2018-10-25 09:17:25 -04:00
Tommaso Teofili 26e14986af SOLR-12879 - added missing test for min_hash qp to QueryEqualityTest 2018-10-25 09:57:16 +02:00
Varun Thacker 71988c756b SOLR-12793: Move TestCloudJSONFacetJoinDomain amd TestCloudJSONFacetSKG to the facet test package 2018-10-24 13:57:35 -07:00
Cassandra Targett 16ee847663 SOLR-12827: remove monospace in headings; correct formatting for heading level indicator; remove redundant "Example #" in the example titles 2018-10-24 15:04:33 -05:00
Cassandra Targett b72f05dac6 SOLR-9317: cleanup a couple of typos; add some description to addreplica examples 2018-10-24 14:41:36 -05:00
Christine Poerschke e62fe45983 SOLR-12772: Correct dotProduct parameters+syntax documentation 2018-10-24 19:49:35 +01:00
Christine Poerschke ab14cc9566 SOLR-9425: fix NullPointerException in TestSolrConfigHandlerConcurrent 2018-10-24 19:30:44 +01:00
Christine Poerschke c277674f0e SOLR-12873: Replace few remaining occurrences of LUCENE_CURRENT with LATEST for luceneMatchVersion. 2018-10-24 19:28:12 +01:00
Christine Poerschke 7fc91deaba SOLR-12905: MultiSolrCloudTestCase now clears static clusterId2cluster in @AfterClass 2018-10-24 19:25:10 +01:00
Christine Poerschke cebf7039ee Fix typo in stream-decorator-reference.adoc file. 2018-10-24 19:22:51 +01:00
Cao Manh Dat e083b1501e Add log.warn when a replica become leader after timeout 2018-10-24 08:56:01 +07:00
David Smiley 3e89b7a771 SOLR-12754: New hl.weightMatches for UnifiedHighlighter WEIGHT_MATCHES
(defaults to true in master/8)
2018-10-23 13:28:10 -04:00
Tommaso Teofili 2e757f6c25 SOLR-12879 - registered MinHashQParserPlugin to QParserPlugin as min_hash 2018-10-23 09:12:46 +02:00
Tommaso Teofili 9df96d2530 SOLR-12879 - added missing attribution in CHANGES.txt 2018-10-23 09:07:38 +02:00
Cao Manh Dat 7512cd9425 SOLR-11812: Remove LIROnShardRestartTest since the transition from old lir to new lir is no longer supported 2018-10-23 09:58:59 +07:00
noble 576d28f643 SOLR-11522: Moved the _get methods to a separate interafce and keep MapWriter clean 2018-10-23 12:35:23 +11:00
Anshum Gupta d799fd53c7 SOLR-5004: Allow a shard to be split into 'n' sub-shards using the collections API 2018-10-22 15:01:24 -07:00
Joel Bernstein fcaea07f3c SOLR-12829: Add plist (parallel list) Streaming Expression 2018-10-22 15:20:13 -04:00
Christine Poerschke c9776d88f9 Three minor variables.adoc edits. 2018-10-22 17:33:11 +01:00
Noble Paul c31a95d261 SOLR-12846: Added support for "host" variable in autoscaling policy rules 2018-10-23 00:03:59 +11:00
Andrzej Bialecki 8c70811f3a SOLR-12729: Unlock the shard on error. 2018-10-22 11:28:09 +02:00
Noble Paul 5de6332209 SOLR-12892: MapWriter to use CharSequence instead of String 2018-10-22 11:14:41 +11:00
Tommaso Teofili a7c9c9d8ce SOLR-12879 - MinHash query parser 2018-10-20 08:28:02 +02:00
Andrew Lundgren 1a8188d92b SOLR-10981: Support for stream.url or stream.file pointing to gzipped data 2018-10-18 19:53:21 -04:00
David Smiley fd9164801e LUCENE-7875: Moved MultiFields static methods to MultiTerms, FieldInfos and MultiBits.
MultiBits is now public and has getLiveDocs.
2018-10-18 19:49:14 -04:00
Jan Høydahl a3fc31e5d2 Remove unnecessary XML exclusions as Jetty handles these by default (janhoy) 2018-10-18 16:38:52 +02:00
Simon Willnauer 5a4fd86cce LUCENE-8535: Drop out of the box Block-Join highlight support
Highlighter doesn't support ToParent and ToChildBlockJoinQuery out of the
box anymore. In oder to highlight on Block-Join Queries a custom WeightedSpanTermExtractor
should be used.
2018-10-18 14:53:01 +02:00
Jason Gerlowski e6f6f352cf SOLR-12856: Small improvements to SolrJ javadocs 2018-10-17 19:10:56 -04:00
Uwe Schindler 4b2136eb3c SOLR-12874: Java 9+ GC Logging filesize parameter should use a unit
(merge branch 'java9plus_gc_logging_filesize' of https://github.com/tpunder/lucene-solr); this closes #470
2018-10-17 23:24:51 +02:00
Erick Erickson fc886497de SOLR-12423: Upgrade to Tika 1.19.1 when available. Fixes #468 2018-10-17 13:06:09 -04:00
Noble Paul 635d1ea535 SOLR-12740: fixed doc asciidoc errors 2018-10-17 12:16:17 +11:00
Christine Poerschke d2f7272b0e SOLR-12877: avoid NPE in TestUtilizeNode.getReplicaList 2018-10-16 12:54:00 -04:00
Christine Poerschke 15002eba2f SOLR-12877: avoid NPE in TestTlogReplica.testRealTimeGet 2018-10-16 12:52:51 -04:00
Christine Poerschke 95af8d6ac2 SOLR-12876: remove @BadApple from ShardParamsTest.testGetShardsTolerantAsBool 2018-10-16 10:52:51 -04:00
Christine Poerschke 7fa19d2676 SOLR-12876: upon failure report exception message in ShardParamsTest.testGetShardsTolerantAsBool 2018-10-16 10:52:11 -04:00
Noble Paul 761f8aaf79 SOLR-12740: adding a link 2018-10-17 00:22:54 +11:00
Noble Paul f1a30bfb00 SOLR-12792: extract test data into separate files in autoscaling tests 2018-10-16 19:11:08 +11:00
Shalin Shekhar Mangar aa0a5289e6 SOLR-12739: Clear all collections in TestCollectionStateWatchers setup so that the collections created by test methods are spread evenly in the cluster. 2018-10-16 12:14:22 +05:30
Noble Paul 8d3810df54 SOLR-12740: migration docs 2018-10-16 17:38:51 +11:00
Noble Paul 9c7b8564d8 SOLR-12806: use autoscaling policies with strict=false to prioritize node allocation 2018-10-16 16:56:51 +11:00
David Smiley 306065fca8 LUCENE-12357: Update ref guide notes 2018-10-15 23:38:09 -04:00
Tim Underwood 5202a713ba Java 9+ GC Logging filesize parameter should be 20M instead of 20000
JEP 158 (https://openjdk.java.net/jeps/158) says the filesize parameter is the “file size in kb” however that appears to not be the case since when it is set to a value of 20000 you end up with GC logs that are only 20000 bytes in length.  Setting the value to 20M produces the desired result of GC log files that are 20MB in size.
2018-10-15 12:52:40 -07:00
Joel Bernstein 73a413cd85 SOLR-12862: Fix TestLang 2018-10-15 15:47:03 -04:00
Joel Bernstein 6c0fbe5a9d SOLR-12862: Add log10 Stream Evaluator and allow the pow Stream Evaluator to accept a vector of exponents 2018-10-15 15:47:03 -04:00
Christine Poerschke 1ccd555862 Fix couple of typos. 2018-10-15 15:08:17 -04:00
Erick Erickson 6c5df58b5a SOLR-12028: BadApple and AwaitsFix annotations usage 2018-10-14 21:13:33 -04:00
Jason Gerlowski 6d1b2e2f38 SOLR-8808: Add null/empty check to SolrClient.deleteByIds 2018-10-13 22:15:36 -04:00
Christine Poerschke 9c8ffabfe3 SOLR-12780: Add support for Leaky ReLU and TanH activations in contrib/ltr NeuralNetworkModel class.
(Kamuela Lau, Christine Poerschke)
2018-10-12 17:08:35 +01:00
Jason Gerlowski 42ac07d11b SOLR-12565: Add SolrJ snippet to 'Using ZooKeeper to manage config' ref-guide page 2018-10-11 14:30:43 -04:00
Joel Bernstein d48f22c1ad SOLR-12851: Update CHANGES.txt 2018-10-11 11:19:57 -04:00
Joel Bernstein a0bb501772 SOLR-12851: Improvements and fixes to let and select Streaming Expressions 2018-10-11 10:43:57 -04:00
Shalin Shekhar Mangar 971a0e3f4a SOLR-12739: Use legacy assignment in AutoAddReplicasPlanActionTest 2018-10-11 08:58:47 +05:30
Jan Høydahl 80011d669a SOLR-12620: Remove the Admin UI Cloud -> Graph (Radial) view 2018-10-10 21:54:34 +02:00
Shalin Shekhar Mangar 095707d547 SOLR-12739: Remove unused import 2018-10-10 18:18:29 +05:30
Shalin Shekhar Mangar 50d1c7b481 SOLR-12739: Release the policy session as soon as we're done with the computation.
This fixes the CollectionsAPIDistributedZkTest.testCoresAreDistributedAcrossNodes test failures. Due to the various tests for exceptional conditions, there were times where the session was not released causing stale data to remain in the policy session cache.
2018-10-10 17:12:50 +05:30
Shalin Shekhar Mangar 940a7303ee SOLR-12739: Use cluster instead of collection as the key for using legacy assignment. 2018-10-10 16:19:17 +05:30
Shalin Shekhar Mangar 9f34a7c776 SOLR-12739: Fix failures in AutoAddReplicasIntegrationTest and its sub-class.
This test too makes assumptions about how replicas are placed. In the legacy assignment strategy, the replica of a given collection are spread equally across all nodes but with the new policy based strategy, all cores across collections are spread out. Therefore the assumptions in this test were wrong. I've changed this test to use the legacy assignment policy because testing the autoAddReplicas feature doesn't have to depend on new replica assignment strategies. This change also fixes a bug in Assign which used "collection" key instead of "cluster" to figure out which strategy to use.
2018-10-10 15:38:52 +05:30
Shalin Shekhar Mangar a66a7f3197 SOLR-12739: Fix CloudSolrClientTest.testNonRetryableRequests failures.
The testNonRetryableRequests test makes an assumption that a collection's replicas are equally distributed among all nodes but with the policy engine it is not true. Instead the policy engine spreads out the cores belonging to all collections equally among all nodes. This is fixed by only creating the collection needed by tests in this class just-in-time.
2018-10-10 13:12:26 +05:30
Noble Paul 3629e76011 SOLR-12843: precommit errors 2018-10-10 15:38:20 +11:00
Steve Rowe 8d205ecd1c SOLR-12843: fix precommit 2018-10-09 17:42:41 -04:00
Steve Rowe 41e3d07369 SOLR-11812: fix precommit 2018-10-09 17:34:16 -04:00
Steve Rowe 50478ea72d SOLR-11812: fix precommit 2018-10-09 17:27:21 -04:00
Andrzej Bialecki 23e22e6460 SOLR-12729: SplitShardCmd should lock the parent shard to prevent parallel splitting requests. 2018-10-09 21:30:10 +02:00
Noble Paul a52d47a1a5 SOLR-12843: precommit errors 2018-10-09 23:17:09 +11:00
Cao Manh Dat a37a213975 SOLR-11812: Remove backward compatibility of old LIR implementation in 8.0 2018-10-09 16:20:49 +07:00
Shalin Shekhar Mangar 184ed88ecb SOLR-12845: Disable the test until we can add a default policy equivalent to the hard coded legacy assignment rules 2018-10-09 13:54:46 +05:30
Noble Paul b4d9b25f44 SOLR-12843: Implement a MultiContentWriter in SolrJ to post multiple files/payload at once 2018-10-09 17:44:40 +11:00
Shalin Shekhar Mangar dbed8bafe6 SOLR-12739: Autoscaling policy framework is now used as the default strategy to select the nodes on which new replicas or replicas of new collections are created.
Previously, the maxShardsPerNode parameter was not allowed on collections when autoscaling policy was configured. Also if an autoscaling policy was configured then the default was to set an unlimited maxShardsPerNode automatically. Now the maxShardsPerNode parameter is always allowed during collection creation and maxShardsPerNode should be set correctly (if required) regardless of whether autoscaling policies are in effect or not. The default value of maxShardsPerNode continues to be 1 as before. It can be set to -1 during collection creation to fall back to the old behavior of unlimited maxShardsPerNode when using autoscaling policy. This patch also fixes PolicyHelper to find the free disk space requirements of a new replica from the leader only if said leader node is alive.
2018-10-09 12:10:28 +05:30
Nicholas Knize 1118299c33 LUCENE-8496: Selective indexing - modify BKDReader/BKDWriter to allow users to select a fewer number of dimensions to be used for creating the index than the total number of dimensions used for field encoding. i.e., dimensions 0 to N may be used to determine how to split the inner nodes, and dimensions N+1 to D are ignored and stored as data dimensions at the leaves. 2018-10-08 18:51:03 -05:00
Joel Bernstein df07a43b56 SOLR-12749: Update CHANGES.txt 2018-10-08 13:05:26 -04:00
Joel Bernstein 6a702ee16b SOLR-12840: Add pairSort Stream Evaluator 2018-10-08 12:53:23 -04:00
David Smiley 49285e8423 Solr CHANGES.txt: forgot leading "*" 2018-10-07 23:17:33 -04:00
Jason Gerlowski 367bdf7f74 SOLR-12803: Ensure CUSC routes docs to right cores
ConcurrentUpdateSolrClient can batch together many documents when making
an indexing request to Solr.  When adding an update request to the
current batch being made, it checks that the query-parameters of the
docs being added match those already in the batch.  But prior to this
commit it never checked that the collections/cores were the same.

This could result in documents being sent to the wrong collection if the
same client is used to index documents to two different
cores/collections simultaneously.

This commit addresses this problem, ensuring that documents aren't added
to a batch directed at a different core/collection.
2018-10-07 10:08:50 -04:00