Apache
/
lucene
mirror of https://github.com/apache/lucene.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
31,165 Commits 28 Branches 466 Tags 780 MiB
Commit Graph

12614 Commits

Author SHA1 Message Date
Christine Poerschke 7fc91deaba SOLR-12905: MultiSolrCloudTestCase now clears static clusterId2cluster in @AfterClass 2018-10-24 19:25:10 +01:00
Christine Poerschke cebf7039ee Fix typo in stream-decorator-reference.adoc file. 2018-10-24 19:22:51 +01:00
Cao Manh Dat e083b1501e Add log.warn when a replica become leader after timeout 2018-10-24 08:56:01 +07:00
David Smiley 3e89b7a771 SOLR-12754: New hl.weightMatches for UnifiedHighlighter WEIGHT_MATCHES 
(defaults to true in master/8)
 2018-10-23 13:28:10 -04:00
Tommaso Teofili 2e757f6c25 SOLR-12879 - registered MinHashQParserPlugin to QParserPlugin as min_hash 2018-10-23 09:12:46 +02:00
Tommaso Teofili 9df96d2530 SOLR-12879 - added missing attribution in CHANGES.txt 2018-10-23 09:07:38 +02:00
Cao Manh Dat 7512cd9425 SOLR-11812: Remove LIROnShardRestartTest since the transition from old lir to new lir is no longer supported 2018-10-23 09:58:59 +07:00
noble 576d28f643 SOLR-11522: Moved the _get methods to a separate interafce and keep MapWriter clean 2018-10-23 12:35:23 +11:00
Anshum Gupta d799fd53c7 SOLR-5004: Allow a shard to be split into 'n' sub-shards using the collections API 2018-10-22 15:01:24 -07:00
Joel Bernstein fcaea07f3c SOLR-12829: Add plist (parallel list) Streaming Expression 2018-10-22 15:20:13 -04:00
Christine Poerschke c9776d88f9 Three minor variables.adoc edits. 2018-10-22 17:33:11 +01:00
Noble Paul c31a95d261 SOLR-12846: Added support for "host" variable in autoscaling policy rules 2018-10-23 00:03:59 +11:00
Andrzej Bialecki 8c70811f3a SOLR-12729: Unlock the shard on error. 2018-10-22 11:28:09 +02:00
Noble Paul 5de6332209 SOLR-12892: MapWriter to use CharSequence instead of String 2018-10-22 11:14:41 +11:00
Tommaso Teofili a7c9c9d8ce SOLR-12879 - MinHash query parser 2018-10-20 08:28:02 +02:00
Andrew Lundgren 1a8188d92b SOLR-10981: Support for stream.url or stream.file pointing to gzipped data 2018-10-18 19:53:21 -04:00
David Smiley fd9164801e LUCENE-7875: Moved MultiFields static methods to MultiTerms, FieldInfos and MultiBits. 
MultiBits is now public and has getLiveDocs.
 2018-10-18 19:49:14 -04:00
Jan Høydahl a3fc31e5d2 Remove unnecessary XML exclusions as Jetty handles these by default (janhoy) 2018-10-18 16:38:52 +02:00
Simon Willnauer 5a4fd86cce LUCENE-8535: Drop out of the box Block-Join highlight support 
Highlighter doesn't support ToParent and ToChildBlockJoinQuery out of the
box anymore. In oder to highlight on Block-Join Queries a custom WeightedSpanTermExtractor
should be used.
 2018-10-18 14:53:01 +02:00
Jason Gerlowski e6f6f352cf SOLR-12856: Small improvements to SolrJ javadocs 2018-10-17 19:10:56 -04:00
Uwe Schindler 4b2136eb3c SOLR-12874: Java 9+ GC Logging filesize parameter should use a unit 
(merge branch 'java9plus_gc_logging_filesize' of https://github.com/tpunder/lucene-solr); this closes #470
 2018-10-17 23:24:51 +02:00
Erick Erickson fc886497de SOLR-12423: Upgrade to Tika 1.19.1 when available. Fixes #468 2018-10-17 13:06:09 -04:00
Noble Paul 635d1ea535 SOLR-12740: fixed doc asciidoc errors 2018-10-17 12:16:17 +11:00
Christine Poerschke d2f7272b0e SOLR-12877: avoid NPE in TestUtilizeNode.getReplicaList 2018-10-16 12:54:00 -04:00
Christine Poerschke 15002eba2f SOLR-12877: avoid NPE in TestTlogReplica.testRealTimeGet 2018-10-16 12:52:51 -04:00
Christine Poerschke 95af8d6ac2 SOLR-12876: remove @BadApple from ShardParamsTest.testGetShardsTolerantAsBool 2018-10-16 10:52:51 -04:00
Christine Poerschke 7fa19d2676 SOLR-12876: upon failure report exception message in ShardParamsTest.testGetShardsTolerantAsBool 2018-10-16 10:52:11 -04:00
Noble Paul 761f8aaf79 SOLR-12740: adding a link 2018-10-17 00:22:54 +11:00
Noble Paul f1a30bfb00 SOLR-12792: extract test data into separate files in autoscaling tests 2018-10-16 19:11:08 +11:00
Shalin Shekhar Mangar aa0a5289e6 SOLR-12739: Clear all collections in TestCollectionStateWatchers setup so that the collections created by test methods are spread evenly in the cluster. 2018-10-16 12:14:22 +05:30
Noble Paul 8d3810df54 SOLR-12740: migration docs 2018-10-16 17:38:51 +11:00
Noble Paul 9c7b8564d8 SOLR-12806: use autoscaling policies with strict=false to prioritize node allocation 2018-10-16 16:56:51 +11:00
David Smiley 306065fca8 LUCENE-12357: Update ref guide notes 2018-10-15 23:38:09 -04:00
Tim Underwood 5202a713ba Java 9+ GC Logging filesize parameter should be 20M instead of 20000 
JEP 158 (https://openjdk.java.net/jeps/158) says the filesize parameter is the “file size in kb” however that appears to not be the case since when it is set to a value of 20000 you end up with GC logs that are only 20000 bytes in length.  Setting the value to 20M produces the desired result of GC log files that are 20MB in size.
 2018-10-15 12:52:40 -07:00
Joel Bernstein 73a413cd85 SOLR-12862: Fix TestLang 2018-10-15 15:47:03 -04:00
Joel Bernstein 6c0fbe5a9d SOLR-12862: Add log10 Stream Evaluator and allow the pow Stream Evaluator to accept a vector of exponents 2018-10-15 15:47:03 -04:00
Christine Poerschke 1ccd555862 Fix couple of typos. 2018-10-15 15:08:17 -04:00
Erick Erickson 6c5df58b5a SOLR-12028: BadApple and AwaitsFix annotations usage 2018-10-14 21:13:33 -04:00
Jason Gerlowski 6d1b2e2f38 SOLR-8808: Add null/empty check to SolrClient.deleteByIds 2018-10-13 22:15:36 -04:00
Christine Poerschke 9c8ffabfe3 SOLR-12780: Add support for Leaky ReLU and TanH activations in contrib/ltr NeuralNetworkModel class. 
(Kamuela Lau, Christine Poerschke)
 2018-10-12 17:08:35 +01:00
Jason Gerlowski 42ac07d11b SOLR-12565: Add SolrJ snippet to 'Using ZooKeeper to manage config' ref-guide page 2018-10-11 14:30:43 -04:00
Joel Bernstein d48f22c1ad SOLR-12851: Update CHANGES.txt 2018-10-11 11:19:57 -04:00
Joel Bernstein a0bb501772 SOLR-12851: Improvements and fixes to let and select Streaming Expressions 2018-10-11 10:43:57 -04:00
Shalin Shekhar Mangar 971a0e3f4a SOLR-12739: Use legacy assignment in AutoAddReplicasPlanActionTest 2018-10-11 08:58:47 +05:30
Jan Høydahl 80011d669a SOLR-12620: Remove the Admin UI Cloud -> Graph (Radial) view 2018-10-10 21:54:34 +02:00
Shalin Shekhar Mangar 095707d547 SOLR-12739: Remove unused import 2018-10-10 18:18:29 +05:30
Shalin Shekhar Mangar 50d1c7b481 SOLR-12739: Release the policy session as soon as we're done with the computation. 
This fixes the CollectionsAPIDistributedZkTest.testCoresAreDistributedAcrossNodes test failures. Due to the various tests for exceptional conditions, there were times where the session was not released causing stale data to remain in the policy session cache.
 2018-10-10 17:12:50 +05:30
Shalin Shekhar Mangar 940a7303ee SOLR-12739: Use cluster instead of collection as the key for using legacy assignment. 2018-10-10 16:19:17 +05:30
Shalin Shekhar Mangar 9f34a7c776 SOLR-12739: Fix failures in AutoAddReplicasIntegrationTest and its sub-class. 
This test too makes assumptions about how replicas are placed. In the legacy assignment strategy, the replica of a given collection are spread equally across all nodes but with the new policy based strategy, all cores across collections are spread out. Therefore the assumptions in this test were wrong. I've changed this test to use the legacy assignment policy because testing the autoAddReplicas feature doesn't have to depend on new replica assignment strategies. This change also fixes a bug in Assign which used "collection" key instead of "cluster" to figure out which strategy to use.
 2018-10-10 15:38:52 +05:30
Shalin Shekhar Mangar a66a7f3197 SOLR-12739: Fix CloudSolrClientTest.testNonRetryableRequests failures. 
The testNonRetryableRequests test makes an assumption that a collection's replicas are equally distributed among all nodes but with the policy engine it is not true. Instead the policy engine spreads out the cores belonging to all collections equally among all nodes. This is fixed by only creating the collection needed by tests in this class just-in-time.
 2018-10-10 13:12:26 +05:30
Noble Paul 3629e76011 SOLR-12843: precommit errors 2018-10-10 15:38:20 +11:00
Steve Rowe 8d205ecd1c SOLR-12843: fix precommit 2018-10-09 17:42:41 -04:00
Steve Rowe 41e3d07369 SOLR-11812: fix precommit 2018-10-09 17:34:16 -04:00
Steve Rowe 50478ea72d SOLR-11812: fix precommit 2018-10-09 17:27:21 -04:00
Andrzej Bialecki 23e22e6460 SOLR-12729: SplitShardCmd should lock the parent shard to prevent parallel splitting requests. 2018-10-09 21:30:10 +02:00
Noble Paul a52d47a1a5 SOLR-12843: precommit errors 2018-10-09 23:17:09 +11:00
Cao Manh Dat a37a213975 SOLR-11812: Remove backward compatibility of old LIR implementation in 8.0 2018-10-09 16:20:49 +07:00
Shalin Shekhar Mangar 184ed88ecb SOLR-12845: Disable the test until we can add a default policy equivalent to the hard coded legacy assignment rules 2018-10-09 13:54:46 +05:30
Noble Paul b4d9b25f44 SOLR-12843: Implement a MultiContentWriter in SolrJ to post multiple files/payload at once 2018-10-09 17:44:40 +11:00
Shalin Shekhar Mangar dbed8bafe6 SOLR-12739: Autoscaling policy framework is now used as the default strategy to select the nodes on which new replicas or replicas of new collections are created. 
Previously, the maxShardsPerNode parameter was not allowed on collections when autoscaling policy was configured. Also if an autoscaling policy was configured then the default was to set an unlimited maxShardsPerNode automatically. Now the maxShardsPerNode parameter is always allowed during collection creation and maxShardsPerNode should be set correctly (if required) regardless of whether autoscaling policies are in effect or not. The default value of maxShardsPerNode continues to be 1 as before. It can be set to -1 during collection creation to fall back to the old behavior of unlimited maxShardsPerNode when using autoscaling policy. This patch also fixes PolicyHelper to find the free disk space requirements of a new replica from the leader only if said leader node is alive.
 2018-10-09 12:10:28 +05:30
Nicholas Knize 1118299c33 LUCENE-8496: Selective indexing - modify BKDReader/BKDWriter to allow users to select a fewer number of dimensions to be used for creating the index than the total number of dimensions used for field encoding. i.e., dimensions 0 to N may be used to determine how to split the inner nodes, and dimensions N+1 to D are ignored and stored as data dimensions at the leaves. 2018-10-08 18:51:03 -05:00
Joel Bernstein df07a43b56 SOLR-12749: Update CHANGES.txt 2018-10-08 13:05:26 -04:00
Joel Bernstein 6a702ee16b SOLR-12840: Add pairSort Stream Evaluator 2018-10-08 12:53:23 -04:00
David Smiley 49285e8423 Solr CHANGES.txt: forgot leading "*" 2018-10-07 23:17:33 -04:00
Jason Gerlowski 367bdf7f74 SOLR-12803: Ensure CUSC routes docs to right cores 
ConcurrentUpdateSolrClient can batch together many documents when making
an indexing request to Solr.  When adding an update request to the
current batch being made, it checks that the query-parameters of the
docs being added match those already in the batch.  But prior to this
commit it never checked that the collections/cores were the same.

This could result in documents being sent to the wrong collection if the
same client is used to index documents to two different
cores/collections simultaneously.

This commit addresses this problem, ensuring that documents aren't added
to a batch directed at a different core/collection.
 2018-10-07 10:08:50 -04:00
David Smiley e2b8beccb0 SOLR-12782: UninvertingReader avoids FieldInfo creation. 
Wrapping is now a bit more lightweight: Does not create FieldInfo for fields that
can't be uninverted (saves mem) and can avoid wrapping the reader altogether if there's nothing to uninvert.
IndexSchema.getUninversionMap refactored to getUninversionMapper and no longer merges FieldInfos.
 2018-10-05 20:40:39 -07:00
Shalin Shekhar Mangar eb47099ee2 SOLR-12836: ZkController creates a cloud solr client with no connection or read timeouts. 
This changes ZkController to use the http client created by the update shard handler instead of creating a custom one.
 2018-10-05 15:18:11 +05:30
Shalin Shekhar Mangar ace0db7a0a SOLR-12835: Document statistics exposed by the Query Result Cache when maxRamMB is configured 2018-10-05 08:20:31 +05:30
Noble Paul 14e6eb2c24 use MapWriter._get() 2018-10-05 08:32:00 +10:00
Jan Høydahl 5fb384c989 SOLR-12814: Metrics history causing "HttpParser URI is too large >8192" when many collections 
This fixes #461
 2018-10-04 18:32:38 +02:00
Joel Bernstein a0487b04ea SOLR-12811: Add enclosingDisk and associated geometric Stream Evaluators 2018-10-04 10:36:27 -04:00
Shalin Shekhar Mangar 793a677d0f SOLR-12827: Fix blurb in ref guide to say that the key is deprecated instead of saying that it is no longer supported. 2018-10-04 16:22:29 +05:30
Andrzej Bialecki 452c2dabf0 SOLR-12815: Implement maxOps limit for IndexSizeTrigger. 2018-10-04 12:48:25 +02:00
Shalin Shekhar Mangar 152fd966a7 SOLR-12827: Migrate cluster wide defaults syntax in cluster properties to a nested structure 
The cluster wide defaults structure has changed from {collectionDefaults: {nrtReplicas : 2}} to {defaults : {collection : {nrtReplicas : 2}}}.  The old format continues to be supported and can be read from ZK as well as written using the V2 set-obj-property syntax but it is deprecated and will be removed in Solr 9. We recommend that users change their API calls to use the new format going forward.
 2018-10-04 16:12:55 +05:30
Shalin Shekhar Mangar 05949a32c9 SOLR-12648: Use the information whether custom preferences were specified in the CloudUtil.usePolicyFramework method instead of comparing directly against default preferences. Comparing against default preferences was wrong because it ignores the case where the user explicitly added the same preferences as the default ones. 2018-10-04 13:26:51 +05:30
Shalin Shekhar Mangar 554ac64666 SOLR-12524: Marking the test as AwaitsFix 2018-10-04 06:53:10 +05:30
Tomas Fernandez Lobbe 46f753d7c6 SOLR-12767: Always include the achieved rf in the response 
This commit deprecates the min_rf parameter. Solr now always includes the achieved replication
factor in the update requests (as if min_rf was always specified). Also, reverts the changes
introduced in SOLR-8034, replicas that don't ack an update will have to recover to prevent
inconsistent shards.
 2018-10-03 09:40:15 -07:00
Joel Bernstein 751bf7db20 SOLR-12828: Add oscillate Stream Evaluator to support sine wave analysis 2018-10-03 12:25:35 -04:00
Noble Paul d8e40796e2 SOLR-12822: /autoscaling/suggestions to include suggestion to add-replica for lost replicas 2018-10-03 23:37:58 +10:00
Andrzej Bialecki abace2987a Fix the CHANGES entry - this is applicable only to 8.0 codebase. 2018-10-03 14:11:43 +02:00
Andrzej Bialecki eba7bedadf SOLR-12725: ParseDateFieldUpdateProcessorFactory should reuse ParsePosition. 2018-10-03 13:59:02 +02:00
Shalin Shekhar Mangar 84683b6aa0 SOLR-12750: Migrate API should lock the collection instead of shard 2018-10-03 16:24:26 +05:30
Shalin Shekhar Mangar 65105aa81b SOLR-12648: Autoscaling framework based replica placement is not used unless a policy is specified or non-empty cluster policy exists 2018-10-03 15:52:51 +05:30
Andrzej Bialecki e687748405 SOLR-12080: Disable this test until it's fixed. 2018-10-03 07:56:26 +02:00
Andrzej Bialecki 2201b65266 SOLR-12709: Several fixes to the simulator and its .system collection auto-creation. 2018-10-02 17:35:45 +02:00
Noble Paul 4ca885ac9e SOLR-12824: fixed test failure 2018-10-02 21:17:22 +10:00
Noble Paul 961d565955 SOLR-12824: NamedList to implement MapWriter interface 2018-10-02 17:34:58 +10:00
David Smiley fe844c739b LUCENE-8513: Remove MultiFields.getFields 
SlowCompositeReaderWrapper now works with MultiTerms directly
 2018-10-01 10:39:12 -04:00
Noble Paul 86e00405b0 SOLR-12792: extract out test data 2018-10-01 22:00:09 +10:00
Cao Manh Dat 93e2ae3fc4 SOLR-12774: IndexOutOfBoundsException on logging startupVersions 2018-10-01 15:25:30 +07:00
Joel Bernstein 3ece536d81 SOLR-11907: Change error message if ConvexHull2D is not provided as the first parameter 2018-09-30 21:11:23 -04:00
Joel Bernstein 3fc58f4a98 SOLR-11907: Add convexHull and associated geometric Stream Evaluators 2018-09-30 20:56:03 -04:00
David Smiley 964cc88cee SOLR-12593: remove date parsing from extract contrib 
* added "ignored_*" to the default configSet
* Updated Ref Guide info on Solr Cell to demonstrate usage without using the techproducts configSet

Closes #438
 2018-09-28 16:50:11 -04:00
Andrzej Bialecki 918b11c7ce For simulated queries count also buffered updates. 2018-09-28 20:24:29 +02:00
Charles Sanders 9481c1f623 SOLR-5163: edismax now throws an exception when qf refers to a nonexistent field 2018-09-27 15:53:26 -04:00
Peter Somogyi 044bc2a485 SOLR-12652: Remove SolrMetricManager.overridableRegistryName() 2018-09-27 15:39:55 -04:00
Andrzej Bialecki 2369c89634 SOLR-12709: Add TestSimExtremeIndexing for testing simulated large indexing jobs. 
Several important improvements to the simulator.
 2018-09-27 14:49:43 +02:00
Shalin Shekhar Mangar c587410f99 SOLR-12756: Refactor Assign and extract replica placement strategies out of it. 
Now, assignment is done with the help of a builder class instead of calling a method with large number of arguments. The number of special cases that had to be handled have been cut down as well.
 2018-09-27 16:15:38 +05:30
Noble Paul a6d39ba859 targetNode is not required for move-replica 2018-09-27 15:27:08 +10:00
Jan Høydahl 03c9c04353 LUCENE-8493: Stop publishing insecure .sha1 files with releases 2018-09-26 15:31:26 +02:00
Cao Manh Dat 667b8299e6 SOLR-12805: Store previous term (generation) of replica when start recovery process 2018-09-26 10:35:44 +07:00
Christine Poerschke 58167666c3 Fix comment typo in SolrConfig. 2018-09-25 17:56:39 +01:00
Noble Paul e16d7d6993 SOLR-11522: /autoscaling/suggestions now include rebalance options as well even if there are no violations 2018-09-26 00:47:03 +10:00
Shalin Shekhar Mangar e437b2f1ed SOLR-9317: Deduplicate node list before trying to find if all nodes are up. The test is also fixed to not send duplicate node names in the createNodeSet parameter. 2018-09-25 12:14:16 +05:30
David Smiley 9bc4b8d4fe SOLR-12759: fix regexp 2018-09-24 15:21:59 -04:00
noble 3f2975c27c SOLR-11522: /autoscaling/suggestions now include rebalance options as well even if there are no violations 2018-09-25 00:34:21 +10:00
Erick Erickson 95cc6f4f76 SOLR-12776: Setting of TMP in solr.cmd causes invisibility of Solr to JDK tools 2018-09-23 16:03:30 -07:00
Varun Thacker 60569fbe4e SOLR-11836: Move CHANGES entry to the 7.6 section 2018-09-21 17:01:37 -07:00
Shalin Shekhar Mangar 4bcace571e SOLR-9317: ADDREPLICA command should be able to add more than one replica to a collection,shard at a time. 
The API now supports 'nrtReplicas', 'tlogReplicas', 'pullReplicas' parameters as well 'createNodeSet' parameter. As part of this change, the CREATESHARD API now delegates placing replicas entirely to the ADDREPLICA command and uses the new parameters to add all the replicas in one API call.
 2018-09-21 15:12:21 +05:30
Erick Erickson dd088fb83e SOLR-12028: BadApple and AwaitsFix annotations usage 2018-09-20 22:31:49 -07:00
Noble Paul 1d604d1b3f SOLR-12792: extract test data into separate files in autoscaling tests 2018-09-21 13:26:52 +10:00
Noble Paul 6adeb5bc44 SOLR-12792: extract test data into separate files in autoscaling tests 2018-09-21 12:55:41 +10:00
Andrzej Bialecki 0dd7b70447 Add toString() to help debugging. 2018-09-20 15:32:42 +02:00
Andrzej Bialecki 5e6c99cc35 Reset the latch between re-runs of the same test. 2018-09-20 14:27:30 +02:00
Alan Woodward c0d2975970 LUCENE-8498: Remove LowerCaseTokenizer 2018-09-20 11:57:05 +01:00
Andrzej Bialecki 52bdcf6bb0 iSOLR-12080: Improve error handling of MoveReplicaCmd. Improve the test stability 
by avoiding killing overseer.
 2018-09-20 12:36:52 +02:00
Andrzej Bialecki 87cd5b14ae Start the splitting after the triggers are in place. 2018-09-20 10:36:24 +02:00
Cassandra Targett 264110e7b9 SOLR-12784: Fix broken link to stemdict.txt by including it in the Guide directly 2018-09-19 14:15:01 -05:00
Andrzej Bialecki 408232635a Fix occasional test failure due to a missing trigger config. 2018-09-19 11:58:30 +02:00
Alan Woodward c696cafc0d LUCENE-8352: Make TokenStreamComponents final 2018-09-19 10:02:56 +01:00
David Smiley c06a7ab0c7 SOLR-12759: fix regexp 2018-09-18 20:21:44 -04:00
David Smiley 5abee478b6 SOLR-12759: detect actual problem and only then "assumeTrue" to bail 2018-09-18 13:43:41 -04:00
Steve Rowe 7d0a7782fa SOLR-12771: add CHANGES entry 2018-09-17 15:02:10 -04:00
Steve Rowe ca86de1784 SOLR-12771: Improve Autoscaling Policy and Preferences documentation 2018-09-17 14:57:52 -04:00
Andrzej Bialecki 36eae57163 SOLR-12765: Incorrect format of JMX cache stats. 2018-09-17 15:33:16 +02:00
David Smiley ac7969e3c0 SOLR-6280: CollapseQParser now throws an error when pointing to a multi-valued field. 2018-09-17 09:08:54 -04:00
Erick Erickson b2b597b038 SOLR-12773: Fix typos widely spread around codebase 2018-09-16 09:46:20 -07:00
Erick Erickson 910a1c0312 SOLR-12028: BadApple and AwaitsFix annotations usage 2018-09-15 21:26:19 -07:00
Cassandra Targett 39733cbf5f SOLR-12551: fix Tika version in list of major components in CHANGES.txt 2018-09-14 08:55:53 -05:00
Tomas Fernandez Lobbe a7a4f68da5 SOLR-12766: Log retries after the backoff 2018-09-13 20:46:38 -07:00
Christine Poerschke d6641ffb1d Fix Ma[n]datory typo in stream-decorator-reference.adoc file. 2018-09-13 21:26:19 +01:00
Tomas Fernandez Lobbe 9f37a6be9b SOLR-12766: Backoff time for internal requests is never more than 2 seconds 2018-09-13 08:43:10 -07:00
David Smiley dea3d69f95 SOLR-12759: assertFalse -> assumeFalse 2018-09-13 09:43:25 -04:00
Tomas Fernandez Lobbe 4a5b914eaa SOLR-12766: Improve backoff for internal retries 
When retrying internal update requests, backoff only once for the full batch of retries
instead of for every request.
Make backoff linear with the number of retries
 2018-09-12 21:11:34 -07:00
David Smiley 6e8c05f6fe SOLR-12361: ref guide changes & CHANGES.txt organization 2018-09-12 17:34:28 -04:00
Christine Poerschke 41e972ee8a Fix num[u]eric typo in stream-evaluator-reference.adoc file. 2018-09-12 22:30:01 +01:00
Cassandra Targett b32dcbbe42 Ref Guide: fix typos; params -> parameters 2018-09-12 15:04:28 -05:00
Cassandra Targett ad7f15d808 Fix typo in build.xml so PDF javadoc links get converted correctly 2018-09-12 15:03:43 -05:00
Jan Høydahl 5b96f89d2b LUCENE-5143: Fix smoketester, fix RM PGP key check, fix solr DOAP file, add CHANGES entry 
Remove unused/stale 'copy-to-stage' and '-dist-keys' targets from ant build
 2018-09-11 22:39:19 +02:00
Varun Thacker 2b553f03be SOLR-11836: add all contributors for the patch 2018-09-11 12:37:50 -07:00
Cassandra Targett 89bc082478 SOLR-12763: upgrade notes + some MergePolicy param fixes 2018-09-11 13:26:42 -05:00
Varun Thacker d35d2063a8 SOLR-11836: FacetStream works with bucketSizeLimit of -1 which will fetch all the buckets 2018-09-11 10:58:04 -07:00
Mike McCandless 398074d0f8 LUCENE-8343: change suggesters to use Long instead of long weight during indexing, and double instead of long score at suggest time 2018-09-11 12:03:40 -04:00
Cassandra Targett a619038e90 SOLR-12701: format/style consistency fixes for math expression docs; CSS change to make bold monospace appear properly 2018-09-11 08:47:16 -05:00
Anshum Gupta a1b6db26db SOLR-12762: Fix javadoc for SolrCloudTestCase.clusterShape() method and add a method that validates only against Active slices while testing 2018-09-10 15:18:32 -07:00
David Smiley 623cdf29ad SOLR-12759: Disable ExtractingRequestHandlerTest on JDK 11 due to 
JDK bug with timezone locale and Date.toString
 2018-09-10 11:45:44 -04:00
David Smiley a537aa20c1 SOLR-6387: Remove/revert dated assertFalse in ExtractingRequestHandlerTest 
Since this problem does not appear anymore in the latest JVMs.
 2018-09-10 11:33:15 -04:00
Jim Ferenczi 3a71bf39d1 Add 7.6.0 version 2018-09-10 16:05:53 +02:00
Jim Ferenczi 1f2b344def Revert "Add version 7.5.1" 
This reverts commit 2ffcb878b4.
 2018-09-10 15:56:05 +02:00
Noble Paul 8fbeedf27f SOLR-12738: removed unused method 2018-09-10 23:54:16 +10:00
Jim Ferenczi 2ffcb878b4 Add version 7.5.1 2018-09-10 09:19:09 +02:00
Noble Paul 4f0320c3f3 SOLR-12738: Incorrect Suggestions in autoscaling framework and refactoring 2018-09-10 12:24:24 +10:00
Joel Bernstein 70f001918e SOLR-11943: Fix RefGuide for latlonVectors and haversineMeters functions. 2018-09-09 20:59:13 -04:00
Joel Bernstein e5232f68cf SOLR-11943: Fix RefGuide for latlonVectors and haversineMeters functions. 2018-09-09 20:53:54 -04:00
Joel Bernstein 304836e675 SOLR-11943: Update RefGuide for latlonVectors and haversineMeters functions. 2018-09-09 20:44:25 -04:00
Erick Erickson 3b62f23f72 SOLR-12055: Enable async logging by default - rollback 2018-09-07 22:51:50 -07:00
Steve Rowe 8f498920bd SOLR-11943: Change scope of commons-math3 solr-core dependency from test to compile, for HaversineMetersEvaluator.java 2018-09-07 16:30:22 -04:00
Joel Bernstein f5ce384fb8 SOLR-11943: Change location... to latlon... 2018-09-07 15:42:34 -04:00
Steve Rowe 2c88922998 SOLR-8742: In HdfsDirectoryTest replace RAMDirectory usages with ByteBuffersDirectory. 2018-09-07 13:19:01 -04:00
Alan Woodward 66c671ea80 LUCENE-8483: Scorer cannot have a null Weight 2018-09-07 11:41:47 +01:00
Erick Erickson 0dc66c236d SOLR-12028: BadApple and AwaitsFix annotations usage 2018-09-06 20:43:51 -07:00
David Smiley 21d130c3ed SOLR-12357: TRA preemptiveCreateMath option. 
Simplified test utility TrackingUpdateProcessorFactory.
Reverted some attempts the TRA used to make in avoiding overseer communication (too complicated).
Closes #433
 2018-09-06 23:38:44 -04:00
Erick Erickson 9e04375dc1 SOLR-12732: TestLogWatcher failure on Jenkins 2018-09-06 19:25:33 -07:00
Joel Bernstein 98611d33a7 SOLR-12749: timeseries() expression missing sum() results for empty buckets 2018-09-06 20:34:26 -04:00
Tomas Fernandez Lobbe ccd9f6fccb SOLR-12612: Accept custom keys in cluster properties (doc changes) 
Also added missing known cluster properties
 2018-09-06 14:38:35 -07:00
Tomas Fernandez Lobbe 0af269fb49 SOLR-12612: Accept custom keys in cluster properties 
Cluster properties restriction of known keys only is relaxed, and now unknown properties starting with "ext."
will be allowed. This allows custom to plugins set their own cluster properties.
 2018-09-06 14:07:30 -07:00
Cassandra Targett 8caa34c4cf SOLR-10697: update Ref Guide for default value changes 2018-09-06 13:25:53 -05:00
Joel Bernstein c684773e8d SOLR-11943: Update CHANGES.txt 2018-09-06 14:23:53 -04:00
Joel Bernstein b8e87a1010 SOLR-11943: Add machine learning functions for location data 2018-09-06 14:01:09 -04:00
Chris Hostetter 597bd5db77 SOLR-9418: Added a new (experimental) PhrasesIdentificationComponent for identifying potential phrases in query input based on overlapping shingles in the index 2018-09-06 10:50:56 -07:00
Cassandra Targett cac589b803 SOLR-12716: Move common params to top of page; insert links to common param section for each trigger; improve consistency 2018-09-06 11:58:51 -05:00
Cassandra Targett 00ce9e067b SOLR-12722: expand "params" -> "parameters (plus a bunch of other things I found in unrelated transformer examples) 2018-09-06 08:54:37 -05:00
Cassandra Targett 9c364b2d86 SOLR-12684: put expression names and params in monospace 2018-09-06 08:16:27 -05:00
Jan Høydahl 285b743a8b SOLR-12745: Wrong header levels on BasicAuth refGuide page 2018-09-06 10:31:18 +02:00
Varun Thacker 89d598e9e8 SOLR-12744: Improve logging messages and verbosity around recoveries 2018-09-05 19:56:25 -07:00
Erick 37375ae600 SOLR-12733: SolrMetricReporterTest failure 2018-09-05 17:04:31 -07:00
Joel Bernstein b4a1548248 SOLR-12701: Fix knnSearch RefGuide 2018-09-05 14:14:59 -04:00
Cassandra Targett 4f05588007 SOLR-12625: fix typos..."an" -> "and" 2018-09-05 12:47:08 -05:00
Cassandra Targett e893f3480d SOLR-12715: change preferredOperation values to lowercase since that's how they're entered 2018-09-05 12:47:08 -05:00
Cassandra Targett 2565010261 SOLR-11690: put command examples in [source] blocks; make NOTE a CAUTION and move up to associated command 2018-09-05 12:47:08 -05:00
Christine Poerschke 3f9937bca2 Fix 'included' and 'number' typos in stream-source-reference.adoc file. 2018-09-05 17:51:00 +01:00
Christine Poerschke f385f02e4b Fix 'including' typo in cloud-screens.adoc file. 2018-09-05 17:46:47 +01:00
Joel Bernstein 719d922cbc SOLR-11863: Fix RefGuide typos 2018-09-05 11:30:27 -04:00
Joel Bernstein 0113adebce SOLR-11863: Add knnRegress to RefGuide 2018-09-05 11:20:30 -04:00
David Smiley e4f256be15 SOLR-12722: [child] transformer now processes 'fl' 2018-09-05 10:50:14 -04:00
Shalin Shekhar Mangar df20c4b9e6 SOLR-11990: Wait for all nodes to be live before running tests. 
A few tests have failed on jenkins where the very first call to Solr to set the policy fails because no live nodes were found. This commit adds a 30 second (max) wait for nodes to be registered live in ZK before attempting to run any test.
 2018-09-05 16:07:10 +05:30
Shalin Shekhar Mangar b6ee0ed5d5 SOLR-12716: NodeLostTrigger should support deleting replicas from lost nodes by setting preferredOperation=deletenode 
This commit adds support for preferredOperation configuration for NodeLostTrigger. The ComputePlanAction now creates DeleteNodeSuggester for each lost node serially when preferredOperation=deletenode. A new section for node lost trigger with exampls is added to the ref guide.
 2018-09-05 15:40:10 +05:30
Dawid Weiss 6be01e2ade LUCENE-8485: Update randomizedtesting to version 2.6.4. 2018-09-05 11:51:02 +02:00
Alan Woodward 3b1a335fb3 LUCENE-6228: Missed refactoring of CollapsingQParserPlugin delegating collector 2018-09-05 08:14:39 +01:00
David Smiley b1b0963947 SOLR-11861 baseConfigSet default 2018-09-04 14:02:46 -04:00
Andrzej Bialecki e0eb7bac02 SOLR-12723: Reduce object creation in HashBasedRouter. 2018-09-04 18:16:00 +02:00
Jan Høydahl d997e8b4a2 SOLR-11690: Improve documentation about DIH password encryption 2018-09-04 14:22:32 +02:00
Shalin Shekhar Mangar 34a85014d5 SOLR-12715: NodeAddedTrigger should support adding replicas to new nodes by setting preferredOperation=addreplica 
This commit adds support for preferredOperation configuration parameter which defaults to movereplica. Changes ComputePlanAction to add all (collection,shard) pair as hints to AddReplicaSuggester when addreplica is selected as the preferred operation.
 2018-09-04 17:05:44 +05:30
Alan Woodward 910a0231f6 LUCENE-6228: Add Scorable class and make LeafCollector.setScorer() take Scorable 2018-09-04 11:01:44 +01:00
Erick Erickson 74b53b1a67 SOLR-12728: RequestLoggingTest fails on occasion, not reproducible 2018-09-03 10:19:33 -07:00
Mikhail Khludnev b4f9042a43 SOLR-12726: Removing obsolete sentences from SolrCloud Auto Scaling Ref Guide. 2018-09-03 20:00:39 +03:00
David Smiley d93c46ea94 LUCENE-8267: adjust CHANGES.txt advise 2018-09-01 17:24:44 -04:00
Varun Thacker 606e529f93 SOLR-10697: HttpShardHandler now uses a default of 100k as maxConnections (10k previously) and default maxConnectionsPerHost as 100k (20 previously). They are now consisent with the UpdateShardHandler defaults 2018-09-01 07:20:15 -06:00
Varun Thacker d55a81df84 SOLR-12704: Guard AddSchemaFieldsUpdateProcessorFactory against null field names and field values 2018-08-31 23:53:30 -06:00
Erick Erickson e7b4495343 SOLR-12055: Last patch had the entry in the wrong place in CHANGES.txt 2018-08-31 20:43:26 -07:00
Erick Erickson 8e75f393b3 SOLR-12055: Enable async logging by default 2018-08-31 20:39:05 -07:00
Shalin Shekhar Mangar 4d78db26be SOLR-11990: Set waitForFinalState=true for the move replica API call so that the cluster is at steady state when the test ends. 2018-08-31 09:42:00 +05:30
Shalin Shekhar Mangar 5670d612e3 SOLR-11990: When a Collection CREATE command fails because of a policy rule violation, the collection metadata remains in ZooKeeper, even though no replicas are added, so the user has to manually delete the zombie collection. 
This is due to a change in behavior made in this issue where collection metadata creation was moved before attempting to use policy to place replicas. This change reverts the behavior by explicitly deleting the metadata when an AssignmentException occurs. Since the policy depends on collection metadata such as WITH_COLLECTION and COLOCATED_WITH properties, moving metadata creation after policy use would have resulted in passing these properties through the entire call stack quite invasively. Therefore the current approach is adopted.
 2018-08-31 09:23:25 +05:30
Steve Rowe 8667132999 SOLR-12689: Add example of collection creation when autoscaling policy/prefs are configured 2018-08-30 20:01:28 -04:00
David Smiley 4096decd8f SOLR-12591: ParseDateField URP should default to "en_US" locale (not ROOT) which is implied by common formats. 
Should fix Java 9,10,11 test fails; Java 8 continues to work.
 2018-08-30 09:53:43 -04:00
Joel Bernstein 86ba65c107 SOLR-10651, SOLR-10784: Add new statistical and machine learning functions to CHANGES.txt for 7.5 release 2018-08-30 08:56:44 -04:00
Shalin Shekhar Mangar ad513cb621 Fixed wrong documentation in ScheduledTrigger. The property name is preferredOperation instead of preferredOp. 2018-08-30 16:58:44 +05:30
Dawid Weiss 54f2565038 LUCENE-8469: Inline calls to the deprecated StringHelper.compare, removed StringHelper.compare from master. 2018-08-30 09:59:51 +02:00
David Smiley 18874a6e36 SOLR-12591: Expand default configSet's date patterns to subsume those of extract contrib 2018-08-29 14:17:44 -04:00
David Smiley cae91b1eaf SOLR-12519: fix testGrandChildFilterJSON 
Simplified differentiating random docs we don't care about from those we do by using IDs less than 0
 2018-08-29 13:35:42 -04:00
Steve Rowe 098f475a67 SOLR-12662: Eliminate possible race conditions by moving Type-by-name map construction to Variable.Type, accessible via Variable.Type.get(name) 2018-08-29 11:26:31 -04:00
David Smiley 5a0e7a615a SOLR-12519: child doc transformer can now produce a nested structure. 
Fixed SolrDocument's confusion of field-attached child documents in addField()
Fixed AtomicUpdateDocumentMerger's confusion of field-attached child documents in isAtomicUpdate()
 2018-08-29 10:02:09 -04:00
Dawid Weiss 545b0dcd04 SOLR-12360: fully numeric host names are valid based on RFC1123, so this test makes no sense. 2018-08-29 10:50:55 +02:00
Joel Bernstein 1cfc735fff SOLR-12634: Add gaussfit to the Math Expressions user guide 2018-08-28 17:01:15 -04:00
Steve Rowe 6430749d46 SOLR-12662: Reproducing TestPolicy failures: NPE and NoClassDefFoundError 2018-08-28 12:42:59 -04:00
Andrzej Bialecki 8d1dce933f SOLR-12392: Fix several bugs in tests and in trigger event serialization. 
Add better support for converting MapWriter instances to JSON.
 2018-08-28 15:11:18 +02:00
Joel Bernstein 04a50b6a2e SOLR-12701: Improve Monte Carlo example 2018-08-27 20:46:26 -04:00
Tomas Fernandez Lobbe d833b4c9d3 SOLR-10028: Fix and improvements to SegmentsInfoRequestHandlerTest 2018-08-27 14:05:50 -07:00
Joel Bernstein 659aed2de1 SOLR-12702: Add math expression userguid documentation 2018-08-27 16:10:15 -04:00
Joel Bernstein f4212a1df0 SOLR-12687: Add to math expressions user guide 2018-08-27 14:15:22 -04:00
Joel Bernstein 94503719ec SOLR-12702: Add zscores Stream Evaluator 2018-08-27 10:54:36 -04:00
Joel Bernstein 08a6d13c92 SOLR-12701: Remove statistical-programming page which is superceded by the new math-expressions paged 2018-08-27 10:30:48 -04:00
Andrzej Bialecki 7a3f837a32 SOLR-12669: Rename tests that use the autoscaling simulation framework. 2018-08-27 15:14:03 +02:00
Joel Bernstein b72ff3babb SOLR-12687: Add functions to cache data structures and mathematical models 2018-08-26 19:48:56 -04:00
Varun Thacker fc9aac11f7 SOLR-12684: Document speed gotchas and partitionKeys usage for ParallelStream. Standardize search streams to specify the export handler in the examples for expressions that operate on all the tuples 2018-08-24 01:20:06 -07:00
Varun Thacker cee309a6f7 SOLR-12572: revert numDocs to be indexed to 1k 2018-08-24 01:02:35 -07:00
Varun Thacker 9e78be40c3 SOLR-11598: Fix bug while setting and resetting string doc-values while exporting documents 2018-08-23 23:57:48 -07:00
Erick Erickson aa10cb7802 SOLR-12028: BadApple and AwaitsFix annotations usage 2018-08-23 16:59:58 -07:00
Adrien Grand 4368ad72d2 LUCENE-8461: Fix test failure. 2018-08-23 23:04:19 +02:00
Steve Rowe 95cb7aa491 SOLR-12590: Improve Solr resource loader coverage in the ref guide 2018-08-23 14:36:05 -04:00
Varun Thacker dfd2801cd2 SOLR-12572: While exporting documents using the export writer, if a field is specified as a sort parameter and also in the fl (field list) parameter, we save on one doc-value lookup. This can bring performance improvements of 15% and upwards depending on how many fields are in common 2018-08-23 10:48:10 -07:00
Adrien Grand 025350ea12 LUCENE-8461: Add Lucene80Codec. 2018-08-23 10:51:45 +02:00
Erick Erickson 8cde1277ec SOLR-12690: Regularize LoggerFactory declarations 2018-08-22 15:26:37 -07:00
Varun Thacker 5eab1c3c68 SOLR-12683: HashQuery will throw an exception if more than 4 partitionKeys is specified. Earlier after the 4th partitionKey the keys would be silently ignored. 2018-08-20 15:21:19 -07:00
Erick Erickson 66d500b5a5 SOLR-12625: Combine SolrDocumentFetcher and RetrieveFieldsOptimizer 2018-08-20 10:37:32 -07:00
Shalin Shekhar Mangar 1c0f95ee04 SOLR-12130: CdcrReplicationDistributedZkTest is broken into two test classes, CdcrOpsAndBoundariesTest which does not require node restarts and CdcrWithNodesRestartsTest which does. The tests themselves are made faster and more resilient to spurious failures 2018-08-20 14:49:13 +05:30
Shalin Shekhar Mangar 079a81f14f SOLR-12675: Make LeaderVoteWaitTimeoutTest more resilient against side effects of test methods. 
Extracted a new method to ensure a given number of jettys are always running in the test setup. Also, delete all collections created by other test methods.
 2018-08-20 14:45:50 +05:30
Shalin Shekhar Mangar 3c9050c3dd SOLR-12679: MiniSolrCloudCluster.startJettySolrRunner method should not add a duplicate jetty instance to the list 2018-08-20 14:24:31 +05:30
Shalin Shekhar Mangar 20d0f67edd SOLR-12680: Fix ClassCastException and AIOOBE in TestSolrConfigHandlerConcurrent 2018-08-20 13:25:56 +05:30
Shalin Shekhar Mangar ee498f5a38 SOLR-12679: MiniSolrCloudCluster.stopJettySolrRunner should remove jetty from the internal list 
While the startJettySolrRunner adds the given jetty instance to the internal list of jetty instances, the stopJettySolrRunner method does not remove the given instance from the list. This leads to inconsistencies such as stopped jettys retained in the internal list and duplicate (stopped) jettys. This commit also fixes TestCollectionsAPIViaSolrCloudCluster to deal with this change.
 2018-08-20 13:17:05 +05:30
Varun Thacker 3e4545219e SOLR-12674: RollupStream should not use the HashQueryParser for 1 worker 2018-08-19 11:59:38 -07:00
Erick Erickson 9f615fbae7 SOLR-12028: BadApple and AwaitsFix annotations usage 2018-08-17 14:40:16 -07:00
Joel Bernstein 52f9cee97b SOLR-12671: Add robust flag to knnRegress Stream Evaluator 2018-08-17 14:26:17 -04:00
Noble Paul 124be4e202 SOLR-12014: Cryptic error message when creating a collection with sharding that violates autoscaling policies 2018-08-18 00:37:50 +10:00
Shalin Shekhar Mangar 6e21cb3aa9 SOLR-11990: Create Collection API now waits for the updated state of the withCollection to be visible after setting the COLOCATED_WITH value 
Sometimes deletion of the withCollection succeeds even though the linked collection exists, if the delete request is sent immediately after the creation of the linked collection. This is because of a race between the delete request and the zookeeper update made by create collection such that the COLOCATED_WITH property is not visible to the overseer collection processor during the delete request. Therefore, we now wait until the property is visible before returning a success to the user. The test also adds more asserts so that a similar race will fail the test immediately with a proper assert message.
 2018-08-17 14:26:30 +05:30
Anshum Gupta 4309ae6f9f SOLR-12475: Fix failing MaxSizeAutoCommitTest 2018-08-16 23:05:21 -07:00
Andrzej Bialecki 585ba164a8 SOLR-12392: Improve reliability of IndexSizeTriggerTest. 2018-08-16 22:05:27 +02:00
Andrzej Bialecki 9572e129f8 SOLR-12668: Autoscaling trigger listeners should be executed in the order of their creation. 2018-08-16 21:44:10 +02:00
David Smiley a661ebc6df SOLR-12591: Avoid JDK 9 bug with certain timezones like AKDT; test with EDT. 
Also standardized on single 'z' in the test patterns, which is equivalent to triple.
 2018-08-16 15:16:26 -04:00
Steve Rowe 711a72ed84 LUCENE-8456: Upgrade Apache Commons Compress to v1.18 2018-08-16 12:06:33 -04:00