Commit Graph

4824 Commits

Author SHA1 Message Date
markrmiller 75b1831967 SOLR-12801: Make massive improvements to the tests.
SOLR-12804: Remove static modifier from Overseer queue access.

SOLR-12896: Introduce more checks for shutdown and closed to improve clean close and shutdown. (Partial)

SOLR-12897: Introduce AlreadyClosedException to clean up silly close / shutdown logging. (Partial)

SOLR-12898: Replace cluster state polling with ZkStateReader#waitFor. (Partial)

SOLR-12923: The new AutoScaling tests are way too flaky and need special attention. (Partial)

SOLR-12932: ant test (without badapples=false) should pass easily for developers. (Partial)

SOLR-12933: Fix SolrCloud distributed commit.
2018-11-29 11:58:51 -06:00
David Smiley 2611c22b6b SOLR-12398: retroactively add CHANGES.txt back-compat break for 7.5 2018-11-28 07:21:34 -08:00
Moshe a346ba0d3c SOLR-5211: Always populate _root_ (if defined).
And, small refactor: Clarified how _version_ is transferred from root to children.
2018-11-25 21:47:49 -05:00
Mikhail Khludnev d7b878e90c SOLR-12546: Let csv response writer to handle docValues fields by default. 2018-11-25 11:26:39 +03:00
Alan Woodward 2459072286 SOLR-12775: Add deprecated versions of LowerCaseTokenizer and LowerCaseTokenizerFactory 2018-11-22 13:54:39 +00:00
Noble Paul 492c3440de SOLR-13006: ZkNodeProps to be able to load from both javabin and JSON 2018-11-21 18:20:03 +11:00
Noble Paul 25bca6f165 SOLR-12992: When using binary format, ExportWriter to directly copy BytesRef instead of creating new String 2018-11-20 14:58:32 +11:00
Christine Poerschke 7abb25eff5 SOLR-12972: deprecate unused SolrIndexConfig.luceneVersion 2018-11-19 14:06:09 +00:00
Cassandra Targett df5540acc9 SOLR-12497: Add documentation for Hadoop credential provider-based keystore/truststore 2018-11-15 00:35:25 -06:00
Erick Erickson 763e64260f SOLR-12881: Remove unneeded import statements 2018-11-14 17:48:15 -08:00
Noble Paul cd1e829732 SOLR-12978: In autoscaling NPE thrown for nodes where value is absent 2018-11-12 18:53:16 +11:00
Noble Paul e6e6ad2c83 SOLR-12977: Autoscaling tries to fetch metrics from dead nodes 2018-11-12 18:44:26 +11:00
Noble Paul 605c3f6f1a SOLR-12977: Autoscaling tries to fetch metrics from dead nodes 2018-11-12 18:39:05 +11:00
Nicholas Knize 6d9c714052 Add 7.7.0 version 2018-11-09 15:20:33 -06:00
Chris Hostetter 77a4bfaa90 SOLR-12962: Added a new 'uninvertible' option for fields and fieldtypes. This defaults to 'true' for backcompat allowing a FieldCache to be built for indexed fields as needed, but users are encouraged to set this to false (using docValues as needed) to reduce the risk of large fluxuations in heap size due to unexpected attempts to sort/facet/function on non-docValue fields. 2018-11-09 08:30:04 -07:00
Tim Underwood fbb987282e SOLR-12880: Show the FacetProcessor class name instead of the
FacetRequest in the JSON Facets debug-trace output
2018-11-08 23:32:26 -05:00
Tim Underwood 243a8a668a SOLR-12964: Use DocValuesIterator.advanceExact() instead of the advance()/docID() pattern 2018-11-08 14:34:17 -05:00
Joel Bernstein 65dc312daf SOLR-12975: Update CHANGES.txt 2018-11-07 21:03:01 -05:00
Joel Bernstein f2cb93605c SOLR-12829: Update CHANGES.txt 2018-11-07 11:22:03 -05:00
Joel Bernstein a197904743 SOLR-12936: Update CHANGES.txt 2018-11-07 09:43:41 -05:00
Joel Bernstein 7bde5e2343 SOLR-11572: Update CHANGES.txt 2018-11-07 09:38:19 -05:00
Joel Bernstein bc88d78c84 SOLR-12795: Update CHANGES.txt 2018-11-07 09:28:47 -05:00
Joel Bernstein e1bdb9a751 SOLR-12971: Update CHANGES.txt 2018-11-07 09:20:33 -05:00
Alexandre Rafalovitch 50cf1cca26 SOLR-12600: Add missing name in CHANGES
Missed it on the last commit
2018-11-07 07:11:03 -05:00
Alexandre Rafalovitch 419d42bf7b SOLR-12600: Fix parameter names in Solr JSON documentation 2018-11-07 07:01:06 -05:00
Noble Paul 6f6a880ec2 SOLR-12023: correcting wrong git merge 2018-11-07 12:56:00 +11:00
David Smiley d0cd4245bd LUCENE-8557: LeafReader.getFieldInfos should always return the same instance
MemoryIndex: compute/cache up-front
Solr Collapse/Expand with top_fc: compute/cache up-front
Json Facets numerics / hash DV: use the cached fieldInfos on SolrIndexSearcher
SolrIndexSearcher: move the cached FieldInfos to SlowCompositeReaderWrapper
2018-11-06 14:45:32 -05:00
Alexandre Rafalovitch 0ddbc4bf95 SOLR-12966: Add Javadoc @since tag to URP classes 2018-11-06 08:05:07 -05:00
Alexandre Rafalovitch c07df19666 SOLR-12956: Add Javadoc @since tag to Analyzer component classes 2018-11-06 07:38:20 -05:00
Noble Paul 08fcce4c98 SOLR-11997: Suggestions API/UI should show an entry where a violation could not be resolved 2018-11-06 22:27:26 +11:00
Christine Poerschke be65b95e80 SOLR-12699: Make contrib/ltr LTRScoringModel immutable and cache its hashCode.
(Stanislav Livotov, Edward Ribeiro, Christine Poerschke)
2018-11-05 18:56:40 +00:00
Steve Rowe 01808eee93 SOLR-12243: Edismax missing phrase queries when phrases contain multiterm synonyms 2018-11-05 10:32:49 -05:00
Cassandra Targett 1e3cc4861a SOLR-12746: Simplify the Ref Guide HTML structure and use semantic HTML tags where possible. Adds new template files for Asciidoctor HTML conversion. 2018-11-05 09:07:01 -06:00
Gus Heck 45b772f4a9 SOLR-12938 - Cluster status now returns results for aliases instead of
throwing an exception
2018-11-04 12:01:51 -05:00
Noble Paul eb359ca079 SOLR-12023: Autoscaling policy engine shuffles replicas needlessly 2018-11-04 19:23:56 +11:00
Chris Hostetter c5ff4a4444 SOLR-12954: fix facet.pivot refinement bugs when using facet.sort=index and facet.mincount>1 2018-11-02 20:32:32 -07:00
Tim Underwood cf445ba549 SOLR-12882: Eliminate excessive lambda allocation in json facet FacetFieldProcessorByHashDV.collectValFirstPhase 2018-11-01 15:05:16 -04:00
Andrzej Bialecki 3ed64375ef SOLR-12942: Add an option in IndexSizeTrigger to select the split shard method. 2018-10-31 18:47:34 +01:00
Mikhail Khludnev 5aa8ad5b14 SOLR-12875: AIOOBE fix when unique()/uniqueBlock() is used with DVHASH method in json.facet 2018-10-30 10:56:34 +03:00
Steve Rowe c7c7b00ff9 SOLR-12861: In the upgrade note, specify the Solr version in which RAMDirectory will be removed. 2018-10-29 08:44:59 -04:00
Steve Rowe d362439e27 SOLR-12861: Add Solr factory for new ByteBuffersDirectory 2018-10-29 08:23:14 -04:00
Joel Bernstein 5fc4d516b1 SOLR-12862: Update CHANGES.txt 2018-10-28 17:08:26 -04:00
Joel Bernstein 416cc163ba SOLR-12840: Update CHANGES.txt 2018-10-28 14:26:57 -04:00
Joel Bernstein f8ffc1afd6 SOLR-12811: Update CHANGES.txt 2018-10-28 13:47:12 -04:00
Joel Bernstein 7a63e13a3b SOLR-11907: Update CHANGES.txt 2018-10-28 13:42:29 -04:00
Joel Bernstein 1abc38b40e SOLR-12828: Update CHANGES.txt 2018-10-28 13:30:43 -04:00
Marvin Bredal Lillehaug 6c419454a2 SOLR-7557: Fix parsing of child documents using queryAndStreamResponse 2018-10-26 14:59:31 +02:00
Noble Paul f33be7a172 SOLR-12868: Request forwarding for v2 API is broken 2018-10-26 12:50:45 +11:00
Cassandra Targett 8d10939349 SOLR-12423: fix Tika version in CHANGES 2018-10-25 11:56:19 -05:00
Varun Thacker 71988c756b SOLR-12793: Move TestCloudJSONFacetJoinDomain amd TestCloudJSONFacetSKG to the facet test package 2018-10-24 13:57:35 -07:00
David Smiley 3e89b7a771 SOLR-12754: New hl.weightMatches for UnifiedHighlighter WEIGHT_MATCHES
(defaults to true in master/8)
2018-10-23 13:28:10 -04:00
Tommaso Teofili 9df96d2530 SOLR-12879 - added missing attribution in CHANGES.txt 2018-10-23 09:07:38 +02:00
Anshum Gupta d799fd53c7 SOLR-5004: Allow a shard to be split into 'n' sub-shards using the collections API 2018-10-22 15:01:24 -07:00
Noble Paul c31a95d261 SOLR-12846: Added support for "host" variable in autoscaling policy rules 2018-10-23 00:03:59 +11:00
Noble Paul 5de6332209 SOLR-12892: MapWriter to use CharSequence instead of String 2018-10-22 11:14:41 +11:00
Tommaso Teofili a7c9c9d8ce SOLR-12879 - MinHash query parser 2018-10-20 08:28:02 +02:00
Andrew Lundgren 1a8188d92b SOLR-10981: Support for stream.url or stream.file pointing to gzipped data 2018-10-18 19:53:21 -04:00
Uwe Schindler 4b2136eb3c SOLR-12874: Java 9+ GC Logging filesize parameter should use a unit
(merge branch 'java9plus_gc_logging_filesize' of https://github.com/tpunder/lucene-solr); this closes #470
2018-10-17 23:24:51 +02:00
Erick Erickson fc886497de SOLR-12423: Upgrade to Tika 1.19.1 when available. Fixes #468 2018-10-17 13:06:09 -04:00
Noble Paul 9c7b8564d8 SOLR-12806: use autoscaling policies with strict=false to prioritize node allocation 2018-10-16 16:56:51 +11:00
Christine Poerschke 9c8ffabfe3 SOLR-12780: Add support for Leaky ReLU and TanH activations in contrib/ltr NeuralNetworkModel class.
(Kamuela Lau, Christine Poerschke)
2018-10-12 17:08:35 +01:00
Joel Bernstein d48f22c1ad SOLR-12851: Update CHANGES.txt 2018-10-11 11:19:57 -04:00
Jan Høydahl 80011d669a SOLR-12620: Remove the Admin UI Cloud -> Graph (Radial) view 2018-10-10 21:54:34 +02:00
Andrzej Bialecki 23e22e6460 SOLR-12729: SplitShardCmd should lock the parent shard to prevent parallel splitting requests. 2018-10-09 21:30:10 +02:00
Cao Manh Dat a37a213975 SOLR-11812: Remove backward compatibility of old LIR implementation in 8.0 2018-10-09 16:20:49 +07:00
Noble Paul b4d9b25f44 SOLR-12843: Implement a MultiContentWriter in SolrJ to post multiple files/payload at once 2018-10-09 17:44:40 +11:00
Shalin Shekhar Mangar dbed8bafe6 SOLR-12739: Autoscaling policy framework is now used as the default strategy to select the nodes on which new replicas or replicas of new collections are created.
Previously, the maxShardsPerNode parameter was not allowed on collections when autoscaling policy was configured. Also if an autoscaling policy was configured then the default was to set an unlimited maxShardsPerNode automatically. Now the maxShardsPerNode parameter is always allowed during collection creation and maxShardsPerNode should be set correctly (if required) regardless of whether autoscaling policies are in effect or not. The default value of maxShardsPerNode continues to be 1 as before. It can be set to -1 during collection creation to fall back to the old behavior of unlimited maxShardsPerNode when using autoscaling policy. This patch also fixes PolicyHelper to find the free disk space requirements of a new replica from the leader only if said leader node is alive.
2018-10-09 12:10:28 +05:30
Joel Bernstein df07a43b56 SOLR-12749: Update CHANGES.txt 2018-10-08 13:05:26 -04:00
David Smiley 49285e8423 Solr CHANGES.txt: forgot leading "*" 2018-10-07 23:17:33 -04:00
Jason Gerlowski 367bdf7f74 SOLR-12803: Ensure CUSC routes docs to right cores
ConcurrentUpdateSolrClient can batch together many documents when making
an indexing request to Solr.  When adding an update request to the
current batch being made, it checks that the query-parameters of the
docs being added match those already in the batch.  But prior to this
commit it never checked that the collections/cores were the same.

This could result in documents being sent to the wrong collection if the
same client is used to index documents to two different
cores/collections simultaneously.

This commit addresses this problem, ensuring that documents aren't added
to a batch directed at a different core/collection.
2018-10-07 10:08:50 -04:00
David Smiley e2b8beccb0 SOLR-12782: UninvertingReader avoids FieldInfo creation.
Wrapping is now a bit more lightweight: Does not create FieldInfo for fields that
can't be uninverted (saves mem) and can avoid wrapping the reader altogether if there's nothing to uninvert.
IndexSchema.getUninversionMap refactored to getUninversionMapper and no longer merges FieldInfos.
2018-10-05 20:40:39 -07:00
Shalin Shekhar Mangar eb47099ee2 SOLR-12836: ZkController creates a cloud solr client with no connection or read timeouts.
This changes ZkController to use the http client created by the update shard handler instead of creating a custom one.
2018-10-05 15:18:11 +05:30
Shalin Shekhar Mangar ace0db7a0a SOLR-12835: Document statistics exposed by the Query Result Cache when maxRamMB is configured 2018-10-05 08:20:31 +05:30
Jan Høydahl 5fb384c989 SOLR-12814: Metrics history causing "HttpParser URI is too large >8192" when many collections
This fixes #461
2018-10-04 18:32:38 +02:00
Andrzej Bialecki 452c2dabf0 SOLR-12815: Implement maxOps limit for IndexSizeTrigger. 2018-10-04 12:48:25 +02:00
Shalin Shekhar Mangar 152fd966a7 SOLR-12827: Migrate cluster wide defaults syntax in cluster properties to a nested structure
The cluster wide defaults structure has changed from {collectionDefaults: {nrtReplicas : 2}} to {defaults : {collection : {nrtReplicas : 2}}}.  The old format continues to be supported and can be read from ZK as well as written using the V2 set-obj-property syntax but it is deprecated and will be removed in Solr 9. We recommend that users change their API calls to use the new format going forward.
2018-10-04 16:12:55 +05:30
Tomas Fernandez Lobbe 46f753d7c6 SOLR-12767: Always include the achieved rf in the response
This commit deprecates the min_rf parameter. Solr now always includes the achieved replication
factor in the update requests (as if min_rf was always specified). Also, reverts the changes
introduced in SOLR-8034, replicas that don't ack an update will have to recover to prevent
inconsistent shards.
2018-10-03 09:40:15 -07:00
Noble Paul d8e40796e2 SOLR-12822: /autoscaling/suggestions to include suggestion to add-replica for lost replicas 2018-10-03 23:37:58 +10:00
Andrzej Bialecki abace2987a Fix the CHANGES entry - this is applicable only to 8.0 codebase. 2018-10-03 14:11:43 +02:00
Andrzej Bialecki eba7bedadf SOLR-12725: ParseDateFieldUpdateProcessorFactory should reuse ParsePosition. 2018-10-03 13:59:02 +02:00
Shalin Shekhar Mangar 84683b6aa0 SOLR-12750: Migrate API should lock the collection instead of shard 2018-10-03 16:24:26 +05:30
Shalin Shekhar Mangar 65105aa81b SOLR-12648: Autoscaling framework based replica placement is not used unless a policy is specified or non-empty cluster policy exists 2018-10-03 15:52:51 +05:30
David Smiley fe844c739b LUCENE-8513: Remove MultiFields.getFields
SlowCompositeReaderWrapper now works with MultiTerms directly
2018-10-01 10:39:12 -04:00
David Smiley 964cc88cee SOLR-12593: remove date parsing from extract contrib
* added "ignored_*" to the default configSet
* Updated Ref Guide info on Solr Cell to demonstrate usage without using the techproducts configSet

Closes #438
2018-09-28 16:50:11 -04:00
Charles Sanders 9481c1f623 SOLR-5163: edismax now throws an exception when qf refers to a nonexistent field 2018-09-27 15:53:26 -04:00
Peter Somogyi 044bc2a485 SOLR-12652: Remove SolrMetricManager.overridableRegistryName() 2018-09-27 15:39:55 -04:00
Shalin Shekhar Mangar c587410f99 SOLR-12756: Refactor Assign and extract replica placement strategies out of it.
Now, assignment is done with the help of a builder class instead of calling a method with large number of arguments. The number of special cases that had to be handled have been cut down as well.
2018-09-27 16:15:38 +05:30
Cao Manh Dat 667b8299e6 SOLR-12805: Store previous term (generation) of replica when start recovery process 2018-09-26 10:35:44 +07:00
noble 3f2975c27c SOLR-11522: /autoscaling/suggestions now include rebalance options as well even if there are no violations 2018-09-25 00:34:21 +10:00
Erick Erickson 95cc6f4f76 SOLR-12776: Setting of TMP in solr.cmd causes invisibility of Solr to JDK tools 2018-09-23 16:03:30 -07:00
Varun Thacker 60569fbe4e SOLR-11836: Move CHANGES entry to the 7.6 section 2018-09-21 17:01:37 -07:00
Shalin Shekhar Mangar 4bcace571e SOLR-9317: ADDREPLICA command should be able to add more than one replica to a collection,shard at a time.
The API now supports 'nrtReplicas', 'tlogReplicas', 'pullReplicas' parameters as well 'createNodeSet' parameter. As part of this change, the CREATESHARD API now delegates placing replicas entirely to the ADDREPLICA command and uses the new parameters to add all the replicas in one API call.
2018-09-21 15:12:21 +05:30
Steve Rowe 7d0a7782fa SOLR-12771: add CHANGES entry 2018-09-17 15:02:10 -04:00
Andrzej Bialecki 36eae57163 SOLR-12765: Incorrect format of JMX cache stats. 2018-09-17 15:33:16 +02:00
David Smiley ac7969e3c0 SOLR-6280: CollapseQParser now throws an error when pointing to a multi-valued field. 2018-09-17 09:08:54 -04:00
Erick Erickson b2b597b038 SOLR-12773: Fix typos widely spread around codebase 2018-09-16 09:46:20 -07:00
Cassandra Targett 39733cbf5f SOLR-12551: fix Tika version in list of major components in CHANGES.txt 2018-09-14 08:55:53 -05:00
Tomas Fernandez Lobbe 4a5b914eaa SOLR-12766: Improve backoff for internal retries
When retrying internal update requests, backoff only once for the full batch of retries
instead of for every request.
Make backoff linear with the number of retries
2018-09-12 21:11:34 -07:00
David Smiley 6e8c05f6fe SOLR-12361: ref guide changes & CHANGES.txt organization 2018-09-12 17:34:28 -04:00
Varun Thacker 2b553f03be SOLR-11836: add all contributors for the patch 2018-09-11 12:37:50 -07:00