Commit Graph

30155 Commits

Author SHA1 Message Date
yonik 1067cabc19 SOLR-12170: fix date format exceptions for terms facet on date field 2018-05-09 15:42:58 -04:00
Joel Bernstein 144f00a1e3 Squashed commit of the following:
commit e5074c3223e394af17f686294a67a1dd3ecdd147
Author: Joel Bernstein <jbernste@apache.org>
Date:   Wed May 9 13:16:34 2018 -0400

    SOLR-12280: WIP

commit 69cdeccf161177d10f4d2407542392aaee3fcfe8
Author: Joel Bernstein <jbernste@apache.org>
Date:   Wed May 9 13:08:02 2018 -0400

    SOLR-12280: WIP

commit c94f0c87c3e57c023d622ad2411e522c4aac491c
Author: Joel Bernstein <jbernste@apache.org>
Date:   Wed May 9 11:54:58 2018 -0400

    SOLR-12280: WIP

commit 68dd1e73355cb84410f2d0ff3a51797ed6194a10
Author: Joel Bernstein <jbernste@apache.org>
Date:   Wed May 9 10:54:32 2018 -0400

    SOLR-12280: WIP

commit 04a010543418a469100fa299c606a7b1eed452e1
Author: Joel Bernstein <jbernste@apache.org>
Date:   Wed May 9 10:47:27 2018 -0400

    SOLR-12280: WIP

commit a6bbfbadaafe33fcdf93d5c72755e30dadadf017
Author: Joel Bernstein <jbernste@apache.org>
Date:   Wed May 9 09:40:08 2018 -0400

    SOLR-12280: WIP

commit 5d27961aa291bcd71527337632981bcdf62369b4
Author: Joel Bernstein <jbernste@apache.org>
Date:   Tue May 8 20:43:33 2018 -0400

    SOLR-12280: WIP

commit e982cf939f429c05b736f6292c68dd96d7ebc027
Author: Joel Bernstein <jbernste@apache.org>
Date:   Tue May 8 13:27:29 2018 -0400

    SOLR-12280: WIP

commit aae78ab6f387c28a080021bc919ef51864540be2
Author: Joel Bernstein <jbernste@apache.org>
Date:   Tue May 8 12:23:52 2018 -0400

    SOLR-12280: WIP

commit 0787ad76f0f4c62c860784b15490d8a988939997
Author: Joel Bernstein <jbernste@apache.org>
Date:   Tue May 8 12:20:38 2018 -0400

    SOLR-12280: WIP

commit 4df098376ba05188702cca8582959c3fe18066f5
Author: Joel Bernstein <jbernste@apache.org>
Date:   Tue May 8 12:12:11 2018 -0400

    SOLR-12280: WIP

commit 5c0be5136bbab7e0c33b3b8a7b0395b1b330e96d
Author: Joel Bernstein <jbernste@apache.org>
Date:   Tue May 8 12:04:57 2018 -0400

    SOLR-12280: WIP

commit 6c6feac4c2e5a49a5eab87a228713d1b93c8fc70
Author: Joel Bernstein <jbernste@apache.org>
Date:   Tue May 8 11:57:49 2018 -0400

    SOLR-12280: WIP

commit 7d46d11c9dd3a51b68600c2c889f586147545294
Author: Joel Bernstein <jbernste@apache.org>
Date:   Tue May 8 11:50:51 2018 -0400

    SOLR-12280: WIP

commit 8b6bf19d0091203ed63b39d070dd02a9bece6a61
Author: Joel Bernstein <jbernste@apache.org>
Date:   Mon May 7 10:53:14 2018 -0400

    SOLR-12280: WIP

commit 5466591999816eaacde6ce18d824d7688e5f4fe8
Author: Joel Bernstein <jbernste@apache.org>
Date:   Fri May 4 15:12:43 2018 -0400

    SOLR-12280: WIP

commit d7fff7d557a7fd26011c21445b7969b2cd81036f
Author: Joel Bernstein <jbernste@apache.org>
Date:   Fri Apr 27 12:50:27 2018 -0400

    SOLR-12280: Initial commit
2018-05-09 13:24:08 -04:00
Simon Willnauer 4177252a10 [TEST] Never oversize bitset 2018-05-09 19:11:13 +02:00
Simon Willnauer a3c86373e4 LUCENE-8298: Allow DocValues updates to reset a value
Today once a document has a value in a certain DV field this values
can only be changed but not removed. While resetting / removing a value
from a field is certainly a corner case it can be used to undelete a
soft-deleted document unless it's merged away.
This allows to rollback changes without rolling back to another commitpoint
or trashing all uncommitted changes. In certain cenarios it can be used to
"repair" history of documents in distributed systems.
2018-05-09 18:57:57 +02:00
Adrien Grand 7873cf845e LUCENE-8296: PendingDeletes may no longer write to live docs after they are shared. 2018-05-09 15:40:14 +02:00
Adrien Grand 8dc69428e3 LUCENE-8303: Make LiveDocsFormat only responsible for serialization/deserialization of live docs. 2018-05-09 15:40:14 +02:00
Dawid Weiss b53ee58023 LUCENE-8301: Update randomizedtesting to 2.6.0 2018-05-09 13:28:03 +02:00
Mikhail Khludnev ef8edbab00 SOLR-12303: documenting default \[subquery].qt trap. 2018-05-09 12:47:46 +03:00
Simon Willnauer 6262b7757b [TEST] Fix TestNorms to ensure that max token lenght is at least 3 to have predictable norms 2018-05-09 10:04:18 +02:00
Varun Thacker 1705e4f291 SOLR-12265: Upgrade to Jetty 9.4.10 2018-05-08 21:31:09 -07:00
David Smiley c3d28a5b0f SOLR-12258: A V2 request referencing a collection or alias may fail to resolve it if it was just recently created.
Now we sync with ZooKeeper and try one more time.  V1 partially did this but only for aliases; now it does both.
2018-05-08 15:10:07 -04:00
Erick Erickson abb57c5c81 SOLR-12192: Error when ulimit is unlimited 2018-05-08 09:54:40 -07:00
Dawid Weiss 85c00e77ef LUCENE-8267: removed references to memory codecs. 2018-05-08 10:32:11 +02:00
David Smiley 08ee037ff8 SOLR-12308: LISTALIASES is now assured to return an up-to-date response
* MiniSolrCloudCluster.deleteAllCollections will now first delete aliases
* Minor refactorings to AliasesManager, AliasIntegrationTest, CreateRoutedAliasTest
2018-05-07 22:17:30 -04:00
Dawid Weiss 3e8f31ead0 LUCENE-8261: non-recursive->recursive (javadoc update). 2018-05-07 21:34:59 +02:00
David Smiley 81f611209c SOLR-12312: Replication's IndexFetcher buf size should be initialized
to an amount no greater than the size of the file being transferred.
2018-05-07 14:54:11 -04:00
Simon Willnauer b0b32931b2 LUCENE-8297: Add IW#tryUpdateDocValues(Reader, int, Fields...)
IndexWriter can update doc values for a specific term but this might
affect all documents containing the term. With tryUpdateDocValues
users can update doc-values fields for individual documents. This allows
for instance to soft-delete individual documents.
The new method shares most of it's code with tryDeleteDocuments.
2018-05-07 14:35:59 +02:00
Jason Gerlowski 6521d86dde SOLR-12279: Reject invalid 'blockUnknown' values for 'bin/solr auth' 2018-05-07 07:41:13 -04:00
Dawid Weiss 445c0aa47e LUCENE-8261: InterpolatedProperties.interpolate and recursive property references. 2018-05-07 13:22:11 +02:00
Simon Willnauer f9942b525b LUCENE-8275: Suppress WindowsFS TestDirectoryTaxonomyWriter
TestDirectoryTaxonomyWriter#testRecreateAndRefresh can't deal with pending
files since it creates multiple IW instances on the same directory.
2018-05-07 12:01:32 +02:00
markrmiller 5fc7251540 SOLR-12290: We must close ContentStreams because we don't know the source of the inputstream - use a CloseShield to prevent tripping our close assert in SolrDispatchFilter. 2018-05-06 14:25:59 -05:00
Uwe Schindler 0922e58c2c Merge branch 'master' of https://git-wip-us.apache.org/repos/asf/lucene-solr 2018-05-06 15:54:04 +02:00
Uwe Schindler fb5b42a0e4 SOLR-12316: Fix test to work on linux and test also windows in a better way 2018-05-06 15:53:07 +02:00
Mikhail Khludnev beaf3a47eb SOLR-8998: documentation fix. 2018-05-06 16:46:56 +03:00
Uwe Schindler 1b76011421 SOLR-12316: Do not allow to use absolute URIs for including other files in solrconfig.xml and schema parsing 2018-05-06 14:21:34 +02:00
Erick Erickson 89fc02a3b0 SOLR-12028: BadApple and AwaitsFix annotations usage 2018-05-04 22:30:18 -07:00
Mark Miller 3a2572db79 SOLR-12293: Updates need to use their own connection pool to maintain connection reuse and prevent spurious recoveries. 2018-05-04 20:02:56 -05:00
Mark Miller 296201055f SOLR-12290: Do not close any servlet streams and improve our servlet stream closing prevention code for users and devs. 2018-05-04 18:02:06 -05:00
Adrien Grand ad0ad2ec89 LUCENE-8295: Remove useless liveDocsSharedPending flag. 2018-05-04 14:38:42 +02:00
Simon Willnauer 3a6f5313d6 LUCENE-8293: Ensure only hard deletes are carried over in a merge
Today we carry over hard deletes based on the SegmentReaders liveDocs.
This is not correct if soft-deletes are used especially with rentention
policies. If a soft delete is added while a segment is merged the document
might end up hard deleted in the target segment. This isn't necessarily a
correctness issue but causes unnecessary writes of hard-deletes. The biggest
issue here is that we assert that previously deleted documents are still deleted
in the live-docs we apply and that might be violated by the retention policy.
2018-05-04 12:16:03 +02:00
Anshum Gupta b617489638 SOLR-11277: Add auto hard commit setting based on tlog size (this closes #358) 2018-05-03 15:00:47 -07:00
Christine Poerschke ab11867364 json-facet-api.adoc typo fix. 2018-05-03 18:42:56 +01:00
Jim Ferenczi 9b261087ab LUCENE-8231: Add missing part of speech filter in the SPI META-INF file 2018-05-03 16:11:52 +02:00
Simon Willnauer 591fc6627a LUCENE-8290: Keep soft deletes in sync with on-disk DocValues
Today we pass on the doc values update to the PendingDeletes
when it's applied. This might cause issues with a rentention policy
merge policy that will see a deleted document but not it's value on
disk.
This change moves back the PendingDeletes callback to flush time
in order to be consistent with what is actually updated on disk.

This change also makes sure we write values to disk on flush that
are in the reader pool as well as extra best effort checks to drop
fully deleted segments on flush, commit and getReader.
2018-05-03 13:38:35 +02:00
Varun Thacker 8b9c2a3185 SOLR-12288: Add more MDC logging information to core admin requests 2018-05-02 23:36:50 -07:00
Cao Manh Dat ed948efabf SOLR-12278: Fix typo errors in ref-guide 2018-05-03 10:40:21 +07:00
Cao Manh Dat 596d0dc9a6 SOLR-12278: Adding ref-guide doc for IgnoreLargeDocumentProcessorFactory 2018-05-03 10:35:03 +07:00
Varun Thacker 84925ba9ab SOLR-12289: Add more MDC logging information to collection admin requests 2018-05-02 19:01:07 -07:00
Adrien Grand 67c13bbe2e LUCENE-8142: Fix QueryUtils to only call getMaxScore when it is legal to do so. 2018-05-02 17:42:18 +02:00
Simon Willnauer 82e7cb2322 LUCENE-8289: Share logic between Numeric and Binary DocValuesFieldUpdates
NumericDocValuesFieldUpdates and BinaryDocValuesFieldUpdates duplicate
a significant amount of logic that can all be pushed into the base class.
This change moves all the logic that is independent of the type to the base
class.
2018-05-02 17:22:45 +02:00
Mikhail Khludnev df713fc700 SOLR-8998: ref guide update. 2018-05-02 18:23:15 +03:00
Adrien Grand 46ecb73976 LUCENE-8142: Fix AssertingImpactsEnum and add missing javadoc. 2018-05-02 17:20:42 +02:00
Adrien Grand e00c4cede2 LUCENE-8279: CheckIndex now cross-checks terms with norms. 2018-05-02 14:49:32 +02:00
Adrien Grand af680af77f LUCENE-8142: Make postings APIs expose raw impacts rather than scores. 2018-05-02 14:49:32 +02:00
Cao Manh Dat 555b7ef270 SOLR-12278: Add IgnoreLargeDocumentProcessFactory 2018-05-02 17:43:29 +07:00
koji ee2198d6bd SOLR-12202: Fix errors in solr-exporter.cmd 2018-05-02 13:59:13 +09:00
Mikhail Khludnev ee7b52f4c6 SOLR-8998: uniqueBlock() aggreagation for singlevalue string fields in json.facet 2018-05-01 20:19:15 +03:00
jdyer1 d92b891f95 SOLR-12284: Stop adding parenthesis to word-break suggestions, unless query uses boolean operators. 2018-04-30 13:47:19 -05:00
Karl Wright 871ffbe10e Merge branch 'master' of https://git-wip-us.apache.org/repos/asf/lucene-solr 2018-04-30 06:12:46 -04:00
Karl Wright ff68acf244 LUCENE-8280: Reorganize to allow us to try lots of strategies until we get one. 2018-04-30 06:12:31 -04:00