Commit Graph

2637 Commits

Author SHA1 Message Date
David Smiley d3d0df9da1
SOLR-14472: Autoscale "cores": use metrics to count
Also counts all cores (lazy, transient), although currently impossible to use these in SolrCloud.
2020-05-18 17:41:29 -04:00
murblanc d2825282c9
SOLR-14473: Improve Overseer Javadoc (#1510)
Co-authored-by: Ilan Ginzburg <iginzburg@salesforce.com>
2020-05-18 15:21:16 -05:00
Uwe Schindler 06df50e759
LUCENE-9321: Port markdown task to Gradle (#1477) 2020-05-17 14:46:26 +02:00
Michael Gibney 54dca800a9
SOLR-14471: Fix last-place replica after shards.preference rules (#1507)
Properly apply base replica ordering to last-place shards.preference matches
2020-05-14 21:31:35 -07:00
Joel Bernstein f1db56afaf SOLR-14478: Allow the diff Stream Evaluator to operate on the rows of a matrix 2020-05-14 09:52:05 -04:00
Andrzej Bialecki dd4fa8f2f8 SOLR-14423: Additional fixes for object caching and incorrect test assumptions. 2020-05-13 19:37:12 +02:00
Samuel García Martínez adddab9d14
SOLR-14456: Fix Content-Type header forwarding on compressed requests (#1480)
Co-authored-by: Samuel García Martínez <samuelgma@inditex.com>
2020-05-12 17:50:07 -04:00
Andrzej Bialecki 4680e9245f SOLR-14423: Move static SolrClientCache from StreamHandler to CoreContainer for wider reuse and better life-cycle management. 2020-05-12 21:44:00 +02:00
Tomas Fernandez Lobbe d9f9d6dd47
SOLR-13289: Add Support for BlockMax WAND (#1456)
Add support for BlockMax WAND via a minExactHits parameter. Hits will be counted accurately at least until this value, and above that, the count will be an approximation. In distributed search requests, the count will be per shard, so potentially the count will be accurately counted until numShards * minExactHits. The response will include the value numFoundExact which can be true (The value in numFound is exact) or false (the value in numFound is an approximation).
2020-05-08 14:25:47 -07:00
Erick Erickson 9ae05e9b4f LUCENE-7788: fail precommit on unparameterised log messages and examine for wasted work/objects 2020-04-30 19:50:31 -04:00
Erick Erickson 6e96d01efc LUCENE-7788: fail precommit on unparameterised log messages and examine for wasted work/objects 2020-04-29 10:56:54 -04:00
Erick Erickson 960610a615 LUCENE-7788: fail precommit on unparameterised log messages and examine for wasted work/objects 2020-04-27 20:45:57 -04:00
Mike Drob 950a34ce13 SOLR-14412 use parameterized logging 2020-04-22 12:11:53 -05:00
Andrzej Bialecki 5d60ff4613 SOLR-12845: Add a default autoscaling cluster policy. 2020-04-22 17:46:39 +02:00
Mike Drob 58f9c79c6d
SOLR-14412 zkRun+https (#1437)
SOLR-14412

Check for results after retries failed in SolrClientNodeStateProvider
Set urlScheme=https with zkRun
2020-04-20 12:55:43 -05:00
Jan Høydahl 03363f413f
SOLR-14371 Zk StatusHandler should know about dynamic zk config (#1392) 2020-04-17 16:30:27 +02:00
Markus Schuch 74ecc13816 SOLR-14387 add testcase for ids with separators to GetByIdTest and fix SolrClient to escape ids properly 2020-04-16 11:52:03 -05:00
Shalin Shekhar Mangar 3e0f7b1971 SOLR-9909: Actually delete SolrjNamedThreadFactory.java 2020-04-13 13:47:20 +05:30
Shalin Shekhar Mangar 13f19f6555 SOLR-9906: SolrjNamedThreadFactory is deprecated in favor of SolrNamedThreadFactory. DefaultSolrThreadFactory is removed from solr-core in favor of SolrNamedThreadFactory in solrj package and all solr-core classes now use SolrNamedThreadFactory 2020-04-13 08:16:35 +05:30
Erick Erickson 1ca7067a81 SOLR-12028: BadApple and AwaitsFix annotations usage, Unannotated tests that haven't failed in a while 2020-03-30 20:37:55 -04:00
Ishan Chattopadhyaya 782ded2d7a SOLR-14317: HttpClusterStateProvider throws exception when only one node down (Closes #1342) 2020-03-29 07:20:32 +05:30
Munendra S N 132228d450 SOLR-14344: remove deprecated HttpSolrClient's Remote*Exception
* All usages are replaced by BaseHttpSolrClient's Remote*Exception
2020-03-28 11:36:06 +05:30
Andy Throgmorton d1601f6fdf SOLR-14260: SolrJ pluggable ConnectionSocketFactory in HttpClientUtil
see SocketFactoryRegistryProvider
Fixes #1261
2020-03-26 22:15:50 -04:00
mariemat aad814ba63 SOLR-14340: Remove unnecessary configset verification checks
Improves CLUSTERSTATUS times for massive clusters.
Closes #1373
2020-03-24 15:34:20 -04:00
Andrzej Bialecki 68e4304453 SOLR-14347: Autoscaling placement wrong when concurrent replica placements are calculated. 2020-03-23 18:21:40 +01:00
Munendra S N 5630619dfd SOLR-14343: set initcapacity properly in NamedList
* This is when map or map.entry array is passed in constructor
2020-03-23 19:54:54 +05:30
Munendra S N e36733d01d SOLR-14350: fix test failure due to SOLR-14012 2020-03-19 22:43:29 +05:30
Aroop 9a8602c96e
SOLR-14316: Fix unchecked type warning in JavaBinCodec (#1344)
Fix an unchecked type conversion warning in JavaBinCodec's readMapEntry's equals() method
Add test

Co-authored-by: Aroop Ganguly <aroop_ganguly@apple.com>
2020-03-12 09:55:01 -07:00
David Smiley 732348ec7f SOLR-14197: SolrResourceLoader refactorings to reduce API
* Remove SRL.listConfigDir (unused)
* Remove SRL.getDataDir
* Remove SRL.getCoreName
* Remove SRL.getCoreProperties
 XmlConfigFile needs to be passed in the substitutableProperties
 IndexSchema needs to be passed in the substitutableProperties
 Remove redundant Properties from CoreContainer constructors
* Remove SRL.newAdminHandlerInstance (unused)
* Remove SRL.openSchema and openConfig
* Avoid SRL.getConfigDir
 Also harmonized similar initialization logic between DIH Tika processor & ExtractingRequestHandler.
* Ensure SRL.addToClassLoader and reloadLuceneSPI are called at most once
 Don't auto-load "lib" in constructor; wrong place for this logic.
* Avoid SRL.getInstancePath
 Added SolrCore.getInstancePath instead
 Use CoreContainer.getSolrHome instead
 NodeConfig should track solrHome separate from SolrResourceLoader
* Simplify some SolrCore constructors
* Move locateSolrHome to new SolrPaths
* Move "User Files" stuff to SolrPaths
2020-03-11 09:20:28 -04:00
Marc A. Morissette 051133c13f
SOLR-12550: ConcurrentUpdateSolrClient doesn't respect timeouts for commits and optimize (#417)
ConcurrentUpdateSolrClient now propagates its connection and read timeouts to the private HttpSolrClient used to commit and optimize.
2020-02-20 04:29:20 -08:00
Christine Poerschke 003303a9cc SOLR-13041: Add hashCode for autoscaling.Condition to accompany the already present equals.
(Zsolt Gyulavari via Christine Poerschke)
2020-02-18 14:47:44 +00:00
Chris Hostetter 49e20dbee4 SOLR-14245: Fix ReplicaListTransformerTest
Previous changes to this issue 'fixed' the way the test was creating mock Replica instances,
to ensure all properties were specified -- but these changes tickled a bug in the existing test
scaffolding that caused it's "expecations" to be based on a regex check against only the base "url"
even though the test logic itself looked at the entire "core url"

The result is that there were reproducible failures if/when the randomly generated regex matched
".*1.*" because the existing test logic did not expect that to match the url or a Replica with
a core name of "core1" because it only considered the base url
2020-02-12 11:10:26 -07:00
Andrzej Bialecki 9a19093586 SOLR-14245: Validate Replica / ReplicaInfo on creation. 2020-02-07 17:56:39 +01:00
Robert Muir 0d339043e3
LUCENE-9209: fix javadocs to be html5, enable doclint html checks, remove jtidy
Current javadocs declare an HTML5 doctype: !DOCTYPE HTML. Some HTML5
features are used, but unfortunately also some constructs that do not
exist in HTML5 are used as well.

Because of this, we have no checking of any html syntax. jtidy is
disabled because it works with html4. doclint is disabled because it
works with html5. our docs are neither.

javadoc "doclint" feature can efficiently check that the html isn't
crazy. we just have to fix really ancient removed/deprecated stuff
(such as use of tt tag).

This enables the html checking in both ant and gradle. The docs are
fixed via straightforward transformations.

One exception is table cellpadding, for this some helper CSS classes
were added to make the transition easier (since it must apply padding
to inner th/td, not possible inline). I added TODOs, we should clean
this up. Most problems look like they may have been generated from a
GUI or similar and not a human.
2020-02-06 22:30:52 -05:00
Houston Putman 80ed8c281b
SOLR-13887: Use the default idleTimeout instead of 0 for HTTP2 (#991) 2020-02-05 11:15:37 -08:00
Chris Hostetter c5d0391df9 SOLR-14241: New delete() Stream Decorator 2020-02-05 10:49:24 -07:00
Joel Bernstein db78f6cd00 SOLR-14139: Support backtick phrase queries in Streaming Expressions 2020-01-31 11:54:14 -05:00
Chris Hostetter 517438e356 New /stream test cases showing authn+authz edge cases in cloud mode
This triggers various places in the Streaming Expressions code that use background threads
to confirm that the expected credentails (or lack of) are propogarded along.

Test currently has comments + workarounds for 2 known client issues:
 - SOLR-14226: SolrStream reports AuthN/AuthZ failures (401|403) as IOException w/o details
 - SOLR-14222: CloudSolrClient converts (update) 403 error to 500 error
2020-01-30 10:01:03 -07:00
Robert Muir 975df9ddd3
LUCENE-9182: add apache license headers to all .gradle files and enforce in rat task 2020-01-27 12:05:34 -05:00
Nick Vercammen 60a2926546
SOLR-14205 Do not fail when given timeout to connectionImpl.isValid() = 0
Closes #1204

Signed-off-by: Kevin Risden <krisden@apache.org>
2020-01-23 10:12:43 -05:00
Mike 338d386ae0
LUCENE-9145 First pass addressing static analysis (#1181)
Fixed a bunch of the smaller warnings found by error-prone compiler
plugin, while ignoring a lot of the bigger ones.
2020-01-17 13:30:39 -06:00
Dawid Weiss d7726495c5 Merge remote-tracking branch 'origin/master' into gradle-master 2020-01-09 19:22:09 +01:00
Kevin Risden 22155bf7a7
SOLR-14163: SOLR_SSL_CLIENT_HOSTNAME_VERIFICATION needs to work with Jetty server/client SSL contexts
Closes #1147

Signed-off-by: Kevin Risden <krisden@apache.org>
2020-01-09 10:28:35 -05:00
andywebb1975 ffe75fb441 SOLR-14165: set SolrResponse's serialVersionUID explicitly 2020-01-10 01:04:10 +11:00
Dawid Weiss 0674fada65 Merge remote-tracking branch 'origin/master' into gradle-master 2020-01-09 11:56:02 +01:00
Tomas Fernandez Lobbe a9beeb1d1e SOLR-14169: Fix 20 Resource Leak warnings in SolrJ's apache/solr/common 2020-01-08 11:16:32 -08:00
Dawid Weiss 405d227c55 Merge remote-tracking branch 'origin/master' into gradle-master 2020-01-07 08:45:12 +01:00
Nick Vercammen 1e0471a247
SOLR-14153: Return correct isolation level when retrieving it from the SQL Connection
As transactions are not supported a request to getTransactionIsolation() should return TRANSACTION_NONE (https://docs.oracle.com/javase/8/docs/api/java/sql/Connection.html#TRANSACTION_NONE)

Signed-off-by: Kevin Risden <krisden@apache.org>
2020-01-03 14:24:55 -05:00
Dawid Weiss d2409fe499 Follow-up unused import removal. 2020-01-03 14:20:52 +01:00
Dawid Weiss 6d1e34d0cc Follow-up unused import removal. 2020-01-03 14:20:21 +01:00
Dawid Weiss 985af95732 SOLR-13778: Solrj client will retry requests on SSLException with a suppressed SocketException (very likely a hard-closed socket connection) 2020-01-03 14:12:23 +01:00
Dawid Weiss f789e053d2 Solrj client will retry requests on SSLException with a suppressed SocketException (very likely a hard-closed socket connection) 2020-01-03 14:09:37 +01:00
Dawid Weiss 1a690d95ad Merge remote-tracking branch 'origin/master' into gradle-master 2020-01-02 10:49:19 +01:00
Nándor Mátravölgyi 4c9cc2cefd LUCENE-9093: UnifiedHighlighter LengthGoalBreakIterator frag align
Matches in passages should be centered better on average.
 Closes #1123
2020-01-01 00:57:00 -05:00
Dawid Weiss 23f3fd2d48 Merge remote-tracking branch 'origin/master' into gradle-master 2019-12-25 13:14:57 +01:00
Noble Paul ef15ae9805
SOLR-14125 : Streaming expressions to be loadable from packages (#1108)
SOLR-14125: Make <expressible> plugins work with packages
2019-12-23 15:20:26 +11:00
Tomas Fernandez Lobbe c4f68bdab9
SOLR-14095: Let the overseer use javabin to store responses in ZooKeeper (#1095)
The Overseer used java serialization to store command responses in ZooKeeper. This commit changes the code to use Javabin instead, while allowing Java serialization with a System property in case it's needed for compatibility
2019-12-20 14:55:01 -08:00
Dawid Weiss 5897b78572 Merge remote-tracking branch 'origin/master' into gradle-master 2019-12-20 17:35:40 +01:00
Kevin Risden aab3c5faa3
SOLR-14106: Cleanup Jetty SslContextFactory usage
Jetty 9.4.16.v20190411 and up introduced separate
client and server SslContextFactory implementations.
This split requires the proper use of of
SslContextFactory in clients and server configs.

This fixes the following
* SSL with SOLR_SSL_NEED_CLIENT_AUTH not working since v8.2.0
* Http2SolrClient SSL not working in branch_8x

Signed-off-by: Kevin Risden <krisden@apache.org>
2019-12-19 23:05:47 -05:00
Jason Gerlowski 7cfa31b103 SOLR-14042: Fix varargs precommit warnings 2019-12-19 10:03:04 -05:00
Matthias Krueger 1e5100d5a5
SOLR-14091: Removing deprecated configuration of Jetty's soLingerTime option
Signed-off-by: Kevin Risden <krisden@apache.org>
2019-12-18 17:24:43 -05:00
Dawid Weiss 4c94a13e69 Merge remote-tracking branch 'origin/master' into gradle-master 2019-12-17 13:38:14 +01:00
Robert Muir dc35e5752b LUCENE-9094: Ban ObjectInputStream and ObjectOutputStream in forbidden-apis 2019-12-16 13:31:11 -05:00
Dawid Weiss 4500f0e327 Consolidating versions between gradle and ant. 2019-12-13 13:31:23 +01:00
Dawid Weiss 035cede6b8 Merge remote-tracking branch 'origin/master' into gradle-master 2019-12-13 10:51:14 +01:00
Andrzej Bialecki e155649026 SOLR-13975: Make sure the stall time is adjusted up when an unusually long
poll time is configured.
2019-12-12 19:58:03 +01:00
Dawid Weiss 6094d4dd13 Merge remote-tracking branch 'origin/master' into gradle-master 2019-12-12 14:16:48 +01:00
noble b35f1debe3 SOLR-14013: javabin performance regressions 2019-12-12 23:26:37 +11:00
Joel Bernstein ee0a6b45ca SOLR-14060: Allow the random Streaming Expression to create the x-axis 2019-12-11 20:37:20 -05:00
Robert Muir dc031ea382 SOLR-14050: clean up tests use of network addresses
Solr tests now have a similar policy to Lucene, loopback use only. If a
test tries to resolve or connect to the internet, it will get SecurityException.

Some solr tests explicitly try to talk to dead nodes with real
networking. This is not good and asking for trouble, but use low loopback port numbers instead of
multicast addresses. The idea is that it fails faster. Move these to
constants so that stuff isn't copy-pasted everywhere, in case we have to
do something different later.
2019-12-11 12:51:45 -05:00
Dawid Weiss 27d5509644 Merge remote-tracking branch 'origin/master' into gradle-master 2019-12-11 08:57:18 +01:00
Andrzej Bialecki c4f0c33638 SOLR-13975, SOLR-13896: ConcurrentUpdateSolrClient connection stall prevention. 2019-12-10 21:45:43 +01:00
Andrzej Bialecki 6d03baa485 SOLR-13806: SolrJ QueryResponse._explainMap is incorrectly typed. 2019-12-10 20:44:17 +01:00
Joel Bernstein 8c6a2640ed SOLR-14043: Allow the precision Stream Evaluator to operate on matrices 2019-12-10 12:57:05 -05:00
Dawid Weiss 20eaaa012d Merge remote-tracking branch 'origin/master' into gradle-master 2019-12-10 14:52:30 +01:00
Houston Putman 1c78d2c637
SOLR-12217: Support shards.preference in SolrJ for individual shard requests (#984) 2019-12-09 17:11:58 -05:00
Dawid Weiss 511bcaa4c1 Merge remote-tracking branch 'origin/master' into gradle-master 2019-12-09 22:37:08 +01:00
Joel Bernstein 1eaa5b5ac2 SOLR-13957: Add sensible defaults for the facet, random, facet2D, timeseries, stats and update Streaming Expressions 2019-12-09 16:04:03 -05:00
Dawid Weiss f853d994ec Merge remote-tracking branch 'origin/master' into gradle-master 2019-12-09 16:48:21 +01:00
Christine Poerschke df933f8104 SOLR-14030: fix 2 javac warnings: [dep-ann] deprecated item is not annotated with @Deprecated 2019-12-09 14:13:52 +00:00
Dawid Weiss c3bb81f032 Merge remote-tracking branch 'origin/master' into gradle-master 2019-12-07 10:53:34 +01:00
Dawid Weiss 2a6ffd23fa Reverting aalto change. 2019-12-07 10:53:30 +01:00
Mike 155ab116a2
Revert "SOLR-13990: Switch out woodstox-core-asl with aalto-xml and upgrade woodstox stax-2 API (#1050)" (#1063)
This reverts commit 2387bb9d60.
2019-12-06 17:08:40 -06:00
Dawid Weiss 226f5490a0 Correct lucene version passed to tests to be stripped of qualifiers. 2019-12-06 13:05:10 +01:00
Dawid Weiss 8e81037180 Merging with master, updating deps. 2019-12-06 12:16:07 +01:00
Dawid Weiss f371df327f Merge remote-tracking branch 'origin/master' into gradle-master 2019-12-06 11:57:29 +01:00
Jan Høydahl 7417fa1cf3
SOLR-13954: Embedded ZooKeeper in Solr now does not try to load JettyAdminServer (#1059) 2019-12-06 11:03:23 +01:00
Anshum Gupta 2387bb9d60
SOLR-13990: Switch out woodstox-core-asl with aalto-xml and upgrade woodstox stax-2 API (#1050) 2019-12-05 18:37:53 +05:30
Dawid Weiss 1a24ccb4ee Merge remote-tracking branch 'origin/master' into gradle-master 2019-12-05 11:17:34 +01:00
Andrzej Bialecki f71c2c8e92 SOLR-13981: Remove unused DistributedQueue interface. (Andras Salamon) 2019-12-04 11:23:49 +01:00
Robert Muir 165529767b SOLR-14000: clean up more static field leaks in tests
On windows, these objects can't be inspected due to security restrictions. So the test runner fails the tests since it does not know how big the leak is.
2019-12-03 18:51:00 -05:00
Jeff 16f793915e SOLR-13926: javadocs on CompositeIdRouter
Closes #1009
2019-12-03 17:43:01 -05:00
Anshum Gupta 09df6647ac
SOLR-13998: Add thread safety annotations to classes (#1053) 2019-12-04 01:19:56 +05:30
Dawid Weiss 7c26c6de02 Merge remote-tracking branch 'origin/master' into gradle-master 2019-12-03 18:45:12 +01:00
noble a51c7b89f2 SOLR-13995: Move ZkShardTerms.Terms to SolrJ 2019-12-03 15:16:34 +11:00
Noble Paul d8f9f47ca0
SOLR-13992: Refactor code to have collection, shard name in Replica,Slice (#1051)
* SOLR-13992: Refactor code to have collection name shard name in Replica,Slice
2019-12-03 13:10:19 +11:00
Dawid Weiss d4a9842375 Initial gradle build layer. 2019-12-02 15:34:57 +01:00
noble 6c7a095f33 SOLR-13963: JavaBinCodec has concurrent modification of CharArr resulting in corrupt internode updates 2019-11-26 08:12:23 +11:00
Dawid Weiss 063c82ebd6 SOLR-13952: reverting Erick's commit (with permission). 2019-11-25 17:56:20 +01:00
Erick Erickson 4b34d726ab SOLR-13952: Separate out Gradle-specific code from other (mostly test) changes and commit separately 2019-11-24 13:24:40 -05:00
Andy Vuong 4910c0f558 SOLR-13950: Fix getLeaderRetry swallowing interrupt in ZkStateReader (#1023)
Let InterruptedException bubble up
2019-11-22 11:04:45 -08:00
Ishan Chattopadhyaya d9f41f8a5a SOLR-13662: Package manager (CLI) 2019-11-14 18:21:35 +05:30
Istvan Farkas 21a54c4bc7
SOLR-13921: Processing UpdateRequest with delegation token throws NullPointerException
Signed-off-by: Kevin Risden <krisden@apache.org>
2019-11-13 11:11:45 -05:00
noble 7a207a9353 SOLR-13822: Missing package-info files 2019-11-08 14:46:53 +11:00
Joel Bernstein 4f849e7a49 SOLR-13864: MathExpressionTest non-reproducible failures due to assertions of non-absolutes and randomization beyond test seed 2019-11-05 15:15:19 -05:00
Noble Paul b5f5b0f2bc
SOLR-13841: removed jackson dependencies from SolrJ and provided a mapping to our annotation (#992)
Provide mappings for jackson annotation @JsonProperty to use Jackson deserializer
2019-11-04 16:38:21 +11:00
Joel Bernstein c908ea2e5a SOLR-10786: Add DBSCAN clustering Streaming Evaluator 2019-11-02 14:27:42 -04:00
Chris Hennick 74333c3af2 SOLR-13783: Add space after comma in NamedList.toString() (#979) 2019-10-28 17:09:08 -07:00
Tomas Fernandez Lobbe ee82e4567f SOLR-13865: Add missing package docs 2019-10-28 16:25:26 -07:00
Houston Putman fa27e476f7 SOLR-13865: Migrate replica routing code to SolrJ (#974)
* [SOLR-13865] Migrate replica routing code to  solrJ

* Added a CommonTestInjection class.

* Fixing imports.

* Reverted extraneous streaming changes.

* Fix precommit errors.

* Changing name of the RLTManager.

* Splitting up existing tests.

* Updated documentation.

* Added solr/CHANGES.txt entry
2019-10-28 15:49:21 -07:00
noble e5a5ceb6d8 a simple perf test to check serialization/deserialization perf 2019-10-28 17:17:26 +11:00
Noble Paul 98f08d39aa
SOLR-13822: Isolated Classloading from packages (#957)
SOLR-13822: A Package management system with the following features. A packages.json in ZK to store
  the configuration, APIs to read/edit them and isolated classloaders to load the classes from
  those packages if the 'class' attribute is prefixed with `<package-name>:`
2019-10-24 08:55:11 +11:00
Andrzej Bialecki c1174dc0d6 SOLR-13831: Support defining arbitrary autoscaling simulation scenarios. 2019-10-23 20:48:10 +02:00
Mikhail Khludnev afdb80069c SOLR-13824: reject prematurely closed curly bracket in JSON. 2019-10-21 23:25:06 +03:00
Noble Paul 831f90fa36
SOLR-13841: Add jackson databind annotations to SolrJ classpath
SOLR-13841: Add jackson databind annotations to SolrJ classpath
2019-10-20 10:00:13 +11:00
Munendra S N cabc125eef SOLR-13403: fix NPE in terms for DatePointField
* This fixes NPE and adds support for DatePointField in terms
  component
2019-10-18 23:45:57 +05:30
Munendra S N 227a624f8a SOLR-12769: correct documentation for delete op in request params API 2019-10-18 21:13:35 +05:30
Munendra S N dce0c5953c SOLR-13827: fail on unknown operation in Request Parameters API 2019-10-18 21:08:33 +05:30
Andrzej Bialecki f07998fc23 SOLR-13677: All Metrics Gauges should be unregistered by components that registered them. 2019-10-18 17:15:04 +02:00
Ishan Chattopadhyaya e2b160b865 SOLR-13834: ZkController#getSolrCloudManager() now uses the same ZkStateReader instance instead of instantiating a new one
ZkController#getSolrCloudManager() created a new instance of ZkStateReader, thereby causing mismatch in the
visibility of the cluster state and, as a result, undesired race conditions.
2019-10-15 14:51:02 +05:30
Jan Høydahl 64fb42c714
SOLR-13665: Added missing netty dependencies to solrJ (#938) 2019-10-15 10:35:05 +02:00
Koen De Groote e7e6cfaecf LUCENE-8994: Code Cleanup - Pass values to list constructor instead of empty constructor followed by addAll(). (#919) 2019-10-14 18:45:47 +02:00
Koen De Groote 04786244d0 LUCENE-8979: Code Cleanup: Use entryset for map iteration wherever possible. - part 2 2019-10-14 18:36:19 +02:00
Noble Paul b6ea7d60b7
SOLR-13731: javabin must support a 1:1 mapping of the JSON update format 2019-10-14 11:07:38 +11:00
Joel Bernstein ad1c24e190 SOLR-13829: RecursiveEvaluator casts Continuous numbers to Discrete Numbers, causing mismatch 2019-10-10 21:19:25 -04:00
Cao Manh Dat 1cda424503 SOLR-13293: ConcurrentUpdateHttp2SolrClient always log AsynchronousCloseException exception error on indexing 2019-10-09 20:56:50 +01:00
Noble Paul e3bd5a7da2
SOLR-13821: Package Store for storing package artifacts (#929)
SOLR-13821: Package Store for storing package artifacts
2019-10-08 14:24:33 +11:00
Andrzej Bialecki c0a446b179 SOLR-13790: LRUStatsCache size explosion and ineffective caching. 2019-10-07 19:53:52 +02:00
Jason Gerlowski 24afd95902 SOLR-13539: Improve atomic-update test coverage
Closes #665
2019-10-07 08:27:29 -04:00
Joel Bernstein 88fee95d54 SOLR-13298: Allow zplot to plot matrices 2019-10-06 22:18:00 -04:00
Noble Paul c5dc671aa3
SOLR-13787: An annotation based system to write v2 APIs
This is to make V2 APIs easier to write and less error prone
* All specs are always in sync with code
* specs are generated from code
*  no need to learn and write json schema
2019-10-07 09:19:57 +11:00
Mikhail Khludnev 1cf7368ed8 SOLR-13719: introducing SolrClient.ping(collection) 2019-10-06 23:36:58 +03:00
Ishan Chattopadhyaya 515af6d3ec SOLR-13661: Reverting all half-baked stuff from SOLR-13707, SOLR-13659, SOLR-13565, SOLR-13650, SOLR-13710, SOLR-13721, SOLR-13637
All half baked package management and hot-classloading code reverted to allow for a fresh start.
2019-10-06 18:00:40 +05:30
Thomas Wöckinger 22e96697de SOLR-13795: Managed schema should do a core reload in standalone mode.
Fixes #902
2019-10-04 13:05:01 -04:00
Thomas Wöckinger 4ddde00667 SOLR-13802: Write analyzer property luceneMatchVersion to managed schema 2019-10-01 09:17:59 -04:00
Joel Bernstein 22b8943407 SOLR-13632: Fix precommit 2019-09-29 19:14:43 -04:00
Joel Bernstein d4f612368d SOLR-13632: Support integral plots, cosine distance and string truncation with math expressions 2019-09-29 19:01:40 -04:00
Munendra S N e5d95011f0 SOLR-13417: handle stats on date/str fields in solrj's JSON facet resp
* Except for min/max aggregation in all other cases values woudl be
  number. As for same data/string field, value can vary based on
  aggregation used, capture response in Map<String, Object>
2019-09-28 12:08:55 +05:30
David Smiley 0d0af505a0 SOLR-13784: EmbeddedSolrServer coreName optional 2019-09-25 11:33:28 -04:00
Munendra S N 59fe7b7d9f SOLR-13725: allow negative values for limit in TermsFacetMap
* when limit is negative all the facet values are returned
* allow mincount=0 in TermsFacetMap.
2019-09-21 11:03:51 +05:30
Munendra S N c22379253c SOLR-13780: fix ClassCastException in NestableJsonFacet
* handle both int and long values for count. In case of single-shard or
  standalone, count is int whereas in multishard count would be long
2019-09-21 10:58:31 +05:30
Jason Gerlowski 2546e7a2ec SOLR-13622: Fix file-handle leak 2019-09-14 20:39:12 -04:00
Koen De Groote ec78ef7852 Changing keyset() to entryset() and sometines values(). (#868) 2019-09-13 14:42:38 +02:00
Andrzej Bialecki 6f22bf0964 SOLR-13742: Allow optional redaction of data saved by 'bin/solr autoscaling -save'.
Fix some unwanted side-effects in snapshots + add more robust unit tests.
2019-09-07 12:09:09 +02:00
Christine Poerschke 6574ae63d4 SOLR-13240: Fixed UTILIZENODE action resulting in IllegalArgumentException.
(Hendrik Haddorp, Richard Goodman, Tim Owen, shalin, noble, Christine Poerschke)
2019-09-06 12:36:33 +01:00
Megan Carey 8c796b5f46 SOLR-13727: Bug fix for V2Request handling in HttpSolrClient
Using regex to validate baseUrl and replace path for V2Requests

 Changed to using Java.net.URL for validation + path replacement
2019-09-04 22:14:15 -04:00
Christine Poerschke 5204d0f963 SOLR-13736: reduce code duplication in TestPolicy.testNodeLostMultipleReplica 2019-09-04 15:51:36 +01:00
Jason Gerlowski 319cb005d3 SOLR-13539: Introduce EmbeddedSolrServerTestBase
This groundwork commit allows tests to randomize request content-type
more flexibly.  This will be taken advantage of by subsequent commits.

Co-Authored-By: Thomas Woeckinger
Closes: #755
2019-08-29 09:52:46 -04:00
Noble Paul cf21340294
SOLR-13723: JettySolrRunner should support /api/* (the v2 end point) 2019-08-29 14:01:52 +10:00
Tomas Fernandez Lobbe 00f4bbe6fc
Merge pull request #717 from KoenDG/SOLR-13542
SOLR-13542: Code cleanup - Avoid using stream filter count where possible
2019-08-27 11:37:39 -07:00
Noble Paul e23c50b2a8
SOLR-13710: Persist package jars locally & expose them over http 2019-08-27 14:04:42 +10:00
KoenDG e2a285b6df Code changes and CHANGES.txt editted.
The majority of the code seems to already be using anyMatch and noneMatch logic, these few remaining instances were using count() and comparing the result to 0.
This changes everything to anyMatch and noneMatch, which is also potentially more performant.

Extra newline.
2019-08-26 22:16:20 +02:00
Tomas Fernandez Lobbe 225fd3d8ee SOLR-13655: Fix precommit 2019-08-23 15:29:36 -07:00
Atri Sharma 19aecb0f7d SOLR-13655:Upgrade Collections.unModifiableSet to Set.of and Set.copyOf (#817) 2019-08-23 14:31:28 -07:00
Noble Paul d1e4d81355
SOLR-13707: API to expose the currently used package name, details for each plugin (#841) 2019-08-22 16:27:19 +10:00
Tomas Fernandez Lobbe 8f4103dd4b SOLR-13257: Support deterministic replica routing
Deterministic replica routing can help improve caching and allow a more consistent paging when sorting by score

This closes #677
2019-08-21 11:31:12 -07:00
Noble Paul a4b0ab530f
SOLR-13650: Support for named global classloaders 2019-08-20 05:00:38 +10:00
Noble Paul 7415fe4539
SOLR-13677: All Metrics Gauges should be unregistered by the objects that registered them (#836)
* SOLR-13677: All Metrics Gauges should be unregistered by the objects that registered them
2019-08-19 19:48:06 +10:00
Christine Poerschke 9e6047331b SOLR-13240: make operation-not-null checks consistent in TestPolicy.testNodeLostMultipleReplica
(Richard Goodman via Christine Poerschke)
2019-08-13 15:24:19 +01:00
Megan Carey 768ca7c5a7 SOLR-13399: Adding splitByPrefix param to IndexSizeTrigger; some splitByPrefix test and code cleanup 2019-08-12 15:59:45 -04:00
Erick Erickson f6f1b4244c SOLR-13568: Precommit fail Java var until 9x. Fail var... 2019-08-11 11:49:54 -04:00
Noble Paul e45e8127d5
SOLR-13682: command line option to export documents to a file
* SOLR-13682: command line option to export documents to a file
2019-08-10 16:34:23 +10:00
Jason Gerlowski 2eb493d170 SOLR-13622: Rename FilesStream -> CatStream
Also fixes an 'cat' OS-dependent bug in StreamExpressionTest.
2019-08-08 08:38:21 -04:00
Shalin Shekhar Mangar ed137dbe28 SOLR-13674: NodeAddedTrigger does not support configuration of replica type hint.
A new replicaType property has been added to NodeAddTrigger so that new replicas of the given type are added when the preferredOp is addreplica. The default value of replicaType is `NRT`.

This closes #821.
2019-08-08 15:14:55 +05:30
yonik 19ddcfd282 SOLR-13399: ability to use id field for compositeId histogram 2019-08-06 14:10:20 -04:00
Munendra S N 8c4fde94fe SOLR-12555: use expectThrows() to verify the ex thrown in tests 2019-08-03 13:00:49 +05:30
Joel Bernstein ee0fd49244 SOLR-13667: Fix precommit 2019-08-02 15:48:55 -04:00
Joel Bernstein 03a39666c0 SOLR-13667: Add upper, lower, trim and split Stream Evaluators 2019-08-02 15:38:26 -04:00
Joel Bernstein 254a17b3b0 SOLR-13625: Fix precommit 2019-07-30 10:42:06 -04:00
Joel Bernstein 62955b1a4e SOLR-13625: Fix broken test cases 2019-07-30 10:42:06 -04:00
Joel Bernstein d0674866ed SOLR-13625: Add CsvStream, TsvStream Streaming Expressions and supporting Stream Evaluators 2019-07-30 10:42:06 -04:00
Jason Gerlowski dc8e9afff9 SOLR-13622: Add fileStream stream-source 2019-07-25 09:13:00 -04:00
noble afa64c892b SOLR-13637: removed ununsed code 2019-07-21 12:29:02 -07:00
Noble Paul 631edee1cb
SOLR-13637 Enable loading of plugins from the corecontainer memclassloader 2019-07-21 12:21:56 -07:00
Munendra S N 96d400f511 SOLR-12870: use StandardCharsets instead of String values
Fixes #469
2019-07-20 10:10:32 +05:30
Noble Paul bd30c3701e
SOLR-13565, SOLR-13553 (#774)
* SOLR-13565: initial commit

* SOLR-13565: updated with testcase

* SOLR-13565: removed unused methods

* SOLR-13565: better logging

* SOLR-13565: disable SSL

* SOLR-13565: more tests

* SOLR-13565: syncing with master

* SOLR-13565: fixing tests

* SOLR-13565: fixing tests

* SOLR-13534: Fix test

Remove buggy 'port roulette' code that can easily fail if OS gives the selected port to a different process just before creating the server

Use jetty's built in support for listining on an OS selected port instead

Also increase timeouts to better account for slow/heavily loaded (ie:jenkins) VMs where SolrCore reloading may take longer then 10 seconds

* SOLR-13565: set proper permission name

* SOLR-13565: syncing with master

* SOLR-13565: syncing with master

* SOLR-13565: removed accidental change

* SOLR-13565: removed accidental change

* SOLR-13565: removed accidental change

* SOLR-13565: more tests

* SOLR-13565: Tests with key signing tests

* SOLR-13565: fixing concurrency issues in tests

* SOLR-13565: add tests with 512 bit RSA

* SOLR-13565: fixing concurrency issues

* SOLR-13565: remove unused code
2019-07-20 14:20:32 +10:00
yonik c5cabf1e03 SOLR-13399: SPLITSHARD splitByPrefix for compositeId 2019-07-19 11:35:01 -04:00
Chris Hostetter 24b94b8dac Harden StreamDecoratorTest
remove flakey dependency on sleep (to wait for cache expiration) w/explicit instruction to ignore cache

sleep is not garunteed to sleep the exact amount (based on limitations of the system clock)
2019-07-18 19:40:24 -07:00
Gus Heck c97551cc36 SOLR-13375 - 2 dimensional routed aliases 2019-07-15 09:57:13 -04:00
Andrzej Bialecki dd4813d5b8 SOLR-13583: Return 400 Bad Request instead of 500 Server Error when a complex
alias is found but a simple alias was expected.
2019-07-05 09:19:32 +02:00
Andrzej Bialecki 717afb11fc SOLR-13583: Impossible to delete a collection with the same name as an existing alias. 2019-07-03 15:52:36 +02:00
Joel Bernstein 96d11063a7 SOLR-13589: Fix precommit 2019-07-01 21:54:25 -04:00
Joel Bernstein 6a99151eae SOLR-13589: Add zplot cluster test case 2019-07-01 21:39:45 -04:00
Joel Bernstein 2f6a681b39 SOLR-13589: Allow zplot to visualize clusters and convex hulls 2019-07-01 21:39:45 -04:00
Chris Hostetter aaf20aefa4 SOLR-12988: SSLTestConfig has been changed to throw AssumptionViolatedException when tests/seeds request SSL but the JVM appears to be an OpenJDK version known to have SSL bugs
SOLR-13574: Add CHANGES entry that was overlooked
2019-06-27 15:51:20 -07:00
Chris Hostetter 7e57d3a9d9 SOLR-13574: Fix many test and test-framework classes to not fail on After/AfterClass cleanup if assumptions fail in Before/BeforeClass setup 2019-06-27 10:28:06 -07:00
Jan Høydahl b54126169b SOLR-13569: AdminUI visual indication of prod/test/dev environment 2019-06-26 12:09:02 +02:00
Andrzej Bialecki 4d1058db6e SOLR-13566: REINDEXCOLLECTION does not work with (basic) authentication. 2019-06-25 16:54:27 +02:00
Noble Paul 742c80550c reformatting 2019-06-25 17:02:17 +10:00
Mikhail Khludnev 4589bbe47b SOLR-12866: Turn TestHdfsCloudBackupRestore ON. No changes yet. 2019-06-25 08:49:26 +03:00
Chris Hostetter 689fa583a0 Revert "SOLR-12988: SSLTestConfig has been changed to throw AssumptionViolatedException when tests/seeds request SSL but the JVM appears to be an OpenJDK version known to have SSL bugs"
This reverts commit 6d6f14d391.

Reason for revert: after doing more testing I realized there are tests I overlooked which can (with randomized SSL usage) trigger NullPointerException
(or other related failures) in After/AfterClass due assumptions about cleanup that isn't actaully neccessary due to the AssumptionFailure
that may occur during Before/BeforeClass
2019-06-24 15:42:23 -07:00
Chris Hostetter 6d6f14d391 SOLR-12988: SSLTestConfig has been changed to throw AssumptionViolatedException when tests/seeds request SSL but the JVM appears to be an OpenJDK version known to have SSL bugs 2019-06-24 15:02:18 -07:00
Mikhail Khludnev 9137a0b0fe SOLR-13545: ContentStreamUpdateRequest to close file. 2019-06-21 23:38:08 +03:00
Gus Heck 5d47875184 SOLR-13419 - Better infix for TRA collection names 2019-06-20 09:47:52 -04:00
Joel Bernstein e88366c9b6 SOLR-10291: Add match Stream Evaluator to support regex matching 2019-06-19 19:40:20 -04:00
Cao Manh Dat 91944a468e SOLR-12988: Skip running tests with SSL on Java 11 to 11.0.2 2019-06-19 10:43:17 +01:00
Joel Bernstein 8a35088947 SOLR-13560: Fix precommit 2019-06-18 22:33:40 -04:00
Joel Bernstein 1dd98ca65d SOLR-13560: Add isNull and notNull Stream Evaluators 2019-06-18 22:33:40 -04:00
Noble Paul ed42d36c7b SOLR-13329: changed the put:on-each to put: on-each-node 2019-06-19 00:16:57 +10:00
Cao Manh Dat c8382890ae SOLR-12988: Avoid using TLSv1.3 for HttpClient 2019-06-18 12:49:51 +01:00