Commit Graph

13743 Commits

Author SHA1 Message Date
Ishan Chattopadhyaya de39472f07 SOLR-13662: Fixes to package manager
* Better logging and error reporting
* Fixing deploy command to handle previously undeployed packages
* Test now uses @LogLevel annotation
* Deploy command had a hard coded collection name by mistake, fix it
2019-12-15 10:54:51 +05:30
David Smiley 7b27fb651b SOLR-14069: Ref guide: overhaul: resources, libs, plugins, config-sets (#1077)
* split "resource-and-plugin-loading.adoc" into "resource-loading.adoc" and "libs.adoc" then overhauled both.
* enhanced "config-sets.adoc", moving some content in from elsewhere; bit of an overhaul.
* solr-plugins.adoc is now top-level; overhauled content
* Move resource-loading.adoc up a level in the TOC to underneath "The Well-Configured Solr Instance.
* Separate out the leading sentence.

(cherry picked from commit 7c048c5070)
2019-12-14 12:03:28 -05:00
David Smiley e2ce7d918d SOLR-14069: Ref guide: overhaul: resources, libs, plugins, config-sets (#1077)
* split "resource-and-plugin-loading.adoc" into "resource-loading.adoc" and "libs.adoc" then overhauled both.
* enhanced "config-sets.adoc", moving some content in from elsewhere; bit of an overhaul.
* solr-plugins.adoc is now top-level; overhauled content
* Move resource-loading.adoc up a level in the TOC to underneath "The Well-Configured Solr Instance.
* Separate out the leading sentence.

(cherry picked from commit 7c048c5070)
2019-12-14 12:00:26 -05:00
Kevin Risden 15f570fc4b
SOLR-14077: Hadoop shouldn't need to look for metrics config in user home
Signed-off-by: Kevin Risden <krisden@apache.org>
2019-12-13 22:09:28 -05:00
yonik 1be81700be SOLR-14079: fix SPLITSHARD splitByPrefix in async mode 2019-12-13 17:56:20 -05:00
erick 453577cbd5 SOLR-14026: Upgrade Jetty to 9.4.24.v20191120 and dropwizard to 4.1.2, moved to 8.5 in CHANGES.txt 2019-12-13 12:43:49 -05:00
erick 1a48a87f61 SOLR-14026: Upgrade Jetty to 9.4.24.v20191120 and dropwizard to 4.1.2
(cherry picked from commit 8278886966)
2019-12-13 12:15:32 -05:00
Robert Muir 4a3fa721fb SOLR-14076: clean up static fields leak in nightly-only test 2019-12-13 04:06:33 -05:00
noble 9717540b8e SOLR-14013: javabin performance regressions 2019-12-13 17:42:24 +11:00
Kevin Risden c021a253fe
SOLR-14048: Improve Hadoop test sanity checks
Signed-off-by: Kevin Risden <krisden@apache.org>
2019-12-12 22:27:17 -05:00
Andrzej Bialecki 640e6fc3c0 SOLR-13975: Make sure the stall time is adjusted up when an unusually long
poll time is configured.
2019-12-12 19:07:36 +01:00
Kevin Risden 85b433e277
SOLR-14047: Make sure tests don't pickup other Hadoop installs
Signed-off-by: Kevin Risden <krisden@apache.org>
2019-12-12 10:36:54 -05:00
Ishan Chattopadhyaya 8d07ba5c9c SOLR-14065: Deprecate Velocity 2019-12-12 16:13:59 +05:30
Ishan Chattopadhyaya 4c7f5039c7 SOLR-13978: Removed LTR from default configset 2019-12-12 15:09:59 +05:30
Ishan Chattopadhyaya 72b3c54e7d SOLR-14071: Untrusted configsets shouldn't be allowed to use <lib> directive 2019-12-12 15:01:06 +05:30
Adrien Grand 451d5348f4 Add next minor version 8.5 2019-12-12 09:33:20 +01:00
Ishan Chattopadhyaya 08b8d116f8 SOLR-13978: Remove non-essential components from default configset
The default configset no longer has the following:
   - Library inclusions (<lib ../>) for extraction, solr-cell libs, clustering, velocity and language identifier
   - /browse, /tvrh and /update/extract handlers
   - TermVector component (if someone wants it, can be added using config APIs)
   - XSLT response writer
   - Velocity response writer
If you want to use them in your collections, please add them to your configset manually or through the Config APIs.
2019-12-12 10:44:35 +05:30
Munendra S N 576591205c SOLR-13970: disallow using collapse/expand with grouping
* Using collapse with grouping would cause inconsistent behavior.
  This is because grouping calls the same postfilter twice without
  resetting the internal state of the DocValues cache
* Using expand with grouping would cause NPE
2019-12-12 10:22:32 +05:30
Ishan Chattopadhyaya b52bed0a47 SOLR-14062: Split IndexSizeTriggerTest into three 2019-12-12 10:17:25 +05:30
Ishan Chattopadhyaya a13b387fb5 SOLR-13945: SPLITSHARD can cause data loss due to rollback when final commit fails 2019-12-12 09:03:07 +05:30
Kevin Risden 5b4266db7d
SOLR-14053: Fix HDFS tests to be ignored if Native I/O isn't available (remove tests.disableHdfs)
Signed-off-by: Kevin Risden <krisden@apache.org>
2019-12-11 22:03:08 -05:00
Dawid Weiss d6e7898bc9
SOLR-14053: Don't start hdfs when native libraries can't be loaded. Remove tests.disableHdfs. (#1072) 2019-12-11 22:03:01 -05:00
Joel Bernstein c4dce29582 SOLR-14060: Update CHANGES.txt 2019-12-11 21:00:13 -05:00
Joel Bernstein deea5868ad SOLR-14060: Allow the random Streaming Expression to create the x-axis 2019-12-11 20:38:15 -05:00
Mikhail Khludnev f914d9aac7 SOLR-13904: Make Analytics component sensitive to timeAllowed. 2019-12-12 00:11:39 +03:00
Robert Muir 715b2151ac SOLR-14050: clean up tests use of network addresses
Solr tests now have a similar policy to Lucene, loopback use only. If a
test tries to resolve or connect to the internet, it will get SecurityException.

Some solr tests explicitly try to talk to dead nodes with real
networking. This is not good and asking for trouble, but use low loopback port numbers instead of
multicast addresses. The idea is that it fails faster. Move these to
constants so that stuff isn't copy-pasted everywhere, in case we have to
do something different later.
2019-12-11 13:27:03 -05:00
Erik Hatcher 9dfee35b9f SOLR-14025: VelocityResponseWriter hardening 2019-12-11 12:38:58 -05:00
Joel Bernstein 9c5284fe0b SOLR-13957: Update CHANGES.txt 2019-12-11 12:03:29 -05:00
Joel Bernstein a4f2c099ec SOLR-14043: Update CHANGES.txt 2019-12-11 11:58:34 -05:00
Jason Gerlowski e81ebc0312 SOLR-13999: Add missing CHANGES.txt entry 2019-12-11 07:44:56 -05:00
Jason Gerlowski d1f503290f SOLR-13972: Warn about insecure settings on startup (#1058) 2019-12-11 07:17:23 -05:00
Andrzej Bialecki 783a40a93c SOLR-13975, SOLR-13896: ConcurrentUpdateSolrClient connection stall prevention. 2019-12-11 12:19:25 +01:00
Erick Erickson dda88f73bb SOLR-13953: Prometheus exporter in SolrCloud mode limited to 100 nodes
(cherry picked from commit d189520935)
2019-12-10 20:26:04 -05:00
Kevin Risden d4882891df
SOLR-14033: Fix Hadoop tests with security manager
This removes the Solr security manager hacks
for Hadoop. It does so by:
* Using a fake group mapping class instead of ShellGroupMapping
* Copies a few Hadoop classes and modifies them for tests with no Shell
* Nulls out some of the static variables in the tests

The Hadoop files were copied from Apache Hadoop 3.2.0
and copied to the test package to be only picked up
during tests. They were modified to remove the need to
shell out for access. The assumption is that these
HDFS integration tests only run on Unix based systems
and therefore Windows compatibility was removed in some
of the modified classes. The long term goal is to remove
these custom Hadoop classes. All the copied classes are
in the org.apache.hadoop package.

Signed-off-by: Kevin Risden <krisden@apache.org>
2019-12-10 19:49:33 -05:00
Thomas Wöckinger f4b208bc4e SOLR-13966: forgot to test empty list
(cherry picked from commit 9e84da95a2)
2019-12-10 16:29:47 -05:00
Vergil Cheynov 133a99e634 SOLR-13999: Document zkHost 'topic()' stream param 2019-12-10 16:07:45 -05:00
Andrzej Bialecki 7362a76e6e SOLR-13806: SolrJ QueryResponse._explainMap is incorrectly typed. 2019-12-10 20:44:46 +01:00
Joel Bernstein 10cfb08a38 SOLR-14043: Allow the precision Stream Evaluator to operate on matrices 2019-12-10 13:14:19 -05:00
Joel Bernstein 57761f5b53 SOLR-13957: Add sensible defaults for the facet, random, facet2D, timeseries, stats and update Streaming Expressions 2019-12-10 09:47:17 -05:00
Andrzej Bialecki c9a156e1d8 SOLR-13563: SPLITSHARD using LINK method fails on disk usage checks. 2019-12-10 14:22:04 +01:00
Christine Poerschke b7fa0171e5 Fix 5 javac warnings: 'yield' may become a restricted identifier in a future release. 2019-12-10 12:49:44 +00:00
Alessandro Benedetti 662c455ab0 SOLR-14029: Solr Ref Guide: clarify requestDispatcher handleSelect=true
(cherry picked from commit e84a23529e)
2019-12-09 23:29:30 -05:00
Houston Putman 53345cb1cd SOLR-12217: Support shards.preference in SolrJ for individual shard requests (#984) 2019-12-09 23:13:33 -05:00
Thomas Wöckinger 87aa11baf8 SOLR-13966: LatLonPointSpatialField fix for RealTimeGetComponent
used in atomic/partial updates.
Closes #1035

(cherry picked from commit e250f3e82c)
2019-12-09 22:53:33 -05:00
Kevin Risden 346b515666
SOLR-14039: SOLR-13987 broke multiple node /select handler due to jetty.xml whitespace
Signed-off-by: Kevin Risden <krisden@apache.org>
2019-12-09 20:26:37 -05:00
Chris Hostetter d0c6ab8bac SOLR-14032: some misc ref-guide improvements related to clarifying the pros/cons of the diff ways to 'boost' documents by func/query
(cherry picked from commit 485e140e93)
2019-12-09 15:35:07 -07:00
ngomx afa4eb92dc
SOLR-13818: Upgrade jackson to 2.10.0
Signed-off-by: Kevin Risden <krisden@apache.org>
2019-12-09 11:52:26 -05:00
Christine Poerschke 8e4e9cbcaa SOLR-14030: fix 2 javac warnings: [dep-ann] deprecated item is not annotated with @Deprecated 2019-12-09 14:35:15 +00:00
Andrzej Bialecki 349fe428c4 SOLR-13979: Expose separate metrics for distributed and non-distributed requests. 2019-12-09 13:51:35 +01:00
Jan Høydahl 9dd1b4accc SOLR-13977: Move changes entry to 8.4
(cherry picked from commit 0d78535dcf)
2019-12-09 10:28:38 +01:00
Munendra S N 42a6fcbdd9 SOLR-11706: fix for multivalued trie date in min/max and more tests
* selecting single value for multivalued trie date field is not
  supported.
* add additional tests for variance, unique, hll aggregations
2019-12-08 11:04:52 +05:30
Michael Gibney 65a1804aeb SOLR-7798: robust support for expand when used w/o collapsing (#325)
There are applications of ExpandComponent that intentionally do not
involve prior collapsing of results on the expand field, which can lead
to an NPE in expand component when expand.field (for matched docs) has
fewer unique values than the number of matched docs.

This commit refines the approach taken in SOLR-13877, which addressed
the same underlying issue.
2019-12-08 10:11:18 +05:30
Kevin Risden 7ad7bbe05c
SOLR-13987: Admin UI should not rely on javascript eval()
* Removes `'unsafe-eval'` from CSP `script-src`
* Enables Angular CSP mode
* Removes `eval()` JSON parsing in `cloud.js`
* Removes `jstree` themes error

Signed-off-by: Kevin Risden <krisden@apache.org>
2019-12-07 16:52:19 -05:00
Kevin Risden 970264c6d2
SOLR-14028: Fix test permissions for TestSolrCLIRunExample
Signed-off-by: Kevin Risden <krisden@apache.org>
2019-12-07 16:33:58 -05:00
Munendra S N 0a26e38fbe SOLR-11706: minor refactors
* rename stdDev, variance methods to reflect the functionality
* add util functions to compute corrected stdDev and variance
* use DocValuesIterator#advanceExact to check if values exists for the doc
2019-12-07 11:39:00 +05:30
Erick Erickson b0ffacab00 SOLR-13988: Harden CreateCollectionCleanupTest. Incorporate Dawid Weiss' suggestion for windows
(cherry picked from commit 7d5d44a3c4)
2019-12-06 19:11:43 -05:00
Jason Gerlowski e44bcc05c4 SOLR-13087: Remove 'whoami' usage in bin/solr
whoami displays a warning if the effective-uid is not in /etc/password.
This can happen in certain situations when running in a docker
container.  This replaces the 'whoami' usage with a safer check.
2019-12-06 15:32:38 -05:00
Erick Erickson 230ab97acb SOLR-13988: Harden CreateCollectionCleanupTest
(cherry picked from commit 106b9d6866)
2019-12-06 12:00:18 -05:00
Jan Høydahl 912789bb93 SOLR-13954: Embedded ZooKeeper in Solr now does not try to load JettyAdminServer (#1059)
(cherry picked from commit 7417fa1cf3)
2019-12-06 11:05:11 +01:00
Robert Muir 0cd302d7b7 SOLR-14020: move hadoop hacks out of lucene TestSecurityManager into a solr one 2019-12-05 14:56:21 -05:00
Andrzej Bialecki 5865893e64 SOLR-13831: Context property _loop_iter_ should be a string in order to support
variable expansion.
2019-12-05 18:27:43 +01:00
Robert Muir e6728cdf64 SOLR-13993: sandbox velocity template render (if security manager is enabled)
The solr permissions are weak sauce due to the huge number of features, third-party dependencies, etc.

Hence they have access to do many things. For "scripting" such as velocity we have to look at a more aggressive stance:

Step 1: Can we wrap a sandbox around the whole goddamn thing and call it a day?
Step 2: Let's separate the "engine" from "untrusted code" and only be an asshole to the latter.
Step 3: Java's security is shit, Lets contain that classloader and whitelist access.
2019-12-05 01:36:58 -05:00
Munendra S N 2d2f4b9521 SOLR-11706: add support for aggregation on multivalued fields
* min, max, sum, sumsq, avg, stddev, variance, percentile aggregations
  in JSON facets now supports multivalued fields
2019-12-05 11:01:50 +05:30
Robert Muir 5325c29cf9 SOLR-14015: remove blanket filesystem read access from solr-tests.policy
Restrict this to only minimal paths like lucene. It is the defense for directory traversal attacks.
It will also help find bad bugs where things are reading filesystem in the wrong locations.
2019-12-05 00:06:57 -05:00
Andrzej Bialecki 6ebe4d16d2 SOLR-13981: Remove unused DistributedQueue interface. (Andras Salamon) 2019-12-04 11:14:07 +01:00
Anshum Gupta b4375cc235
SOLR-13998: Add thread safety annotations to classes (#1053) (#1057) 2019-12-04 12:09:22 +05:30
Robert Muir 11f1c958eb SOLR-14002: fix another static leak in test 2019-12-03 22:44:07 -05:00
Robert Muir 08720cf5c0 SOLR-14000: clean up more static field leaks in tests
On windows, these objects can't be inspected due to security restrictions. So the test runner fails the tests since it does not know how big the leak is.
2019-12-03 18:53:43 -05:00
Jeff dc15f2e563 SOLR-13926: javadocs on CompositeIdRouter
Closes #1009

(cherry picked from commit 16f793915e)
2019-12-03 17:45:09 -05:00
Robert Muir 72b86bc222 fix static leaks, null stuff out in afterclass 2019-12-03 06:28:52 -05:00
Robert Muir 55b77358cf SOLR-13982: set security-related http response headers by default
Unfortunately, as a first start this is very weak protection against
e.g. XSS.  This is because some 'unsafe-xxx' rules must be present due
to the insecurity of angular JS: Until SOLR-13987 is fixed, XSS & co are
still easy.
2019-12-03 06:18:11 -05:00
noble 664d93591f SOLR-13995: Move ZkShardTerms.Terms to SolrJ 2019-12-03 15:37:22 +11:00
Noble Paul 80abab2935 SOLR-13992: Refactor code to have collection, shard name in Replica,Slice (#1051)
* SOLR-13992: Refactor code to have collection name shard name in Replica,Slice
2019-12-03 13:12:23 +11:00
Cassandra Targett 0ebb62a9f2 SOLR-13885: various Ref Guide typos. This closes #990 2019-12-02 13:38:06 -06:00
Shalin Shekhar Mangar ba95111d71 SOLR-13805: NPE when calling /solr/admin/info/health on standalone solr
(cherry picked from commit 5a697344ed)
2019-11-30 10:04:44 +05:30
Jan Høydahl 325e72c45f SOLR-13977: solr create -c not working under Windows 10
(cherry picked from commit 936f4b6ee9)
2019-11-29 13:07:50 +01:00
Bruno Roustant 1927e850c8
SOLR-13968: Support postingsFormat and docValuesFormat in schema fields.
Closes #1039
2019-11-28 17:17:23 +01:00
David Smiley 8b2d8d0947 SOLR-13971: Revert changes to the default configset. * clarified these are Java system properties * trivial dead code change; Boolean.getBoolean returns a primitive 2019-11-28 11:07:51 -05:00
Ishan Chattopadhyaya 26b5506290 8.3.1 release: CHANGES got misaligned 2019-11-28 19:41:07 +05:30
Ishan Chattopadhyaya bf2899fb00 SOLR-13971: Renamed the velocity template parameter names 2019-11-28 15:44:19 +05:30
Jan Høydahl ee39b15b86 SOLR-13969: Clean up and document AuditEvent API (#1041)
(cherry picked from commit 9f78482295)
2019-11-28 09:57:01 +01:00
Ishan Chattopadhyaya 05c5bcc8b3 SOLR-13971: Removing velocity from _default and disabling custom template support by default 2019-11-28 07:54:37 +05:30
Andrzej Bialecki 2144bc9b4e Fix the list of common handler metrics. 2019-11-27 16:01:27 +01:00
Jonathan Pool c2542b6a76 Correct inconsistency on plugin support (#272)
(cherry picked from commit a5ab17db82)
2019-11-27 08:56:26 +01:00
Eduardo Leggiero 316e130409 Removed extra whitespace (#292)
(cherry picked from commit 70c5942f3d)
2019-11-27 08:51:51 +01:00
noble 4ad3902137 SOLR-13963: JavaBinCodec has concurrent modification of CharArr resulting in corrupt internode updates 2019-11-26 08:22:48 +11:00
Thomas Wöckinger 5e24a010e0 SOLR-13961: Allow null/empty for removal of child doc in atomic update
Cherry pick: b5fd6d7b22
2019-11-25 10:46:48 -05:00
Jan Høydahl 340b238f1c SOLR-12193: reverting one line back to trace
(cherry picked from commit 592ea19eff)
2019-11-24 00:06:47 +01:00
Jan Høydahl 5f11efb2d5 SOLR-12193: Move some log messages to TRACE level, remove some dead code
(cherry picked from commit d809bc27f1)
2019-11-24 00:03:36 +01:00
Jan Høydahl 3adb0903bf SOLR-13465 CoreContainer.auditloggerPlugin should be volatile (#672)
(cherry picked from commit 312431b182)
2019-11-23 01:29:31 +01:00
Jan Høydahl 29e172f6e2 SOLR-13905 Make findRequestType in AuditEvent more robust (#1014)
(cherry picked from commit e45c5ce9b9)
2019-11-22 23:35:44 +01:00
Eric Pugh 4b37fb0c8f SOLR-13947: Document how to load your own streaming plugins (#1025) 2019-11-22 11:26:24 -08:00
Tomas Fernandez Lobbe 65888d0542 SOLR-13950: Add attribution 2019-11-22 11:07:30 -08:00
Andy Vuong a25ecd7f30 SOLR-13950: Fix getLeaderRetry swallowing interrupt in ZkStateReader (#1023)
Let InterruptedException bubble up
2019-11-22 11:07:25 -08:00
Munendra S N 2ba55b7e3c SOLR-13912: add support for countvals aggregation in JSON facet module
* This aggregation is equivalent to StatsComponent's count
2019-11-22 18:38:49 +05:30
Chris Hostetter 070b691b1f SOLR-13946: Fix SpellCheckCollatorTest.testEstimatedHitCounts lower/upper bounds to match computable values based on random merge policies
(cherry picked from commit 8f30f6436c)
2019-11-21 11:46:56 -07:00
Tomas Fernandez Lobbe 4a3c15f118 SOLR-13907: Cloud view tree - fixed placement 2019-11-20 10:57:00 -08:00
Jan Høydahl 58d5680a90 SOLR-13941: Configure JettySolrRunner same as in web.xml (#1018)
(cherry picked from commit f00bcd5609)
2019-11-20 10:31:23 +01:00
Cassandra Targett cebd6eddd2 SOLR-13782: add CHANGES entry 2019-11-19 15:57:38 -06:00
Cassandra Targett 5a24379b1b SOLR-13782: Remove PDF Ref Guide build (#999)
closes #999
2019-11-19 15:55:28 -06:00
Andrzej Bialecki 4837e62989 SOLR-13898: Add more information to the failure message. 2019-11-19 16:58:20 +01:00
Adrien Grand cb1a72ad16 LUCENE-9027: Use SIMD instructions to decode postings. (#973) 2019-11-19 10:29:36 +01:00
Chris Hostetter 8759dea69a SOLR-13943: AwaitsFix TimeRoutedAliasUpdateProcessorTest.testDateMathInStart
(cherry picked from commit 59465c20c4)
2019-11-18 16:32:41 -07:00
Chris Hostetter cb72085ee8 HdfsRecoveryZkTest & HdfsNNFailoverTest: Remove @BadApple anotation
These tests were originally anotated @BadApple in early 2018 as pat of SOLR-12028.

Neither test has failed since 2018-12-28.

Since we no longer have logs from those older jenkins builds, it's hard to be certain how/why this
test was failing, or why exactly it stopped failing – but it's possible the underlying issues were
addressed by general hardening of SolrCloud and the associated base test classes around the same time.

(cherry picked from commit 1411aaee94)
2019-11-18 14:32:21 -07:00
Mikhail Khludnev 1c0c244129 LUCENE-9036: ExitableDirectoryReader checks timeout on DocValues access. 2019-11-18 23:37:10 +03:00
Chris Hostetter 3b7e33790a SOLR-13924: AwaitsFix: MoveReplicaHDFSTest
(cherry picked from commit f9076d85cf)
2019-11-18 09:58:41 -07:00
Ishan Chattopadhyaya e435d92084 SOLR-13662, SOLR-13822: Fixing bug with refresh API, un-ignoring the test and new reference guide on Package Management 2019-11-18 04:00:42 +05:30
Ishan Chattopadhyaya 1e0e5d1b08 SOLR-13662: Ignoring the PackageManagerCLITest until further investigation of failures 2019-11-17 06:05:20 +05:30
Chris Hostetter e6dc96d4d8 TestDistributedStatsComponentCardinality: Remove @BadApple anotation
This test was originally anotated @BadApple ~2018-10-14 as pat of SOLR-12028.

So far in 2019, it has failed in 62 jenkins-BadApple builds, but all prior to 2019-06-14.

Since we no longer have logs from those older jenkins builds, it's hard to be certain how/why
this test was failing, or why exactly it *stopped* failing -- but a likely suspect is that
the root cause of the problem may have been fixed as part of the Jetty upgrade in SOLR-13541.

(cherry picked from commit 3fb39b2960)
2019-11-16 08:08:08 -07:00
Munendra S N 5cce058631 SOLR-13911: add support for missing aggregation in JSON facet module
* This missing aggregation is equivalent to StatsComponent's missing
2019-11-16 12:13:16 +05:30
Andrzej Bialecki 4d1fff37fc SOLR-13898: Allow inexact double comparison. Close resources. 2019-11-15 20:34:46 +01:00
Chris Hostetter 95e791622b SOLR-13909: ReplicationHandler testing: Replace the completely broken CheckBackupStatus with a new BackupStatusChecker helper class
(cherry picked from commit 805305c410)
2019-11-15 10:17:55 -07:00
Tomas Fernandez Lobbe 3a7ea9756c SOLR-13860: Ignore testKillTlogReplica 2019-11-14 15:17:06 -08:00
Ishan Chattopadhyaya f462fe2794 SOLR-13662: Renaming the test jars to .tmp to avoid precommit failures. Adding timeout for test failure fix. 2019-11-15 01:05:25 +02:00
Andrzej Bialecki 6e655a99ce SOLR-13817: Deprecate legacy SolrCache implementations. 2019-11-14 21:22:18 +01:00
Ishan Chattopadhyaya 6edbda7429 SOLR-13662: Package manager (CLI) 2019-11-14 19:19:58 +05:30
Istvan Farkas a1777b540b
SOLR-13921: Processing UpdateRequest with delegation token throws NullPointerException
Signed-off-by: Kevin Risden <krisden@apache.org>
2019-11-13 13:03:41 -05:00
Andrzej Bialecki 3c06fbcad2 SOLR-13898: Non-atomic use of SolrCache get / put. 2019-11-13 18:10:12 +01:00
Chris Hostetter 8c12979fdd SOLR-13872: Fixed Backup failures due to race conditions in saving/reserving commit points
(cherry picked from commit 30e55e2b6e)
2019-11-13 08:59:22 -07:00
noble 086bad30f0 SOLR-13821: Return the size of the file 2019-11-13 18:55:29 +11:00
noble e428315387 SOLR-13822: Added a testcase and a bug fix 2019-11-13 17:44:40 +11:00
noble bb2385025f SOLR-13841: Added 'JsonProperty' to forbidden APIs 2019-11-13 17:43:53 +11:00
Chris Hostetter 700aeeb58f Fix SOLR-13869 typo in CHANGES.txt
(cherry picked from commit 5df9a51cbf)
2019-11-12 14:04:53 -07:00
Chris Hostetter b872863da9 SOLR-13864: SolrTestCaseJ4.getNextAvailablePort() has been deprecated
(cherry picked from commit 603be023fe)
2019-11-12 13:42:14 -07:00
Chris Hostetter 26b7799af6 SOLR-13870: SolrJmxReporterTest no longer depends on (buggy) getNextAvailablePort()
(cherry picked from commit 367fe2f341)
2019-11-12 09:42:43 -07:00
noble d4f2a84df5 SOLR-13822: more ref guide 2019-11-12 18:04:01 +11:00
Noble Paul 07e1df28df SOLR-13822: Ref guide and error handling
SOLR-13822: Ref guide and error handling for package loader, package store
2019-11-12 16:50:25 +11:00
noble a09f2df216 SOLR-13822: Missing package-info files 2019-11-08 14:42:49 +11:00
noble edb5f63869 SOLR-13822: precommit error fixed 2019-11-08 12:56:26 +11:00
Houston Putman f4eea9b2f5 SOLR-13844: Fixing tests related to ShardTerms recovery removal (#995) 2019-11-06 17:25:52 +00:00
Noble Paul 37059eb594
SOLR-13822: Isolated Classloading from packages (#997)
* SOLR-13821: A Package store to store and load package artifacts 

* SOLR-13822: A Package management system with the following features. A packages.json in ZK to store
  the configuration, APIs to read/edit them and isolated classloaders to load the classes from
  those packages if the 'class' attribute is prefixed with `<package-name>:` 

*  SOLR-13841: Provide mappings for jackson annotation @JsonProperty to use Jackson deserializer
2019-11-06 19:45:14 +11:00
Joel Bernstein e4f23388dc SOLR-13864: MathExpressionTest non-reproducible failures due to assertions of non-absolutes and randomization beyond test seed 2019-11-05 15:16:33 -05:00
Joel Bernstein 3d69d112bc Fix CHANGES.txt 2019-11-05 09:20:34 -05:00
Joel Bernstein 70f5533045 SOLR-10786: Update CHANGES.txt 2019-11-05 09:18:41 -05:00
Andrzej Bialecki 848529128f SOLR-13882: Collections API COLSTATUS does not check live_nodes when reporting replica's status. 2019-11-05 14:07:24 +01:00
Jason Gerlowski a98198cc04 SOLR-13762: Allow BinaryField use with non-binary wt's.
Closes #883
2019-11-04 08:44:33 -05:00
Houston Putman 2f8b3ea634 SOLR-13844: Remove replica recovery terms with the replica term (#951) 2019-11-04 09:41:40 +00:00
Joel Bernstein fa7fe3af19 SOLR-10786: Add DBSCAN clustering Streaming Evaluator 2019-11-02 14:52:51 -04:00
Tomas Fernandez Lobbe 332f1d7741 SOLR-13207: Fix tests 2019-11-01 15:54:43 -07:00
Chris Hennick 543d0b79aa SOLR-13207: Handle query errors in calculateMinShouldMatch (#978)
Traps error that arises when the < operator is used at the end of a query field.
Also handles NumberFormatException when the operand isn't a number.
2019-11-01 10:43:34 -07:00
Munendra S N 0e3a66be43 SOLR-13823: fix ClassCastEx in group.query when score is requested
* This makes sures score computed for standalone and distributed
  is same for group.query. This is done by using mainQuery to compute
  scores
2019-10-29 14:07:20 +05:30
Munendra S N 2055983d80 SOLR-13877: fix NPE in expand component
* This could happen when expand component is not used with collapse
  and matched docs have fewer unique values
2019-10-29 14:07:20 +05:30
Munendra S N e713811b17 update documentation for q.op and df
* defaultSearchField and defaultOperator are removed from schema.
  update the documentation to reflect this change
2019-10-29 10:53:47 +05:30
Tomas Fernandez Lobbe 220faa5cbf SOLR-13865: Add missing package docs 2019-10-28 16:25:01 -07:00
Houston Putman bf26279699 SOLR-13865: Migrate replica routing code to SolrJ (#974)
* [SOLR-13865] Migrate replica routing code to  solrJ

* Added a CommonTestInjection class.

* Fixing imports.

* Reverted extraneous streaming changes.

* Fix precommit errors.

* Changing name of the RLTManager.

* Splitting up existing tests.

* Updated documentation.

* Added solr/CHANGES.txt entry
2019-10-28 15:51:04 -07:00
noble 8489b0f159 a simple perf test to check serialization/deserialization perf 2019-10-28 17:18:37 +11:00
Tobias Ibounig dfad6f0fd6 Add temporal unit to warmupTime param in ref guide (#975) 2019-10-25 15:02:06 -05:00
Cassandra Targett 3a7bf3b3af SOLR-13847: Fix docs for Metrics Trigger 2019-10-25 13:58:49 -05:00
Tomas Fernandez Lobbe c82aa3e61b SOLR-13860: Enable back TestTlogReplica (#965)
* Wait for leader in testBasicLeaderElection

It can take some time (>4 seconds) to elect a new leader, and if the update is attempted immediately it'll fail. Need to either wait for the leader or retry the udpate in case of failure (which is what clients would do)

* Wait for leader to be active in testKillTlogReplica

* Add hack to prevent unrelated failure

* Reduce the time wait time for replica state change

* A more robust attempt to add replicas in the tests

* Wait for replication for 2 times the replication time
2019-10-24 12:02:26 -07:00
Munendra S N 21e58bc128 SOLR-12393:fix score not returned if expanded docs sorted by non-score 2019-10-24 20:02:32 +05:30
Andrzej Bialecki b029de191e SOLR-13677: Add a missing override, which resulted in missing metrics (reported by tflobbe). 2019-10-24 13:02:23 +02:00
Munendra S N 255bdaebbc SOLR-13403: test terms component with point fields on empty index 2019-10-24 10:23:19 +05:30
David Smiley 9a108996bb SOLR-13855: DistributedZkUpdateProcessor needs to propagate URP.finish()
Important since Run URP finish() propagates to updateLog to fsync()!
Closes #969

(cherry picked from commit 3ae8204248)
2019-10-23 17:51:27 -04:00
Andrzej Bialecki 6e6b36cbcd SOLR-13831: Support defining arbitrary autoscaling simulation scenarios. 2019-10-23 21:14:05 +02:00
Munendra S N c5d91017d0 SOLR-13403: disable distrib test for point fields in terms 2019-10-22 11:06:38 +05:30
Mikhail Khludnev 0b8b1438e9 SOLR-13824: reject prematurely closed curly bracket in JSON. 2019-10-21 23:35:15 +03:00
epugh 0356dbef7b tweak documentation to be clearer about uprefix
(cherry picked from commit 2e6119e8fd)
2019-10-20 23:52:32 -04:00
Munendra S N 437b7445c6 SOLR-9802: fix grouping failure for date fields in solrcloud
Closes #221
2019-10-20 16:10:55 +05:30
Munendra S N c65451115c SOLR-13403: fix NPE in terms for DatePointField
* This fixes NPE and adds support for DatePointField in terms
  component
2019-10-19 00:09:07 +05:30
Andrzej Bialecki 441af3e7aa SOLR-13677: All Metrics Gauges should be unregistered by components that registered them. 2019-10-18 18:44:16 +02:00
Munendra S N b8213cef1a SOLR-12769: correct documentation for delete op in request params API 2019-10-18 21:29:05 +05:30
Munendra S N 2cbe03429e SOLR-13827: fail on unknown operation in Request Parameters API 2019-10-18 21:28:53 +05:30
Shalin Shekhar Mangar ab65f34686 SOLR-13843: The MOVEREPLICA API ignores replica type and always adds 'nrt' replicas
(cherry picked from commit 86a40c1cd5)
2019-10-18 14:52:26 +05:30
Chris Hostetter 28c1049a25 SOLR-13741: Harden AuditLoggerIntegrationTest
(cherry picked from commit 63e9bcf5d1)
2019-10-16 16:56:57 -07:00
Chris Hostetter 3a67c82c91 SOLR-13852: Fix TestCloudNestedDocsSort to ensure child docs are never created in a way that violates uniqueKey rules
(cherry picked from commit ebc720c5b0)
2019-10-16 16:04:58 -07:00
Jan Høydahl 5a074b0fe4 SOLR-13835 HttpSolrCall produces incorrect extra AuditEvent on AuthorizationResponse.PROMPT (#946)
(cherry picked from commit 611c4f960e)
2019-10-17 00:47:42 +02:00
Cassandra Targett 802e97d6aa SOLR-12786: Update Ref Guide build tool versions & fix section links for new format requirements 2019-10-16 12:43:59 -05:00
Cassandra Targett fec849f6ff Ref Guide: fix headline case 2019-10-16 10:09:26 -05:00
Andrzej Bialecki ac418540d0 SOLR-13849: Ignore events created by running triggers. 2019-10-16 10:34:18 +02:00
Chris Hostetter 59548c16d3 SOLR-13846: workaround - elliminate use of problematic PreemptiveBasicAuthClientBuilderFactory in tests that don't need it
(cherry picked from commit 939b3364e6)
2019-10-15 15:38:02 -07:00
Cassandra Targett e685cf7087 Ref Guide: first pass at 8.3 upgrade notes 2019-10-15 09:46:51 -05:00
Cassandra Targett b65f62cbd1 Ref Guide: fix headline case, e.g & i.e, random spaces 2019-10-15 09:46:03 -05:00
Cassandra Targett b6cbc60ab5 Ref Guide: Upgrade Notes for 8.2 (neglected to do earlier) 2019-10-15 08:14:55 -05:00
Ishan Chattopadhyaya fb4b2a8834 SOLR-13834: ZkController#getSolrCloudManager() now uses the same ZkStateReader instance instead of instantiating a new one
ZkController#getSolrCloudManager() created a new instance of ZkStateReader, thereby causing mismatch in the
visibility of the cluster state and, as a result, undesired race conditions.
2019-10-15 14:52:16 +05:30
Ishan Chattopadhyaya 46df93ced4 SOLR-13793: Limiting number of forwards to total replicas in collection to avoid deadly forwarding loops 2019-10-15 14:43:57 +05:30
Jan Høydahl 337dbd50a6 SOLR-13665: Added missing netty dependencies to solrJ (#938)
(cherry picked from commit 64fb42c714)
2019-10-15 10:36:45 +02:00
Cassandra Targett d1b3b14008 Ref Guide: Fix errant & empty style block throwing errors 2019-10-14 19:55:56 -05:00
Koen De Groote 575f8a6ad8 LUCENE-8994: Code Cleanup - Pass values to list constructor instead of empty constructor followed by addAll(). (#919) 2019-10-14 19:56:23 +02:00
Koen De Groote 93f9a093cc LUCENE-8979: Code Cleanup: Use entryset for map iteration wherever possible. - part 2 2019-10-14 19:56:00 +02:00
Noble Paul 41779e5f60 SOLR-13731: javabin must support a 1:1 mapping of the JSON update format 2019-10-14 11:09:23 +11:00
yonik 845c3e9775 SOLR-13815: enhance live split test to fail more often 2019-10-13 17:10:40 -04:00
noble 83c80376fa SOLR-13787: Better error logging 2019-10-12 16:36:04 +11:00
Yonik Seeley cc62b9fac2 SOLR-13815: fix live split data loss due to cluster state change between checking current shard state and getting list of subShards (#920)
* SOLR-13815: add simple live split test to help debugging possible issue

* SOLR-13815: fix live split data loss due to cluster state change berween checking current shard state and getting list of subShards
2019-10-11 15:11:04 -04:00
noble 71e9564e0d SOLR-13787: Support for Payload<T> as 3rd param 2019-10-12 00:38:06 +11:00
noble dcb7abfc0e SOLR-13787: Added support for PayLoad<T> as 3rd param 2019-10-12 00:28:19 +11:00
Joel Bernstein 946df69a8a SOLR-13829: Update CHANGES.txt 2019-10-11 09:04:08 -04:00
Gus Heck cdca1fcd67 SOLR-13760 update CHANGES.txt
(cherry picked from commit fb3d030e05)
2019-10-10 21:38:47 -04:00
Joel Bernstein f38ce1a815 SOLR-13829: RecursiveEvaluator casts Continuous numbers to Discrete Numbers, causing mismatch 2019-10-10 21:26:36 -04:00
noble 25ec0ddb73 SOLR-13821: Incorrect file path escape in windows 2019-10-11 11:49:12 +11:00
Gus Heck d5b26be691 SOLR-13760 - restore viability of date math in TRA start property by
fixing the start date for time routed aliases
upon the receipt of the first document to avoid problems
with date math calculations required by DRA's

(cherry picked from commit be813bd0ae)
2019-10-10 20:29:51 -04:00
Andrzej Bialecki 9c96834ca7 SOLR-13828: Improve ExecutePlanAction error handling. 2019-10-10 23:59:30 +02:00
Jason Gerlowski 2189172b74 SOLR-13820: Small corrections to Rule-Based Auth docs 2019-10-10 17:05:13 -04:00
Cao Manh Dat 21dfdac46c SOLR-13293: Fix compile error on Java 8 2019-10-10 08:10:16 +01:00
Cao Manh Dat 8864320e39 SOLR-13293: ConcurrentUpdateHttp2SolrClient always log AsynchronousCloseException exception error on indexing 2019-10-09 20:57:25 +01:00
noble 485b702da7 SOLR-13821: missing package-info.java 2019-10-09 23:25:18 +11:00
Ishan Chattopadhyaya a46340330f Adding version 8.4.0 2019-10-08 19:56:42 +05:30
Joel Bernstein a4a1d2f7a8 SOLR-13298: Update CHANGES.txt 2019-10-08 10:03:23 -04:00
Andrzej Bialecki 47aece66b4 SOLR-13376: Multi-node race condition to create/remove nodeLost markers. 2019-10-08 13:42:43 +02:00
Noble Paul f19aaa8097 SOLR-13821: Package Store for storing package artifacts (#929)
SOLR-13821: Package Store for storing package artifacts
2019-10-08 22:21:41 +11:00
Jason Gerlowski 8d040bf1db Fix atomic-update test failures 2019-10-08 06:32:17 -04:00