32709 Commits

Author SHA1 Message Date
Dawid Weiss
9e236a4835
SOLR-14053: Don't start hdfs when native libraries can't be loaded. Remove tests.disableHdfs. (#1072) 2019-12-11 15:01:24 +01:00
Robert Muir
6e2da8780c LUCENE-9079: add missing newlines to end of hunspell test files... we aren't trying to test corner cases of LineNumberReader 2019-12-11 08:38:11 -05:00
Jason Gerlowski
4f2fedbe6b SOLR-13999: Add missing CHANGES.txt entry 2019-12-11 07:43:23 -05:00
Jason Gerlowski
d8aa04575f
SOLR-13972: Warn about insecure settings on startup (#1058) 2019-12-11 07:16:09 -05:00
Ignacio Vera
2ef2ddd77c
LUCENE-8620: Add CONTAINS support for LatLonShape and XYShape (#872) 2019-12-11 09:16:51 +01:00
Erick Erickson
d189520935 SOLR-13953: Prometheus exporter in SolrCloud mode limited to 100 nodes 2019-12-10 20:19:30 -05:00
Ishan Chattopadhyaya
34f11c9f57 SOLR-13822: Fix Eclipse project 2019-12-11 05:55:30 +05:30
Thomas Wöckinger
9e84da95a2 SOLR-13966: forgot to test empty list 2019-12-10 16:29:19 -05:00
Kevin Risden
48775ea18e
SOLR-14033: Fix Hadoop tests with security manager
This removes the Solr security manager hacks
for Hadoop. It does so by:
* Using a fake group mapping class instead of ShellGroupMapping
* Copies a few Hadoop classes and modifies them for tests with no Shell
* Nulls out some of the static variables in the tests

The Hadoop files were copied from Apache Hadoop 3.2.0
and copied to the test package to be only picked up
during tests. They were modified to remove the need to
shell out for access. The assumption is that these
HDFS integration tests only run on Unix based systems
and therefore Windows compatibility was removed in some
of the modified classes. The long term goal is to remove
these custom Hadoop classes. All the copied classes are
in the org.apache.hadoop package.

Signed-off-by: Kevin Risden <krisden@apache.org>
2019-12-10 16:15:24 -05:00
Vergil Cheynov
20d3284a09 "Added missing parameter under 'topic parameters'" (#1056) 2019-12-10 16:05:46 -05:00
Andrzej Bialecki
c4f0c33638 SOLR-13975, SOLR-13896: ConcurrentUpdateSolrClient connection stall prevention. 2019-12-10 21:45:43 +01:00
Andrzej Bialecki
6d03baa485 SOLR-13806: SolrJ QueryResponse._explainMap is incorrectly typed. 2019-12-10 20:44:17 +01:00
Joel Bernstein
8c6a2640ed SOLR-14043: Allow the precision Stream Evaluator to operate on matrices 2019-12-10 12:57:05 -05:00
Andrzej Bialecki
fed199df7b SOLR-13563: SPLITSHARD using LINK method fails on disk usage checks. 2019-12-10 14:21:37 +01:00
Christine Poerschke
340017a4d3 LUCENE-8944: remove "I am authorized to contribute" wording in the Pull Request Template 2019-12-10 12:34:23 +00:00
Christine Poerschke
b97afd79ca Fix 5 javac warnings: 'yield' may become a restricted identifier in a future release. 2019-12-10 12:32:34 +00:00
Alessandro Benedetti
e84a23529e SOLR-14029: Solr Ref Guide: clarify requestDispatcher handleSelect=true 2019-12-09 23:28:45 -05:00
Thomas Wöckinger
e250f3e82c SOLR-13966: LatLonPointSpatialField fix for RealTimeGetComponent
used in atomic/partial updates.
Closes #1035
2019-12-09 22:51:18 -05:00
Kevin Risden
12825f3642
SOLR-14039: SOLR-13987 broke multiple node /select handler due to jetty.xml whitespace
Signed-off-by: Kevin Risden <krisden@apache.org>
2019-12-09 19:29:37 -05:00
Chris Hostetter
485e140e93 SOLR-14032: some misc ref-guide improvements related to clarifying the pros/cons of the diff ways to 'boost' documents by func/query 2019-12-09 15:34:42 -07:00
Houston Putman
1c78d2c637
SOLR-12217: Support shards.preference in SolrJ for individual shard requests (#984) 2019-12-09 17:11:58 -05:00
Joel Bernstein
1eaa5b5ac2 SOLR-13957: Add sensible defaults for the facet, random, facet2D, timeseries, stats and update Streaming Expressions 2019-12-09 16:04:03 -05:00
Adrien Grand
c413656b62
LUCENE-9071: Speed up BM25 scores. (#1043) 2019-12-09 18:59:18 +01:00
Christine Poerschke
df933f8104 SOLR-14030: fix 2 javac warnings: [dep-ann] deprecated item is not annotated with @Deprecated 2019-12-09 14:13:52 +00:00
Christine Poerschke
49631ace9f LUCENE-8996: maxScore was sometimes missing from distributed grouped responses.
(Julien Massenet, Diego Ceccarelli, Munendra S N, Christine Poerschke)
2019-12-09 13:09:44 +00:00
Andrzej Bialecki
86cab79730 SOLR-13979: Expose separate metrics for distributed and non-distributed requests. 2019-12-09 13:46:33 +01:00
Jan Høydahl
0d78535dcf SOLR-13977: Move changes entry to 8.4 2019-12-09 10:27:53 +01:00
Daiki Tsuzuku
79007128e3 LUCENE-9085: Fix assertion in CharacterUtils (#1067) 2019-12-09 08:32:07 +01:00
Munendra S N
df508ffe01 SOLR-11706: fix for multivalued trie date in min/max and more tests
* selecting single value for multivalued trie date field is not
  supported.
* add additional tests for variance, unique, hll aggregations
2019-12-08 10:49:37 +05:30
Michael Gibney
8e9876f516 SOLR-7798: robust support for expand when used w/o collapsing (#325)
There are applications of ExpandComponent that intentionally do not
involve prior collapsing of results on the expand field, which can lead
to an NPE in expand component when expand.field (for matched docs) has
fewer unique values than the number of matched docs.

This commit refines the approach taken in SOLR-13877, which addressed
the same underlying issue.
2019-12-08 09:59:33 +05:30
ngomx
07e4d86207
SOLR-13818: Upgrade jackson to 2.10.0
Signed-off-by: Kevin Risden <krisden@apache.org>
2019-12-07 19:09:18 -05:00
Kevin Risden
f9e15839bf
SOLR-13987: Admin UI should not rely on javascript eval()
* Removes `'unsafe-eval'` from CSP `script-src`
* Enables Angular CSP mode
* Removes `eval()` JSON parsing in `cloud.js`
* Removes `jstree` themes error

Signed-off-by: Kevin Risden <krisden@apache.org>
2019-12-07 16:40:04 -05:00
Kevin Risden
7c8635d600
SOLR-14028: Fix test permissions for TestSolrCLIRunExample
Signed-off-by: Kevin Risden <krisden@apache.org>
2019-12-07 16:32:11 -05:00
Munendra S N
a1e51cd777 SOLR-11706: minor refactors
* rename stdDev, variance methods to reflect the functionality
* add util functions to compute corrected stdDev and variance
* use DocValuesIterator#advanceExact to check if values exists for the doc
2019-12-07 11:16:25 +05:30
Erick Erickson
7d5d44a3c4 SOLR-13988: Harden CreateCollectionCleanupTest. Incorporate Dawid Weiss' suggestion for windows 2019-12-06 19:10:27 -05:00
Mike
155ab116a2
Revert "SOLR-13990: Switch out woodstox-core-asl with aalto-xml and upgrade woodstox stax-2 API (#1050)" (#1063)
This reverts commit 2387bb9d60ae44eeeb4fbcb2f2877f46be5303a0.
2019-12-06 17:08:40 -06:00
Jason Gerlowski
62e0222aef SOLR-13087: Remove 'whoami' usage in bin/solr
whoami displays a warning if the effective-uid is not in /etc/password.
This can happen in certain situations when running in a docker
container.  This replaces the 'whoami' usage with a safer check.
2019-12-06 15:31:37 -05:00
Dawid Weiss
a7444f7af4 LUCENE-9077: Add support for running under gradle test runner. 2019-12-06 19:00:50 +01:00
Erick Erickson
106b9d6866 SOLR-13988: Harden CreateCollectionCleanupTest 2019-12-06 11:59:53 -05:00
Dawid Weiss
9ec8a86d69 LUCENE-9077: Add support for running under gradle test runner. 2019-12-06 16:31:32 +01:00
Kevin Risden
dad933b933
SOLR-14001: fix HdfsBackupRepositoryTest on windows
Signed-off-by: Kevin Risden <krisden@apache.org>
2019-12-06 09:49:13 -05:00
Jan Høydahl
7417fa1cf3
SOLR-13954: Embedded ZooKeeper in Solr now does not try to load JettyAdminServer (#1059) 2019-12-06 11:03:23 +01:00
Robert Muir
33ca971d2b SOLR-14020: move hadoop hacks out of lucene TestSecurityManager into a solr one 2019-12-05 14:53:23 -05:00
Andrzej Bialecki
d2b01ef28f SOLR-13831: Context property _loop_iter_ should be a string in order to support
variable expansion.
2019-12-05 18:27:12 +01:00
Anshum Gupta
2387bb9d60
SOLR-13990: Switch out woodstox-core-asl with aalto-xml and upgrade woodstox stax-2 API (#1050) 2019-12-05 18:37:53 +05:30
Robert Muir
e77027dd8c SOLR-13993: sandbox velocity template render (if security manager is enabled)
The solr permissions are weak sauce due to the huge number of features, third-party dependencies, etc.

Hence they have access to do many things. For "scripting" such as velocity we have to look at a more aggressive stance:

Step 1: Can we wrap a sandbox around the whole goddamn thing and call it a day?
Step 2: Let's separate the "engine" from "untrusted code" and only be an asshole to the latter.
Step 3: Java's security is shit, Lets contain that classloader and whitelist access.
2019-12-05 01:06:38 -05:00
Munendra S N
12e8cca644 SOLR-11706: add support for aggregation on multivalued fields
* min, max, sum, sumsq, avg, stddev, variance, percentile aggregations
  in JSON facets now supports multivalued fields
2019-12-05 10:48:22 +05:30
Robert Muir
c4126ef858 SOLR-14015: remove blanket filesystem read access from solr-tests.policy
Restrict this to only minimal paths like lucene. It is the defense for directory traversal attacks.
It will also help find bad bugs where things are reading filesystem in the wrong locations.
2019-12-04 23:16:19 -05:00
Andrzej Bialecki
f71c2c8e92 SOLR-13981: Remove unused DistributedQueue interface. (Andras Salamon) 2019-12-04 11:23:49 +01:00
Ishan Chattopadhyaya
2096b1a52e Add back-compat indices for 8.3.1 2019-12-04 10:17:27 +05:30