13743 Commits

Author SHA1 Message Date
Munendra S N
42a6fcbdd9 SOLR-11706: fix for multivalued trie date in min/max and more tests
* selecting single value for multivalued trie date field is not
  supported.
* add additional tests for variance, unique, hll aggregations
2019-12-08 11:04:52 +05:30
Michael Gibney
65a1804aeb SOLR-7798: robust support for expand when used w/o collapsing (#325)
There are applications of ExpandComponent that intentionally do not
involve prior collapsing of results on the expand field, which can lead
to an NPE in expand component when expand.field (for matched docs) has
fewer unique values than the number of matched docs.

This commit refines the approach taken in SOLR-13877, which addressed
the same underlying issue.
2019-12-08 10:11:18 +05:30
Kevin Risden
7ad7bbe05c
SOLR-13987: Admin UI should not rely on javascript eval()
* Removes `'unsafe-eval'` from CSP `script-src`
* Enables Angular CSP mode
* Removes `eval()` JSON parsing in `cloud.js`
* Removes `jstree` themes error

Signed-off-by: Kevin Risden <krisden@apache.org>
2019-12-07 16:52:19 -05:00
Kevin Risden
970264c6d2
SOLR-14028: Fix test permissions for TestSolrCLIRunExample
Signed-off-by: Kevin Risden <krisden@apache.org>
2019-12-07 16:33:58 -05:00
Munendra S N
0a26e38fbe SOLR-11706: minor refactors
* rename stdDev, variance methods to reflect the functionality
* add util functions to compute corrected stdDev and variance
* use DocValuesIterator#advanceExact to check if values exists for the doc
2019-12-07 11:39:00 +05:30
Erick Erickson
b0ffacab00 SOLR-13988: Harden CreateCollectionCleanupTest. Incorporate Dawid Weiss' suggestion for windows
(cherry picked from commit 7d5d44a3c42797b312310df8a7f4af910e052124)
2019-12-06 19:11:43 -05:00
Jason Gerlowski
e44bcc05c4 SOLR-13087: Remove 'whoami' usage in bin/solr
whoami displays a warning if the effective-uid is not in /etc/password.
This can happen in certain situations when running in a docker
container.  This replaces the 'whoami' usage with a safer check.
2019-12-06 15:32:38 -05:00
Erick Erickson
230ab97acb SOLR-13988: Harden CreateCollectionCleanupTest
(cherry picked from commit 106b9d686602b05f02139e296ea3a388a5fac406)
2019-12-06 12:00:18 -05:00
Jan Høydahl
912789bb93 SOLR-13954: Embedded ZooKeeper in Solr now does not try to load JettyAdminServer (#1059)
(cherry picked from commit 7417fa1cf3a7875b76419793a38080059f52b1fc)
2019-12-06 11:05:11 +01:00
Robert Muir
0cd302d7b7 SOLR-14020: move hadoop hacks out of lucene TestSecurityManager into a solr one 2019-12-05 14:56:21 -05:00
Andrzej Bialecki
5865893e64 SOLR-13831: Context property _loop_iter_ should be a string in order to support
variable expansion.
2019-12-05 18:27:43 +01:00
Robert Muir
e6728cdf64 SOLR-13993: sandbox velocity template render (if security manager is enabled)
The solr permissions are weak sauce due to the huge number of features, third-party dependencies, etc.

Hence they have access to do many things. For "scripting" such as velocity we have to look at a more aggressive stance:

Step 1: Can we wrap a sandbox around the whole goddamn thing and call it a day?
Step 2: Let's separate the "engine" from "untrusted code" and only be an asshole to the latter.
Step 3: Java's security is shit, Lets contain that classloader and whitelist access.
2019-12-05 01:36:58 -05:00
Munendra S N
2d2f4b9521 SOLR-11706: add support for aggregation on multivalued fields
* min, max, sum, sumsq, avg, stddev, variance, percentile aggregations
  in JSON facets now supports multivalued fields
2019-12-05 11:01:50 +05:30
Robert Muir
5325c29cf9 SOLR-14015: remove blanket filesystem read access from solr-tests.policy
Restrict this to only minimal paths like lucene. It is the defense for directory traversal attacks.
It will also help find bad bugs where things are reading filesystem in the wrong locations.
2019-12-05 00:06:57 -05:00
Andrzej Bialecki
6ebe4d16d2 SOLR-13981: Remove unused DistributedQueue interface. (Andras Salamon) 2019-12-04 11:14:07 +01:00
Anshum Gupta
b4375cc235
SOLR-13998: Add thread safety annotations to classes (#1053) (#1057) 2019-12-04 12:09:22 +05:30
Robert Muir
11f1c958eb SOLR-14002: fix another static leak in test 2019-12-03 22:44:07 -05:00
Robert Muir
08720cf5c0 SOLR-14000: clean up more static field leaks in tests
On windows, these objects can't be inspected due to security restrictions. So the test runner fails the tests since it does not know how big the leak is.
2019-12-03 18:53:43 -05:00
Jeff
dc15f2e563 SOLR-13926: javadocs on CompositeIdRouter
Closes #1009

(cherry picked from commit 16f793915ec6dfceecf0267c66ac0c051da2d0c4)
2019-12-03 17:45:09 -05:00
Robert Muir
72b86bc222 fix static leaks, null stuff out in afterclass 2019-12-03 06:28:52 -05:00
Robert Muir
55b77358cf SOLR-13982: set security-related http response headers by default
Unfortunately, as a first start this is very weak protection against
e.g. XSS.  This is because some 'unsafe-xxx' rules must be present due
to the insecurity of angular JS: Until SOLR-13987 is fixed, XSS & co are
still easy.
2019-12-03 06:18:11 -05:00
noble
664d93591f SOLR-13995: Move ZkShardTerms.Terms to SolrJ 2019-12-03 15:37:22 +11:00
Noble Paul
80abab2935 SOLR-13992: Refactor code to have collection, shard name in Replica,Slice (#1051)
* SOLR-13992: Refactor code to have collection name shard name in Replica,Slice
2019-12-03 13:12:23 +11:00
Cassandra Targett
0ebb62a9f2 SOLR-13885: various Ref Guide typos. This closes #990 2019-12-02 13:38:06 -06:00
Shalin Shekhar Mangar
ba95111d71 SOLR-13805: NPE when calling /solr/admin/info/health on standalone solr
(cherry picked from commit 5a697344ed1be537ef2acdd18aab653283593370)
2019-11-30 10:04:44 +05:30
Jan Høydahl
325e72c45f SOLR-13977: solr create -c not working under Windows 10
(cherry picked from commit 936f4b6ee9cd8c7f9a17800aadc8c5a91bdf74f6)
2019-11-29 13:07:50 +01:00
Bruno Roustant
1927e850c8
SOLR-13968: Support postingsFormat and docValuesFormat in schema fields.
Closes #1039
2019-11-28 17:17:23 +01:00
David Smiley
8b2d8d0947 SOLR-13971: Revert changes to the default configset. * clarified these are Java system properties * trivial dead code change; Boolean.getBoolean returns a primitive 2019-11-28 11:07:51 -05:00
Ishan Chattopadhyaya
26b5506290 8.3.1 release: CHANGES got misaligned 2019-11-28 19:41:07 +05:30
Ishan Chattopadhyaya
bf2899fb00 SOLR-13971: Renamed the velocity template parameter names 2019-11-28 15:44:19 +05:30
Jan Høydahl
ee39b15b86 SOLR-13969: Clean up and document AuditEvent API (#1041)
(cherry picked from commit 9f78482295819ba10a383d3027c1d6313c6e2e7d)
2019-11-28 09:57:01 +01:00
Ishan Chattopadhyaya
05c5bcc8b3 SOLR-13971: Removing velocity from _default and disabling custom template support by default 2019-11-28 07:54:37 +05:30
Andrzej Bialecki
2144bc9b4e Fix the list of common handler metrics. 2019-11-27 16:01:27 +01:00
Jonathan Pool
c2542b6a76 Correct inconsistency on plugin support (#272)
(cherry picked from commit a5ab17db82aa030f3ace7d05f347e9e60db6adca)
2019-11-27 08:56:26 +01:00
Eduardo Leggiero
316e130409 Removed extra whitespace (#292)
(cherry picked from commit 70c5942f3d084b62c67e1d37f22ba97bcd1b9b2b)
2019-11-27 08:51:51 +01:00
noble
4ad3902137 SOLR-13963: JavaBinCodec has concurrent modification of CharArr resulting in corrupt internode updates 2019-11-26 08:22:48 +11:00
Thomas Wöckinger
5e24a010e0 SOLR-13961: Allow null/empty for removal of child doc in atomic update
Cherry pick: b5fd6d7b22002a06bdc626999a6a527ff6f46488
2019-11-25 10:46:48 -05:00
Jan Høydahl
340b238f1c SOLR-12193: reverting one line back to trace
(cherry picked from commit 592ea19eff0a0d4225f92d0b96bfb3c9559c077e)
2019-11-24 00:06:47 +01:00
Jan Høydahl
5f11efb2d5 SOLR-12193: Move some log messages to TRACE level, remove some dead code
(cherry picked from commit d809bc27f1b5cd6d97e0bfe688c99d481bc42d39)
2019-11-24 00:03:36 +01:00
Jan Høydahl
3adb0903bf SOLR-13465 CoreContainer.auditloggerPlugin should be volatile (#672)
(cherry picked from commit 312431b1821a67c9ddb7e219b9203d6fd7bdd5df)
2019-11-23 01:29:31 +01:00
Jan Høydahl
29e172f6e2 SOLR-13905 Make findRequestType in AuditEvent more robust (#1014)
(cherry picked from commit e45c5ce9b9e70650f119976b8b2d91b3c760cb48)
2019-11-22 23:35:44 +01:00
Eric Pugh
4b37fb0c8f SOLR-13947: Document how to load your own streaming plugins (#1025) 2019-11-22 11:26:24 -08:00
Tomas Fernandez Lobbe
65888d0542 SOLR-13950: Add attribution 2019-11-22 11:07:30 -08:00
Andy Vuong
a25ecd7f30 SOLR-13950: Fix getLeaderRetry swallowing interrupt in ZkStateReader (#1023)
Let InterruptedException bubble up
2019-11-22 11:07:25 -08:00
Munendra S N
2ba55b7e3c SOLR-13912: add support for countvals aggregation in JSON facet module
* This aggregation is equivalent to StatsComponent's count
2019-11-22 18:38:49 +05:30
Chris Hostetter
070b691b1f SOLR-13946: Fix SpellCheckCollatorTest.testEstimatedHitCounts lower/upper bounds to match computable values based on random merge policies
(cherry picked from commit 8f30f6436c13d757ea70d1168be5442810709130)
2019-11-21 11:46:56 -07:00
Tomas Fernandez Lobbe
4a3c15f118 SOLR-13907: Cloud view tree - fixed placement 2019-11-20 10:57:00 -08:00
Jan Høydahl
58d5680a90 SOLR-13941: Configure JettySolrRunner same as in web.xml (#1018)
(cherry picked from commit f00bcd560901ebed420c51e52fda788ae8654103)
2019-11-20 10:31:23 +01:00
Cassandra Targett
cebd6eddd2 SOLR-13782: add CHANGES entry 2019-11-19 15:57:38 -06:00
Cassandra Targett
5a24379b1b SOLR-13782: Remove PDF Ref Guide build (#999)
closes #999
2019-11-19 15:55:28 -06:00