Commit Graph

33211 Commits

Author SHA1 Message Date
Dawid Weiss 5ab59f59ac SOLR-11207: minor changes:
- added 'owasp' task to the root project. This depends on
dependencyCheckAggregate which seems to be a better fit for multi-module
projects than dependencyCheckAnalyze (the difference is vague to me
from plugin's documentation).

- you can run the "gradlew owasp" task explicitly and it'll run the
validation without any flags.

- the owasp task is only added to check if validation.owasp property
is true. I think this should stay as the default on non-CI systems
(developer defaults) because it's a significant chunk of time it takes
to download and validate dependencies.

- I'm not sure *all* configurations should be included in the check...
perhaps we should only limit ourselves to actual runtime dependencies
 not build dependencies, solr-ref-guide, etc.
2020-01-26 10:45:05 +01:00
Jan Høydahl 74a8d6d5ac SOLR-11207: Add OWASP dependency checker to gradle build (#1121)
* SOLR-11207: Add OWASP dependency checker to gradle build
2020-01-26 10:01:51 +01:00
Gus Heck 127ce3e360 SOLR-13749 adjust changes to reflect backport to 8.5 2020-01-25 00:53:27 -05:00
Cassandra Targett 74e88deba7 Revert "SOLR-12930: move Gradle docs from ./help/ to new ./dev-docs/ directory"
This reverts commit 2d8650d36c.
2020-01-24 15:56:00 -06:00
Cassandra Targett ba77a5f2eb SOLR-14214: Clean up client lists and references 2020-01-24 15:46:30 -06:00
Mike eaa3dbe440
SOLR-14162 TestInjection can leak Timer objects (#1137) 2020-01-24 14:04:22 -06:00
Paul Merlin 24f7a28ac1 Add Github Workflow for Gradle Wrapper Validation (#1207) 2020-01-24 20:42:30 +01:00
Robert Muir f5e9bb9493
LUCENE-9165: explicitly cast with the horrible groovy language so that numbers above 9 don't fail 2020-01-24 09:53:47 -05:00
Robert Muir c53cc3edaf
LUCENE-9167: test speedup for slowest/pathological tests (round 3) 2020-01-24 08:58:59 -05:00
Robert Muir 4d61e4aaab
change generate-defaults.gradle not to cap testsJvms at 4 2020-01-24 08:49:17 -05:00
Adrien Grand b283b8df62
LUCENE-4702: Terms dictionary compression. (#1126)
Compress blocks of suffixes in order to make the terms dictionary more
space-efficient. Two compression algorithms are used depending on which one is
more space-efficient:
 - LowercaseAsciiCompression, which applies when all bytes are in the
   `[0x1F,0x3F)` or `[0x5F,0x7F)` ranges, which notably include all digits,
   lowercase ASCII characters, '.', '-' and '_', and encodes 4 chars on 3 bytes.
   It is very often applicable on analyzed content and decompresses very quickly
   thanks to auto-vectorization support in the JVM.
 - LZ4, when the compression ratio is less than 0.75.

I was a bit unhappy with the complexity of the high-compression LZ4 option, so
I simplified it in order to only keep the logic that detects duplicate strings.
The logic about what to do in case overlapping matches are found, which was
responsible for most of the complexity while only yielding tiny benefits, has
been removed.
2020-01-24 14:46:57 +01:00
Robert Muir a29a4f4aa5
LUCENE-9168: don't let crazy tests run us out of open files with these params 2020-01-24 08:46:50 -05:00
Mikhail Khludnev 16e537db7e SOLR-12045: Know how Analytic Component deployment. 2020-01-23 23:22:32 +03:00
Cassandra Targett 2d8650d36c SOLR-12930: move Gradle docs from ./help/ to new ./dev-docs/ directory 2020-01-23 14:04:19 -06:00
Cassandra Targett 64cb1c8fe8
SOLR-12930: Create developer docs directories in source repo (#1164) 2020-01-23 14:00:23 -06:00
Kevin Risden b150202c85
SOLR-11554: Support handling OPTIONS request for Hadoop authentication filter
Signed-off-by: Kevin Risden <krisden@apache.org>
2020-01-23 13:45:54 -05:00
Andrzej Bialecki 434f90265b SOLR-14211: Fix a bug introduced in SOLR-14192. 2020-01-23 19:33:12 +01:00
Anshum Gupta 3c0146196a
SOLR-14206: Annotate HttpSolrCall as thread-safe (#1203)
* SOLR-14206: Annotate HttpSolrCall and V2HttpCall as thread-safe
2020-01-23 08:37:03 -08:00
Nick Vercammen 60a2926546
SOLR-14205 Do not fail when given timeout to connectionImpl.isValid() = 0
Closes #1204

Signed-off-by: Kevin Risden <krisden@apache.org>
2020-01-23 10:12:43 -05:00
Kevin Risden 9b6fc1b9fc
SOLR-14132: Upgrade Angular JS 1.3.8 to 1.7.9
* Upgrade Angular JS 1.3.8 to 1.7.9
* Upgrade Angular Chosen v1.3.0 and Chosen to v1.8.7
* Remove older jquery 1.7.2 version
* Remove non minified Angular JS files

Closes #1196

Signed-off-by: Kevin Risden <krisden@apache.org>
2020-01-23 09:20:12 -05:00
Jan Høydahl e744f7977e
SOLR-14196: AdminUI login not working for JWTAuth when blockUnknown=false (#1190) 2020-01-23 14:51:36 +01:00
Shalin Shekhar Mangar 84270dc6cf SOLR-14172: Collection metadata remains in zookeeper if too many shards are requested.
This also fixes a bug where an inability to assign a node based on existing autoscaling policy resulted in a server error instead of a bad request.

This closes #1152.
2020-01-23 15:19:53 +05:30
Shalin Shekhar Mangar 04193d5252 SOLR-14207: Fix logging statements with less or more arguments than placeholders 2020-01-23 14:00:08 +05:30
Houston Putman c53cbb12f4 SOLR-11746: Adding CHANGES.txt entry 2020-01-22 23:44:25 -05:00
Robert Muir f440fbdf59
LUCENE-9083: throw assumption if you try to remap /dev to /dev with this test mock 2020-01-22 21:58:52 -05:00
Houston Putman ffba54a827 SOLR-11746: Adding existence queries for PointFields
* DocValuesFieldExistsQuery and NormsFieldExistsQuery are used for existence queries when possible.
* Added documentation on the difference between field:* and field:[* TO *]
2020-01-22 18:00:55 -05:00
Robert Muir 1051db4038
LUCENE-9163: test speedup for slowest/pathological tests
Calming down individual test methods with double-digit execution times
after running tests many times.

There are a few more issues remaining, but this solves the majority of them.
2020-01-22 17:49:33 -05:00
Chris Hostetter 6b3e7feba1 SOLR-14159: Eliminate some 'spin loops' in tests that may be contributing factors to odd test failures 2020-01-22 14:44:56 -07:00
David Smiley 49300bea73
dev-tools/idea/ small .iml cleanup 2020-01-22 16:25:34 -05:00
Jan Høydahl 75c64089a1
SOLR-14198: Nullpointer exception in AuditEvent with AuthorizationContext (#1192) 2020-01-22 21:39:43 +01:00
David Smiley f1db918e20
SOLR-14040: restore legacy Collection auto-creation 2020-01-22 15:26:37 -05:00
Chris Hostetter 95dfddc7d4 SOLR-12859: Fixed DocExpirationUpdateProcessorFactory to work with BasicAuth and other auth plugins that delegate to PKI for server initiated node-to-node communication. 2020-01-22 09:32:25 -07:00
Robert Muir 8fd3fbd93c
TestPointValues only index 300k docs in NIGHTLY configuration, that is too much locally 2020-01-22 10:27:15 -05:00
Robert Muir b7694535eb
mark StressRamUsageEstimator tests nightly.
This is consistently the slowest test for me in all of lucene core by
far. Takes around an entire minute. Mark it nightly: should catch any
issues with RAM estimation but keep local builds fast.
2020-01-22 10:19:44 -05:00
Robert Muir 9dae566ee7
LUCENE-9160: add params/docs to override jvm params in gradle build, default C2 off in tests.
Adds some build parameters to tune how tests run. There is an example
shown by "gradle helpLocalSettings"

Default C2 off in tests as it is wasteful locally and causes slowdown of
tests runs. You can override this by setting tests.jvmargs for gradle,
or args for ant.

Some crazy lucene stress tests may need to be toned down after the
change, as they may have been doing too many iterations by default...
but this is not a new problem.
2020-01-22 09:58:30 -05:00
Joel Bernstein 25ba52d1a0 SOLR-14130: Update CHANGES.txt 2020-01-22 09:52:20 -05:00
Ishan Chattopadhyaya cc9c494a34 Synchronizing 8.4.1 changes 2020-01-22 11:31:12 +05:30
Ishan Chattopadhyaya f6ca662f33 Synchronizing 8.4.1 changes 2020-01-22 11:21:53 +05:30
Robert Muir 3ecd7a03aa
LUCENE-9159: merge gradle/ant test security policies (main file) 2020-01-21 23:43:31 -05:00
Robert Muir 7e0534d87c
LUCENE-9159: merge gradle/ant test security policies 2020-01-21 21:26:37 -05:00
Robert Muir c754a764d4
LUCENE-9157: test speedup for slowest tests 2020-01-21 19:27:19 -05:00
Christine Poerschke 1af171e47f SOLR-13965: Factor out public static StreamHandler.addExpressiblePlugins method. 2020-01-21 18:33:26 +00:00
David Smiley ab924fd4ea
SOLR-14040: shareSchema support for SolrCloud
* Use Caffeine impl and weak values (to the schema). Previously the cache never evicted!
* now populating the configSet name from ZK into CloudDescriptor when CloudDescriptor is loaded
* actual schema name needs to be deterministic now; fallback from non-existent managed-schema to schema.xml will thwart this cache
* a test conf/core.properties wasn't actually used and became a problem in it's weird location after I refactored some logic
2020-01-21 13:18:37 -05:00
Mike ec6a9aab09
LUCENE-9098 Use multibyte code-points for complex fuzzy query (#1194) 2020-01-21 12:16:42 -06:00
Bruno Roustant 8894babd4a
LUCENE-9135: Make UniformSplit FieldMetadata counters long.
Closes #1168
2020-01-21 11:24:26 +01:00
Andrzej Bialecki 6244b7150e SOLR-14192: Race condition between SchemaManager and ZkIndexSchemaReader. 2020-01-20 17:11:47 +01:00
Adrien Grand bddb06b650 CompetitiveImpactAccumulator should protect its costly invariant checks behind an `assert`. 2020-01-20 11:16:09 +01:00
Dawid Weiss 351b30489c LUCENE-9077: Enable javac linting as in ant. TONS of warnings are currently printed. 2020-01-20 10:10:48 +01:00
Dawid Weiss 1ad6bc9361 LUCENE-9077: Allow locally staged files in git status precommit check. 2020-01-20 09:36:14 +01:00
Nicholas Knize aad849bf87 LUCENE-8621: Refactor LatLonShape, XYShape, and all query and utility classes from sandbox to core 2020-01-17 14:34:40 -06:00