230 Commits

Author SHA1 Message Date
Jan Høydahl
523b783f63 SOLR-14109: Always log to stdout from server/scripts/cloud-scripts/zkcli.{bat|sh} (#1130)
(cherry picked from commit 33bd811fb8b2a9bee595548e96c2a74721aa11b3)
2019-12-30 16:36:18 +01:00
Robert Muir
300e81b655 SOLR-14141: eliminate JKS keystore from solr ssl docs.
Currently the documentation pretends to create a JKS keystore. It is
only actually a JKS keystore on java 8: on java9+ it is a PKCS12
keystore with a .jks extension (because PKCS12 is the new java default).
It works even though solr explicitly tells the JDK
(SOLR_SSL_KEY_STORE_TYPE=JKS) that its JKS when it is in fact not, due
to how keystore backwards compatibility was implemented.

Fix docs to explicitly create a PKCS12 keystore with .p12 extension and
so on instead of a PKCS12 keystore masquerading as a JKS one. This
simplifies the SSL steps since the "conversion" step (which was doing
nothing) from .JKS -> .P12 can be removed.
2019-12-29 09:34:55 -05:00
Robert Muir
89d88de5c2 SOLR-13984: add (experimental, disabled by default) security manager support (#1082)
* SOLR-13984: add (experimental, disabled by default) security manager support.

User can set SOLR_SECURITY_MANAGER_ENABLED=true to enable security manager at runtime.

The current policy file used by tests is moved to solr/server
Additional permissions are granted for the filesystem locations set by bin/solr, and networking everywhere is enabled.

This takes advantage of the fact that permission entries are ignored if properties are not defined:
https://docs.oracle.com/javase/7/docs/technotes/guides/security/PolicyFiles.html#PropertyExp
2019-12-24 06:31:14 -08:00
Robert Muir
d7ff40f53f SOLR-14136: ip whitelist/blacklist via env vars (#1111)
SOLR-14136: ip whitelist/blacklist via env vars

This makes it easy to restrict access to Solr by IP. For example SOLR_IP_WHITELIST="127.0.0.1, 192.168.0.0/24, [::1], [2000:123:4:5::]/64" would restrict access to v4/v6 localhost, the 192.168.0 ipv4 network, and 2000:123:4:5 ipv6 network. Any other IP will receive a 403 response.

Blacklisting functionality can deny access to problematic addresses or networks that would otherwise be allowed. For example SOLR_IP_BLACKLIST="192.168.0.3, 192.168.0.4" would explicitly prevent those two specific addresses from accessing solr.
2019-12-23 16:28:12 -08:00
Robert Muir
baeaa56fb2 SOLR-14138: enable request log via environ var, remove deprecated jetty class usage, respect SOLR_LOGS_DIR (#1110)
User can now set SOLR_REQUESTLOG_ENABLED=true to enable the jetty request log, instead of editing XML. The location of the request logs will respect SOLR_LOGS_DIR if that is set. The deprecated NCSARequestLog is no longer used, instead it uses CustomRequestLog with NCSA_FORMAT.
2019-12-23 07:38:56 -08:00
Kevin Risden
3f23002456
SOLR-14106: Cleanup Jetty SslContextFactory usage
Jetty 9.4.16.v20190411 and up introduced separate
client and server SslContextFactory implementations.
This split requires the proper use of of
SslContextFactory in clients and server configs.

This fixes the following
* SSL with SOLR_SSL_NEED_CLIENT_AUTH not working since v8.2.0
* Http2SolrClient SSL not working in branch_8x

Signed-off-by: Kevin Risden <krisden@apache.org>
2019-12-19 23:19:12 -05:00
Matthias Krueger
d226aba686
SOLR-14091: Removing deprecated configuration of Jetty's soLingerTime option
Signed-off-by: Kevin Risden <krisden@apache.org>
2019-12-18 19:30:31 -05:00
Ishan Chattopadhyaya
4c7f5039c7 SOLR-13978: Removed LTR from default configset 2019-12-12 15:09:59 +05:30
Adrien Grand
451d5348f4 Add next minor version 8.5 2019-12-12 09:33:20 +01:00
Ishan Chattopadhyaya
08b8d116f8 SOLR-13978: Remove non-essential components from default configset
The default configset no longer has the following:
   - Library inclusions (<lib ../>) for extraction, solr-cell libs, clustering, velocity and language identifier
   - /browse, /tvrh and /update/extract handlers
   - TermVector component (if someone wants it, can be added using config APIs)
   - XSLT response writer
   - Velocity response writer
If you want to use them in your collections, please add them to your configset manually or through the Config APIs.
2019-12-12 10:44:35 +05:30
Kevin Risden
346b515666
SOLR-14039: SOLR-13987 broke multiple node /select handler due to jetty.xml whitespace
Signed-off-by: Kevin Risden <krisden@apache.org>
2019-12-09 20:26:37 -05:00
Kevin Risden
7ad7bbe05c
SOLR-13987: Admin UI should not rely on javascript eval()
* Removes `'unsafe-eval'` from CSP `script-src`
* Enables Angular CSP mode
* Removes `eval()` JSON parsing in `cloud.js`
* Removes `jstree` themes error

Signed-off-by: Kevin Risden <krisden@apache.org>
2019-12-07 16:52:19 -05:00
Jan Høydahl
912789bb93 SOLR-13954: Embedded ZooKeeper in Solr now does not try to load JettyAdminServer (#1059)
(cherry picked from commit 7417fa1cf3a7875b76419793a38080059f52b1fc)
2019-12-06 11:05:11 +01:00
Robert Muir
55b77358cf SOLR-13982: set security-related http response headers by default
Unfortunately, as a first start this is very weak protection against
e.g. XSS.  This is because some 'unsafe-xxx' rules must be present due
to the insecurity of angular JS: Until SOLR-13987 is fixed, XSS & co are
still easy.
2019-12-03 06:18:11 -05:00
David Smiley
8b2d8d0947 SOLR-13971: Revert changes to the default configset. * clarified these are Java system properties * trivial dead code change; Boolean.getBoolean returns a primitive 2019-11-28 11:07:51 -05:00
Ishan Chattopadhyaya
05c5bcc8b3 SOLR-13971: Removing velocity from _default and disabling custom template support by default 2019-11-28 07:54:37 +05:30
Ishan Chattopadhyaya
a46340330f Adding version 8.4.0 2019-10-08 19:56:42 +05:30
Cao Manh Dat
494d823e9d SOLR-13798: SSL: Adding Enabling/Disabling client's hostname verification config 2019-09-30 16:31:11 +01:00
iverase
51f4340796 Add next minor version 8.3.0 2019-07-11 12:47:34 +02:00
Tomoko Uchida
bb074f6a8a SOLR-13602: Add a field type for Estonian language to default managed_schema 2019-07-03 21:00:43 +09:00
Munendra S N
fc15cd79f7 SOLR-12554: Expose IndexWriterConfig's ramPerThreadHardLimitMB
* When ramPerThreadHardLimitMB is not specified, then Lucene's
  default value 1945 is used. The specified value should be
  greater than 0 and less than 2048MB
2019-07-01 23:47:26 +05:30
Ishan Chattopadhyaya
8ea32d61fe Adding 8.2 version 2019-05-01 14:51:55 +05:30
Andrzej Bialecki
7fd49c3228 SOLR-12461: Upgrade Dropwizard Metrics to 4.0.5 release. 2019-04-18 19:09:06 +02:00
Uwe Schindler
e1901aaabb SOLR-13409: Disable HTML directory listings in admin interface to prevent possible security issues 2019-04-17 11:05:24 +02:00
Chris Hostetter
59a3c45d9c SOLR-13336: add maxBooleanClauses (default to 1024) setting to solr.xml, reverting previous effective value of Integer.MAX_VALUE-1, to restrict risk of pathalogical query expansion.
(cherry picked from commit d90034f0d61cd1525e10d07cf064a8647dc08cc9)
2019-04-15 10:27:29 -07:00
Kevin Risden
f545e64061
SOLR-13335: Upgrade to velocity 2.0 and velocity-tools 3.0
Signed-off-by: Kevin Risden <krisden@apache.org>
2019-03-25 10:02:23 -04:00
erick
a108b4f730 SOLR-13268: Clean up any test failures resulting from SOLR-12055 (async logging). Kevin's upgrades
(cherry picked from commit fe5a96a)
2019-02-24 10:05:57 -08:00
erick
07cc2d98ef SOLR-12055: Enable async logging by default SOLR-12753: Async logging ring buffer and OOM error
(cherry picked from commit 0de3905)
2019-02-22 12:47:29 -08:00
Alan Woodward
83f8d14226 Add next minor release version 8.1.0
This reverts commit b20afd322daa0ded3a890bb01a6497124c1187c6.
2019-02-12 09:15:58 +00:00
jimczi
b20afd322d Revert "Add next minor release version 8.1.0"
This reverts commit df4fabb3dfd5c3957b830a4e129291a3d8588f33.
2019-01-29 17:02:40 +01:00
jimczi
df4fabb3df Add next minor release version 8.1.0 2019-01-29 14:15:32 +01:00
David Smiley
8413b105c2 SOLR-12768: added _nest_path_ to the default schema (thereby enabling nested docs)
* new NestPathField encapsulating details for how _nest_path_ is indexed
** tweaked the analysis to index 1 token instead of variable
* TokenizerChain has new CustomAnalyzer copy-constructor

(cherry picked from commit 381a30b26ca1737123b65aefc685367d1aa038b9)
2019-01-28 13:26:56 -05:00
Tomas Fernandez Lobbe
e9db95831b SOLR-12770: Make it possible to configure a host whitelist for distributed search 2019-01-15 11:49:11 -08:00
Jason Gerlowski
c34f29a4b4 SOLR-13090: Add sysprop override for maxBooleanClauses 2019-01-02 10:58:32 -05:00
Cao Manh Dat
f80e8e1167 Merge jira/http2 branch to master 2018-12-16 16:58:20 +00:00
Jan Høydahl
a3fc31e5d2 Remove unnecessary XML exclusions as Jetty handles these by default (janhoy) 2018-10-18 16:38:52 +02:00
David Smiley
964cc88cee SOLR-12593: remove date parsing from extract contrib
* added "ignored_*" to the default configSet
* Updated Ref Guide info on Solr Cell to demonstrate usage without using the techproducts configSet

Closes #438
2018-09-28 16:50:11 -04:00
Erick Erickson
3b62f23f72 SOLR-12055: Enable async logging by default - rollback 2018-09-07 22:51:50 -07:00
Erick Erickson
8e75f393b3 SOLR-12055: Enable async logging by default 2018-08-31 20:39:05 -07:00
David Smiley
18874a6e36 SOLR-12591: Expand default configSet's date patterns to subsume those of extract contrib 2018-08-29 14:17:44 -04:00
Uwe Schindler
928b92caa0 SOLR-12655: Add Korean morphological analyzer ("nori") to default distribution. This also adds examples for configuration in Solr's schema 2018-08-11 14:07:31 +02:00
David Smiley
c3887b351e SOLR-12586: Change ParseDateFieldUpdateProcessorFactory to use java.time.DateTimeFormatter, not Joda Time.
Note: slightly different pattern language!
Remove Joda Time.
Closes #428
2018-08-07 11:51:16 -04:00
Erick Erickson
93ae3669b5 SOLR-12008: Settle a location for the log4j2.xml file 2018-07-11 20:57:38 -07:00
Alexandre Rafalovitch
b7d14c50fb SOLR-11694: Remove outdated UIMA module 2018-07-07 09:58:57 -04:00
Ishan Chattopadhyaya
4138ad662e SOLR-12428: Solr LTR jar now included in _default configset's solrconfig.xml 2018-06-18 15:02:20 +05:30
Jan Høydahl
30bf6b657f SOLR-12350: Do not use docValues as stored for _str (copy)fields in _default configset 2018-06-08 15:12:48 +02:00
Varun Thacker
44015e2acd SOLR-11453: Configuring slowQueryThresholdMillis logs slow requests to a separate file - solr_slow_requests.log 2018-05-28 12:43:05 -07:00
Varun Thacker
8a697ee09c SOLR-12265: Fix jetty-start shade issue 2018-05-10 10:10:44 -07:00
Mark Miller
5e2a5a5b8c SOLR-10783: Add support for Hadoop Credential Provider as SSL/TLS store password source. 2018-04-09 21:57:56 -05:00
Joel Bernstein
d420139c27 SOLR-12175: Add random field type and dynamic field to the default managed-schema 2018-04-05 14:00:07 -04:00