diff --git a/solr/CHANGES.txt b/solr/CHANGES.txt index fe674906e99..9db4b331324 100644 --- a/solr/CHANGES.txt +++ b/solr/CHANGES.txt @@ -8,1750 +8,14 @@ caching, replication, and a web administration interface. See http://lucene.apache.org/solr for more information. - -Getting Started ---------------- -You need a Java 1.8 VM or later installed. -In this release, there is an example Solr server including a bundled -servlet container in the directory named "example". -See the Quick Start guide at http://lucene.apache.org/solr/quickstart.html - -================== 7.0.0 ================== - -Upgrading from Solr 6.x ----------------------- - -* HttpClientInterceptorPlugin is now HttpClientBuilderPlugin and must work with a - SolrHttpClientBuilder rather than an HttpClientConfigurer. - -* HttpClientUtil now allows configuring HttpClient instances via SolrHttpClientBuilder - rather than an HttpClientConfigurer. Use of env variable SOLR_AUTHENTICATION_CLIENT_CONFIGURER - no longer works, please use SOLR_AUTHENTICATION_CLIENT_BUILDER - -* SolrClient implementations now use their own internal configuration for socket timeouts, - connect timeouts, and allowing redirects rather than what is set as the default when - building the HttpClient instance. Use the appropriate setters on the SolrClient instance. - -* HttpSolrClient#setAllowCompression has been removed and compression must be enabled as - a constructor param. - -* HttpSolrClient#setDefaultMaxConnectionsPerHost and - HttpSolrClient#setMaxTotalConnections have been removed. These now default very - high and can only be changed via param when creating an HttpClient instance. - -* Query time join with scoring {!join score=none} (even none) doesn't handle single value numeric fields. - Users are advised to convert these fields into string and reindex. - -* Deprecated collection and configset methods on MiniSolrCloudCluster have been - removed - -Bug Fixes ----------------------- -* SOLR-9262: Connection and read timeouts are being ignored by UpdateShardHandler after SOLR-4509. - (Mark Miller, shalin) - -Optimizations ----------------------- - -* SOLR-4509: Move to non deprecated HttpClient impl classes to remove stale connection - check on every request and move connection lifecycle management towards the client. - (Ryan Zezeski, Mark Miller, Shawn Heisey, Steve Davids) - -* SOLR-9255: Rename SOLR_AUTHENTICATION_CLIENT_CONFIGURER -> SOLR_AUTHENTICATION_CLIENT_BUILDER (janhoy) - -* SOLR-9579: Make Solr's SchemaField implement Lucene's IndexableFieldType, removing the - creation of a Lucene FieldType every time a field is indexed. (John Call, yonik) - - -================== 6.4.0 ================== - -Consult the LUCENE_CHANGES.txt file for additional, low level, changes in this release. - -Versions of Major Components ---------------------- -Apache Tika 1.13 -Carrot2 3.15.0 -Velocity 1.7 and Velocity Tools 2.0 -Apache UIMA 2.3.1 -Apache ZooKeeper 3.4.6 -Jetty 9.3.8.v20160314 - -Detailed Change List ----------------------- - -Upgrade Notes ----------------------- - -* SOLR-9166: Export handler returns zero for numeric fields that are not in the original doc. One - consequence of this change is that you must be aware that some tuples will not have values if - there were none in the original document. - -* SOLR-8785: Metrics related classes in org.apache.solr.util.stats have been removed in favor of - the dropwizard metrics library. Any custom plugins using these classes should be changed to use - the equivalent classes from the metrics library. - As part of this, the following changes were made to the output of Overseer Status API: - * The "totalTime" metric has been removed because it is no longer supported - * The metrics "75thPctlRequestTime", "95thPctlRequestTime", "99thPctlRequestTime" - and "999thPctlRequestTime" in Overseer Status API have been renamed to "75thPcRequestTime", "95thPcRequestTime" - and so on for consistency with stats output in other parts of Solr. - * The metrics "avgRequestsPerMinute", "5minRateRequestsPerMinute" and "15minRateRequestsPerMinute" have been - replaced by corresponding per-second rates viz. "avgRequestsPerSecond", "5minRateRequestsPerSecond" - and "15minRateRequestsPerSecond" for consistency with stats output in other parts of Solr. - -New Features ----------------------- -* SOLR-9293: Solrj client support for hierarchical clusters and other topics - marker. (Dawid Weiss) - -* SOLR-9681: FacetModule / JSON Facet API added the ability to add filters directly to - any facet command. The filters are applied after any domain change operations. - Example: { type:terms, field:category, filter:"user:yonik" } - (yonik) - -* SOLR-9442: Adds Array of NamedValuePair (json.nl=arrnvp) style to JSONResponseWriter. - (Jonny Marks, Christine Poerschke) - -* SOLR-9481: Authentication and Authorization plugins now work in standalone mode if security.json is placed in - SOLR_HOME on every node. Editing config through API is supported but affects only that one node. - (janhoy) - -* SOLR-8542: Adds Solr Learning to Rank (LTR) plugin for reranking results with machine learning models. - (Michael Nilsson, Diego Ceccarelli, Joshua Pantony, Jon Dorando, Naveen Santhapuri, Alessandro Benedetti, David Grohmann, Christine Poerschke) - -* SOLR-9055: Make collection backup/restore extensible. (Hrishikesh Gadre, Varun Thacker, Mark Miller) - -* SOLR-9682: JSON Facet API: added "param" query type to facet domain filter specification to obtain - filters via query parameters. (yonik) - -* SOLR-9038: Add a command-line tool to manage the snapshots functionality (Hrishikesh Gadre via yonik) - -* SOLR-9633: Limit memory consumed by FastLRUCache with a new 'maxRamMB' config parameter. - (yonik, Michael Sun, shalin) - -* SOLR-9666: SolrJ LukeResponse support dynamic fields (Fengtan via Kevin Risden) - -* SOLR-9077: Streaming expressions should support collection alias (Kevin Risden) - -* SOLR-9324: Support Secure Impersonation / Proxy User for solr authentication - (Gregory Chanan, Hrishikesh Gadre via yonik) - -* SOLR-9721: javabin Tuple parser for streaming and other end points (noble) - -Optimizations ----------------------- -* SOLR-9704: Facet Module / JSON Facet API: Optimize blockChildren facets that have - filters specified by using those filters as acceptDocs. (yonik) - -* SOLR-9726: Reduce number of lookupOrd calls made by the DocValuesFacets.getCounts method. - (Jonny Marks via Christine Poerschke) - -* SOLR-9772: Deriving distributed sort values (fieldSortValues) should reuse - comparator and only invalidate leafComparator. (John Call via yonik) - -* SOLR-9786: FieldType has a new getSetQuery() method that can take a set of terms - and create a more efficient query (such as TermsQuery). The solr query parser has been - changed to use this method when appropriate. The parser also knows when it is being - used to parse a filter and will create TermsQueries from large lists of normal terms - or numbers, resulting in a query that will execute faster. This also acts to avoid - BooleanQuery maximum clause limit. Query parsing itself has also been optimized, - resulting in less produced garbage and 5-7% better performance. - (yonik) - - -Bug Fixes ----------------------- -* SOLR-9701: NPE in export handler when "fl" parameter is omitted. - (Erick Erickson) - -* SOLR-9433: SolrCore clean-up logic uses incorrect path to delete dataDir on failure to create a core. - (Evan Sayer, shalin) - -* SOLR-9360: Solr script not properly checking SOLR_PID - (Alessandro Benedetti via Erick Erickson) - -* SOLR-9716: RecoveryStrategy sends prep recovery command without setting read time out which can cause - replica recovery to hang indefinitely on network partitions. (Cao Manh Dat, shalin) - -* SOLR-9624: In Admin UI, do not attempt to highlight CSV output (Alexandre Rafalovitch) - -* SOLR-9005: In files example, add a guard condition to javascript URP script (Alexandre Rafalovitch) - -* SOLR-9519: JSON Facet API: don't stop at an empty facet bucket if any sub-facets still have a chance - of matching something due to filter exclusions (which can widen the domain again). - (Michael Sun, yonik) - -* SOLR-9740: A bug in macro expansion of multi-valued parameters caused non-expanded values - after the first expanded value in the same multi-valued parameter to be dropped. - (Erik Hatcher, yonik) - -* SOLR-9751: PreAnalyzedField can cause managed schema corruption. (Steve Rowe) - -* SOLR-9736: Solr resolves the collection name against the first available leader or first replica - of the first slice. This puts undue pressure on leader cores and likely on the wrong ones. This is - fixed to randomly pick a leader on updates or a replica core otherwise. (Cao Manh Dat via shalin) - -* SOLR-9284: The HDFS BlockDirectoryCache should not let it's keysToRelease or names maps grow indefinitely. - (Mark Miller, Michael Sun) - -* SOLR-9729: JDBCStream improvements (Kevin Risden) - -* SOLR-9626: new Admin UI now also highlights matched terms in the Analysis screen. (Alexandre Rafalovitch) - -* SOLR-9512: CloudSolrClient's cluster state cache can break direct updates to leaders (noble) - -Other Changes ----------------------- - -* SOLR-7539: Upgrade the clustering plugin to Carrot2 3.15.0. (Dawid Weiss) - -* SOLR-9621: Remove several Guava & Apache Commons calls in favor of java 8 alternatives. - (Michael Braun via David Smiley) - -* SOLR-9720: Refactor Responsewriters to remove dependencies on TupleStream, - Tuple, Explanation (noble) - -* SOLR-9717: Refactor '/export' to not hardcode the JSON output and to use an API (noble) - -* SOLR-9739: JavabinCodec implements PushWriter interface (noble) - -* SOLR-8332: Factor HttpShardHandler[Factory]'s url shuffling out into a ReplicaListTransformer class. - (Christine Poerschke, Noble Paul) - -* SOLR-9597: Add setReadOnly(String ...) to ConnectionImpl (Kevin Risden) - -* SOLR-9609: Change hard-coded keysize from 512 to 1024 (Jeremy Martini via Erick Erickson) - -* SOLR-8785: Use Dropwizard Metrics library for core metrics. The copied over code in - org.apache.solr.util.stats has been removed. (Jeff Wartes, Kelvin Wong, Christine Poerschke, shalin) - -* SOLR-9784: Refactor CloudSolrClient to eliminate direct dependency on ZK (noble) - -================== 6.3.0 ================== - -Consult the LUCENE_CHANGES.txt file for additional, low level, changes in this release. - -Versions of Major Components ---------------------- -Apache Tika 1.13 -Carrot2 3.12.0 -Velocity 1.7 and Velocity Tools 2.0 -Apache UIMA 2.3.1 -Apache ZooKeeper 3.4.6 -Jetty 9.3.8.v20160314 - -Detailed Change List ----------------------- - -Upgrade Notes ----------------------- - -* If you use the JSON Facet API (json.facet) with method=stream, you must now set sort='index asc' to get the streaming - behavior; otherwise it won't stream. Reminder: "method" is a hint that doesn't change defaults of other parameters. - -* If you use the JSON Facet API (json.facet) to facet on a numeric field and if you use mincount=0 or if you set the - prefix, then you will now get an error as these options are incompatible with numeric faceting. - -* Solr's logging verbosity at the INFO level has been greatly reduced, and - you may need to update the log configs to use the DEBUG level to see all the - logging messages you used to see at INFO level before. - -* We are no longer backing up solr.log and solr_gc.log files in date-stamped copies forever. If you relied on - the solr_log_ or solr_gc_log_ being in the logs folder that will no longer be the case. - See SOLR-9570 for details. - -* The create/deleteCollection methods on MiniSolrCloudCluster have been - deprecated. Clients should instead use the CollectionAdminRequest API. In - addition, MiniSolrCloudCluster#uploadConfigDir(File, String) has been - deprecated in favour of #uploadConfigSet(Path, String) - -* The bin/solr.in.sh (bin/solr.in.cmd on Windows) is now completely commented by default. Previously, this wasn't so, - which had the effect of masking existing environment variables. - -New Features ----------------------- -* SOLR-5725: facet.method=enum can bypass exact counts calculation with facet.exists=true, it just returns 1 for - terms which exists in result docset. (Alexey Kozhemiakin, Sebastian Koziel, Radoslaw Zielinski via Mikhail Khludnev) - -* SOLR-9127: Excel workbook (.xlsx) response writer. use 'wt=xlsx' (Tony Moriarty, noble) - -* SOLR-9469: JettySolrRunner now has the option of restarting using a different - port (Alan Woodward) - -* SOLR-9319: DELETEREPLICA can accept a 'count' and remove appropriate replicas (Nitin Sharma, noble) - -* SOLR-8186: Reduce logging to logs/solr--console.log when not running in foreground mode - Show timestamp also in foreground log. Also removes some logging noise. (janhoy) - -* SOLR-8487: Adds CommitStream to support sending commits to a collection being updated. (Dennis Gove) - -* SOLR-9534: You can now set Solr's log level through environment variable SOLR_LOG_LEVEL - Also adds conveience arguments -q (quiet: WARN) and -v (verbose: DEBUG) to bin/solr (janhoy) - -* SOLR-9537: Support facet scoring with the scoreNodes expression (Joel Bernstein) - -* SOLR-9558: DIH TemplateTransformerto to support multivalued fields (Ted Sullivan via noble) - -* SOLR-9557: Every implicit requesthandler now has a default 'useParams' attribute (noble) - -* SOLR-9572: config API to show expanded useParams for request handlers inline (noble) - -* SOLR-9258: Optimizing, storing and deploying AI models with Streaming Expressions (Cao Manh Dat, Joel Bernstein) - -* SOLR-9205: Added method LukeResponse.getSchemaFlags() which returns field - information as an EnumSet (Fengtan, Alan Woodward) - -* SOLR-9520: Kerberos delegation support in SolrJ (Ishan Chattopadhyaya, noble) - -* SOLR-9146: Parallel SQL engine should support >, >=, <, <=, <>, != syntax (Timothy Potter, Joel Bernstein, Kevin Risden) - -* SOLR-9337: Add fetch Streaming Expression (Joel Bernstein) - -* SOLR-9103: Restore ability for users to add custom Streaming Expressions (Cao Manh Dat) - -* SOLR-9657: New TemplateUpdateProcessorFactory added (noble) - -* SOLR-9417: Allow daemons to terminate when they finish iterating a topic (Joel Bernstein) - -* SOLR-8370: Display configured Similarity in Schema-Browser, both global/default and per-field/field-type - (janhoy, Alexandre Rafalovitch) - -* SOLR-9326: Ability to create/delete/list snapshots at collection level. - (Hrishikesh Gadre via yonik) - -* SOLR-9662: New parameter -u in bin/post to pass basicauth credentials (janhoy) - -* SOLR-9654: Add "overrequest" parameter to JSON Facet API to control amount of overrequest - on a distributed terms facet. (yonik) - -* SOLR-2212: Add a factory class corresponding to Lucene's NoMergePolicy. (Lance Norskog, Cao Manh Dat via shalin) - -* SOLR-9670: Support SOLR_AUTHENTICATION_OPTS in solr.cmd (janhoy) - -* SOLR-9559: Add ExecutorStream to execute stored Streaming Expressions (Joel Bernstein) - -* SOLR-1085: Add support for MoreLikeThis queries and responses in SolrJ client. - (Maurice Jumelet, Bill Mitchell, Cao Manh Dat via shalin) - -Bug Fixes ----------------------- - -* SOLR-9310: PeerSync fails on a node restart due to IndexFingerPrint mismatch (Pushkar Raste, noble) - -* SOLR-9484: The modify collection API should wait for the modified properties to show up in the - cluster state. (Cao Manh Dat, shalin) - -* SOLR-9507: CoreContainer threads now correctly set their MDC logging values - (Alan Woodward) - -* SOLR-9522: Improve error handling in ZKPropertiesWriter (Varun Thacker) - -* SOLR-8080: bin/solr start script now exits with informative message if using wrong Java version (janhoy) - -* SOLR-9475: bin/install_solr_service.sh script got improved detection of Linux distro, especially within - virtualized/Docker environment through parsing of /etc/*-release files. Now also supports CentOS. (janhoy) - -* SOLR-9524: SolrIndexSearcher.getIndexFingerprint uses dubious synchronization (Mike Drob, noble) - -* SOLR-9542: Kerberos delegation tokens requires Jackson library (Ishan Chattopadhyaya via noble) - -* SOLR-9330: Fix AlreadyClosedException on admin/mbeans?stats=true (Mikhail Khludnev) - -* SOLR-9411: Better validation for Schema API add-field and add-dynamic-field (janhoy, Steve Rowe) - -* SOLR-9504: A replica with an empty index becomes the leader even when other more qualified replicas - are in line. (shalin) - -* SOLR-9554: Fix NullPointerException when cores are loaded in parallel and switch schema.xml to managed-scheme. - (Alan Woodward, Mikhail Khludnev) - -* SOLR-9556: OverseerAutoFailoverReplicaThread was not exiting on interrupt - (Alan Woodward) - -* SOLR-9563: Collection creation could fail if an ADDREPLICA subrequest arrived - at a node before its local state had updated with the new collection data - (Alan Woodward) - -* SOLR-9278: Index replication interactions with IndexWriter can cause deadlock. (Xunlong via Mark Miller) - -* SOLR-9604: Pooled SSL connections were not being re-used (Alan Woodward, - Mikhail Khludnev, hossman) - -* SOLR-9325: solr.log is now written to $SOLR_LOGS_DIR without changing log4j.properties (janhoy) - -* SOLR-9518: Kerberos Delegation Tokens don't work without a chrooted ZK (Ishan Chattopadhyaya,via noble) - -* SOLR-9687: Fixed Interval Facet count issue in cases of open/close intervals on the same values - (Andy Chillrud, Tomás Fernández Löbbe) - -* SOLR-9441: Solr collection backup on HDFS can only be manipulated by the Solr process owner. - (Hrishikesh Gadre via Mark Miller) - -* SOLR-9536: OldBackupDirectory timestamp field needs to be initialized to avoid NPE. - (Hrishikesh Gadre, hossman via Mark Miller) - -* SOLR-2039: Multivalued fields with dynamic names does not work properly with DIH. - (K A, ruslan.shv, Cao Manh Dat via shalin) - -* SOLR-4164: group.limit=-1 was not supported for grouping in distributed mode. - (Cao Manh Dat, Lance Norskog, Webster Homer, hossman, yonik) - -* SOLR-9692: blockUnknown property makes inter-node communication impossible (noble) - -* SOLR-2094: XPathEntityProcessor should reinitialize the XPathRecordReader instance if - the 'forEach' or 'xpath' attributes are templates & it is not a root entity (Cao Manh Dat, noble) - -* SOLR-9697: zk upconfig broken on windows (Xavier Jmlucjav via janhoy) - -Optimizations ----------------------- - -* SOLR-9374: Speed up Jmx MBean retrieval for FieldCache. (Tim Owen via shalin) - -* SOLR-9449: Example schemas do not index _version_ field anymore because the field - has DocValues enabled already. (shalin) - -* SOLR-9447: Do not clone SolrInputDocument if update processor chain does not contain custom processors. - (shalin) - -* SOLR-9452: JsonRecordReader should not deep copy document before handler.handle(). (noble, shalin) - -* SOLR-9142: JSON Facet API: new method=dvhash can be chosen for fields with high cardinality. (David Smiley) - -* SOLR-9446: Leader failure after creating a freshly replicated index can send nodes into recovery even if - index was not changed (Pushkar Raste, noble) - -* SOLR-9592: retrieving docValues as stored values was sped up by using the proper leaf - reader rather than ask for a global view. In extreme cases, this leads to a 100x speedup. - (Takahiro Ishikawa, yonik) - -* SOLR-9566: Don't put replicas into recovery when first creating a Collection - (Alan Woodward) - -* SOLR-9546: Eliminate unnecessary boxing/unboxing going on in SolrParams (Pushkar Raste, noble) - -* SOLR-9506: cache IndexFingerprint for each segment (Pushkar Raste, yonik, noble) - -* SOLR-7506: Roll over GC logs by default via bin/solr scripts (shalin, janhoy) - -Other Changes ----------------------- - -* SOLR-9412: Add failOnMissingParams option to MacroExpander, add TestMacroExpander class. - (Jon Dorando, Christine Poerschke) - -* SOLR-9406: SolrSuggester should selectively register close hook (Gethin James, Joel Bernstein) - -* SOLR-8961: Add a test module for solr-test-framework (Alan Woodward) - -* SOLR-9474: MiniSolrCloudCluster will not reuse ports by default when - restarting its JettySolrRunners (Alan Woodward) - -* SOLR-9498: Remove HDFS properties from DIH solrconfig.xml, as started in SOLR-6943 (Alexandre Rafalovitch) - -* SOLR-9365: Reduce noise in solr logs during graceful shutdown. (Cao Manh Dat via shalin) - -* SOLR-9451: Make clusterstatus command logging less verbose. (Varun Thacker) - -* SOLR-9502: ResponseWriters should natively support MapSerializable (noble) - -* SOLR-9538: Relocate (BinaryResponse|JSON|Smile)Writer tests to org.apache.solr.response - which is the package of the classes they test. (Jonny Marks via Christine Poerschke) - -* SOLR-9508: Install script install_solr_service.sh now checks existence of tools. - New option -n to avoid starting service after installation (janhoy) - -* SOLR-7826: Refuse "bin/solr create" if run as root, unless -force is specified (janhoy, Binoy Dalal) - -* SOLR-6871: Updated the quickstart tutorial to cover the 6.2.0 release, and added ant target - "generate-website-quickstart" to convert the bundled version of the tutorial into one suitable - for the website. - -* SOLR-5563: Move lots of SolrCloud logging from 'info' to 'debug' (janhoy, Alan - Woodward) - -* SOLR-9544: Allow ObjectReleaseTracker more time to check for asynchronously - closing resources (Alan Woodward) - -* SOLR-6677: Reduced logging during startup and shutdown, moved more logs to DEBUG level - (janhoy, Shawn Heisey, Alan Woodward) - -* SOLR-6090: Remove unreachable printLayout usage in cloud tests. (Cao Manh Dat via shalin) - -* SOLR-9551: Add JSONWriter constructor variant, JSONWriterTest.testConstantsUnchanged test. - (Jonny Marks, Christine Poerschke) - -* SOLR-9500: Add a LogLevel annotation to set log levels on specific tests (Alan - Woodward) - -* SOLR-9548: The beginning of solr.log now starts with a more informative welcome message (janhoy) - -* SOLR-9547: Do not allow bin/solr start as root user, unless -force param specified (janhoy) - -* SOLR-9567: Make ReRankQParserPlugin's private ReRankCollector a public class of its own. (Christine Poerschke) - -* SOLR-7436: Solr stops printing stacktraces in log and output (janhoy, hossman, Markus Jelsma) - -* SOLR-9576: Make FieldAnalysisRequestHandler, DocumentAnalysisRequestHandler & DumpRequestHandler - implicit (noble) - -* SOLR-9574: Factor out AbstractReRankQuery from ReRankQParserPlugin's private ReRankQuery. (Christine Poerschke) - -* SOLR-5041: Add a test to make sure that a leader always recovers from log on startup. (Cao Manh Dat, shalin) - -* SOLR-9588: Remove Guava dependency from SolrJ (Ishan Chattopadhyaya, noble) - -* SOLR-8140: Remove mentions of unimplemented admin-extra from the new Admin UI (Alexandre Rafalovitch) - -* SOLR-9589: Remove jackson dependency from SolrJ (Ishan Chattopadhyaya, noble) - -* SOLR-8385: Narrow StreamFactory.withFunctionName clazz parameter to prevent misconfiguration (Jason Gerlowski, Kevin Risden) - -* SOLR-8969: SQLHandler causes NPE in non-cloud mode (Markus Jelsma, Kevin Risden) - -* SOLR-9610: New AssertTool in SolrCLI for easier cross platform assertions from command line (janhoy) - -* SOLR-9680: Better error messages in SolrCLI when authentication required (janhoy) - -* SOLR-9639: Test only fix. Prevent CDCR tests from removing collection during recovery that used to blow up jvm (Mikhail Khludnev) - -* SOLR-9625: Add HelloWorldSolrCloudTestCase class (Christine Poerschke, Alan Woodward, Alexandre Rafalovitch) - -* SOLR-9642: Refactor the core level snapshot cleanup mechanism to rely on Lucene (Hrishikesh Gadre via yonik) - -* SOLR-9627: Add QParser.getSortSpec, deprecate misleadingly named QParser.getSort (Judith Silverman, Christine Poerschke) - -* SOLR-9632: Add MiniSolrCloudCluster#deleteAllCollections() method (Alan Woodward) - -* SOLR-9634: Deprecate collection methods on MiniSolrCloudCluster (Alan Woodward) - -* SOLR-7850: Moved defaults within bin/solr.in.sh (and bin/solr.in.cmd on Windows) to bin/solr (and bin/solr.cmd) - such that the default state of these files is to set nothing. This makes Solr work better with Docker. (David Smiley) - -* SOLR-9570: Various log tidying now happens at Solr startup: - Old solr_log_ and solr_gc_log_ files are removed, avoiding disks to fill up, - solr.log.X files are rotated, preserving solr.log from last run in solr.log.1, solr.log.1 => solr.log.2 etc - solr-*-console.log files are moved into $SOLR_LOGS_DIR/archived/ instead of being overwritten - Last JVM garbage collection log solr_gc.log is moved into $SOLR_LOGS_DIR/archived/ - (janhoy) - -* SOLR-4531: Add tests to ensure that recovery does not fail on corrupted tlogs. - (Simon Scofield, Cao Manh Dat via shalin) - -* SOLR-5245: Add a test to ensure that election contexts are keyed off both collection name and coreNodeName - so that killing a shard in one collection does not result in leader election in a different collection. - See SOLR-5243 for the related bug. (Cao Manh Dat via shalin) - -* SOLR-9533: Reload core config when a core is reloaded (Gethin James, Joel Bernstein) - -* SOLR-9371: Fix bin/solr calculations for start/stop wait time and RMI_PORT. - (Shawn Heisey via Erick Erickson) - - -================== 6.2.1 ================== - -Bug Fixes ----------------------- - -* SOLR-9494: Use of {!collapse} sometimes doesn't correctly return true for Collector.needsScores(), especially when the - query was cached. This can cause an exception when 'q' is a SpanQuery or potentially others. (David Smiley) - -* SOLR-6744: fl renaming / alias of uniqueKey field generates null pointer exception in SolrCloud configuration - (Mike Drob via Tomás Fernández Löbbe) - -* SOLR-9445: Admin requests are retried by CloudSolrClient and LBHttpSolrClient on failure. (shalin) - -* SOLR-9439: Shard split clean up logic for older failed splits is faulty. The delete shard API - has also been made more resilient against failures resulting from non-existent cores. (shalin) - -* SOLR-9430: Fix locale lookup in DIH to use BCP47 language tags - to be consistent with other places in Solr. Language names still work for backwards - compatibility. (Uwe Schindler, Boris Steiner) - -* SOLR-9389: HDFS Transaction logs stay open for writes which leaks Xceivers. (Tim Owen via Mark Miller) - -* SOLR-9188: blockUnknown property makes inter-node communication impossible (noble) - -* SOLR-9455: Deleting a sub-shard in recovery state can mark parent shard as inactive. (shalin) - -* SOLR-9461: DELETENODE, REPLACENODE should pass down the 'async' param to subcommands (shalin, noble) - -* SOLR-9444: Fix path usage for cloud backup/restore. (Hrishikesh Gadre, Uwe Schindler, Varun Thacker) - -* SOLR-9381: Snitch for freedisk uses '/' instead of 'coreRootDirectory' (Tim Owen, noble) - -* SOLR-9488: Shard split can fail to write commit data on shutdown/restart causing replicas to recover - without replicating the index. This can cause data loss. (shalin) - -* SOLR-9490: Fixed bugs in BoolField that caused it to erroneously return "false" for all docs depending - on usage (Colvin Cowie, Dan Fox, hossman) - -* SOLR-9438: Shard split can be marked successful and sub-shard states switched to 'active' even when - one or more sub-shards replicas do not recover due to the leader crashing or restarting between the time - the replicas are created and before they can recover. This can cause data loss. (shalin) - -* SOLR-9408: Fix TreeMergeOutputFormat to add timestamp metadata to a commit. SolrCloud replication relies on this. - (Jessica Cheng Mallet via Varun Thacker) - -Other Changes ----------------------- - -* SOLR-7362: Fix TestReqParamsAPI test failures (noble, Varun Thacker) - -================== 6.2.0 ================== - -Versions of Major Components ---------------------- -Apache Tika 1.13 -Carrot2 3.12.0 -Velocity 1.7 and Velocity Tools 2.0 -Apache UIMA 2.3.1 -Apache ZooKeeper 3.4.6 -Jetty 9.3.8.v20160314 - -Detailed Change List ----------------------- - -New Features ----------------------- - -* SOLR-9187: Support dates and booleans in /export handler, support boolean DocValues fields (Erick Erickson) - -* SOLR-8048: bin/solr script should support basic auth credentials provided in solr.in.sh (noble) - -* SOLR-7374: Core level Backup/Restore now supports specifying the directory implementation to use - via the "repository" parameter. (Hrishikesh Gadre, Varun Thacker, Mark Miller) - -* SOLR-9216: Support collection.configName in MODIFYCOLLECTION request (Keith Laban, noble) - -* SOLR-9251: Support for a new tag 'role' in replica placement rules (noble) - -* SOLR-9194: Enhance the bin/solr script to perform file operations to/from Zookeeper (Erick Erickson, janhoy) - -* SOLR-9242: Collection Backup/Restore now supports specifying the directory implementation to use - via the "repository" parameter. (Hrishikesh Gadre, Varun Thacker) - -* SOLR-9193: Add scoreNodes Streaming Expression (Joel Bernstein) - -* SOLR-9243: Add terms.list parameter to the TermsComponent to fetch the docFreq for a list of terms - (Joel Bernstein) - -* SOLR-9090: Add directUpdatesToLeadersOnly flag to solrj CloudSolrClient. - (Marvin Justice, Christine Poerschke) - -* SOLR-9270: Allow spatialContextFactory to be simply "JTS". And if any spatial params include the old - Spatial4j package "com.spatial4j.core" it is rewritten to "org.locationtech.spatial4j" with a warning. - (David Smiley) - -* SOLR-9240: Support parallel ETL with the topic expression (Joel Bernstein) - -* SOLR-9275: XML QueryParser support (defType=xmlparser) now extensible via configuration. - (Christine Poerschke) - -* SOLR-9200: Add Delegation Token Support to Solr. - (Gregory Chanan) - -* SOLR-9038: Solr core snapshots: The current commit can be snapshotted which retains the commit and associates it with - a name. The core admin API can create snapshots, list them, and delete them. Snapshot names can be referenced in - doing a core backup, and in replication. Snapshot metadata is stored in a new snapshot_metadata/ dir. - (Hrishikesh Gadre via David Smiley) - -* SOLR-9279: New boolean comparison function queries comparing numeric arguments: gt, gte, lt, lte, eq - (Doug Turnbull, David Smiley) - -* SOLR-9252: Feature selection and logistic regression on text (Cao Manh Dat, Joel Bernstein) - -* SOLR-6465: CDCR: fall back to whole-index replication when tlogs are insufficient. - (Noble Paul, Renaud Delbru, shalin) - -* SOLR-9320: A REPLACENODE command to decommission an existing node with another new node - (noble, Nitin Sharma, Varun Thacker) - -* SOLR-9318: A DELETENODE command to delete all replicas in that node (noble, Nitin Sharma, Varun Thacker) - -Bug Fixes ----------------------- - -* SOLR-9191: OverseerTaskQueue.peekTopN() fatally flawed (Scott Blum, Noble Paul) - -* SOLR-9199: ZkController#publishAndWaitForDownStates logic is inefficient (Hrishikesh Gadre) - -* SOLR-9161: Change SolrPluginUtils.invokeSetters implementation to accommodate setter variants. - (Christine Poerschke, Steve Rowe, Uwe Schindler) - -* SOLR-9234: srcField parameter works only when all fields are captured in the /update/json/docs - endpoint (noble) - -* SOLR-8546: SOLR-8546: TestLazyCores is failing a lot on the Jenkins cluster. (Erick Erickson) - -* SOLR-9237: DefaultSolrHighlighter.doHighlightingByFastVectorHighlighter can't be overidden (janhoy) - -* SOLR-8626: 404 error when clicking nodes in cloud graph view in angular UI. (janhoy, Trey Grainger via shalin) - -* SOLR-9254: GraphTermsQueryQParserPlugin throws NPE when field being searched is not present in segment - (Joel Bernstein) - -* SOLR-8657: Fix SolrRequestInfo error logs if QuerySenderListener is being used (Pascal Chollet, - Tomás Fernández Löbbe) - -* SOLR-8777: Duplicate Solr process can cripple a running process. (Jessica Cheng Mallet, Scott Blum, shalin) - -* SOLR-9246: If the JDBCStream sees an unknown column type it will now throw a detailed exception. (Dennis Gove) - -* SOLR-9181: Fix some races in CollectionStateWatcher API (Alan Woodward, Scott - Blum) - -* SOLR-9235: Fixed NPE when using non-numeric range query in deleteByQuery (hossman) - -* SOLR-9088: Fixed TestManagedSchemaAPI failures which exposed race conditions in the schema API ( Varun Thacker, noble) - -* SOLR-9207: PeerSync recovery failes if number of updates requested is high. A new useRangeVersions config option - is introduced (defaults to true) to send version ranges instead of individual versions for peer sync. - (Pushkar Raste, shalin) - -* SOLR-8858: SolrIndexSearcher#doc() completely ignores field filters unless lazy field loading is enabled. - (Caleb Rackliffe, David Smiley, shalin) - -* SOLR-9236: AutoAddReplicas will append an extra /tlog to the update log location on replica failover. - (Eungsop Yoo, Mark Miller) - -* SOLR-9291: ZkSolrResourceLoader should not retry fetching resources if the server has been shutdown. - (shalin) - -* SOLR-9287: Including 'score' in the 'fl' param when doing an RTG no longer causes an NPE - (hossman, Ishan Chattopadhyaya) - -* SOLR-7280: In cloud-mode sort the cores smartly before loading & limit threads to improve cluster stability - (noble, Erick Erickson, shalin) - -* SOLR-9285: Fixed AIOOBE when using ValueSourceAugmenter in single node RTG (hossman) - -* SOLR-9288: Fix [docid] transformer to return -1 when used in RTG with uncommitted doc (hossman) - -* SOLR-9309: Fix SolrCloud RTG response structure when multi ids requested but only 1 found (hossman) - -* SOLR-9334: CloudSolrClient.collectionStateCache is unbounded (noble) - -* SOLR-9339: NPE in CloudSolrClient when the response is null (noble) - -* SOLR-8596: Web UI doesn't correctly generate queries which include local parameters (Alexandre Rafalovitch, janhoy) - -* SOLR-8645: managed-schema is now syntax highlighted in cloud->Tree view (Alexandre Rafalovitch via janhoy) - -* SOLR-8379: UI Cloud->Tree view now shows .txt files correctly (Alexandre Rafalovitch via janhoy) - -* SOLR-9003: New Admin UI's Dataimport screen now correctly displays DIH Debug output (Alexandre Rafalovitch) - -* SOLR-9308: Fix distributed RTG to forward request params, fixes fq and non-default fl params (hossman) - -* SOLR-9179: NPE in IndexSchema using IBM JDK (noble, Colvin Cowie) - -* SOLR-9397: Config API does not support adding caches (noble) - -* SOLR-9405: ConcurrentModificationException in ZkStateReader.getStateWatchers. - (Alan Woodward, Edward Ribeiro, shalin) - -* SOLR-9232: Admin UI now fully implements Swap Cores interface (Alexandre Rafalovitch) - -* SOLR-8715: Admin UI's Schema screen now works for fields with stored=false and some content indexed (Alexandre Rafalovitch) - -* SOLR-8911: In Admin UI, enable scrolling for overflowing Versions and JVM property values (Alexandre Rafalovitch) - -* SOLR-9002: Admin UI now correctly displays json and text files in the collection/Files screen (Upayavira, Alexandre Rafalovitch) - -* SOLR-8993: Admin UI now correctly supports multiple DIH handler end-points (Upayavira, Alexandre Rafalovitch) - -* SOLR-9032: Admin UI now correctly implements Create Alias command (Upayavira, Alexandre Rafalovitch) - -* SOLR-9391: LBHttpSolrClient.request now correctly returns Rsp.server when - previously skipped servers were successfully tried. (Christine Poerschke) - -Optimizations ----------------------- - -* SOLR-9219: Make hdfs blockcache read buffer sizes configurable and improve cache concurrency. (Mark Miller) - -* SOLR-9264: Optimize ZkController.publishAndWaitForDownStates to not read all collection states and - watch relevant collections instead. (Hrishikesh Gadre, shalin) - -* SOLR-9335: Solr cache/search/update stats counters now use LongAdder which are supposed to have higher throughput - under high contention. (Varun Thacker) - -* SOLR-9350: JSON Facets: method="stream" will no longer always uses & populates the filter cache, likely - flushing it. 'cacheDf' can be configured to set a doc frequency threshold, now defaulting to 1/16th doc count. - Using -1 Disables use of the cache. (David Smiley, yonik) - -Other Changes ----------------------- - -* SOLR-9195: Remove unnecessary allocation and null check in UpdateRequestProcessorChain's - getReqProcessors method. (Christine Poerschke) - -* SOLR-8981: Upgraded Extraction module to Apache Tika 1.13. - (Tim Allison, Lewis John McGibbney via Uwe Schindler) - -* SOLR-9076: Update to Hadoop 2.7.2 - (Mark Miller, Gregory Chanan) - -* SOLR-8787: TestAuthenticationFramework should not extend TestMiniSolrCloudCluster. (Trey Cahill via shalin) - -* SOLR-9180: More comprehensive tests of psuedo-fields for RTG and SolrCloud requests (hossman) - -* SOLR-7930: Comment out trappy references to example docs in elevate.xml files (Erick Erickson) - -* SOLR-9277: Clean up some more remnants of supporting old and new style solr.xml in tests (Erick Erickson) - -* SOLR-9163: Sync up basic_configs and data_driven_schema_configs, removing almost all differences - except what is required for schemaless. (yonik) - -* SOLR-9340: Change ZooKeeper disconnect and session expiry related logging from INFO to WARN to - make debugging easier (Varun Thacker) - -* SOLR-9358: [AngularUI] In Cloud->Tree file view area, collapse metadata by default (janhoy) - -* SOLR-9256: asserting hasNext() contract in JdbcDataSource in DataImportHandler (Kristine Jetzke via Mikhai Khludnev) - -* SOLR-9209: extracting JdbcDataSource.createResultSetIterator() for extension (Kristine Jetzke via Mikhai Khludnev) - -* SOLR-9353: Factor out ReRankQParserPlugin.ReRankQueryRescorer private class. (Christine Poerschke) - -* SOLR-9392: Fixed CDCR Test failures which were due to leaked resources. (shalin) - -* SOLR-9385: Add QParser.getParser(String,SolrQueryRequest) variant. (Christine Poerschke) - -* SOLR-9367: Improved TestInjection's randomization logic to use LuceneTestCase.random() (hossman) - -* SOLR-9331: Remove ReRankQuery's length constructor argument and member. (Christine Poerschke) - -* SOLR-9092: For the delete replica command we attempt to send the core admin delete request only - if that node is actually up. (Jessica Cheng Mallet, Varun Thacker) - -* SOLR-9410: Make ReRankQParserPlugin's private ReRankWeight a public class of its own. (Christine Poerschke) - -* SOLR-9404: Refactor move/renames in JSON FacetProcessor and FacetFieldProcessor. (David Smiley) - -* SOLR-9421: Refactored out OverseerCollectionMessageHandler to smaller classes (noble) - -* SOLR-8643: BlockJoinFacetComponent is substituted by BlockJoinFacetDocSetComponent. It doesn't need to change solrconfig.xml (Mikhail Khludnev) - -* SOLR-8644: Test asserts that block join facets work with parent level fq exclusions. (Dr. Oleg Savrasov via Mikhail Khludnev) - -================== 6.1.0 ================== - -Consult the LUCENE_CHANGES.txt file for additional, low level, changes in this release. - -Versions of Major Components ---------------------- -Apache Tika 1.7 -Carrot2 3.12.0 -Velocity 1.7 and Velocity Tools 2.0 -Apache UIMA 2.3.1 -Apache ZooKeeper 3.4.6 -Jetty 9.3.8.v20160314 - -Upgrading from Solr any prior release ----------------------- - -* If you use historical dates, specifically on or before the year 1582, you should re-index. - -Detailed Change List ----------------------- - -New Features ----------------------- - -* SOLR-8782: Add asynchronous sugar methods to the SolrJ Collections API. You - can now call .processAsync() to run a method asynchronously, or - .processAndWait() to wait for a call to finish without holding HTTP - collections open. (Alan Woodward) - -* SOLR-8765: Enforce required parameters at query construction time in the SolrJ - Collections API, add static factory methods, and deprecate old setter methods. - (Alan Woodward, Jason Gerlowski) - -* SOLR-8842: authorization APIs do not use name as an identifier for a permission - for update, delete commands and 'before' attribute (noble) - -* SOLR-8814: Support GeoJSON response writer and general spatial formatting. Adding - &wt=geojson&geojson.field= - Will return a FeatureCollection for each SolrDocumentList and a Feature with the - requested geometry for each SolrDocument. The requested geometry field needs - to either extend AbstractSpatialFieldType or store a GeoJSON string. This also adds - a [geo] DocumentTransformer that can return the Shape in a variety of formats: - &fl=[geo f= w=(GeoJSON|WKT|POLY)] - The default format is GeoJSON. For information on the supported formats, see: - https://github.com/locationtech/spatial4j/blob/master/FORMATS.md - To return the FeatureCollection as the root element, add '&omitHeader=true" (ryan) - -* SOLR-8859: Spatial fields like RPT can now be configured to use Spatial4j registered shape formats - e.g. via format="GeoJSON". (ryan, David Smiley) - -* SOLR-445: new TolerantUpdateProcessorFactory to support skipping update commands that cause - failures when sending multiple updates in a single request. - (Erick Erickson, Tomás Fernández Löbbe, Anshum Gupta, hossman) - -* SOLR-8890: New static method in DistributedUpdateProcessorFactory to allow UpdateProcessorFactories - to indicate request params that should be forwarded when DUP distributes updates. (hossman) - -* SOLR-8888: Add shortestPath Streaming Expression. This expression performs a breadth first - graph traversal to find the shortest path(s) in an unweighted, directed graph stored in a - SolrCloud collection. (Joel Bernstein) - -* SOLR-8938: Add optional --excluderegex argument to ZkCLI. (Christine Poerschke) - -* SOLR-8976: Add SolrJ support for REBALANCELEADERS Collections API (Anshum Gupta) - -* SOLR-8962: Add sort Streaming Expression. The expression takes a single input stream and a - comparator and outputs tuples in stable order of the comparator. (Dennis Gove) - -* SOLR-8349: Allow sharing of large in memory data structures across cores (Gus Heck, noble) - -* SOLR-9009: Adds ability to get an Explanation of a Streaming Expression (Dennis Gove) - -* SOLR-8918: Adds Streaming to the admin page under the collections section. Includes - ability to see graphically the expression explanation (Dennis Gove) - -* SOLR-8913: When using a shared filesystem we should store data dir and tlog dir locations in - the cluster state. (Mark Miller) - -* SOLR-8809: Implement Connection.prepareStatement (Kevin Risden) - -* SOLR-9020: Implement StatementImpl/ResultSetImpl get/set fetch* methods and proper errors for traversal methods (Kevin Risden) - -* SOLR-9041: 'core-admin-read' and 'core-admin-edit' are well known permissions (noble) - -* SOLR-8986: Add Random Streaming Expression (Joel Bernstein) - -* SOLR-8925: Add gatherNodes Streaming Expression to support breadth first traversals (Joel Bernstein) - -* SOLR-9027: Add GraphTermsQuery to limit traversal on high frequency nodes (Joel Bernstein, David Smiley) - -* SOLR-5750: Add /admin/collections?action=BACKUP and RESTORE assuming access to a shared file system. - (Varun Thacker, David Smiley) - -* SOLR-9049: RuleBasedAuthorizationPlugin supports regex in param values eg: "command" : "REGEX:(i?)create" (noble) - -* SOLR-8972: Add GraphHandler and GraphMLResponseWriter to support graph visualizations (Joel Bernstein) - -* SOLR-9026: Extend facet telemetry support to legacy (non-json) facets under "debug/facet-debug" in - the response. (Michael Sun, yonik) - -* SOLR-7117: Provide an option to limit the maximum number of cores that can be created on a node by the - Auto Add Replica feature. For this you can set a "maxCoresPerNode" property via the Cluster Property API - (Varun Thacker, Mark Miller) - -* SOLR-8208: [subquery] document transformer executes separate requests per result document. (Cao Manh Dat via Mikhail Khludnev) - -* SOLR-8323, SOLR-9113: Add CollectionStateWatcher API (Alan Woodward, Scott Blum) - -* SOLR-8988: Adds query option facet.distrib.mco which when set to true allows the use of facet.mincount=1 in cloud mode. - (Keith Laban, Dennis Gove) - -* SOLR-8583: Apply highlighting to hl.alternateField by default for Default and FastVectorHighlighter. - Turn off with hl.highlightAlternate=false (janhoy, David Smiley) - -* SOLR-7123: '/update/json/docs' path supports nested documents (noble) - -* SOLR-8610: Resolve variables in encryptKeyFile of DIH's JdbcDataSource (Kristine Jetzke via Mikhail Khludnev) - -* SOLR-7739: Add a new ClassificationUpdateProcessorFactory. (Alessandro Benedetti via Tommaso Teofili) - -Bug Fixes ----------------------- - -* SOLR-8855: The HDFS BlockDirectory should not clean up it's cache on shutdown. (Mark Miller) - -* SOLR-8948: OverseerTaskQueue.containsTaskWithRequestId encounters json parse error if a - SolrResponse node is in the overseer queue. (Jessica Cheng Mallet via shalin) - -* SOLR-7729: ConcurrentUpdateSolrClient ignores the collection parameter in some methods. - (Nicolas Gavalda, Jorge Luis Betancourt Gonzalez via Mark Miller) - -* SOLR-8662: SchemaManager waits correctly for replicas to be notified of a new change. - (sarowe, Noble Paul, Varun Thacker) - -* SOLR-8983: Cleanup clusterstate and replicas for a failed create collection request - (Varun Thacker, Anshum Gupta) - -* SOLR-9029: fix rare ZkStateReader visibility race during collection state format update (Scott Blum, hossman) - -* SOLR-9046: Fix solr.cmd that wrongly assumes Jetty will always listen on 0.0.0.0. - (Bram Van Dam, Uwe Schindler) - -* SOLR-9064: Adds an explanation of the incoming stream to an UpdateStream's explanation (Dennis Gove) - -* SOLR-9128: Fix error handling issues in Streaming classes (Joel Bernstein) - -* SOLR-9151: Fix SolrCLI so that bin/solr -e cloud example can be run from any CWD (janhoy) - -* SOLR-9141: Fix ClassCastException when using the /sql handler count() function with - single-shard collections (Minoru Osuka via James Dyer) - -* SOLR-9165: Spellcheck does not return collations if "maxCollationTries" is used with "cursorMark". - (James Dyer) - -* SOLR-8940: Fix group.sort option (hossman) - -* SOLR-8612: closing JDBC Statement on failures in DataImportHandler (DIH) (Kristine Jetzke via Mikhail Khludnev) - -* SOLR-8676: keep LOG4J_CONFIG in solr.cmd (Kristine Jetzke via Mikhail Khludnev) - -* SOLR-9198: config APIs unable to add multiple values with same name (noble) - -* SOLR-8812: edismax: turn off mm processing if no explicit mm spec is provided - and there are explicit operators (except for AND) - addresses problems caused by SOLR-2649. - (Greg Pendlebury, Jan Høydahl, Erick Erickson, Steve Rowe) - -* SOLR-9176: facet method ENUM was sometimes unnecessarily being rewritten to - FCS, causing slowdowns (Alessandro Benedetti, Jesse McLaughlin, Alan Woodward) - -Optimizations ----------------------- -* SOLR-8722: Don't force a full ZkStateReader refresh on every Overseer operation. - (Scott Blum via shalin) - -* SOLR-8745: Deprecate costly ZkStateReader.updateClusterState(), replace with a narrow - forceUpdateCollection(collection) (Scott Blum via shalin) - -* SOLR-8856: Do not cache merge or 'read once' contexts in the hdfs block cache. (Mark Miller, Mike Drob) - -* SOLR-8922: Optimize filter creation (DocSetCollector) to minimize the amount of garbage - produced. This resulted in up to 3x throughput when small filter creation was the bottleneck, - as well as orders of magnitude less garbage. (Jeff Wartes, yonik) - -* SOLR-8937: bin/post (SimplePostTool) now streams the standard input instead of buffering fully. - (David Smiley) - -* SOLR-8973: Zookeeper frenzy when a core is first created. (Janmejay Singh, Scott Blum, shalin) - -* SOLR-9014: Deprecate and reduce usage of ClusterState methods which may make calls to ZK via - the lazy collection reference. (Scott Blum, shalin) - -* SOLR-9106: Cluster properties are now cached on ZkStateReader. (Alan Woodward) - -* SOLR-9147: Upgrade commons-io to 2.5, avoid expensive array resizing in EmbeddedSolrServer (Mikhail Khludnev) - -* SOLR-8744: Overseer operations performed with fine grained mutual exclusion (noble, Scott Blum) - -* SOLR-9204: Improve performance of getting directory size with hdfs. (Mark Miller) - -Other Changes ----------------------- -* SOLR-8860: Remove back-compat handling of router format made in SOLR-4221 in 4.5.0. (shalin) - -* SOLR-8866: UpdateLog will now throw an exception if it doesn't know how to serialize a value. - (David Smiley) - -* SOLR-8842: security rules made more foolproof by asking the requesthandler about the well known - permission name.
 The APIs are also modified to ue 'index' as the unique identifier instead of name. - Name is an optional attribute
 now and only to be used when specifying well-known permissions (noble) - -* SOLR-5616: Simplifies grouping code to use ResponseBuilder.needDocList() to determine if it needs to - generate a doc list for grouped results. (Steven Bower, Keith Laban, Dennis Gove) - -* SOLR-8869: Optionally disable printing field cache entries in SolrFieldCacheMBean (Gregory Chanan) - -* SOLR-8892: Allow SolrInfoMBeans to return different statistics for /jmx vs web ui calls. - (Gregory Chanan, Mark Miller) - -* SOLR-8097: Implement builder pattern design for constructing SolrJ clients and also deprecate direct construction - of client objects. (Jason Gerlowski, Shawn Heisey, Anshum Gupta) - -* SOLR-9015: Adds SelectStream as a default function in the StreamHandler (Dennis Gove) - -* SOLR-8929: Add an idea module for solr/server to enable launching start.jar (Scott Blum, Steve Rowe) - -* SOLR-8933: Solr should not close container streams. (Mike Drob, Uwe Schindler, Mark Miller) - -* SOLR-9037: Replace multiple "/replication" strings with one static constant. (Christine Poerschke) - -* SOLR-9047: zkcli should allow alternative locations for log4j configuration (Gregory Chanan) - -* SOLR-9066: Make CountMetric return long instead of double (Kevin Risden) - -* SOLR-9065, SOLR-9072, SOLR-9132: Migrate some distributed tests to SolrCloudTestCase. (Alan Woodward) - -* SOLR-8184: Negative tests for JDBC Connection String (Susheel Kumar, Jason Gerlowski, Kevin Risden) - -* SOLR-8458: Add Streaming Expressions tests for parameter substitution (Joel Bernstein, Cao Manh Dat, Dennis Gove, Kevin Risden) - -* SOLR-8467: CloudSolrStream and FacetStream should take a SolrParams object rather than a - Map to allow more complex Solr queries to be specified. (Erick Erickson) - -* SOLR-9083: Remove all and from schemas. NOTE: as in the JIRA I left a few in to insure the (no cost) - back compat. (Erick Erickson) - -* SOLR-9105: Fix a bunch of typos across 103 files (Bartosz Krasiński via janhoy) - -* SOLR-9159: New cloud based concurrent atomic update test (hossman) - -* SOLR-9119: several static methods in ValueSourceParser have been made private (hossman) - -* SOLR-9110: Move JoinFromCollection- SubQueryTransformer- BlockJoinFacet- Distrib Tests to SolrCloudTestCase (Mikhail Khludnev) - -* SOLR-9136: Separate out the error statistics into server-side error vs client-side error - (Jessica Cheng Mallet via Erick Erickson) - -* SOLR-9107: new @RandomizeSSL annotation for more fine grained control of SSL testing (hossman, sarowe) - -* SOLR-9081: Make SolrTestCaseJ4.beforeClass() / .afterClass() public so it - works with Mockito (Georg Sorst, Alan Woodward) - -* SOLR-8445: fix line separator in log4j.properties files (Ahmet Arslan via Mikhail Khludnev) - -* SOLR-2199: DataImportHandler (DIH) JdbcDataSource supports multiple resultsets per query (Kristine Jetzke, Mark Waddle via Mikhail Khludnev) - -================== 6.0.1 ================== - -Upgrade Notes ----------------------- - -* If you use historical dates, specifically on or before the year 1582, you should re-index. - -Bug Fixes ----------------------- - -* SOLR-8914: ZkStateReader's refreshLiveNodes(Watcher) is not thread safe. (Scott Blum, hoss, - sarowe, Erick Erickson, Mark Miller, shalin) - -* SOLR-9016: Fix SolrIdentifierValidator to not allow empty identifiers. (Shai Erera) - -* SOLR-8992: Restore Schema API GET method functionality removed in 6.0 (noble, Steve Rowe) - -* SOLR-9080, SOLR-9085: (6.0 bug) For years <= 1582, date math (round,add,sub) introduced error. Range faceting - on such dates was also affected. With this fixed, this is the first release range faceting works on BC years. - (David Smiley) - -* SOLR-8857: HdfsUpdateLog does not use configured or new default number of version buckets and is - hard coded to 256. (Mark Miller, yonik, Gregory Chanan) - -* SOLR-8902: Make sure ReturnFields only returns the requested fields from (fl=) evn when - DocumentTransformers ask for getExtraRequestFields() (ryan) - -* SOLR-8875: SolrCloud Overseer clusterState could unexpectedly be null resulting in NPE. - (Scott Blum via David Smiley) - -* SOLR-8946: bin/post failed to detect stdin usage on Ubuntu; maybe other unixes. (David Smiley) - -* SOLR-9004: Fix "name" field type definition in films example. (Alexandre Rafalovitch via Varun Thacker) - -* SOLR-8990: Fix top term links from schema browser page to use {!term} parser (hossman) - -* SOLR-8971: Preserve root cause when wrapping exceptions (hossman) - -* SOLR-9034: Atomic updates failed to work when there were copyField targets that had docValues - enabled. (Karthik Ramachandran, Ishan Chattopadhyaya, yonik) - -* SOLR-9028: Fixed some test related bugs preventing SSL + ClientAuth from ever being tested (hossman) - -* SOLR-9059: NPE in SolrClientCache following collection reload (Joel Bernstein, Ryan Yacyshyn) - -* SOLR-8792: ZooKeeper ACL support fixed. (Esther Quansah, Ishan Chattopadhyaya, Steve Rowe) - -* SOLR-9030: The 'downnode' overseer command can trip asserts in ZkStateWriter. - (Scott Blum, Mark Miller, shalin) - -* SOLR-9036: Solr slave is doing full replication (entire index) of index after master restart. - (Lior Sapir, Mark Miller, shalin) - -* SOLR-9058: Makes HashJoinStream and OuterHashJoinStream support different field names in the - incoming streams, eg. fieldA=fieldB. (Dennis Gove, Stephan Osthold) - -* SOLR-9093: Fix NullPointerException in TopGroupsShardResponseProcessor. (Christine Poerschke) - -* SOLR-9118: HashQParserPlugin should trim partition keys (Joel Bernstein) - -* SOLR-9117: The first SolrCore is leaked after reload. (Jessica Cheng Mallet via shalin) - -* SOLR-9116: Race condition causing occasional SolrIndexSearcher leak when SolrCore is reloaded. - (Jessica Cheng Mallet via shalin) - -* SOLR-8801: /bin/solr create script always returns exit code 0 when a collection/core already exists. - (Khalid Alharbi, Marius Grama via Steve Rowe) - -* SOLR-9134: Fix RestManager.addManagedResource return value. (Christine Poerschke) - -Other Changes ----------------------- -* SOLR-7516: Improve javadocs for JavaBinCodec, ObjectResolver and enforce the single-usage policy. - (Jason Gerlowski, Benoit Vanalderweireldt, shalin) - -* SOLR-8967: In SolrCloud mode, under the 'Core Selector' dropdown in the UI the Replication tab won't be displayed - anymore. The Replication tab is only beneficial to users running Solr in master-slave mode. (Varun Thacker) - -* SOLR-8985: Added back support for 'includeDynamic' flag to /schema/fields endpoint (noble) - -* SOLR-9131: Fix "start solr" text in cluster.vm Velocity template (janhoy) - -* SOLR-9053: Upgrade commons-fileupload to 1.3.1, fixing a potential vulnerability (Jeff Field, Mike Drob via janhoy) - -* SOLR-9115: Get rid of javax.xml.bind.DatatypeConverter in SimplePostTool - for Java 9 compatibility. (Uwe Schindler) - -* SOLR-5776,SOLR-9068,SOLR-8970: - - Refactor SSLConfig so that SSLTestConfig can provide SSLContexts using a NullSecureRandom - to prevent SSL tests from blocking on entropy starved machines. - - SSLTestConfig: Alternate (psuedo random) NullSecureRandom for Constants.SUN_OS. - - SSLTestConfig: Replace NullSecureRandom w/ NotSecurePsuedoRandom. - - Change SSLTestConfig to use a keystore file that is included as a resource in the - test-framework jar so users subclassing SolrTestCaseJ4 don't need to preserve magic paths. - (hossman) - -================== 6.0.0 ================== - -Consult the LUCENE_CHANGES.txt file for additional, low level, changes in this release - -Versions of Major Components ---------------------- -Apache Tika 1.7 -Carrot2 3.12.0 -Velocity 1.7 and Velocity Tools 2.0 -Apache UIMA 2.3.1 -Apache ZooKeeper 3.4.6 -Jetty 9.3.8.v20160314 - -System Requirements ----------------------- -* LUCENE-5950: Move to Java 8 as minimum Java version. - (Ryan Ernst, Uwe Schindler) - -Upgrading from Solr 5.x ----------------------- - -* The deprecated SolrServer and subclasses have been removed, use SolrClient - instead. - -* The deprecated configuration in solrconfig.xml has been removed. - Please remove it from solrconfig.xml. - -* SolrClient.shutdown() has been removed, use SolrClient.close() instead. - -* The deprecated zkCredientialsProvider element in solrcloud section of solr.xml - is now removed. Use the correct spelling (zkCredentialsProvider) instead. - -* SOLR-7957: internal/expert - ResultContext was significantly changed and expanded - to allow for multiple full query results (DocLists) per Solr request. - TransformContext was rendered redundant and was removed. (yonik) - -* Several changes have been made regarding the "Similarity" used in Solr, in order to provide - better default behavior for new users. There are 3 key impacts of these changes on existing - users who upgrade: - * DefaultSimilarityFactory has been removed. If you currently have DefaultSimilarityFactory explicitly - referenced in your schema.xml, edit your config to use the functionally identical - ClassicSimilarityFactory. See SOLR-8239 for more details. - * The implicit default Similarity used when no is configured in schema.xml has - been changed to SchemaSimilarityFactory. Users who wish to preserve back-compatible behavior should - either explicitly configure ClassicSimilarityFactory, or ensure that the luceneMatchVersion - for the collection is less then 6.0. See SOLR-8270 + SOLR-8271 for details. - * SchemaSimilarityFactory has been modified to use BM25Similarity as the default for fieldTypes that - do not explicitly declare a Similarity. The legacy behavior of using ClassicSimilarity as the - default will occur if the luceneMatchVersion for the collection is less then 6.0, or the - 'defaultSimFromFieldType' configuration option may be used to specify any default of your choosing. - See SOLR-8261 + SOLR-8329 for more details. - -* If your solrconfig.xml file doesn't explicitly mention the schemaFactory to use then Solr will choose - the ManagedIndexSchemaFactory by default. Previously it would have chosen ClassicIndexSchemaFactory. - This means that the Schema APIs ( //schema ) are enabled and the schema is mutable. - When Solr starts your schema.xml file will be renamed to managed-schema. If you want to retain the old behaviour - then please ensure that the solrconfig.xml explicitly uses the ClassicIndexSchemaFactory : - or your luceneMatchVersion in the solrconfig.xml is less than 6.0 - -* SolrIndexSearcher.QueryCommand and QueryResult were moved to their own classes. If you reference them - in your code, you should import them under o.a.s.search (or use your IDE's "Organize Imports"). - -* SOLR-8698: 'useParams' attribute specified in request handler cannot be overridden from request params - -* When requesting stats in date fields, "sum" is now a double value instead of a date. See SOLR-8671 - -* SOLR-8736: The deprecated GET methods for schema are now accessible through the bulk API. The output - has less details and is not backward compatible. - -* In the past, Solr guaranteed that retrieval of multi-valued fields would preserve the order of values. - Because values may now be retrieved from column-stored fields (docValues="true"), in conjunction with the - fact that docValues do not currently preserve order, means that users should set useDocValuesAsStored="false" - to prevent future optizations from using the column-stored values over the row-stored values when - fields have both stored="true" and docValues="true". - -* Formatted date-times from Solr have some differences. If the year is more than 4 digits, there is a leading '+'. - When there is a non-zero number of milliseconds, it is padded with zeros to 3 digits. Negative year (BC) dates are - now possible. Parsing: It is now an error to supply a portion of the date out of its, range, like 67 seconds. - -* SolrJ no longer includes DateUtil. If for some reason you need to format or parse dates, simply use Instant.format() - and Instant.parse(). - -* If you are using an RPT or other spatial field referencing Spatial4j in its configuration, then replace the string - "com.spatial4j.core" with "org.locationtech.spatial4j". Consider updating direct to Solr 6.2 which accepts the - old value, albeit with a warning. - -Detailed Change List ----------------------- - -New Features ----------------------- - -* SOLR-3085: New edismax param mm.autoRelax which helps in certain cases of the stopwords/zero-hits issue (janhoy) - -* SOLR-7560: Parallel SQL Support (Joel Bernstein) - -* SOLR-7707: Add StreamExpression Support to RollupStream (Dennis Gove, Joel Bernstein) - -* SOLR-7903: Add the FacetStream to the Streaming API and wire it into the SQLHandler (Joel Bernstein) - -* SOLR-7986: JDBC Driver for SQL Interface (Uwe Schindler, Joel Bernstein) - -* SOLR-8038: Add the StatsStream to the Streaming API and wire it into the SQLHandler (Joel Bernstein) - -* SOLR-8086: Add support for SELECT DISTINCT queries to the SQL interface (Joel Bernstein) - -* SOLR-7543: Basic graph traversal query - Example: {!graph from="node_id" to="edge_id"}id:doc_1 - (Kevin Watters, yonik) - -* SOLR-6273: Cross Data Center Replication. Active/passive replication for separate - SolrClouds hosted on separate data centers. (Renaud Delbru, Yonik Seeley via Erick Erickson) - -* SOLR-7938: MergeStream now supports merging more than 2 streams together (Dennis Gove) - -* SOLR-8198: Change ReducerStream to use StreamEqualitor instead of StreamComparator (Dennis Gove) - -* SOLR-8268: StatsStream now implements the Expressible interface (Dennis Gove) - -* SOLR-7584: Adds Inner and LeftOuter Joins to the Streaming API and Streaming Expressions (Dennis Gove, Corey Wu) - -* SOLR-8188: Adds Hash and OuterHash Joins to the Streaming API and Streaming Expressions (Dennis Gove) - -* SOLR-7669: Add SelectStream and Tuple Operations to the Streaming API and Streaming Expressions (Dennis Gove) - -* SOLR-8337: Add ReduceOperation and wire it into the ReducerStream (Joel Bernstein) - -* SOLR-7904: Add StreamExpression Support to FacetStream (Dennis Gove) - -* SOLR-6398: Add IterativeMergeStrategy to support running Parallel Iterative Algorithms inside of Solr - (Joel Bernstein) - -* SOLR-8436: Real-time get now supports filters. (yonik) - -* SOLR-7535: Add UpdateStream to Streaming API and Streaming Expression (Jason Gerlowski, Joel Bernstein) - -* SOLR-8479: Add JDBCStream to Streaming API and Streaming Expressions for integration with external data sources - (Dennis Gove) - -* SOLR-8002: Add column alias support to the Parallel SQL Interface (Joel Bernstein) - -* SOLR-7525: Add ComplementStream and IntersectStream to the Streaming API and Streaming Expressions - (Dennis Gove, Jason Gerlowski, Joel Bernstein) - -* SOLR-8415: Provide command to switch between non/secure mode in ZK - (Mike Drob, Gregory Chanan) - -* SOLR-8556: Add ConcatOperation to be used with the SelectStream (Joel Bernstein, Dennis Gove) - -* SOLR-8550: Add asynchronous DaemonStreams to the Streaming API (Joel Bernstein) - -* SOLR-8285: Ensure the /export handler works with NULL field values (Joel Bernstein) - -* SOLR-8502: Improve Solr JDBC Driver to support SQL Clients like DBVisualizer (Kevin Risden, Joel Bernstein) - -* SOLR-8588: Add TopicStream to the streaming API to support publish/subscribe messaging (Joel Bernstein, Kevin Risden) - -* SOLR-8666: Adds header 'zkConnected' to response of SearchHandler and PingRequestHandler to notify the client when - a connection to zookeeper has been lost and there is a possibility of stale data on the node the request is coming - from. (Keith Laban, Dennis Gove) - -* SOLR-8522: Make it possible to use ip fragments in replica placement rules , such as ip_1, ip_2 etc (Arcadius Ahouansou, noble) - -* SOLR-8698: params.json can now specify 'appends' and 'invariants' (noble) - -* SOLR-8831: allow _version_ field to be retrievable via docValues (yonik) - - -Bug Fixes ----------------------- -* SOLR-8386: Add field option in the new admin UI schema page loads up even when no schemaFactory has been - explicitly specified since the default is ManagedIndexSchemaFactory. (Erick Erickson, Upayavira, Varun Thacker) - -* SOLR-8191: Guard against CloudSolrStream close method NullPointerException - (Kevin Risden, Joel Bernstein) - -* SOLR-8485: SelectStream now properly handles non-lowercase and/or quoted select field names (Dennis Gove) - -* SOLR-8525: Fix a few places that were failing to pass dimensional - values settings when copying a FieldInfo (Ishan Chattopadhyaya via - Mike McCandless) - -* SOLR-8409: Ensures that quotes in solr params (eg. q param) are properly handled (Dennis Gove) - -* SOLR-8640: CloudSolrClient does not send credentials for update request (noble, hoss) - -* SOLR-8461: CloudSolrStream and ParallelStream can choose replicas that are not active - (Cao Manh Dat, Varun Thacker, Joel Bernstein) - -* SOLR-8527: Improve JdbcTest to cleanup properly on failures (Kevin Risden, Joel Bernstein) - -* SOLR-8578: Successful or not, requests are not always fully consumed by Solrj clients and we - count on HttpClient or the JVM. (Mark Miller) - -* SOLR-8683: Always consume the full request on the server, not just in the case of an error. - (Mark Miller) - -* SOLR-8416: The collections create API should return after all replicas are active. - (Michael Sun, Mark Miller, Alexey Serba) - -* SOLR-8701: CloudSolrClient decides that there are no healthy nodes to handle a request too early. - (Mark Miller) - -* SOLR-8694: DistributedMap/Queue can create too many Watchers and some code simplification. - (Scott Blum via Mark Miller) - -* SOLR-8695: Ensure ZK watchers are not triggering our watch logic on connection events and - make this handling more consistent. (Scott Blum via Mark Miller) - -* SOLR-8633: DistributedUpdateProcess processCommit/deleteByQuery call finish on DUP and - SolrCmdDistributor, which violates the lifecycle and can cause bugs. (hossman via Mark Miller) - -* SOLR-8656: PeerSync should use same nUpdates everywhere. (Ramsey Haddad via Mark Miller) - -* SOLR-8697, SOLR-8837: Scope ZK election nodes by session to prevent elections from interfering with each other - and other small LeaderElector improvements. (Scott Blum via Mark Miller, Alan - Woodward) - -* SOLR-8599: After a failed connection during construction of SolrZkClient attempt to retry until a connection - can be made. (Keith Laban, Dennis Gove) - -* SOLR-8497: Merge index does not mark the Directory objects it creates as 'done' and they are retained in the - Directory cache. (Sivlio Sanchez, Mark Miller) - -* SOLR-8696: Start the Overseer before actions that need the overseer on init and when reconnecting after - zk expiration and improve init logic. (Scott Blum, Mark Miller) - -* SOLR-8420: Fix long overflow in sumOfSquares for Date statistics. (Tom Hill, Christine Poerschke, - Tomás Fernández Löbbe) - -* SOLR-8748: OverseerTaskProcessor limits number of concurrent tasks to just 10 even though the thread pool - size is 100. The limit has now been increased to 100. (Scott Blum, shalin) - -* SOLR-8375: ReplicaAssigner rejects valid nodes (Kelvin Tan, noble) - -* SOLR-8738: Fixed false success response when invalid deleteByQuery requests intially hit non-leader - cloud nodes (hossman) - -* SOLR-8771: Multi-threaded core shutdown creates executor per core. (Mike Drob via Mark Miller) - -* SOLR-8145: Fix position of OOM killer script when starting Solr in the background (Jurian Broertjes via - Timothy Potter) - -* SOLR-8769: Fix document exclusion in mlt query parser in Cloud mode for schemas that have non-"id" - unique field (Erik Hatcher, Anshum Gupta) - -* SOLR-8728: ReplicaAssigner throws NPE when a partial list of nodes are only participating in replica - placement. splitshard should preassign nodes using rules, if rules are present (noble, Shai Erera) - -* SOLR-8779: Fix missing InterruptedException handling in ZkStateReader.java (Varun Thacker) - -* SOLR-8449: Fix the core restore functionality to allow restoring multiple times on the same core - (Johannes Brucher, Varun Thacker) - -* SOLR-8155: JSON Facet API - field faceting on a multi-valued string field without - docValues (i.e. UnInvertedField implementation), but with a prefix or with a sort - other than count, resulted in incorrect results. This has been fixed, and facet.prefix - support for facet.method=uif has been enabled. (Mikhail Khludnev, yonik) - -* SOLR-8790: Collections API responses contain node name in the core-level responses that are - returned. (Anshum Gupta) - -* SOLR-8804: Fix a race condition in the ClusterStatus API call whereby the call would fail when a concurrent delete - collection api command was executed (Alexey Serba, Varun Thacker) - -* SOLR-8835: JSON Facet API: fix faceting exception on multi-valued numeric fields that - have docValues. (yonik) - -* SOLR-8838: Returning non-stored docValues is incorrect for negative floats and doubles. - (Ishan Chattopadhyaya, Steve Rowe) - -* SOLR-8867: {!frange} queries will now avoid matching documents without a value in the - numeric field. For more complex functions, FunctionValues.exists() must also return true - for the document to match. (yonik) - -* SOLR-8886: Fix TrieField.toObject(IndexableField) to work for field with docValues - enabled. (yonik) - -* SOLR-8891: Fix StrField.toObject and toExternal to work with docValue IndexableField - instances. (yonik) - -* SOLR-8865: Real-time get sometimes fails to retrieve stored fields from docValues. - (Ishan Chattopadhyaya, yonik) - -Optimizations ----------------------- -* SOLR-7876: Speed up queries and operations that use many terms when timeAllowed has not been - specified. Speedups of up to 8% were observed. (yonik) - -* SOLR-8037: Speed up creation of filters from term range queries (i.e. non-numeric range queries) - and use the filter cache for term range queries that are part of larger queries. Some observed - speedups were up to 2.5x for production of filters, and up to 10x for query evaluation with - embedded term range queres that resulted in filter cache hits. (yonik) - -* SOLR-8559: FCS facet performance optimization which significantly speeds up processing when terms - are high cardinality and the matching docset is small. When facet minCount > 0 and the number of - matching documents is small (or 0) this enhancement prevents considering terms which have a 0 - count. Also includes change to move to the next non-zero term value when selecting a segment - position. (Keith Laban, Steve Bower, Dennis Gove) - -* SOLR-8532: Optimize GraphQuery when maxDepth is set by not collecting edges at the maxDepth level. - (Kevin Watters via yonik) - -* SOLR-8669: Non binary responses use chunked encoding because we flush the outputstream early. - (Mark Miller) - -* SOLR-8720: ZkController#publishAndWaitForDownStates should use #publishNodeAsDown. (Mark Miller) - -* SOLR-8082: Can't query against negative float or double values when indexed="false" - docValues="true" multiValued="false". (hossman, Ishan Chattopadhyaya, yonik, Steve Rowe) - -Other Changes ----------------------- - -* SOLR-6127: Improve example docs, using films data (Varun Thacker via ehatcher) - -* SOLR-6895: Deprecated SolrServer classes have been removed (Alan Woodward, - Erik Hatcher) - -* SOLR-6954: Deprecated SolrClient.shutdown() method removed (Alan Woodward) - -* SOLR-7355: Switch from Google's ConcurrentLinkedHashMap to Caffeine. Only - affects HDFS support. (Ben Manes via Shawn Heisey) - -* SOLR-7624: Remove deprecated zkCredientialsProvider element in solrcloud section of solr.xml. - (Xu Zhang, Per Steffensen, Ramkumar Aiyengar, Mark Miller) - -* SOLR-7513: Add Equalitors to Streaming Expressions (Dennis Gove, Joel Bernstein) - -* SOLR-7528: Simplify Interfaces used in Streaming Expressions (Dennis Gove, Joel Bernstein) - -* SOLR-7554: Add checks in Streams for incoming stream order (Dennis Gove, Joel Bernstein) - -* SOLR-7441: Improve overall robustness of the Streaming stack: Streaming API, - Streaming Expressions, Parallel SQL (Joel Bernstein) - -* SOLR-8153: Support upper case and mixed case column identifiers in the SQL interface - (Joel Bernstein) - -* SOLR-8132: HDFSDirectoryFactory now defaults to using the global block cache. (Mark Miller) - -* SOLR-8261: Change SchemaSimilarityFactory default to BM25Similarity (hossman) - -* SOLR-8259: Remove deprecated JettySolrRunner.getDispatchFilter() - -* SOLR-8258: Change default hdfs tlog replication factor from 1 to 3. (Mark Miller) - -* SOLR-8270: Change implicit default Similarity to use BM25 when luceneMatchVersion >= 6 (hossman) - -* SOLR-8271: Change implicit default Similarity to use SchemaSimilarityFactory when luceneMatchVersion >= 6 (hossman) - -* SOLR-8179: SQL JDBC - DriverImpl loadParams doesn't support keys with no values in the connection string - (Kevin Risden, Joel Bernstein) - -* SOLR-8131: Make ManagedIndexSchemaFactory the default schemaFactory when luceneMatchVersion >= 6 - (Uwe Schindler, shalin, Varun Thacker) - -* SOLR-8266: Remove Java Serialization from the Streaming API. The /stream handler now only accepts - Streaming Expressions. (Jason Gerlowski, Joel Bernstein) - -* SOLR-8426: Enable /export, /stream and /sql handlers by default and remove them from example configs. (shalin) - -* SOLR-8443: Change /stream handler http param from "stream" to "expr" (Joel Bernstein, Dennis Gove) - -* SOLR-5209: Unloading or deleting the last replica of a shard now no longer - cascades to remove the shard from the clusterstate. (Christine Poerschke) - -* SOLR-8190: Implement Closeable on TupleStream (Kevin Risden, Joel Bernstein) - -* SOLR-8529: Improve JdbcTest to not use plain assert statements (Kevin Risden, Joel Bernstein) - -* SOLR-7339: Upgrade Jetty to v9.3.8.v20160314. (Gregg Donovan, shalin, Mark Miller, Steve Rowe) - -* SOLR-5730: Make Lucene's SortingMergePolicy and EarlyTerminatingSortingCollector configurable in Solr. - (Christine Poerschke, hossmann, Tomás Fernández Löbbe, Shai Erera) - -* SOLR-8677: Prevent shards containing invalid characters from being created. Checks added server-side - and in SolrJ. (Shai Erera, Jason Gerlowski, Anshum Gupta) - -* SOLR-8693: Improve ZkStateReader logging. (Scott Blum via Mark Miller) - -* SOLR-8710: Upgrade morfologik-stemming to version 2.1.0. (Dawid Weiss) - -* SOLR-8711: Upgrade Carrot2 clustering dependency to 3.12.0. (Dawid Weiss) - -* SOLR-8690: Make peersync fingerprinting optional with solr.disableFingerprint system - property. (yonik) - -* SOLR-8691: Cache index fingerprints per searcher. (yonik) - -* SOLR-8746: Renamed Overseer.getInQueue to getStateUpdateQueue, getInternalQueue to getInternalWorkQueue - and added javadocs. (Scott Blum, shalin) - -* SOLR-8752: Add a test for SizeLimitedDistributedMap and improve javadocs. (shalin) - -* SOLR-8671: Date statistics: make "sum" a double instead of a long/date (Tom Hill, Christine Poerschke, - Tomás Fernández Löbbe) - -* SOLR-8713: new UI and example solrconfig files point to Reference Guide for Solr Query Syntax instead - of the wiki. (Marius Grama via Tomás Fernández Löbbe) - -* SOLR-8758: Add a new SolrCloudTestCase class, using MiniSolrCloudCluster (Alan - Woodward) - -* SOLR-8736: schema GET operations on fields, dynamicFields, fieldTypes, copyField are - reimplemented as a part of the bulk API with less details (noble) - -* SOLR-8766: Remove deprecated tag in solrconfig.xml and support for admin/gettableFiles - (noble, Jason Gerlowski, Varun Thacker) - -* SOLR-8799: Improve error message when tuple can't be read by SolrJ JDBC (Kevin Risden, Joel Bernstein) - -* SOLR-8836: Return 400, and a SolrException when an invalid json is provided to the update handler - instead of 500. (Jason Gerlowski via Anshum Gupta) - -* SOLR-8740: docValues are now enabled by default for most non-text (string, date, and numeric) fields - in the schema templates. (yonik) - -* SOLR-8819: Implement DatabaseMetaDataImpl getTables() and fix getSchemas(). (Trey Cahill, - Joel Bernstein, Kevin Risden) - -* SOLR-8810: Implement Connection.setReadOnly, Statement.set/getFetchSize, - ResultSet.getType (Kevin Risden) - -* SOLR-8904: All dates are formatted via Instant.toString() (ISO-8601); see Solr upgrade notes for differences. Will - now parse (and format) dates with a leading '+' or '-' (BC dates or dates > 4 digit year. - [value] and ms() and contrib/analytics now parse with date math. (David Smiley) - -* SOLR-8904: DateUtil in SolrJ moved to the extraction contrib as ExtractionDateUtil. Obsolete methods were removed. - (David Smiley) - -======================= 5.5.3 ======================= - -Consult the LUCENE_CHANGES.txt file for additional, low level, changes in this release. - -Versions of Major Components ---------------------- -Apache Tika 1.13 -Carrot2 3.12.0 -Velocity 1.7 and Velocity Tools 2.0 -Apache UIMA 2.3.1 -Apache ZooKeeper 3.4.6 -Jetty 9.3.8.v20160314 - - -(No Changes) - - ======================= 5.5.2 ======================= -Consult the LUCENE_CHANGES.txt file for additional, low level, changes in this release. - -Versions of Major Components ---------------------- -Apache Tika 1.7 -Carrot2 3.10.4 -Velocity 1.7 and Velocity Tools 2.0 -Apache UIMA 2.3.1 -Apache ZooKeeper 3.4.6 -Jetty 9.2.13.v20150730 - Bug Fixes ---------------------- - -* SOLR-8695: Ensure ZK watchers are not triggering our watch logic on connection events and - make this handling more consistent. (Scott Blum via Mark Miller) * SOLR-9198: config APIs unable to add multiple values with same name (noble) -* SOLR-9191: OverseerTaskQueue.peekTopN() fatally flawed (Scott Blum, Noble Paul) - -* SOLR-8812: edismax: turn off mm processing if no explicit mm spec is provided - and there are explicit operators (except for AND) - addresses problems caused by SOLR-2649. - (Greg Pendlebury, Jan Høydahl, Erick Erickson, Steve Rowe) - -* SOLR-9034: Atomic updates failed to work when there were copyField targets that had docValues - enabled. (Karthik Ramachandran, Ishan Chattopadhyaya, yonik) - -* SOLR-8940: Fix group.sort option (hossman) - -* SOLR-8857: HdfsUpdateLog does not use configured or new default number of version buckets and is - hard coded to 256. (Mark Miller, yonik, Gregory Chanan) - -* SOLR-8875: SolrCloud Overseer clusterState could unexpectedly be null resulting in NPE. - (Scott Blum via David Smiley) - -* SOLR-8946: bin/post failed to detect stdin usage on Ubuntu; maybe other unixes. (David Smiley) - -* SOLR-9004: Fix "name" field type definition in films example. (Alexandre Rafalovitch via Varun Thacker) - -* SOLR-8990: Fix top term links from schema browser page to use {!term} parser (hossman) - -* SOLR-8971: Preserve root cause when wrapping exceptions (hossman) - -* SOLR-8792: ZooKeeper ACL support fixed. (Esther Quansah, Ishan Chattopadhyaya, Steve Rowe) - -* SOLR-9030: The 'downnode' overseer command can trip asserts in ZkStateWriter. - (Scott Blum, Mark Miller, shalin) - -* SOLR-9036: Solr slave is doing full replication (entire index) of index after master restart. - (Lior Sapir, Mark Miller, shalin) - -* SOLR-9093: Fix NullPointerException in TopGroupsShardResponseProcessor. (Christine Poerschke) - -* SOLR-9118: HashQParserPlugin should trim partition keys (Joel Bernstein) - -* SOLR-9117: The first SolrCore is leaked after reload. (Jessica Cheng Mallet via shalin) - -* SOLR-9116: Race condition causing occasional SolrIndexSearcher leak when SolrCore is reloaded. - (Jessica Cheng Mallet via shalin) - -* SOLR-8801: /bin/solr create script always returns exit code 0 when a collection/core already exists. - (Khalid Alharbi, Marius Grama via Steve Rowe) - -* SOLR-9134: Fix RestManager.addManagedResource return value. (Christine Poerschke) - -* SOLR-9151: Fix SolrCLI so that bin/solr -e cloud example can be run from any CWD (janhoy) - -* SOLR-9165: Spellcheck does not return collations if "maxCollationTries" is used with "cursorMark". - (James Dyer) - -* SOLR-8612: closing JDBC Statement on failures in DataImportHandler (DIH) (Kristine Jetzke via Mikhail Khludnev) - -* SOLR-8676: keep LOG4J_CONFIG in solr.cmd (Kristine Jetzke via Mikhail Khludnev) - -* SOLR-9176: facet method ENUM was sometimes unnecessarily being rewritten to - FCS, causing slowdowns (Alessandro Benedetti, Jesse McLaughlin, Alan Woodward) - -Other Changes ----------------------- - -* SOLR-7516: Improve javadocs for JavaBinCodec, ObjectResolver and enforce the single-usage policy. - (Jason Gerlowski, Benoit Vanalderweireldt, shalin) - -* SOLR-8967: In SolrCloud mode, under the 'Core Selector' dropdown in the UI the Replication tab won't be displayed - anymore. The Replication tab is only beneficial to users running Solr in master-slave mode. (Varun Thacker) - -* SOLR-9131: Fix "start solr" text in cluster.vm Velocity template (janhoy) - -* SOLR-9053: Upgrade commons-fileupload to 1.3.1, fixing a potential vulnerability (Jeff Field, Mike Drob via janhoy) - -* SOLR-8866: UpdateLog will now throw an exception if it doesn't know how to serialize a value. - (David Smiley) - -* SOLR-8933: Solr should not close container streams. (Mike Drob, Uwe Schindler, Mark Miller) - -* SOLR-9037: Replace multiple "/replication" strings with one static constant. (Christine Poerschke) - -* SOLR-9047: zkcli should allow alternative locations for log4j configuration (Gregory Chanan) - -* SOLR-9105: Fix a bunch of typos across 103 files (Bartosz Krasiński via janhoy) - -* SOLR-8445: fix line separator in log4j.properties files (Ahmet Arslan via Mikhail Khludnev) - -* SOLR-8674: Stop ignoring sysprop solr.tests.mergePolicy, and make tests randomly choose between - setting and , which was added in SOLR-8621. (Christine Poerschke) +* SOLR-9234: srcField works only when all fields are captured in the /update/json/docs + endpoint (noble) ======================= 5.5.1 ======================= @@ -2038,6 +302,9 @@ New Features * SOLR-8560: Added RequestStatusState enum which can be used when comparing states of asynchronous requests. (Shai Erera) +* SOLR-8415: Provide command to switch between non/secure mode in ZK + (Mike Drob, Gregory Chanan) + * SOLR-8586: added index fingerprint, a hash over all versions currently in the index. PeerSync now uses this to check if replicas are in sync. (yonik) @@ -2156,27 +423,31 @@ Bug Fixes * SOLR-8607: The Schema API refuses to add new fields that match existing dynamic fields. (Jan Høydahl, Steve Rowe) -* SOLR-8575: Fix HDFSLogReader replay status numbers, a performance bug where we can reopen - FSDataInputStream much too often, and an hdfs tlog data integrity bug. - (Mark Miller, Patrick Dvorack, yonik) - +* SOLR-8640: CloudSolrClient does not send credentials for update request (noble, hoss) + * SOLR-8651: The commitWithin parameter is not passed on for deleteById in UpdateRequest in distributed queries (Jessica Cheng Mallet via Erick Erickson) * SOLR-8551: Make collection deletion more robust. (Mark Miller) - + Optimizations ---------------------- * SOLR-8501: Specify the entity request size when known in HttpSolrClient. (Mark Miller) +* SOLR-8559: FCS facet performance optimization which significantly speeds up processing when terms + are high cardinality and the matching docset is small. When facet minCount > 0 and the number of + matching documents is small (or 0) this enhancement prevents considering terms which have a 0 + count. Also includes change to move to the next non-zero term value when selecting a segment + position. (Keith Laban, Steve Bower, Dennis Gove) + * SOLR-8615: Just like creating cores, we should use multiple threads when closing cores. (Mark Miller) * SOLR-7281: Add an overseer action to publish an entire node as 'down'. (Mark Miller, shalin) -* SOLR-8669: Non binary responses use chunked encoding because we flush the outputstream early. - (Mark Miller) +* SOLR-8082: Can't query against negative float or double values when indexed="false" + docValues="true" multiValued="false". (hossman, Ishan Chattopadhyaya, yonik, Steve Rowe) Other Changes ---------------------- @@ -2194,7 +465,7 @@ Other Changes (Christine Poerschke) * SOLR-8338: in OverseerTest replace strings such as "collection1" and "state" with variable - or enum equivalent (Christine Poerschke) + or enum equivalent. (Christine Poerschke) * SOLR-8333: Several API tweaks so that public APIs were no longer refering to private classes (ehatcher, Shawn Heisey, hossman) @@ -2267,6 +538,8 @@ Other Changes * SOLR-8455: RecovertStrategy logging improvements and sleep-between-recovery-attempts bug fix. (Shai Erera) +* SOLR-8476: Refactor and cleanup CoreAdminHandler (noble, Varun THacker) + * SOLR-8481: TestSearchPerf no longer needs to duplicate SolrIndexSearcher.(NO_CHECK_QCACHE|NO_CHECK_FILTERCACHE) (Christine Poerschke) @@ -2294,8 +567,6 @@ Other Changes * SOLR-7042: bin/post now uses /update/json/docs for application/json content types, including support for .jsonl (JSON Lines) files. (Erik Hatcher and shalin) -* SOLR-8476: Refactor and cleanup CoreAdminHandler (noble, Varun Thacker) - * SOLR-8535: Support forcing define-lucene-javadoc-url to be local (Gregory Chanan) * SOLR-8549: Solr start script checks for cores which have failed to load as well before attempting to @@ -2358,11 +629,15 @@ Bug Fixes * SOLR-8418: Adapt to changes in LUCENE-6590 for use of boosts with MLTHandler and Simple/CloudMLTQParser (Jens Wille, Ramkumar Aiyengar) +* SOLR-8561: Doing a rolling upgrade to 5.4.0 fails because the new nodes cannot find the + shard leader properties where they expect. This bug was first introduced in 5.4.0 and a + fallback was added so that the leader properties are searched in both the old location + and the new one. (Shai Erera) + New Features ---------------------- * SOLR-8470: Make TTL of PKIAuthenticationPlugin's tokens configurable through a system property - (pkiauth.ttl) (noble) ================== 5.4.0 ================== @@ -2642,6 +917,7 @@ Bug Fixes * SOLR-8355: update permissions were failing node recovery (noble , Anshum Gupta) + Optimizations ---------------------- @@ -2968,11 +1244,11 @@ New Features * SOLR-7742: Support for Immutable ConfigSets (Gregory Chanan) +* SOLR-6234: Scoring for query time join (Mikhail Khludnev) + * SOLR-2522: new two argument option for the existing field() function; picks the min/max value of a docValues field to use as a ValueSource: "field(field_name,min)" and "field(field_name,max)" (hossman) -* SOLR-6234: Scoring for query time join (Mikhail Khludnev) - * SOLR-5882: score local parameter for block join query parser {!parent} (Andrey Kudryavtsev, Mikhail Khludnev) * SOLR-7799: Added includeIndexFieldFlags (backwards compatible default is true) to /admin/luke. @@ -2980,8 +1256,6 @@ New Features * SOLR-7769: Add bin/post -p alias for -port parameter. (ehatcher) -* SOLR-7766: support creation of a coreless collection via createNodeSet=EMPTY (Christine Poerschke) - * SOLR-7849: Solr-managed inter-node authentication when authentication enabled (Noble Paul) * SOLR-7220: Nested C-style comments in queries. (yonik) @@ -2996,6 +1270,7 @@ New Features * SOLR-7837: An AuthenticationPlugin which implements the HTTP BasicAuth protocol and stores credentials securely in ZooKeeper (Noble Paul, Anshum Gupta,Ishan Chattopadhyaya) +* SOLR-7766: support creation of a coreless collection via createNodeSet=EMPTY (Christine Poerschke) Bug Fixes ---------------------- @@ -3180,6 +1455,8 @@ Other Changes * SOLR-7680: Use POST instead of GET when finding versions for mismatches with CloudInspectUtil for tests (Ramkumar Aiyengar) +* SOLR-7662: Refactored response writing to consolidate the logic in one place (Noble Paul) + * SOLR-7665: deprecate the class TransformerWithContext (noble) * SOLR-7629: Have RulesTest consider disk space limitations of where the test is @@ -3224,21 +1501,21 @@ Other Changes ERROR to WARN for zkcli.{sh,cmd} only. (Oliver Schrenk, Tim Potter, Uwe Schindler, shalin) -* SOLR-7735: Look for solr.xml in Zookeeper by default in SolrCloud mode. If not found, it will be loaded - from $SOLR_HOME/solr.xml as before. Sysprop solr.solrxml.location is now gone. (janhoy) - * SOLR-7227: Ship Solr with the Web application directory exploded into server/solr-webapp, solr.war is no longer included in the distribution bundles. (Timothy Potter, Uwe Schindler) * SOLR-6625: Enable registering interceptors for the calls made using HttpClient and make the - request object available at the interceptor context ( Ishan Chattopadhyay, Gregory Chanan, noble, Anshum Gupta) + request object available at the interceptor context ( Ishan Chattopadhyaya, Gregory Chanan, noble, Anshum Gupta) * SOLR-5022: On Java 7 raise permgen for running tests. (Uwe Schindler) * SOLR-7823: TestMiniSolrCloudCluster.testCollectionCreateSearchDelete async collection-creation (sometimes) (Christine Poerschke) +* SOLR-7735: Look for solr.xml in Zookeeper by default in SolrCloud mode. If not found, it will be loaded + from $SOLR_HOME/solr.xml as before. Sysprop solr.solrxml.location is now gone. (janhoy) + * SOLR-7854: Remove unused ZkStateReader.updateClusterState(false) method. (Scott Blum via shalin) * SOLR-7863: Lowercase the CLUSTERPROP command in ZkCLI for consistency, print error for unknown cmd (janhoy) @@ -3496,7 +1773,7 @@ Bug Fixes while accessing other collections. (Shai Erera) * SOLR-7412: Fixed range.facet.other parameter for distributed requests. - (Will Miller, Tomás Fernández Löbbe) + (Will Miller, Tomás Fernándes Löbbe) * SOLR-6087: SolrIndexSearcher makes no DelegatingCollector.finish() call when IndexSearcher throws an expected exception. (Christine Poerschke via shalin) @@ -3651,11 +1928,11 @@ Other Changes * SOLR-5213: Log when shard splitting unexpectedly leads to documents going to no or multiple shards (Christine Poerschke, Ramkumar Aiyengar) -* SOLR-7425: Improve MDC based logging format. (Mark Miller) - * SOLR-4839: Upgrade Jetty to 9.2.10.v20150310 and restlet-jee to 2.3.0 (Bill Bell, Timothy Potter, Uwe Schindler, Mark Miller, Steve Rowe, Steve Davids, shalin) +* SOLR-7425: Improve MDC based logging format. (Mark Miller) + * SOLR-7457: Make DirectoryFactory publishing MBeanInfo extensible. (Mike Drob via Mark Miller) @@ -4208,9 +2485,6 @@ Upgrading from Solr 4.x * AdminHandlers is deprecated, /admin/* are implicitly defined, /get, /replication and handlers are also implicitly registered (refer to SOLR-6792) -* SolrCore.reload(ConfigSet coreConfig, SolrCore prev) was deprecated in 4.10.3 and - removed in 5.0. use SolrCore.reload(ConfigSet coreConfig). See SOLR-5864. - * The "termIndexInterval" option in solrconfig.xml has been a No-Op in the default codec since Solr 4.0, and has been removed completely in 5.0. If you get an "Illegal parameter 'termIndexInterval'" error when upgrading, you can safely remove this option from your @@ -4334,8 +2608,6 @@ New Features * SOLR-6565: SolrRequest support for query params (Gregory Chanan) -* SOLR-6476: Create a bulk mode for schema API (Noble Paul, Steve Rowe) - * SOLR-6512: Add a collections API call to add/delete arbitrary properties to a specific replica. Optionally adding sliceUnique=true will remove this property from all other replicas within a particular slice. @@ -4359,7 +2631,7 @@ New Features * SOLR-5992: add "removeregex" as an atomic update operation (Vitaliy Zhovtyuk via Erick Erickson) -* SOLR-6633: /update/json/docs path can now save the underlying json doc asa string field +* SOLR-6633: /update/json/docs path can now save the underlying json doc as a string field and better support added to the default example (Noble Paul) * SOLR-6650: Add optional slow request logging at WARN level @@ -4397,14 +2669,14 @@ New Features * SOLR-6729: createNodeSet.shuffle=(true|false) support for /admin/collections?action=CREATE. (Christine Poerschke, Ramkumar Aiyengar via Mark Miller) +* SOLR-6879: Have an option to disable autoAddReplicas temporarily for all collections. + (Varun Thacker via Steve Rowe) + * SOLR-6851: Scripts to support installing and running Solr as a service on Linux (Timothy Potter, Hossman, Steve Rowe) * SOLR-6770: Add/edit param sets and use them in Requests (Noble Paul) -* SOLR-6879: Have an option to disable autoAddReplicas temporarily for all collections. - (Varun Thacker via Steve Rowe) - * SOLR-6435: Add bin/post script to simplify posting content to Solr (Erik Hatcher) * SOLR-6761: Ability to ignore commit and/or optimize requests from clients when running in @@ -4434,6 +2706,7 @@ New Features * SOLR-5147: Support child documents in DIH (Vadim Kirilchuk, Shawn Heisey, Thomas Champagne, Mikhail Khludnev via Noble Paul) + Bug Fixes ---------------------- @@ -4532,12 +2805,12 @@ Bug Fixes * SOLR-6850: AutoAddReplicas makes a call to wait to see live replicas that times out after 30 milliseconds instead of 30 seconds. (Varun Thacker via Mark Miller) -* SOLR-6397: zkcli script put/putfile should allow overwriting an existing znode's data - (Timothy Potter) - * SOLR-6873: Lib relative path is incorrect for techproduct configset (Alexandre Rafalovitch via Erick Erickson) +* SOLR-6397: zkcli script put/putfile should allow overwriting an existing znode's data + (Timothy Potter) + * SOLR-6899: Change public setter for CollectionAdminRequest.action to protected. (Anshum Gupta) @@ -4573,7 +2846,7 @@ Bug Fixes * SOLR-6764: Field types need to be re-informed after reloading a managed schema from ZK (Timothy Potter) - + * SOLR-6931: We should do a limited retry when using HttpClient. (Mark Miller, Hrishikesh Gadre, Gregory Chanan) @@ -4777,9 +3050,6 @@ Other Changes unnecessary plugin definitions, implicit registration of /replication, /get and /admin/* handlers (Noble Paul) -* SOLR-5864: Remove previous SolrCore as parameter on reload. - (Tomás Fernández Löbbe) - * SOLR-4792: Stop shipping a .war. (Robert Muir, Ramkumar Aiyengar, Mark Miller) * SOLR-6799: Update Saxon-HE to 9.6.0-2. (Mark Miller) @@ -4836,8 +3106,6 @@ Other Changes more user-friendly error reporting (no stack trace), and the ability to pass a directory when using bin/solr to create a core or collection (Timothy Potter) -* SOLR-6885: Add core name to RecoveryThread name. (Christine Poerschke via shalin) - * SOLR-6855: bin/solr -e dih launches, but has some path cruft issues preventing some of the imports don't work (Hossman, Timothy Potter) @@ -4908,7 +3176,7 @@ Other Changes Paul, Chris Hostetter) * SOLR-6521: CloudSolrClient should synchronize cache cluster state loading - ( Noble Paul, Jessica Cheng Mallet) + ( Noble Paul, Jessica Cheng Mallet) * SOLR-7018: bin/solr stop should stop if there is only one node running or generate an error message prompting the user to be explicit about which of multiple nodes @@ -5490,31 +3758,6 @@ Other Changes * SOLR-6391: Improve message for CREATECOLLECTION failure due to missing numShards (Anshum Gupta) -================== 4.9.1 ================== - -Versions of Major Components ---------------------- -Apache Tika 1.5 (with upgraded Apache POI 3.10.1) -Carrot2 3.9.0 -Velocity 1.7 and Velocity Tools 2.0 -Apache UIMA 2.3.1 -Apache ZooKeeper 3.4.6 - -Detailed Change List ----------------------- - -Other Changes ---------------------- - -* SOLR-6503: Removed support for parsing netcdf files in Solr Cell because - of license issues. If you need support for this format, download the parser - JAR yourself (version 4.2) and add it to contrib/extraction/lib folder: - http://www.unidata.ucar.edu/software/thredds/current/netcdf-java/ - (Uwe Schindler) - -* SOLR-6388: Force upgrade of Apache POI dependency in Solr Cell to version - 3.10.1 to fix CVE-2014-3529 and CVE-2014-3574. (Uwe Schindler) - ================== 4.9.0 ================== Versions of Major Components @@ -11902,122 +10145,6 @@ Documentation * SOLR-1792: Documented peculiar behavior of TestHarness.LocalRequestFactory (hossman) -================== Release 1.4.1 ================== -Release Date: See http://lucene.apache.org/solr for the official release date. - -Upgrading from Solr 1.4 ------------------------ - -This is a bug fix release - no changes are required when upgrading from Solr 1.4. -However, a reindex is needed for some of the analysis fixes to take effect. - -Versions of Major Components ----------------------------- -Apache Lucene 2.9.3 -Apache Tika 0.4 -Carrot2 3.1.0 - -Lucene Information ----------------- - -Since Solr is built on top of Lucene, many people add customizations to Solr -that are dependent on Lucene. Please see http://lucene.apache.org/java/2_9_3/, -especially http://lucene.apache.org/java/2_9_3/changes/Changes.html for more -information on the version of Lucene used in Solr. - -Bug Fixes ----------------------- - -* SOLR-1934: Upgrade to Apache Lucene 2.9.3 to obtain several bug - fixes from the previous 2.9.1. See the Lucene 2.9.3 release notes - for details. (hossman, Mark Miller) - -* SOLR-1432: Make the new ValueSource.getValues(context,reader) delegate - to the original ValueSource.getValues(reader) so custom sources - will work. (yonik) - -* SOLR-1572: FastLRUCache correctly implemented the LRU policy only - for the first 2B accesses. (yonik) - -* SOLR-1595: StreamingUpdateSolrServer used the platform default character - set when streaming updates, rather than using UTF-8 as the HTTP headers - indicated, leading to an encoding mismatch. (hossman, yonik) - -* SOLR-1660: CapitalizationFilter crashes if you use the maxWordCountOption - (Robert Muir via shalin) - -* SOLR-1662: Added Javadocs in BufferedTokenStream and fixed incorrect cloning - in TestBufferedTokenStream (Robert Muir, Uwe Schindler via shalin) - -* SOLR-1711: SolrJ - StreamingUpdateSolrServer had a race condition that - could halt the streaming of documents. The original patch to fix this - (never officially released) introduced another hanging bug due to - connections not being released. (Attila Babo, Erik Hetzner via yonik) - -* SOLR-1748, SOLR-1747, SOLR-1746, SOLR-1745, SOLR-1744: Streams and Readers - retrieved from ContentStreams are not closed in various places, resulting - in file descriptor leaks. - (Christoff Brill, Mark Miller) - -* SOLR-1580: Solr Configuration ignores 'mergeFactor' parameter, always - uses Lucene default. (Lance Norskog via Mark Miller) - -* SOLR-1777: fieldTypes with sortMissingLast=true or sortMissingFirst=true can - result in incorrectly sorted results. (yonik) - -* SOLR-1797: fix ConcurrentModificationException and potential memory - leaks in ResourceLoader. (yonik) - -* SOLR-1798: Small memory leak (~100 bytes) in fastLRUCache for every - commit. (yonik) - -* SOLR-1522: Show proper message if