Commit Graph

1946 Commits

Author SHA1 Message Date
Chris Hostetter efc2f32ea0 SOLR-11711: Fixed distributed processing of facet.field/facet.pivot sub requests to prevent requesting unneccessary and excessive '0' count terms from each shard 2017-12-11 10:26:55 -07:00
Noble Paul 071d9270d5 SOLR-11669: Policy Session lifecycle cleanup 2017-12-06 15:04:04 +11:00
Varun Thacker 2c14b91418 SOLR-11590: Synchronize ZK connect/disconnect handling so that they are processed in linear order 2017-12-05 13:34:50 -08:00
Andrzej Bialecki 41644bdcdc SOLR-11458: Improve error handling in MoveReplicaCmd to avoid potential loss of data. 2017-12-05 14:46:05 +01:00
Joel Bernstein cd10d0bda0 SOLR-11485: Fix precommit 2017-12-04 23:06:59 -05:00
Joel Bernstein 862f48761c SOLR-11485: Fix broken tests 2017-12-04 22:46:43 -05:00
Joel Bernstein f8c69270a1 SOLR-11485: Fix precommit 2017-12-04 21:43:07 -05:00
Joel Bernstein 8750e5f2a9 SOLR-11485: Add olsRegress, spline and derivative Stream Evaluators 2017-12-04 21:09:41 -05:00
Anshum Gupta 8c855fa287 The queue size for ConcurrentUpdateSolrClient should default to 10 instead of throwing an IllegalArgumentException 2017-12-01 14:25:02 -08:00
Anshum Gupta ebdaa44182 SOLR-11608: Correctly parse the new core-name in the V2 core rename API. 2017-11-29 13:17:17 -08:00
Joel Bernstein 70767b109f SOLR-11697: Add geometricDistribution Stream Evaluator 2017-11-28 21:23:15 -05:00
Shalin Shekhar Mangar 207e546122 SOLR-11202: Implement a set-property command for AutoScaling API 2017-11-28 16:08:32 +05:30
Joel Bernstein 8072b46b63 SOLR-11680: Add normalizeSum Stream Evaluator 2017-11-27 13:38:43 -05:00
Joel Bernstein 7acccd5157 SOLR-11674: Support ranges in the probability Stream Evaluator 2017-11-26 21:32:05 -05:00
Noble Paul 2bde0eab3f SOLR-9743: A new UTILIZENODE command 2017-11-24 00:32:26 +10:30
Joel Bernstein 17078019e2 SOLR-11569: Add support for distance matrices to the distance Stream Evaluator 2017-11-22 18:31:08 -05:00
David Smiley 6f99196e81 SOLR-11444: CloudSolrClient could have thrown an NPE if the collection doesn't exist.
Refactor: Tidy the exception throwing
2017-11-17 23:22:22 -05:00
David Smiley fd1820a430 SOLR-11487: Collection Aliases may now have metadata 2017-11-16 13:57:22 -05:00
Noble Paul cfea3d5e83 SOLR-11642: remove Policy.Session from OverseerCollectionMessageHandler 2017-11-15 21:18:33 +10:30
Noble Paul 79283834bc SOLR-11380:removed GenericRequest.setContentStreams() 2017-11-15 03:55:17 +10:30
Noble Paul 65cd8bbbf4 SOLR-11538: Implement port suggestion 2017-11-14 23:23:35 +10:30
Andrzej Bialecki fc678da2dd SOLR-11642: Implement ObjectCache for SolrCloudManager. 2017-11-14 13:21:26 +01:00
Noble Paul 8e60dc52c5 SOLR-11538: Implement suggestions for port,ip_*, nodeRole,sysprop.*, metrics:* 2017-11-14 15:17:53 +10:30
Joel Bernstein 59360b4617 SOLR-11570: Add support for correlation matrices to the corr Stream Evaluator 2017-11-13 19:44:46 -05:00
Shalin Shekhar Mangar 3045349140 SOLR-11638: Fix CloudSolrClientTest periodic failures after SOLR-11507 2017-11-13 15:50:45 +05:30
Joel Bernstein 9ea9a85339 SOLR-11571: Add diff Stream Evaluator to support time series differencing 2017-11-10 13:15:41 -05:00
David Smiley a43c318a51 SOLR-11507: randomize parallelUpdates for test CloudSolrClientBuilder 2017-11-09 15:58:58 -05:00
David Smiley df3b01744c SOLR-10469: Move CloudSolrClient.setParallelUpdates to its Builder 2017-11-09 15:48:35 -05:00
Noble Paul 6c46569705 SOLR-11614: ReplicaAssigner to use SolrCloudManager 2017-11-09 23:18:28 +10:30
Joel Bernstein 23fe16d3e9 SOLR-11607: Add grandSum, sumRows, sumColumns, scalarDivide, scalarMultiply, scalarAdd, scalarSubtract Stream Evaluators 2017-11-07 19:46:26 -05:00
Noble Paul a03d6bc8c2 SOLR-11380: deprecated getContentStreams() 2017-11-07 17:56:52 +10:30
Uwe Schindler 3ab1a07662 SOLR-11606: Disable tests automatically if Mockito does not work with Java runtime (Java 10) 2017-11-04 19:37:28 +01:00
Joel Bernstein 2a2cf4b5e4 SOLR-11602: Fix precommit 2017-11-03 15:29:11 -04:00
Joel Bernstein d723578034 SOLR-11602: Add Markov Chain Stream Evaluator 2017-11-03 15:00:43 -04:00
Joel Bernstein 0ebf5e0896 SOLR-11599: Change normalize function to standardize and make it work with matrices 2017-11-02 21:37:29 -04:00
Joel Bernstein e915078707 SOLR-10680: Add minMaxScale Stream Evaluator 2017-11-02 13:44:42 -04:00
Andrzej Bialecki 6008b186a2 SOLR-11072: Fix creation of searchRate triggers via API, add a unit test, other minor edits. 2017-11-02 16:32:29 +01:00
Noble Paul f564f9ca4b SOLR-11380: Test failure 2017-11-02 19:22:57 +10:30
Noble Paul 0e738a0369 SOLR-11380: V2request also converted to do streaming write 2017-11-02 17:39:31 +10:30
Joel Bernstein 6eea7f70a0 SOLR-11594: Add precision Stream Evaluator 2017-11-01 13:35:35 -04:00
Joel Bernstein 6d5a7920ae SOLR-11593: Add support for covariance matrices to the cov Stream Evaluator 2017-11-01 11:30:15 -04:00
Noble Paul 1b8747ec4f SOLR-11380: XML request writer also stream request 2017-11-01 19:26:22 +10:30
Shalin Shekhar Mangar 2e4b6929d2 SOLR-9440: Revert visibility change of collectionWatches 2017-11-01 10:15:39 +05:30
Joel Bernstein 5633268a45 SOLR-11567: Add triangularDistribution Stream Evaluator 2017-10-31 19:52:07 -04:00
Shalin Shekhar Mangar 39376cd8b5 SOLR-9440: The ZkStateReader.removeCollectionStateWatcher method can cache a DocCollection reference and never update it causing stale state to be returned in ClusterState 2017-10-31 17:58:36 +05:30
Noble Paul 487f67620d SOLR-11520: Implement autoscaling suggestions for cores count violations 2017-10-31 19:41:17 +10:30
Noble Paul cb3ed762fb SOLR-11380: use the inNull() method to check for empty UpdateRequest 2017-10-31 16:34:00 +10:30
Noble Paul 706b6c9171 SOLR-11380: SolrJ must stream docs to server instead of writing to a buffer first 2017-10-31 13:16:31 +10:30
Joel Bernstein 3edb23471b SOLR-11565: Add unit Stream Evaluator to support unitizing of vectors 2017-10-30 20:17:22 -04:00
Christine Poerschke b8bcaf9246 SOLR-10132: A new optional facet.matches parameter to return facet buckets only for terms that match a regular expression. (Gus Heck, Christine Poerschke) 2017-10-30 18:03:25 +00:00
Joel Bernstein b7332f65b7 SEARCH-11566: Add transpose Stream Evaluator to support transposing of matrices 2017-10-30 12:59:13 -04:00
Joel Bernstein e0239b9e84 SOLR-11568: Add matrix Stream Evaluator to support efficient matrix operations 2017-10-29 20:59:57 -04:00
Noble Paul f1a6b68d75 SOLR-11484: fixing NPE 2017-10-28 12:04:10 +10:30
Tomas Fernandez Lobbe 03084fa754 SOLR-11557: SolrZkClient.checkInterrupted interrupts current thread 2017-10-27 09:57:22 -07:00
Noble Paul 0d29f7a1a2 SOLR-11484: CloudSolrClient does not invalidate cache or retry for RouteException 2017-10-27 15:28:24 +10:30
Cassandra Targett 7ece47caf1 SOLR-11032: Update SolrJ tutorial with new example test for real tested code samples 2017-10-26 15:25:05 -05:00
Andrzej Bialecki ed611a0851 SOLR-11320: Lock autoscaling triggers when changes they requested are being made. 2017-10-26 15:42:48 +02:00
Andrzej Bialecki 99f5760142 SOLR-9735: Fix v2 API for AutoscalingHistoryHandler. 2017-10-26 15:21:10 +02:00
Shalin Shekhar Mangar 4674d26408 SOLR-11524: Added /admin/autoscaling/suggestions to ADMIN_PATHS so that SolrJ can call this API without a requiring a collection name 2017-10-26 17:35:58 +05:30
Shalin Shekhar Mangar b5d3d242ef SOLR-9735: Fix autoscaling.Commands.json structure 2017-10-26 15:14:11 +05:30
Cassandra Targett 01b8cd8d44 SOLR-11135: remove cwiki.apache.org references in javadocs 2017-10-25 09:59:02 -05:00
Noble Paul a72330e9b9 SOLR-11548: make ZkOperation an interface 2017-10-25 18:14:48 +10:30
Noble Paul 6305ed6695 SOLR-11524: A new autoscaling/suggestions API end-point which gives autoscaling suggestions
SOLR-11519: Implement suggestions for replica count violations

SOLR-11518: Implement Suggestions for freedisk violations
2017-10-24 23:39:13 +10:30
Joel Bernstein a6e1237451 SOLR-11429: Add loess Stream Evaluator to support Local Regression interpolation 2017-10-23 14:45:10 -04:00
Noble Paul acdf87cc41 SOLR-11500: MOVEREPLICA api missing in V2 2017-10-23 15:34:17 +10:30
Andrzej Bialecki d3e949c07b SOLR-11072: Implement trigger for searchRate event type. 2017-10-19 11:36:59 +02:00
David Smiley e001f35289 SOLR-11444: Improve consistency of collection alias handling and collection list references.
Other refactorings of nearby code too.
2017-10-19 00:02:24 -04:00
Alexandre Rafalovitch 70784f4561 SOLR-11490: Add missing @since tags
To all descendants of TupleStream
2017-10-18 21:38:51 -04:00
Andrzej Bialecki 8b4ab2644d SOLR-11448: Implement an option in collection commands to wait for final results. 2017-10-18 16:28:56 +02:00
Noble Paul e441b3ac4e SOLR-11359: refactored replica name parsing into Utils 2017-10-18 16:58:59 +10:30
Andrzej Bialecki a91af34705 SOLR-11491: Fix a ClassCastException. 2017-10-17 19:15:59 +02:00
Noble Paul 0953cb3270 SOLR-11500: MOVEREPLICA api missing in V2 2017-10-17 23:34:12 +10:30
Noble Paul fb97ff1400 SOLR-11359: Refactored 2017-10-17 00:06:42 +10:30
Noble Paul 141b08a40f SOLR-11359: Refactored 2017-10-16 23:57:29 +10:30
Andrzej Bialecki fc88e225d2 SOLR-11491: Support retrieval of cluster properties in HttpClusterStateProvider. 2017-10-16 10:09:58 +02:00
Andrzej Bialecki 8dd489edce SOLR-11285: Support simulations at scale in the autoscaling framework,
part 1 (refactoring).
2017-10-14 18:15:40 +02:00
Cao Manh Dat 9543e85460 SOLR-11443: Remove the usage of workqueue for Overseer 2017-10-14 09:33:17 +07:00
Noble Paul 371f731520 SOLR-11451: added logging to track the failures 2017-10-11 00:42:55 +10:30
Joel Bernstein aa6ec0ee54 SOLR-11377: Add expMovingAverage (exponential moving average) Stream Evaluator 2017-10-08 21:03:47 -04:00
Joel Bernstein b9c8aa7059 SOLR-11439: Add harmonicFit Stream Evaluator 2017-10-08 21:03:47 -04:00
Andrzej Bialecki 5c62fb56f7 SOLR-11285: Fix a bug in Policy modifier methods. 2017-10-04 20:53:20 +02:00
Joel Bernstein 070d6d3748 SOLR-11392: Change collection names in test case 2017-10-04 14:29:15 -04:00
Joel Bernstein 1782dd9ca9 SOLR-11436: Add polyfit and polyfitDerivative Stream Evaluators 2017-10-04 14:02:13 -04:00
Steve Rowe fe38dcafbe fix precommit errors after merging autoscaling branch into master 2017-10-04 12:17:40 -04:00
Noble Paul 0e679e4edf Merge branch 'feature/autoscaling' of https://git-wip-us.apache.org/repos/asf/lucene-solr 2017-10-04 18:53:51 +10:30
markrmiller fc429399ec SOLR-11425: SolrClientBuilder does not allow infinite timeout (value 0). 2017-10-03 09:08:26 -05:00
Noble Paul 310bcd7cbe Merge branch 'master' of https://git-wip-us.apache.org/repos/asf/lucene-solr into feature/autoscaling 2017-10-03 23:57:15 +10:30
Noble Paul 942b6715b3 policy should compare the approx val instead of actual val when moving replicas around 2017-10-02 13:05:50 +10:30
Joel Bernstein c322e36926 SOLR-11422: Add probabilities parameter to the enumeratedDistribution Stream Evaluator 2017-09-29 13:10:26 -04:00
Joel Bernstein 71eb59e043 SOLR-11420: sql Streaming Expression should use the default collection if none is provided 2017-09-29 10:36:26 -04:00
Joel Bernstein 633af79406 SOLR-11415: Add betaDistribution Stream Evaluator 2017-09-29 09:57:45 -04:00
Joel Bernstein 86fa1cf11b SOLR-11418: Allow comments in Streaming Expressions 2017-09-28 21:36:13 -04:00
Joel Bernstein 3f94f2ed4c SOLR-11414: Add gammaDistribution Stream Evaluator 2017-09-28 14:08:38 -04:00
Joel Bernstein 790533da12 SOLR-11401: Add zipFDistribution Stream Evaluator 2017-09-27 21:47:43 -04:00
Joel Bernstein 6b3447defd SOLR-11400: Add logNormalDistribution Stream Evaluator 2017-09-27 13:53:03 -04:00
Erick Erickson 424fb3bfb7 SOLR-11224: SolrStream.close can hit an NPE 2017-09-26 09:26:12 -07:00
Joel Bernstein 0e5c3aa3dc SOLR-11398: Add weibullDistribution Stream Evaluator 2017-09-25 21:41:55 -04:00
Joel Bernstein 7da8325cee SOLR-11388: Add test case 2017-09-23 21:31:38 -04:00
Joel Bernstein d5274ff239 SOLR-11392: StreamExpressionTest.testParallelExecutorStream fails too frequently 2017-09-23 13:03:19 -04:00
Joel Bernstein e62f9f85d0 SOLR-11388: Fix sample function 2017-09-23 13:03:19 -04:00
Joel Bernstein 5c9af8640e SOLR-11388: Add monteCarlo Stream Evaluator to support Monte Carlo simulations WIP 2017-09-23 13:03:18 -04:00
Joel Bernstein fc8d7ee1b0 SOLR-11387: testPoissonDistribution fails too frequently 2017-09-21 21:04:30 -04:00
Shalin Shekhar Mangar e13c4c34f0 SOLR-11085: Improve resiliency of autoscaling actions against overseer restarts and operation failures 2017-09-20 16:40:27 -07:00
Noble Paul 6c3226876e SOLR-11368: Abstract out DistibutedQueue as an interface 2017-09-20 15:44:32 +09:30
Joel Bernstein e0327719a3 SOLR-11354: Fix precommit 2017-09-19 21:26:49 -04:00
Joel Bernstein 565b6c6e5a SOLR-11354: Add factorial and movingMedian Stream Evaluators 2017-09-19 21:26:33 -04:00
Shalin Shekhar Mangar 341a730ad5 Revert "SOLR-11072: Implement trigger for searchRate event type."
This reverts commit 8ef83bf
2017-09-18 09:26:49 -07:00
Shalin Shekhar Mangar bc25e846bc Revert "SOLR-11072: Fix searchRate trigger hookup to ComputePlanAction. Make the trigger more robust by supporting host collections with warm shards. Add unit test."
This reverts commit 6fb2803
2017-09-18 09:25:27 -07:00
Shalin Shekhar Mangar de3107c70f Merge branch 'master' into feature/autoscaling
# Conflicts:
#	solr/CHANGES.txt
2017-09-18 09:23:41 -07:00
Joel Bernstein 1544839309 SOLR-11350: Add primes Stream Evaluator 2017-09-11 15:00:19 -04:00
Joel Bernstein a4fc14baed SOLR-11344: Fix copyOfRange Stream Evaluator so the end index parameter can be equal to the length array 2017-09-09 20:24:05 -04:00
Joel Bernstein c229dc328f SOLR-11342: Add sumDifference and meanDifference Stream Evaluators 2017-09-08 21:08:29 -04:00
Joel Bernstein e8dee89c87 SOLR-11339: Add Canberra, Chebyshev, Earth Movers and Manhattan Distance Stream Evaluators 2017-09-08 15:44:28 -04:00
Joel Bernstein a6142b3b61 SOLR-11338: Add Kendall's Tau-b rank and Spearmans rank correlation Stream Evaluators 2017-09-08 13:01:16 -04:00
Andrzej Bialecki 6fb2803bca SOLR-11072: Fix searchRate trigger hookup to ComputePlanAction. Make
the trigger more robust by supporting host collections with warm shards.
Add unit test.
2017-09-07 17:04:41 +02:00
Steve Rowe 5324c7436c SOLR-11181: fix validate-maven-dependencies 2017-09-07 09:24:02 -04:00
Andrzej Bialecki 8ef83bff12 SOLR-11072: Implement trigger for searchRate event type. 2017-09-07 12:37:57 +02:00
Noble Paul a73ffff8e3 SOLR-11327: MODIFYCOLLECTION should be able to edit policy attribute 2017-09-07 20:01:09 +09:30
Joel Bernstein 26201c8dad SOLR-11241: Fix precommit 2017-09-06 11:32:04 -04:00
Joel Bernstein 4496612120 SOLR-11241: Add discrete counting and probability Stream Evaluators 2017-09-06 11:32:04 -04:00
yonik 2ed1573adc SOLR-11317: change FacetStream to handle int/long as well as double for metrics 2017-09-05 14:14:19 -04:00
Joel Bernstein 3423ae4b92 SOLR-11321: Add ebeAdd, ebeSubtract, ebeDivide, ebeMultiply, dotProduct and cosineSimilarity Stream Evaluators 2017-09-04 18:40:03 -04:00
Noble Paul 054f445a27 SOLR-11307: The SHARD hint is deprecated in favor of a COLL_SHARD hint 2017-09-04 22:55:55 +09:30
Shalin Shekhar Mangar b2cf38c191 Merge branch 'master' into feature/autoscaling
# Conflicts:
#	solr/CHANGES.txt
2017-09-02 21:12:07 +05:30
Dennis Gove 4b6f2e5ca7 SOLR-11283: Refactors all Stream Evaluators in solrj.io.eval to simplify them 2017-08-25 22:07:37 -04:00
Andrzej Bialecki ce7db65e6f Revert "SOLR-11285: Initial refactoring."
This reverts commit aee54ff7d1.
2017-08-24 15:10:29 +02:00
Andrzej Bialecki aee54ff7d1 SOLR-11285: Initial refactoring. 2017-08-24 15:09:37 +02:00
Andrzej Bialecki 98c371f85e SOLR-11076 New /autoscaling/history API to return past cluster events and actions. 2017-08-23 14:00:16 +02:00
Andrzej Bialecki f10993d26d SOLR-10769: Allow multiple nodes in nodeAdded / nodeLost events. 2017-08-23 13:58:32 +02:00
Shalin Shekhar Mangar ac98e89d41 Merge branch 'master' into feature/autoscaling 2017-08-21 12:17:04 +05:30
Ishan Chattopadhyaya c8e0e939e4 SOLR-11183: V2 APIs are now available at /api endpoint 2017-08-20 21:00:15 +05:30
Noble Paul 68bfcd78c7 SOLR-11215: use the new metrics syntax in autoscaling metrics and system properties 2017-08-18 00:38:10 +09:30
Noble Paul 91446f7f77 SOLR:10822: Share a Policy.session object between multiple collection admin calls to get the correct computations 2017-08-15 16:06:35 +09:30
Shalin Shekhar Mangar 5e5462e408 Merge branch 'master' into feature/autoscaling
# Conflicts:
#	solr/CHANGES.txt
2017-08-14 12:00:51 +05:30
Shalin Shekhar Mangar 67de1a3f70 SOLR-9735: Replace nocommit with link to ref guide document 2017-08-11 19:49:08 +05:30
Noble Paul 9a157edf5d SOLR-11205: Any metrics value can be directly accessed in autoscaling policies 2017-08-11 23:27:53 +09:30
Joel Bernstein b3127ec582 SOLR-11225: Add cumulativeProbability Stream Evaluator 2017-08-10 21:55:45 -04:00
Christine Poerschke 9b0fccfbda Remove (package) javadocs in solrj UuidEvaluator. 2017-08-10 17:11:52 +01:00
Christine Poerschke 8e2dab7315 SOLR-11090: Add Replica.getProperty accessor. 2017-08-09 09:48:02 +01:00
Joel Bernstein ea85543ace SOLR-11212: Allow the predict StreamEvaluator to work on arrays as well as a single numeric parameter 2017-08-08 14:53:45 -04:00
Shalin Shekhar Mangar 1f6a94551f Merge branch 'master' into feature/autoscaling
# Conflicts:
#	solr/CHANGES.txt
#	solr/core/src/java/org/apache/solr/cloud/autoscaling/AutoScalingHandler.java
#	solr/core/src/test/org/apache/solr/cloud/SharedFSAutoReplicaFailoverTest.java
#	solr/core/src/test/org/apache/solr/cloud/autoscaling/AutoScalingHandlerTest.java
#	solr/solrj/src/java/org/apache/solr/client/solrj/impl/HttpSolrClient.java
2017-08-08 17:15:46 +05:30
Erick Erickson 53db72c598 SOLR-11198: fix test failures 2017-08-07 09:57:38 -07:00
Erick Erickson e053e2298f SOLR-11198: downconfig downloads empty file as folder, test failures possible fix and logging 2017-08-06 18:21:48 -07:00
Joel Bernstein ee69616957 SOLR-11203-Simple regression output should include R-square 2017-08-06 13:51:39 -04:00
Erick Erickson 522367cc4d SOLR-11198: downconfig downloads empty file as folder 2017-08-06 09:48:16 -07:00
Noble Paul c1d28c3ece SOLR-11178: Change error handling in AutoScalingHandler to be consistent w/ other APIs 2017-08-04 23:41:30 +09:30
Noble Paul 1c47a85f23 SOLR-11178: Change error handling in AutoScalingHandler to be consistent w/ other APIs 2017-08-03 23:01:35 +09:30
Noble Paul 82a426c6e7 SOLR-11157: remove-policy must fail if a policy to be deleted is used by a collection 2017-08-03 11:19:48 +09:30
Anshum Gupta 211d106cc2 SOLR-11126: Node-level health check handler, with SolrJ support 2017-08-02 11:54:49 -07:00
Cao Manh Dat 93ed4770ac SOLR-9321: Remove deprecated methods of ClusterState 2017-08-01 14:55:00 +07:00