2016-07-18 09:42:24 -04:00
|
|
|
/*
|
|
|
|
* Licensed to Elasticsearch under one or more contributor
|
|
|
|
* license agreements. See the NOTICE file distributed with
|
|
|
|
* this work for additional information regarding copyright
|
|
|
|
* ownership. Elasticsearch licenses this file to you under
|
|
|
|
* the Apache License, Version 2.0 (the "License"); you may
|
|
|
|
* not use this file except in compliance with the License.
|
|
|
|
* You may obtain a copy of the License at
|
|
|
|
*
|
|
|
|
* http://www.apache.org/licenses/LICENSE-2.0
|
|
|
|
*
|
|
|
|
* Unless required by applicable law or agreed to in writing,
|
|
|
|
* software distributed under the License is distributed on an
|
|
|
|
* "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
|
|
|
|
* KIND, either express or implied. See the License for the
|
|
|
|
* specific language governing permissions and limitations
|
|
|
|
* under the License.
|
|
|
|
*/
|
|
|
|
|
|
|
|
import org.elasticsearch.gradle.precommit.PrecommitTasks
|
|
|
|
|
|
|
|
apply plugin: 'elasticsearch.build'
|
2016-07-29 10:41:39 -04:00
|
|
|
apply plugin: 'nebula.maven-base-publish'
|
|
|
|
apply plugin: 'nebula.maven-scm'
|
2016-07-18 09:42:24 -04:00
|
|
|
|
|
|
|
group = 'org.elasticsearch.client'
|
|
|
|
|
|
|
|
dependencies {
|
|
|
|
compile "org.elasticsearch:elasticsearch:${version}"
|
2016-07-29 10:41:39 -04:00
|
|
|
compile "org.elasticsearch.plugin:transport-netty4-client:${version}"
|
|
|
|
compile "org.elasticsearch.plugin:reindex-client:${version}"
|
|
|
|
compile "org.elasticsearch.plugin:lang-mustache-client:${version}"
|
|
|
|
compile "org.elasticsearch.plugin:percolator-client:${version}"
|
2017-05-12 09:58:06 -04:00
|
|
|
compile "org.elasticsearch.plugin:parent-join-client:${version}"
|
Add composite aggregator (#26800)
* This change adds a module called `aggs-composite` that defines a new aggregation named `composite`.
The `composite` aggregation is a multi-buckets aggregation that creates composite buckets made of multiple sources.
The sources for each bucket can be defined as:
* A `terms` source, values are extracted from a field or a script.
* A `date_histogram` source, values are extracted from a date field and rounded to the provided interval.
This aggregation can be used to retrieve all buckets of a deeply nested aggregation by flattening the nested aggregation in composite buckets.
A composite buckets is composed of one value per source and is built for each document as the combinations of values in the provided sources.
For instance the following aggregation:
````
"test_agg": {
"terms": {
"field": "field1"
},
"aggs": {
"nested_test_agg":
"terms": {
"field": "field2"
}
}
}
````
... which retrieves the top N terms for `field1` and for each top term in `field1` the top N terms for `field2`, can be replaced by a `composite` aggregation in order to retrieve **all** the combinations of `field1`, `field2` in the matching documents:
````
"composite_agg": {
"composite": {
"sources": [
{
"field1": {
"terms": {
"field": "field1"
}
}
},
{
"field2": {
"terms": {
"field": "field2"
}
}
},
}
}
````
The response of the aggregation looks like this:
````
"aggregations": {
"composite_agg": {
"buckets": [
{
"key": {
"field1": "alabama",
"field2": "almanach"
},
"doc_count": 100
},
{
"key": {
"field1": "alabama",
"field2": "calendar"
},
"doc_count": 1
},
{
"key": {
"field1": "arizona",
"field2": "calendar"
},
"doc_count": 1
}
]
}
}
````
By default this aggregation returns 10 buckets sorted in ascending order of the composite key.
Pagination can be achieved by providing `after` values, the values of the composite key to aggregate after.
For instance the following aggregation will aggregate all composite keys that sorts after `arizona, calendar`:
````
"composite_agg": {
"composite": {
"after": {"field1": "alabama", "field2": "calendar"},
"size": 100,
"sources": [
{
"field1": {
"terms": {
"field": "field1"
}
}
},
{
"field2": {
"terms": {
"field": "field2"
}
}
}
}
}
````
This aggregation is optimized for indices that set an index sorting that match the composite source definition.
For instance the aggregation above could run faster on indices that defines an index sorting like this:
````
"settings": {
"index.sort.field": ["field1", "field2"]
}
````
In this case the `composite` aggregation can early terminate on each segment.
This aggregation also accepts multi-valued field but disables early termination for these fields even if index sorting matches the sources definition.
This is mandatory because index sorting picks only one value per document to perform the sort.
2017-11-16 09:13:36 -05:00
|
|
|
compile "org.elasticsearch.plugin:aggs-composite-client:${version}"
|
2016-07-18 09:42:24 -04:00
|
|
|
testCompile "com.carrotsearch.randomizedtesting:randomizedtesting-runner:${versions.randomizedrunner}"
|
|
|
|
testCompile "junit:junit:${versions.junit}"
|
2016-08-04 09:48:38 -04:00
|
|
|
testCompile "org.hamcrest:hamcrest-all:${versions.hamcrest}"
|
2016-07-18 09:42:24 -04:00
|
|
|
}
|
|
|
|
|
|
|
|
dependencyLicenses {
|
|
|
|
dependencies = project.configurations.runtime.fileCollection {
|
|
|
|
it.group.startsWith('org.elasticsearch') == false
|
|
|
|
}
|
|
|
|
}
|
|
|
|
|
|
|
|
forbiddenApisTest {
|
|
|
|
// we don't use the core test-framework, no lucene classes present so we don't want the es-test-signatures to
|
|
|
|
// be pulled in
|
|
|
|
signaturesURLs = [PrecommitTasks.getResource('/forbidden/jdk-signatures.txt'),
|
|
|
|
PrecommitTasks.getResource('/forbidden/es-all-signatures.txt')]
|
|
|
|
}
|
|
|
|
|
|
|
|
namingConventions {
|
|
|
|
testClass = 'com.carrotsearch.randomizedtesting.RandomizedTest'
|
|
|
|
//we don't have integration tests
|
|
|
|
skipIntegTestInDisguise = true
|
2017-08-17 15:03:47 -04:00
|
|
|
}
|