2013-09-16 17:49:36 -04:00
---
2013-09-26 19:22:28 -04:00
layout: doc_page
2013-09-16 17:49:36 -04:00
---
2014-01-16 18:37:07 -05:00
# Aggregations
2013-09-16 19:01:14 -04:00
Aggregations are specifications of processing over metrics available in Druid.
Available aggregations are:
2013-09-27 20:08:34 -04:00
### Count aggregator
`count` computes the row count that match the filters
```json
{ "type" : "count", "name" : < output_name > }
```
2013-09-16 19:01:14 -04:00
### Sum aggregators
#### `longSum` aggregator
computes the sum of values as a 64-bit, signed integer
2013-09-27 20:08:34 -04:00
```json
{ "type" : "longSum", "name" : < output_name > , "fieldName" : < metric_name > }
```
2013-09-16 19:01:14 -04:00
`name` – output name for the summed value
`fieldName` – name of the metric column to sum over
#### `doubleSum` aggregator
Computes the sum of values as 64-bit floating point value. Similar to `longSum`
2013-09-27 20:08:34 -04:00
```json
{ "type" : "doubleSum", "name" : < output_name > , "fieldName" : < metric_name > }
```
2013-09-16 19:01:14 -04:00
### Min / Max aggregators
#### `min` aggregator
`min` computes the minimum metric value
2013-09-27 20:08:34 -04:00
```json
{ "type" : "min", "name" : < output_name > , "fieldName" : < metric_name > }
```
2013-09-16 19:01:14 -04:00
#### `max` aggregator
`max` computes the maximum metric value
2013-09-27 20:08:34 -04:00
```json
{ "type" : "max", "name" : < output_name > , "fieldName" : < metric_name > }
```
2013-09-16 19:01:14 -04:00
### JavaScript aggregator
Computes an arbitrary JavaScript function over a set of columns (both metrics and dimensions).
All JavaScript functions must return numerical values.
2013-09-27 20:08:34 -04:00
```json
2014-04-25 16:23:43 -04:00
{ "type": "javascript",
"name": "< output_name > ",
2013-09-27 20:08:34 -04:00
"fieldNames" : [ < column1 > , < column2 > , ... ],
"fnAggregate" : "function(current, column1, column2, ...) {
< updates partial aggregate ( current ) based on the current row values >
return < updated partial aggregate >
}",
"fnCombine" : "function(partialA, partialB) { return < combined partial results > ; }",
"fnReset" : "function() { return < initial value > ; }"
}
```
2013-09-16 19:01:14 -04:00
**Example**
2013-09-27 20:08:34 -04:00
```json
{
"type": "javascript",
"name": "sum(log(x)/y) + 10",
"fieldNames": ["x", "y"],
"fnAggregate" : "function(current, a, b) { return current + (Math.log(a) * b); }",
"fnCombine" : "function(partialA, partialB) { return partialA + partialB; }",
"fnReset" : "function() { return 10; }"
}
```
2014-03-05 17:19:38 -05:00
2014-04-25 16:23:43 -04:00
### Cardinality aggregator
2014-03-05 17:19:38 -05:00
2014-04-25 16:23:43 -04:00
Computes the cardinality of a set of Druid dimensions, using HyperLogLog to estimate the cardinality.
2014-03-05 17:19:38 -05:00
2014-04-25 16:23:43 -04:00
```json
{
"type": "cardinality",
"name": "< output_name > ",
"fieldNames": [ < dimension1 > , < dimension2 > , ... ],
"byRow": < false | true > # (optional, defaults to false)
}
```
#### Cardinality by value
2014-04-25 16:24:34 -04:00
When setting `byRow` to `false` (the default) it computes the cardinality of the set composed of the union of all dimension values for all the given dimensions.
2014-04-25 16:23:43 -04:00
* For a single dimension, this is equivalent to
```sql
SELECT COUNT(DISCTINCT(dimension)) FROM < datasource >
```
* For multiple dimensions, this is equivalent to something akin to
```sql
2014-04-25 16:24:34 -04:00
SELECT COUNT(DISTINCT(value)) FROM (
2014-04-25 16:23:43 -04:00
SELECT dim_1 as value FROM < datasource >
UNION
SELECT dim_2 as value FROM < datasource >
UNION
SELECT dim_3 as value FROM < datasource >
)
```
#### Cardinality by row
2014-04-25 16:24:34 -04:00
When setting `byRow` to `true` it computes the cardinality by row, i.e. the cardinality of distinct dimension combinations
2014-04-25 16:23:43 -04:00
This is equivalent to something akin to
```sql
2014-04-25 16:24:34 -04:00
SELECT COUNT(*) FROM ( SELECT DIM1, DIM2, DIM3 FROM < datasource > GROUP BY DIM1, DIM2, DIM3
2014-04-25 16:23:43 -04:00
```
**Example**
Determine the number of distinct categories items are assigned to.
```json
{
"type": "cardinality",
"name": "distinct_values",
"fieldNames": [ "main_category", "secondary_category" ]
}
```
Determine the number of distinct are assigned to.
```json
{
"type": "cardinality",
"name": "distinct_values",
"fieldNames": [ "", "secondary_category" ],
"byRow" : true
}
```
## Complex Aggregations
### HyperUnique aggregator
2014-06-27 19:51:01 -04:00
Uses [HyperLogLog ](http://algo.inria.fr/flajolet/Publications/FlFuGaMe07.pdf ) to compute the estimated cardinality of a dimension that has been aggregated as a "hyperUnique" metric at indexing time.
2014-03-05 17:19:38 -05:00
```json
{ "type" : "hyperUnique", "name" : < output_name > , "fieldName" : < metric_name > }
2014-10-21 17:09:11 -04:00
```
2014-10-21 20:24:44 -04:00
## Miscellaneous Aggregations
### Filtered Aggregator
A filtered aggregator wraps any given aggregator, but only aggregates the values for which the given dimension filter matches.
This makes it possible to compute the results of a filtered and an unfiltered aggregation simultaneously, without having to issue multiple queries, and use both results as part of post-aggregations.
2014-11-19 07:12:37 -05:00
*Limitations:* The filtered aggregator currently only supports 'or', 'and', 'selector' and 'not' filters, i.e. matching one or multiple dimensions against a single value.
2014-10-21 20:24:44 -04:00
*Note:* If only the filtered results are required, consider putting the filter on the query itself, which will be much faster since it does not require scanning all the data.
```json
{
"type" : "filtered",
"filter" : {
"type" : "selector",
"dimension" : < dimension > ,
"value" : < dimension value >
}
"aggregator" : < aggregation >
}
```