druid/docs/content/SegmentMetadataQuery.md

82 lines
2.5 KiB
Markdown
Raw Normal View History

---
2013-09-26 19:22:28 -04:00
layout: doc_page
---
2014-01-16 18:37:07 -05:00
# Segment Metadata Queries
2013-09-13 18:20:39 -04:00
Segment metadata queries return per segment information about:
* Cardinality of all columns in the segment
* Estimated byte size for the segment columns if they were stored in a flat format
* Interval the segment covers
* Column type of all the columns in the segment
* Estimated total segment byte size in if it was stored in a flat format
* Segment id
```json
{
"queryType":"segmentMetadata",
"dataSource":"sample_datasource",
2014-01-28 10:34:13 -05:00
"intervals":["2013-01-01/2014-01-01"]
}
```
2013-09-13 18:20:39 -04:00
There are several main parts to a segment metadata query:
|property|description|required?|
|--------|-----------|---------|
|queryType|This String should always be "segmentMetadata"; this is the first thing Druid looks at to figure out how to interpret the query|yes|
2015-03-26 13:44:11 -04:00
|dataSource|A String or Object defining the data source to query, very similar to a table in a relational database. See [DataSource](DataSource.html) for more information.|yes|
2013-09-13 18:20:39 -04:00
|intervals|A JSON Object representing ISO-8601 Intervals. This defines the time ranges to run the query over.|yes|
2014-05-29 15:53:13 -04:00
|toInclude|A JSON Object representing what columns should be included in the result. Defaults to "all".|no|
2013-09-13 18:20:39 -04:00
|merge|Merge all individual segment metadata results into a single result|no|
2015-03-26 13:44:11 -04:00
|context|See [Context](Context.html)|no|
2013-09-13 18:20:39 -04:00
The format of the result is:
```json
[ {
"id" : "some_id",
"intervals" : [ "2013-05-13T00:00:00.000Z/2013-05-14T00:00:00.000Z" ],
"columns" : {
"__time" : { "type" : "LONG", "size" : 407240380, "cardinality" : null },
"dim1" : { "type" : "STRING", "size" : 100000, "cardinality" : 1944 },
"dim2" : { "type" : "STRING", "size" : 100000, "cardinality" : 1504 },
"metric1" : { "type" : "FLOAT", "size" : 100000, "cardinality" : null }
},
"size" : 300000
} ]
```
2014-05-29 15:53:13 -04:00
Dimension columns will have type `STRING`.
Metric columns will have type `FLOAT` or `LONG` or name of the underlying complex type such as `hyperUnique` in case of COMPLEX metric.
Timestamp column will have type `LONG`.
Only columns which are dimensions (ie, have type `STRING`) will have any cardinality. Rest of the columns (timestamp and metric columns) will show cardinality as `null`.
2014-05-29 15:53:13 -04:00
### toInclude
There are 3 types of toInclude objects.
#### All
The grammar is as follows:
``` json
"toInclude": { "type": "all"}
```
#### None
The grammar is as follows:
``` json
"toInclude": { "type": "none"}
```
#### List
The grammar is as follows:
``` json
"toInclude": { "type": "list", "columns": [<string list of column names>]}
```