druid/examples/quickstart/tutorial/compaction-day-granularity.json

{
  "type": "compact",
  "dataSource": "compaction-tutorial",
  "interval": "2015-09-12/2015-09-13",
  "tuningConfig" : {
    "type" : "index_parallel",
    "maxRowsPerSegment" : 5000000,
    "maxRowsInMemory" : 25000,
    "forceExtendableShardSpecs" : true
  },
  "granularitySpec" : {
    "segmentGranularity" : "DAY",
    "queryGranularity" : "none"
  }
}
New quickstart and tutorials (#6126) * New quickstart and tutorials * PR comments * Fix tranquility 2018-08-09 13:37:52 -07:00			`{`
			`"type": "compact",`
			`"dataSource": "compaction-tutorial",`
			`"interval": "2015-09-12/2015-09-13",`
			`"tuningConfig" : {`
Tutorials use new ingestion spec where possible (#9155) * Tutorials use new ingestion spec where possible There are 2 main changes * Use task type index_parallel instead of index * Remove the use of parser + firehose in favor of inputFormat + inputSource index_parallel is the preferred method starting in 0.17. Setting the job to index_parallel with the default maxNumConcurrentSubTasks(1) is the equivalent of an index task Instead of using a parserSpec, dimensionSpec and timestampSpec have been promoted to the dataSchema. The format is described in the ioConfig as the inputFormat. There are a few cases where the new format is not supported * Hadoop must use firehoses instead of the inputSource and inputFormat * There is no equivalent of a combining firehose as an inputSource * A Combining firehose does not support index_parallel * fix typo 2020-01-15 14:08:29 -08:00			`"type" : "index_parallel",`
Add support maxRowsPerSegment for auto compaction (#6780) * Add support maxRowsPerSegment for auto compaction * fix build * fix build * fix teamcity * add test * fix test * address comment 2019-01-10 09:50:14 -08:00			`"maxRowsPerSegment" : 5000000,`
New quickstart and tutorials (#6126) * New quickstart and tutorials * PR comments * Fix tranquility 2018-08-09 13:37:52 -07:00			`"maxRowsInMemory" : 25000,`
			`"forceExtendableShardSpecs" : true`
First refactor of compaction (#10935) * first pass compaction refactor. includes updated behavior for queryGranularity. removes duplicated doc * fix links, typos, some reorganization * fix spelling. TBD still there for work in progress * updates tutorial examples, adds more clarification around compaction use cases * add granularity spec to automatic compaction config * final edits * spelling fixes * apply suggestions from review * upadtes from review * last edits * move note * clarify null * fix links & spelling * latest review * edits to auto-compaction config * add back rollup * fix links & spelling * Update compaction.md add granularityspec to example 2021-03-24 11:41:44 -07:00			`},`
			`"granularitySpec" : {`
			`"segmentGranularity" : "DAY",`
			`"queryGranularity" : "none"`
New quickstart and tutorials (#6126) * New quickstart and tutorials * PR comments * Fix tranquility 2018-08-09 13:37:52 -07:00			`}`
			`}`