Charles Smith
efbb58e90e
docs: remove maxRowsPerSegment where appropriate ( #12071 )
...
* remove maxRowsPerSegment where appropriate
* fix tutorial, accept suggestions
* Update docs/design/coordinator.md
* additional tutorial file
* fix initial index spec
* accept comments
* Update docs/tutorials/tutorial-compaction.md
Co-authored-by: Victoria Lim <vtlim@users.noreply.github.com>
* Update docs/tutorials/tutorial-compaction.md
Co-authored-by: Victoria Lim <vtlim@users.noreply.github.com>
* Update docs/tutorials/tutorial-compaction.md
Co-authored-by: Victoria Lim <vtlim@users.noreply.github.com>
* Update docs/tutorials/tutorial-compaction.md
Co-authored-by: Victoria Lim <vtlim@users.noreply.github.com>
* Update docs/tutorials/tutorial-compaction.md
Co-authored-by: Victoria Lim <vtlim@users.noreply.github.com>
* Update docs/tutorials/tutorial-compaction.md
Co-authored-by: Victoria Lim <vtlim@users.noreply.github.com>
* Update docs/tutorials/tutorial-compaction.md
Co-authored-by: Victoria Lim <vtlim@users.noreply.github.com>
* Update docs/tutorials/tutorial-compaction.md
Co-authored-by: Victoria Lim <vtlim@users.noreply.github.com>
* Update docs/tutorials/tutorial-compaction.md
Co-authored-by: Victoria Lim <vtlim@users.noreply.github.com>
* Update docs/tutorials/tutorial-compaction.md
Co-authored-by: Victoria Lim <vtlim@users.noreply.github.com>
* Update docs/tutorials/tutorial-compaction.md
Co-authored-by: Victoria Lim <vtlim@users.noreply.github.com>
* Update docs/tutorials/tutorial-compaction.md
Co-authored-by: Victoria Lim <vtlim@users.noreply.github.com>
* Update docs/tutorials/tutorial-compaction.md
Co-authored-by: Victoria Lim <vtlim@users.noreply.github.com>
* add back comment on maxrows per segment
* Update docs/tutorials/tutorial-compaction.md
Co-authored-by: Victoria Lim <vtlim@users.noreply.github.com>
* Update docs/tutorials/tutorial-compaction.md
Co-authored-by: Victoria Lim <vtlim@users.noreply.github.com>
* Update docs/tutorials/tutorial-compaction.md
Co-authored-by: Victoria Lim <vtlim@users.noreply.github.com>
* rm duplicate entry
* Update native-batch-simple-task.md
remove ref to `maxrowspersegment`
* Update native-batch.md
remove ref to `maxrowspersegment`
* final tenticles
* Apply suggestions from code review
Co-authored-by: Victoria Lim <vtlim@users.noreply.github.com>
2022-07-28 16:52:13 +05:30
Suneet Saldanha
85a3d416b0
Tutorials use new ingestion spec where possible ( #9155 )
...
* Tutorials use new ingestion spec where possible
There are 2 main changes
* Use task type index_parallel instead of index
* Remove the use of parser + firehose in favor of inputFormat + inputSource
index_parallel is the preferred method starting in 0.17. Setting the job to
index_parallel with the default maxNumConcurrentSubTasks(1) is the equivalent
of an index task
Instead of using a parserSpec, dimensionSpec and timestampSpec have been
promoted to the dataSchema. The format is described in the ioConfig as the
inputFormat.
There are a few cases where the new format is not supported
* Hadoop must use firehoses instead of the inputSource and inputFormat
* There is no equivalent of a combining firehose as an inputSource
* A Combining firehose does not support index_parallel
* fix typo
2020-01-15 14:08:29 -08:00
Jihoon Son
892d1d35d6
Deprecate NoneShardSpec and drop support for automatic segment merge ( #6883 )
...
* Deprecate noneShardSpec
* clean up noneShardSpec constructor
* revert unnecessary change
* Deprecate mergeTask
* add more doc
* remove convert from indexMerger
* Remove mergeTask
* remove HadoopDruidConverterConfig
* fix build
* fix build
* fix teamcity
* fix teamcity
* fix ServerModule
* fix compilation
* fix compilation
2019-03-15 23:29:25 -07:00
Jihoon Son
6b232d8195
Improve compaction tutorial to demonstrate compaction with keepSegmentGranularity = true ( #7079 )
...
* Improve compaction tutorial to demonstrate compaction with keepSegmentGranularity = true
* typo
* add a warning
2019-02-27 16:02:51 -08:00
Jihoon Son
c35a39d70b
Add support maxRowsPerSegment for auto compaction ( #6780 )
...
* Add support maxRowsPerSegment for auto compaction
* fix build
* fix build
* fix teamcity
* add test
* fix test
* address comment
2019-01-10 09:50:14 -08:00
David Lim
23ad3d214c
fixup docs to download from Apache mirror, fixup tarball name and path, change references from quickstart/* to quickstart/tutorial/* ( #6570 )
2018-11-01 21:47:29 -07:00
Jonathan Wei
24f2e8ba26
New quickstart and tutorials ( #6126 )
...
* New quickstart and tutorials
* PR comments
* Fix tranquility
2018-08-09 14:37:52 -06:00