Charles Smith
efbb58e90e
docs: remove maxRowsPerSegment where appropriate ( #12071 )
...
* remove maxRowsPerSegment where appropriate
* fix tutorial, accept suggestions
* Update docs/design/coordinator.md
* additional tutorial file
* fix initial index spec
* accept comments
* Update docs/tutorials/tutorial-compaction.md
Co-authored-by: Victoria Lim <vtlim@users.noreply.github.com>
* Update docs/tutorials/tutorial-compaction.md
Co-authored-by: Victoria Lim <vtlim@users.noreply.github.com>
* Update docs/tutorials/tutorial-compaction.md
Co-authored-by: Victoria Lim <vtlim@users.noreply.github.com>
* Update docs/tutorials/tutorial-compaction.md
Co-authored-by: Victoria Lim <vtlim@users.noreply.github.com>
* Update docs/tutorials/tutorial-compaction.md
Co-authored-by: Victoria Lim <vtlim@users.noreply.github.com>
* Update docs/tutorials/tutorial-compaction.md
Co-authored-by: Victoria Lim <vtlim@users.noreply.github.com>
* Update docs/tutorials/tutorial-compaction.md
Co-authored-by: Victoria Lim <vtlim@users.noreply.github.com>
* Update docs/tutorials/tutorial-compaction.md
Co-authored-by: Victoria Lim <vtlim@users.noreply.github.com>
* Update docs/tutorials/tutorial-compaction.md
Co-authored-by: Victoria Lim <vtlim@users.noreply.github.com>
* Update docs/tutorials/tutorial-compaction.md
Co-authored-by: Victoria Lim <vtlim@users.noreply.github.com>
* Update docs/tutorials/tutorial-compaction.md
Co-authored-by: Victoria Lim <vtlim@users.noreply.github.com>
* Update docs/tutorials/tutorial-compaction.md
Co-authored-by: Victoria Lim <vtlim@users.noreply.github.com>
* Update docs/tutorials/tutorial-compaction.md
Co-authored-by: Victoria Lim <vtlim@users.noreply.github.com>
* add back comment on maxrows per segment
* Update docs/tutorials/tutorial-compaction.md
Co-authored-by: Victoria Lim <vtlim@users.noreply.github.com>
* Update docs/tutorials/tutorial-compaction.md
Co-authored-by: Victoria Lim <vtlim@users.noreply.github.com>
* Update docs/tutorials/tutorial-compaction.md
Co-authored-by: Victoria Lim <vtlim@users.noreply.github.com>
* rm duplicate entry
* Update native-batch-simple-task.md
remove ref to `maxrowspersegment`
* Update native-batch.md
remove ref to `maxrowspersegment`
* final tenticles
* Apply suggestions from code review
Co-authored-by: Victoria Lim <vtlim@users.noreply.github.com>
2022-07-28 16:52:13 +05:30
Suneet Saldanha
85a3d416b0
Tutorials use new ingestion spec where possible ( #9155 )
...
* Tutorials use new ingestion spec where possible
There are 2 main changes
* Use task type index_parallel instead of index
* Remove the use of parser + firehose in favor of inputFormat + inputSource
index_parallel is the preferred method starting in 0.17. Setting the job to
index_parallel with the default maxNumConcurrentSubTasks(1) is the equivalent
of an index task
Instead of using a parserSpec, dimensionSpec and timestampSpec have been
promoted to the dataSchema. The format is described in the ioConfig as the
inputFormat.
There are a few cases where the new format is not supported
* Hadoop must use firehoses instead of the inputSource and inputFormat
* There is no equivalent of a combining firehose as an inputSource
* A Combining firehose does not support index_parallel
* fix typo
2020-01-15 14:08:29 -08:00
Jihoon Son
892d1d35d6
Deprecate NoneShardSpec and drop support for automatic segment merge ( #6883 )
...
* Deprecate noneShardSpec
* clean up noneShardSpec constructor
* revert unnecessary change
* Deprecate mergeTask
* add more doc
* remove convert from indexMerger
* Remove mergeTask
* remove HadoopDruidConverterConfig
* fix build
* fix build
* fix teamcity
* fix teamcity
* fix ServerModule
* fix compilation
* fix compilation
2019-03-15 23:29:25 -07:00
Jonathan Wei
3d247498ef
Update tutorials for 0.14.0-incubating ( #7157 )
2019-02-27 19:50:31 -08:00