353475bd36
Docs for automatic compaction ( #12569 )
...
* docs for auto-compaction
* fix broken links
* another link
* Apply suggestions from code review
Co-authored-by: Suneet Saldanha <suneet@apache.org>
* Apply suggestions from code review
Co-authored-by: Suneet Saldanha <suneet@apache.org>
* Apply suggestions from code review
Co-authored-by: Charles Smith <techdocsmith@gmail.com>
Co-authored-by: Suneet Saldanha <suneet@apache.org>
* reorg content for skipOffset
* Update docs/ingestion/automatic-compaction.md
Co-authored-by: Charles Smith <techdocsmith@gmail.com>
* Apply suggestions from code review
Co-authored-by: Kashif Faraz <kashif.faraz@gmail.com>
Co-authored-by: Suneet Saldanha <suneet@apache.org>
Co-authored-by: Charles Smith <techdocsmith@gmail.com>
Co-authored-by: Kashif Faraz <kashif.faraz@gmail.com>
2022-06-09 14:55:12 -07:00
0206a2da5c
Update automatic compaction docs with consistent terminology ( #12416 )
...
* specify automatic compaction where applicable
* Apply suggestions from code review
Co-authored-by: Katya Macedo <38017980+ektravel@users.noreply.github.com>
* update for style and consistency
* implement suggested feedback
* remove duplicate example
* Apply suggestions from code review
Co-authored-by: Katya Macedo <38017980+ektravel@users.noreply.github.com>
* Update docs/ingestion/compaction.md
Co-authored-by: Katya Macedo <38017980+ektravel@users.noreply.github.com>
* Update docs/operations/api-reference.md
* update .spelling
* Adopt review suggestions
Co-authored-by: Katya Macedo <38017980+ektravel@users.noreply.github.com>
2022-05-03 16:22:25 -07:00
d326c681c1
Document config for ingesting null columns ( #12389 )
...
* config for ingesting null columns
* add link
* edit .spelling
* what happens if storeEmptyColumns is disabled
2022-04-05 09:15:42 -07:00
c61b19d443
Refactor SQL docs ( #12239 )
...
* refactor and link fixes
* add sql docs to left nav
* code format for needle
* updated web console script
* link fixes
* update earliest/latest functions
* edits for grammar and style
* more link fixes
* another link
* update with #12226
* update .spelling file
2022-02-11 14:43:30 -08:00
d7463c99e9
Docs - Task ref logs correction ( #11746 )
...
* Update tasks.md
Removed confusing backreference
* Update tasks.md
Changed silly grammar.
2021-12-07 09:15:19 -08:00
7ed46800c3
Docs: Add multi-dimension partitioning doc; refactor native batch and separate into smaller topics. ( #11983 )
...
Adds documentation for multi-dimension partitioning. cc: @kfaraz
Refactors the native batch partitioning topic as follows:
Native batch ingestion covers parallel-index
Native batch simple task indexing covers index
Native batch input sources covers ioSource
Native batch ingestion with firehose covers deprecated firehose
2021-12-03 16:37:14 +05:30
5c3f3da146
Add handoff wait time to IngestionStatsAndErrorsTaskReportData ( #11090 )
...
* Add handoff wait time to ingestion stats report. Refactor some code for batch handoff
* fix checkstyle
* Add assertion to AbstractITBatchIndexTask to make sure report reflects wait for segments happened
* add docs to the task reports section of doc
2021-09-20 22:48:44 -07:00
ee009ec18e
Docs - ingestion task log config and process ( #11678 )
...
* Update index.md
Moved H4s underneath the H3 for the task log location and added hyperlinks.
* Update tasks.md
Added process information around log file generation, and subsumed text from the configuration guide into this explanatory text instead.
* Update tasks.md
.html > .md
* Update docs/ingestion/tasks.md
Co-authored-by: Frank Chen <frankchen@apache.org>
Co-authored-by: Frank Chen <frankchen@apache.org>
2021-09-13 15:49:09 -07:00
6524d838d7
Docs refactor of ingestion. Carries #11541 ( #11576 )
...
* Docs refactor of ingestion. Carries #11541
* Update docs/misc/math-expr.md
* add Apache license
* fix header, add topics to sidebar
* Update docs/ingestion/partitioning.md
* pick up changes to and md from c7fdf1d#11479
Co-authored-by: Suneet Saldanha <suneet@apache.org>
Co-authored-by: Jihoon Son <jihoonson@apache.org>
2021-08-13 08:42:03 -07:00
2df42143ae
Fix idempotence of segment allocation and task report apis in native batch ingestion ( #11189 )
...
* Fix idempotence of segment allocation and task report apis in native
batch ingestion
* better error and javadoc
* checkstyle and dependency
* fix tests and add more tests
* task config instead of context; add doc
* unused import and dependency
* typo in doc
* fix unintended changes
* fix wrong import
* remove unnecessary error handling
* add task context back
* default task context
* fix test and doc
* address comments
* unused imports
2021-05-07 14:29:48 -07:00
ca1412d574
Reduce visibility of Tranquility documentation ( #11134 )
...
* reduce visibility of tranquility doc
Co-authored-by: Charles Smith <38529548+techdocsmith@users.noreply.github.com>
2021-05-03 16:48:24 -07:00
d69533dbd9
First refactor of compaction ( #10935 )
...
* first pass compaction refactor. includes updated behavior for queryGranularity. removes duplicated doc
* fix links, typos, some reorganization
* fix spelling. TBD still there for work in progress
* updates tutorial examples, adds more clarification around compaction use cases
* add granularity spec to automatic compaction config
* final edits
* spelling fixes
* apply suggestions from review
* upadtes from review
* last edits
* move note
* clarify null
* fix links & spelling
* latest review
* edits to auto-compaction config
* add back rollup
* fix links & spelling
* Update compaction.md
add granularityspec to example
2021-03-24 11:41:44 -07:00
6ae8059c09
cleaning up and fixing links ( #10528 )
...
* cleaning up and fixing links
* reverting local link
* Update indexer.md
* link checking
* Fixing one more stale link for PostgreSQL
2020-12-17 13:37:43 -08:00
bcf41922ce
Remove unsupported task types in doc ( #10111 )
2020-07-04 18:13:53 -07:00
1611792855
Add InputSource and InputFormat interfaces ( #8823 )
...
* Add InputSource and InputFormat interfaces
* revert orc dependency
* fix dimension exclusions and failing unit tests
* fix tests
* fix test
* fix test
* fix firehose and inputSource for parallel indexing task
* fix tc
* fix tc: remove unused method
* Formattable
* add needsFormat(); renamed to ObjectSource; pass metricsName for reader
* address comments
* fix closing resource
* fix checkstyle
* fix tests
* remove verify from csv
* Revert "remove verify from csv"
This reverts commit 1ea7758489
2019-11-15 09:22:09 -08:00
7605c23354
Remove Tranquility configs and certain doc references. ( #8793 )
...
Since it hasn't received updates or community interest in a while, it makes sense
to de-emphasize it in the distribution and most documentation (outside of simple
mentions of its existence).
2019-10-30 16:30:16 -07:00
f2a444321b
Added live reports for Kafka and Native batch task ( #8557 )
...
* Added live reports for Kafka and Native batch task
* Removed unused local variables
* Added the missing unit test
* Refine unit test logic, add implementation for HttpRemoteTaskRunner
* checksytle fixes
* Update doc descriptions for updated API
* remove unnecessary files
* Fix spellcheck complaints
* More details for api descriptions
2019-09-23 21:08:36 -07:00
7dcbaca658
Spellcheck docs ( #8548 )
...
* Spellcheck docs
Fix spelling mistakes in docs and add CI job for running spellcheck on
docs.
* Add missing license header
2019-09-17 12:47:30 -07:00
d007477742
Docusaurus build framework + ingestion doc refresh. ( #8311 )
...
* Docusaurus build framework + ingestion doc refresh.
* stick to npm instead of yarn
* fix typos
* restore some _bin
* Adjustments.
* detect and fix redirect anchors
* update anchor lint
* Web-console: remove specific column filters (#8343 )
* add clear filter
* update tool kit
* remove usless check
* auto run
* add %
* Fix resource leak (#8337 )
* Fix resource leak
* Patch comments
* Enable Spotbugs NP_NONNULL_RETURN_VIOLATION (#8234 )
* Fixes from PR review.
* Fix more anchors.
* Preamble nix.
* Fix more anchors, headers
* clean up placeholder page
* add to website lint to travis config
* better broken link checking
* travis fix
* Fixed more broken links
* better redirects
* unfancy catch
* fix LGTM error
* link fixes
* fix md issues
* Addl fixes
2019-08-20 21:48:59 -07:00
Victoria Lim
Peter Marshall
Charles Smith
Lucas Capistrant
Jihoon Son
sthetland
Charles Smith
Fullstop000
Gian Merlino
Rye
Chi Cao Minh