druid/docs/content/querying
Justin Borromeo ad7862c58a Time Ordering On Scans (#7133)
* Moved Scan Builder to Druids class and started on Scan Benchmark setup

* Need to form queries

* It runs.

* Stuff for time-ordered scan query

* Move ScanResultValue timestamp comparator to a separate class for testing

* Licensing stuff

* Change benchmark

* Remove todos

* Added TimestampComparator tests

* Change number of benchmark iterations

* Added time ordering to the scan benchmark

* Changed benchmark params

* More param changes

* Benchmark param change

* Made Jon's changes and removed TODOs

* Broke some long lines into two lines

* nit

* Decrease segment size for less memory usage

* Wrote tests for heapsort scan result values and fixed bug where iterator
wasn't returning elements in correct order

* Wrote more tests for scan result value sort

* Committing a param change to kick teamcity

* Fixed codestyle and forbidden API errors

* .

* Improved conciseness

* nit

* Created an error message for when someone tries to time order a result
set > threshold limit

* Set to spaces over tabs

* Fixing tests WIP

* Fixed failing calcite tests

* Kicking travis with change to benchmark param

* added all query types to scan benchmark

* Fixed benchmark queries

* Renamed sort function

* Added javadoc on ScanResultValueTimestampComparator

* Unused import

* Added more javadoc

* improved doc

* Removed unused import to satisfy PMD check

* Small changes

* Changes based on Gian's comments

* Fixed failing test due to null resultFormat

* Added config and get # of segments

* Set up time ordering strategy decision tree

* Refactor and pQueue works

* Cleanup

* Ordering is correct on n-way merge -> still need to batch events into
ScanResultValues

* WIP

* Sequence stuff is so dirty :(

* Fixed bug introduced by replacing deque with list

* Wrote docs

* Multi-historical setup works

* WIP

* Change so batching only occurs on broker for time-ordered scans

Restricted batching to broker for time-ordered queries and adjusted
tests

Formatting

Cleanup

* Fixed mistakes in merge

* Fixed failing tests

* Reset config

* Wrote tests and added Javadoc

* Nit-change on javadoc

* Checkstyle fix

* Improved test and appeased TeamCity

* Sorry, checkstyle

* Applied Jon's recommended changes

* Checkstyle fix

* Optimization

* Fixed tests

* Updated error message

* Added error message for UOE

* Renaming

* Finish rename

* Smarter limiting for pQueue method

* Optimized n-way merge strategy

* Rename segment limit -> segment partitions limit

* Added a bit of docs

* More comments

* Fix checkstyle and test

* Nit comment

* Fixed failing tests -> allow usage of all types of segment spec

* Fixed failing tests -> allow usage of all types of segment spec

* Revert "Fixed failing tests -> allow usage of all types of segment spec"

This reverts commit ec470288c7.

* Revert "Merge branch '6088-Time-Ordering-On-Scans-N-Way-Merge' of github.com:justinborromeo/incubator-druid into 6088-Time-Ordering-On-Scans-N-Way-Merge"

This reverts commit 57033f36df, reversing
changes made to 8f01d8dd16.

* Check type of segment spec before using for time ordering

* Fix bug in numRowsScanned

* Fix bug messing up count of rows

* Fix docs and flipped boolean in ScanQueryLimitRowIterator

* Refactor n-way merge

* Added test for n-way merge

* Refixed regression

* Checkstyle and doc update

* Modified sequence limit to accept longs and added test for long limits

* doc fix

* Implemented Clint's recommendations
2019-03-28 14:37:09 -07:00
..
aggregations.md Add missing redirects and fix broken links (#7213) 2019-03-09 15:16:23 -08:00
caching.md Further improve caching documentation. (#7236) 2019-03-11 17:57:00 -07:00
datasource.md Add master/data/query server concepts to docs/packaging (#6916) 2019-01-30 19:41:07 -08:00
datasourcemetadataquery.md Front Matter header needs to be on the first line for md to be rendered properly by jekyll (#6733) 2018-12-13 11:47:20 -08:00
dimensionspecs.md Add master/data/query server concepts to docs/packaging (#6916) 2019-01-30 19:41:07 -08:00
filters.md add version comparator for StringComparator (#6745) 2019-01-08 17:17:03 -08:00
granularities.md Front Matter header needs to be on the first line for md to be rendered properly by jekyll (#6733) 2018-12-13 11:47:20 -08:00
groupbyquery.md Reword 'node' to 'process' (#7172) 2019-02-28 18:10:39 -08:00
having.md Front Matter header needs to be on the first line for md to be rendered properly by jekyll (#6733) 2018-12-13 11:47:20 -08:00
hll-old.md Update approximate aggregators docs (#6848) 2019-01-11 21:50:51 -08:00
joins.md Front Matter header needs to be on the first line for md to be rendered properly by jekyll (#6733) 2018-12-13 11:47:20 -08:00
limitspec.md Front Matter header needs to be on the first line for md to be rendered properly by jekyll (#6733) 2018-12-13 11:47:20 -08:00
lookups.md Reword 'node' to 'process' (#7172) 2019-02-28 18:10:39 -08:00
multi-value-dimensions.md Front Matter header needs to be on the first line for md to be rendered properly by jekyll (#6733) 2018-12-13 11:47:20 -08:00
multitenancy.md Reword 'node' to 'process' (#7172) 2019-02-28 18:10:39 -08:00
post-aggregations.md Front Matter header needs to be on the first line for md to be rendered properly by jekyll (#6733) 2018-12-13 11:47:20 -08:00
query-context.md Further improve caching documentation. (#7236) 2019-03-11 17:57:00 -07:00
querying.md Added better QueryInterruptedException error message for UnsupportedOperationException (#7248) 2019-03-26 15:20:24 -07:00
scan-query.md Time Ordering On Scans (#7133) 2019-03-28 14:37:09 -07:00
searchquery.md Reword 'node' to 'process' (#7172) 2019-02-28 18:10:39 -08:00
searchqueryspec.md Front Matter header needs to be on the first line for md to be rendered properly by jekyll (#6733) 2018-12-13 11:47:20 -08:00
segmentmetadataquery.md Add master/data/query server concepts to docs/packaging (#6916) 2019-01-30 19:41:07 -08:00
select-query.md Fix broken link on select query doc page (#6933) 2019-01-28 17:02:21 -08:00
sorting-orders.md add version comparator for StringComparator (#6745) 2019-01-08 17:17:03 -08:00
sql.md Add column type to sys table docs (#7359) 2019-03-27 20:21:57 -07:00
timeboundaryquery.md Front Matter header needs to be on the first line for md to be rendered properly by jekyll (#6733) 2018-12-13 11:47:20 -08:00
timeseriesquery.md Front Matter header needs to be on the first line for md to be rendered properly by jekyll (#6733) 2018-12-13 11:47:20 -08:00
topnmetricspec.md Front Matter header needs to be on the first line for md to be rendered properly by jekyll (#6733) 2018-12-13 11:47:20 -08:00
topnquery.md Reword 'node' to 'process' (#7172) 2019-02-28 18:10:39 -08:00
virtual-columns.md Front Matter header needs to be on the first line for md to be rendered properly by jekyll (#6733) 2018-12-13 11:47:20 -08:00