Clint Wylie
f7283378ac
remove deprecated standalone realtime node ( #7915 )
...
* remove CliRealtime, RealtimeManager, etc
* add redirects for deleted page to page that explains the deleted thing
* adjust docs
2019-07-02 18:12:17 -07:00
Clint Wylie
93b738bbfa
expression language array constructor and sql multi-value string filtering support ( #7973 )
...
* expr array constructor and sql multi-value string support
* doc fix
* checkstyle
* change from feedback
2019-07-01 15:14:50 -07:00
Eyal Yurman
3650eed1aa
Improve pull-deps reference in extensions page. ( #8002 )
2019-07-01 11:18:27 -07:00
Xue Yu
2831944056
support NVL sql function ( #7965 )
...
* sql nvl
* add nvl in sql doc
2019-06-30 13:14:30 -07:00
Jihoon Son
f148249f64
Fix wrong redirect for orc extension ( #7983 )
2019-06-27 16:27:08 -07:00
Alexander Saydakov
f38a62e949
theta sketch to string post agg ( #7937 )
2019-06-27 15:09:57 -07:00
Vadim Ogievetsky
ad45ef12ed
fix SQL doc comment ( #7981 )
2019-06-27 15:05:45 -07:00
Jihoon Son
c4aaf26797
Add missing redirect for ORC extension document ( #7979 )
2019-06-27 14:23:44 -07:00
Clint Wylie
10d6b0318d
clarify granularity docs ( #7977 )
2019-06-27 08:51:22 -07:00
Xue Yu
5464c8938f
Add array_slice and array_unshift function expr ( #7950 )
...
* add array_slice and array_unshift function expr
* feedback address
2019-06-26 16:56:09 -07:00
Benedict Jin
16aafd5788
[ImgBot] Optimize images ( #7873 )
...
*Total -- 10,997.25kb -> 7,160.16kb (34.89%)
/publications/radstack/figures/precompute.png -- 54.20kb -> 16.97kb (68.69%)
/web-console/favicon.png -- 4.41kb -> 1.61kb (63.58%)
/docs/img/indexing_service.png -- 47.37kb -> 21.96kb (53.64%)
/docs/img/segmentPropagation.png -- 62.94kb -> 29.85kb (52.57%)
/docs/content/tutorials/img/tutorial-quickstart-01.png -- 55.62kb -> 29.13kb (47.62%)
/docs/content/tutorials/img/tutorial-deletion-02.png -- 791.43kb -> 429.30kb (45.76%)
/docs/content/tutorials/img/tutorial-deletion-03.png -- 786.79kb -> 427.05kb (45.72%)
/docs/content/tutorials/img/tutorial-retention-00.png -- 135.06kb -> 75.88kb (43.82%)
/docs/content/tutorials/img/tutorial-batch-data-loader-10.png -- 77.23kb -> 43.47kb (43.71%)
/docs/content/tutorials/img/tutorial-batch-data-loader-01.png -- 97.03kb -> 55.16kb (43.15%)
/docs/content/tutorials/img/tutorial-batch-data-loader-07.png -- 79.49kb -> 45.44kb (42.84%)
/docs/content/tutorials/img/tutorial-retention-02.png -- 401.30kb -> 234.68kb (41.52%)
/docs/content/tutorials/img/tutorial-compaction-06.png -- 343.27kb -> 201.87kb (41.19%)
/docs/content/tutorials/img/tutorial-batch-data-loader-09.png -- 105.14kb -> 61.86kb (41.16%)
/docs/content/tutorials/img/tutorial-retention-06.png -- 227.57kb -> 134.35kb (40.97%)
/docs/content/tutorials/img/tutorial-compaction-04.png -- 304.83kb -> 180.04kb (40.94%)
/docs/content/tutorials/img/tutorial-compaction-02.png -- 273.18kb -> 162.67kb (40.45%)
/docs/content/tutorials/img/tutorial-query-05.png -- 85.03kb -> 50.64kb (40.44%)
/publications/radstack/figures/druid_vs_bigquery.png -- 155.44kb -> 92.85kb (40.27%)
/docs/content/tutorials/img/tutorial-kafka-02.png -- 122.51kb -> 73.93kb (39.65%)
/docs/content/tutorials/img/tutorial-deletion-01.png -- 70.37kb -> 42.56kb (39.52%)
/docs/content/tutorials/img/tutorial-batch-data-loader-06.png -- 103.50kb -> 62.79kb (39.33%)
/docs/content/tutorials/img/tutorial-batch-submit-task-01.png -- 111.25kb -> 67.73kb (39.12%)
/docs/content/tutorials/img/tutorial-query-03.png -- 103.60kb -> 63.51kb (38.69%)
/docs/content/tutorials/img/tutorial-query-04.png -- 105.79kb -> 64.87kb (38.69%)
/docs/content/tutorials/img/tutorial-batch-data-loader-11.png -- 130.20kb -> 81.34kb (37.53%)
/docs/content/tutorials/img/tutorial-query-07.png -- 122.52kb -> 76.79kb (37.32%)
/docs/content/tutorials/img/tutorial-kafka-01.png -- 133.12kb -> 83.47kb (37.3%)
/docs/content/tutorials/img/tutorial-query-06.png -- 127.55kb -> 80.28kb (37.06%)
/docs/content/tutorials/img/tutorial-batch-submit-task-02.png -- 133.07kb -> 84.06kb (36.83%)
/docs/content/tutorials/img/tutorial-retention-05.png -- 60.19kb -> 38.08kb (36.74%)
/docs/content/tutorials/img/tutorial-batch-data-loader-03.png -- 211.92kb -> 134.22kb (36.66%)
/docs/content/tutorials/img/tutorial-batch-data-loader-05.png -- 250.36kb -> 158.68kb (36.62%)
/publications/radstack/figures/radstack.png -- 16.80kb -> 10.67kb (36.48%)
/docs/content/tutorials/img/tutorial-batch-data-loader-08.png -- 158.59kb -> 101.49kb (36%)
/docs/content/tutorials/img/tutorial-batch-data-loader-04.png -- 255.10kb -> 163.33kb (35.97%)
/docs/content/tutorials/img/tutorial-query-02.png -- 126.92kb -> 81.42kb (35.85%)
/docs/content/tutorials/img/tutorial-compaction-01.png -- 53.86kb -> 34.87kb (35.25%)
/docs/img/druid-architecture.png -- 202.23kb -> 130.97kb (35.24%)
/docs/content/tutorials/img/tutorial-retention-01.png -- 52.69kb -> 34.35kb (34.81%)
/docs/img/druid-timeline.png -- 35.87kb -> 23.59kb (34.22%)
/docs/content/tutorials/img/tutorial-query-01.png -- 149.53kb -> 98.56kb (34.08%)
/docs/content/tutorials/img/tutorial-retention-04.png -- 65.91kb -> 43.57kb (33.89%)
/docs/content/tutorials/img/tutorial-compaction-08.png -- 42.24kb -> 28.08kb (33.53%)
/docs/content/tutorials/img/tutorial-compaction-07.png -- 39.17kb -> 26.06kb (33.47%)
/docs/content/tutorials/img/tutorial-compaction-03.png -- 39.17kb -> 26.13kb (33.3%)
/docs/content/tutorials/img/tutorial-compaction-05.png -- 38.85kb -> 25.96kb (33.17%)
/publications/demo/figures/throughput_vs_cardinality.png -- 73.49kb -> 49.31kb (32.9%)
/publications/radstack/figures/throughput_vs_cardinality.png -- 73.49kb -> 49.31kb (32.9%)
/publications/whitepaper/figures/throughput_vs_cardinality.png -- 73.49kb -> 49.31kb (32.9%)
/docs/content/tutorials/img/tutorial-retention-03.png -- 43.11kb -> 29.33kb (31.97%)
/publications/radstack/figures/throughput_vs_num_dims.png -- 72.86kb -> 49.72kb (31.76%)
/publications/whitepaper/figures/throughput_vs_num_dims.png -- 72.86kb -> 49.72kb (31.76%)
/publications/demo/figures/throughput_vs_num_dims.png -- 72.86kb -> 49.72kb (31.76%)
/publications/radstack/figures/joined.png -- 164.14kb -> 113.47kb (30.87%)
/docs/content/tutorials/img/tutorial-batch-data-loader-02.png -- 508.93kb -> 351.85kb (30.87%)
/publications/radstack/figures/imps_clicks.png -- 190.95kb -> 132.70kb (30.51%)
/publications/radstack/figures/shuffled.png -- 180.46kb -> 128.21kb (28.95%)
/publications/radstack/figures/pipeline.png -- 392.54kb -> 281.93kb (28.18%)
/docs/img/druid-manage-1.png -- 108.94kb -> 78.53kb (27.92%)
/publications/radstack/figures/throughput_vs_num_metrics.png -- 85.25kb -> 61.80kb (27.51%)
/publications/demo/figures/throughput_vs_num_metrics.png -- 85.25kb -> 61.80kb (27.51%)
/publications/whitepaper/figures/throughput_vs_num_metrics.png -- 85.25kb -> 61.80kb (27.51%)
/docs/img/druid-production.png -- 50.00kb -> 39.18kb (21.63%)
/docs/img/druid-dataflow-3.png -- 88.25kb -> 69.75kb (20.96%)
/publications/demo/figures/realtime_flow.png -- 51.12kb -> 40.61kb (20.56%)
/publications/demo/figures/realtime_timeline.png -- 36.15kb -> 29.24kb (19.12%)
/publications/demo/figures/tpch_scaling.png -- 43.21kb -> 34.97kb (19.08%)
/publications/demo/figures/caching.png -- 35.26kb -> 29.09kb (17.49%)
/dev/intellij-sdk-config.jpg -- 1,019.35kb -> 864.37kb (15.2%)
/docs/img/druid-column-types.png -- 101.53kb -> 91.17kb (10.2%)
/docs/img/druid-dataflow-2x.png -- 138.30kb -> 127.11kb (8.09%)
2019-06-24 21:27:48 -07:00
Jonathan Wei
35601bb7a0
Add finalizeAsBase64Binary option to FixedBucketsHistogramAggregatorFactory ( #7784 )
...
* Add finalizeAsBase64Binary option to FixedBucketsHistogramAggregatorFactory
* Add finalizeAsBase64Binary option to ApproximateHistogramFactory
* Update approx histogram doc
2019-06-21 18:00:19 -07:00
Clint Wylie
494b8ebe56
multi-value string column support for expressions ( #7588 )
...
* array support for expression language for multi-value string columns
* fix tests?
* fixes
* more tests
* fixes
* cleanup
* more better, more test
* ignore inspection
* license
* license fix
* inspection
* remove dumb import
* more better
* some comments
* add expr rewrite for arrayfn args for more magic, tests
* test stuff
* more tests
* fix test
* fix test
* castfunc can deal with arrays
* needs more empty array
* more tests, make cast to long array more forgiving
* refactor
* simplify ExprMacro Expr implementations with base classes in core
* oops
* more test
* use Shuttle for Parser.flatten, javadoc, cleanup
* fixes and more tests
* unused import
* fixes
* javadocs, cleanup, refactors
* fix imports
* more javadoc
* more javadoc
* more
* more javadocs, nonnullbydefault, minor refactor
* markdown fix
* adjustments
* more doc
* move initial filter out
* docs
* map empty arg lambda, apply function argument validation
* check function args at parse time instead of eval time
* more immutable
* more more immutable
* clarify grammar
* fix docs
* empty array is string test, we need a way to make arrays better maybe in the future, or define empty arrays as other types..
2019-06-19 13:57:37 -07:00
Clint Wylie
71997c16a2
switch links from druid.io to druid.apache.org ( #7914 )
...
* switch links from druid.io to druid.apache.org
* fix it
2019-06-18 09:06:27 -07:00
Vadim Ogievetsky
24dd4573da
Added the web console to the quickstart tutorials and docs ( #7863 )
...
* added console to the quickstart tutorials
* feedback fixes
* feedback fixes
* more typo fixes
* moved reseting cluster section after load data
* update images
* stage -> step
* feedback fixes
* more feedback fixes
2019-06-17 18:00:54 -07:00
Himanshu
b3328b2785
endpoint to delete lookup tier and remove tier on last lookup deletion ( #7852 )
2019-06-15 17:55:50 -07:00
Justin Borromeo
8e5003b01c
Scan Doc Change ( #7903 )
2019-06-15 01:21:34 -07:00
Jihoon Son
3cd9a7507d
Fix script for dependencies report for extensions ( #7899 )
2019-06-14 18:53:50 -07:00
Jihoon Son
a648e1548d
Add support of --exclude-extension argument for dependency report script ( #7786 )
2019-06-14 15:18:59 -07:00
Xue Yu
456a3654ce
add PolygonBound and missing extentions list doc ( #7885 )
2019-06-13 12:03:58 -07:00
Clint Wylie
8117222da3
use right port for kafka tutorial, reinfoce that tutorials assume you are using micro-quickstart single-server configuration ( #7862 )
2019-06-11 08:50:52 -07:00
Xue Yu
ce591d1457
Support var_pop, var_samp, stddev_pop and stddev_samp etc in sql ( #7801 )
...
* support var_pop, stddev_pop etc in sql
* fix sql compatible
* rebase on master
* update doc
2019-06-10 09:40:09 -07:00
Clint Wylie
3fbb0a5e00
Supervisor list api with states and health ( #7839 )
...
* allow optionally listing all supervisors with their state and health
* docs
* add state to full
* clean
* casing
* format
* spelling
2019-06-07 16:26:33 -07:00
Jihoon Son
61ec521135
Remove keepSegmentGranularity option for compaction ( #7747 )
...
* Remove keepSegmentGranularity option from compaction
* fix it test
* clean up
* remove from web console
* fix test
2019-06-03 12:59:15 -07:00
Jihoon Son
e289820bbd
Add a script to find missing backports ( #7817 )
2019-06-03 07:56:52 -07:00
Eyal Yurman
69e9b8a464
Enables SQL by default. ( #7808 )
2019-05-31 20:53:42 -07:00
Justin Borromeo
8032c4add8
Add errors and state to stream supervisor status API endpoint ( #7428 )
...
* Add state and error tracking for seekable stream supervisors
* Fixed nits in docs
* Made inner class static and updated spec test with jackson inject
* Review changes
* Remove redundant config param in supervisor
* Style
* Applied some of Jon's recommendations
* Add transience field
* write test
* implement code review changes except for reconsidering logic of markRunFinishedAndEvaluateHealth()
* remove transience reporting and fix SeekableStreamSupervisorStateManager impl
* move call to stateManager.markRunFinished() from RunNotice to runInternal() for tests
* remove stateHistory because it wasn't adding much value, some fixes, and add more tests
* fix tests
* code review changes and add HTTP health check status
* fix test failure
* refactor to split into a generic SupervisorStateManager and a specific SeekableStreamSupervisorStateManager
* fixup after merge
* code review changes - add additional docs
* cleanup KafkaIndexTaskTest
* add additional documentation for Kinesis indexing
* remove unused throws class
2019-05-31 17:16:01 -07:00
Jonathan Wei
83152a7a00
Fix performance-faq and remove insert-segment-to-db redirects ( #7759 )
2019-05-24 13:20:02 -07:00
Jonathan Wei
cfb7756c9b
Fix references to removed performance FAQ page ( #7755 )
2019-05-24 11:52:40 -07:00
Jonathan Wei
eb0e1a056c
Add limit to timeseries docs ( #7750 )
2019-05-23 19:41:52 -07:00
Jonathan Wei
f2e34a76bd
Fix TOC clustering example link ( #7749 )
2019-05-23 19:41:27 -07:00
Jonathan Wei
ec4d09a02f
Remove obsolete isExcluded config from Kerberos authenticator ( #7745 )
2019-05-23 16:00:05 -07:00
awelsh93
6964ac23a2
Adding influxdb emitter as a contrib extension ( #7717 )
...
* Adding influxdb emitter as a contrib extension
* addressing code review comments
2019-05-23 11:11:48 -07:00
Fangjin Yang
3dec5cd1e4
reorganizing the ToC ( #7734 )
2019-05-23 09:24:38 -07:00
gocho1
bd899b9224
add s3 authentication method informations ( #7674 )
...
* add s3 authentication method informations
* add druid.s3.fileSessionCredentials related content
* remove authentication parameters to avoid confusion as it is more detailed in S3 Deep Storage page
* streamline s3 docs
2019-05-22 11:46:02 -07:00
Gian Merlino
cbbce955de
SQL: Allow NULLs in place of optional arguments in many functions. ( #7709 )
...
* SQL: Allow NULLs in place of optional arguments in many functions.
Also adjust SQL docs to describe how to make time literals using
TIME_PARSE (which is now possible in a nicer way).
* Be less forbidden.
2019-05-21 11:54:34 -07:00
Gian Merlino
b6941551ae
Upgrade various build and doc links to https. ( #7722 )
...
* Upgrade various build and doc links to https.
Where it wasn't possible to upgrade build-time dependencies to https,
I kept http in place but used hardcoded checksums or GPG keys to ensure
that artifacts fetched over http are verified properly.
* Switch to https://apache.org .
2019-05-21 11:30:14 -07:00
Xue Yu
dd7dace70a
Add TIMESTAMPDIFF sql support ( #7695 )
...
* add timestampdiff sql support
* feedback address
2019-05-21 08:05:38 -07:00
Vadim Ogievetsky
156322932f
Update Druid Console docs for 0.15.0 ( #7697 )
...
* Update Druid Console docs for 0.15.0
* SQL -> query
* added links and fix typos
2019-05-21 04:00:42 -07:00
andrewluotechnologies
1add566411
Fix typo (ComplexMetricSerde class name was spelled incorrectly) ( #7694 )
2019-05-19 09:49:54 -07:00
Jihoon Son
94721de141
Add auto tagging milestone script ( #7677 )
...
* Add auto tagging milestone script
* fix usage
* missing newline
* missing newline
2019-05-16 23:11:16 -07:00
Clint Wylie
939b417379
Update tutorial-kafka.md ( #7678 )
2019-05-16 23:10:45 -07:00
Jonathan Wei
d99f77a01b
Add option to use YARN RM as fallback for JobHistory failure ( #7673 )
...
* Add option to use YARN RM as fallback for job status
* PR comments
2019-05-16 13:59:10 -07:00
Fangjin Yang
dc85a5309e
some more doc improvements ( #7675 )
2019-05-16 13:17:21 -07:00
Jonathan Wei
d667655871
Add basic tuning guide, getting started page, updated clustering docs ( #7629 )
...
* Add basic tuning guide, getting started page, updated clustering docs
* Add note about caching, fix tutorial paths
* Adjust hadoop wording
* Add license
* Tweak
* Shrink overlord heaps, fix tutorial urls
* Tweak xlarge peon, update peon sizing
* Update Data peon buffer size
* Fix cluster start scripts
* Add upper level _common to classpath
* Fix cluster data/query confs
* Address PR comments
* Elaborate on connection pools
* PR comments
* Increase druid.broker.http.maxQueuedBytes
* Add guidelines for broker backpressure
* PR comments
2019-05-16 11:13:48 -07:00
Benedict Jin
3df364c472
Fix broken links in api-reference.md ( #7670 )
2019-05-15 18:53:34 -07:00
Clint Wylie
c2abbc24a7
minor web console doc fixes ( #7668 )
2019-05-15 18:52:51 -07:00
Surekha
d3545f5086
Show all server types in sys.servers table ( #7654 )
...
* update sys.servers table to show all servers
* update docs
* Fix integration test
* modify test query for batch integration test
* fix case in test queries
* make the server_type lowercase
* Apply suggestions from code review
Co-Authored-By: Himanshu <g.himanshu@gmail.com>
* Fix compilation from git suggestion
* fix unit test
2019-05-15 16:54:02 -07:00
Gian Merlino
0352f450d7
Fix broken links in docs, add broken link checker. ( #7658 )
...
Also adds back insert-segment-to-db.md with some docs about why and
when it was removed (in #6911 ).
2019-05-15 14:49:50 -07:00
Surekha
917106985f
Update tutorial to delete data ( #7577 )
...
* Update tutorial to delete data
* update tutorial, remove old ways to drop data
* PR comments
2019-05-15 14:40:06 -07:00