9b499df14e
Fix ExpressionVirtualColumn capabilities; fix groupBy's improper uses of StorageAdapter#getColumnCapabilities. ( #8013 )
...
* GroupBy: Fix improper uses of StorageAdapter#getColumnCapabilities.
1) A usage in "isArrayAggregateApplicable" that would potentially incorrectly use
array-based aggregation on a virtual column that shadows a real column.
2) A usage in "process" that would potentially use the more expensive multi-value
aggregation path on a singly-valued virtual column. (No correctness issue, but
a performance issue.)
* Add addl javadoc.
* ExpressionVirtualColumn: Set multi-value flag.
2019-07-05 13:17:05 -07:00
0344a020bb
optimize single string dimension expression selector ( #8014 )
...
* optimize single string dimension expression selector
* more javadoc
* oops
* fix
* fix it
* import
2019-07-04 16:26:10 -07:00
42a7b8849a
remove FirehoseV2 and realtime node extensions ( #8020 )
...
* remove firehosev2 and realtime node extensions
* revert intellij stuff
* rat exclusion
2019-07-04 15:40:22 -07:00
613f09b45a
SQL: Add TIME_CEIL function. ( #8027 )
...
Also simplify conversions for CEIL, FLOOR, and TIME_FLOOR by allowing them to
share more code.
2019-07-04 15:40:03 -07:00
6760505a7e
fix FileUtils performance regression due to FilterOutputStream ( #8024 )
2019-07-04 08:41:17 -07:00
e6ba258197
multi-value string expression transformation fix ( #8019 )
...
* multi-value string expression transformation fix
* fixes
* more docs and test
* revert unintended doc change
* formatting
* change tostring to print binding identifier
* review fixup
* oops
2019-07-03 23:03:47 -07:00
685aeac8eb
CONTRIBUTING: Remove "keep the number of commits small" guidance. ( #8004 )
...
It is no longer really relevant in the world we have of committing
via merge-and-squash.
2019-07-03 11:53:41 -07:00
53a32b6f55
adjust PR template ( #8016 )
2019-07-03 08:31:31 -07:00
3b84246cd6
add SQL docs for multi-value string dimensions ( #8011 )
...
* add SQL docs for multi-value string dimensions
* formatting consistency
* fix typo
* adjust
2019-07-03 08:22:33 -07:00
c556d44a19
more sql support for expression array functions ( #7974 )
...
* more sql support for expression array functions
* prepend/slice
* doc fixes
* fix imports
* fix tests
* add null numeric expr for proper conversions between ExprEval and Expr and back to ExprEval
* re-arrange
* imports :(
* add append/prepend test
2019-07-02 21:39:26 -07:00
f7283378ac
remove deprecated standalone realtime node ( #7915 )
...
* remove CliRealtime, RealtimeManager, etc
* add redirects for deleted page to page that explains the deleted thing
* adjust docs
2019-07-02 18:12:17 -07:00
93b738bbfa
expression language array constructor and sql multi-value string filtering support ( #7973 )
...
* expr array constructor and sql multi-value string support
* doc fix
* checkstyle
* change from feedback
2019-07-01 15:14:50 -07:00
fb56f8d53c
Rename io.druid to org.druid in tdigestsketch extension ( #7996 )
...
* Rename io.druid to org.druid in tdigestsketch extension
* Fix typo
Signed-off-by: Khwunchai Jaengsawang <khwunchai.j@ku.th>
* Add packaging check for community extensions
Signed-off-by: Khwunchai Jaengsawang <khwunchai.j@ku.th>
2019-07-01 12:46:35 -07:00
3650eed1aa
Improve pull-deps reference in extensions page. ( #8002 )
2019-07-01 11:18:27 -07:00
4508d3ff55
Enable RCN_REDUNDANT_NULLCHECK_OF_NULL_VALUE ( #7972 )
2019-07-01 11:25:06 +05:30
e8dedb3de4
Enable MS_MUTABLE_COLLECTION_PKGPROTECT ( #7971 )
2019-07-01 11:24:05 +05:30
f16f13cf61
Web console: Improve data loader styling, enforce stricter TS types ( #8001 )
...
* add assets to auth exclude path
* add frame to tile page
* better empty filter state
* strict TS
* fix segments go to sql
* add unavailable segments
* factor out sugestable input
* fix tests
* update datasources sql
* no depricated extend
* add index spec to tuning configs
* fix scss lint
2019-06-30 19:33:16 -07:00
2831944056
support NVL sql function ( #7965 )
...
* sql nvl
* add nvl in sql doc
2019-06-30 13:14:30 -07:00
6395c08309
Bump commons-codec from 1.7 to 1.12 ( #7995 )
2019-06-29 07:40:19 -07:00
f1270c14f8
Web-Console: add clipboard modal ( #7964 )
...
* add clipboard modal
* rename button
* remove console.log
* fix off by one
* update tests
* update snapshot
* fix casing
* update snapshot
2019-06-28 15:50:18 -07:00
8788849bab
Bump commons-validator from 1.4.0 to 1.5.1 ( #7987 )
2019-06-27 22:00:49 -07:00
f148249f64
Fix wrong redirect for orc extension ( #7983 )
2019-06-27 16:27:08 -07:00
f38a62e949
theta sketch to string post agg ( #7937 )
2019-06-27 15:09:57 -07:00
ad45ef12ed
fix SQL doc comment ( #7981 )
2019-06-27 15:05:45 -07:00
c4aaf26797
Add missing redirect for ORC extension document ( #7979 )
2019-06-27 14:23:44 -07:00
c6baa59f77
Enable DLS_DEAD_LOCAL_STORE ( #7967 )
2019-06-28 04:39:42 +08:00
fba91b77d0
InterruptedException is never thrown ( #7963 )
...
And therefore the block will always be false
2019-06-27 22:21:36 +05:30
10d6b0318d
clarify granularity docs ( #7977 )
2019-06-27 08:51:22 -07:00
7a5bc5ffcd
Bump jaxb-api from 2.3.0 to 2.3.1 ( #7978 )
2019-06-27 08:51:00 -07:00
46ea5b88b7
Add the pull-request template ( #7206 )
...
* Add the pull-request template
* Rewording
* Replaced checklist link, added Rat exclusion
* Update the PR template. Add Concurrency Checklist to the repository
* Merge Description and Design sections. Softer language. Removed requirement to test in production environment. Added a committer's instruction to justify addition of meta tags.
* Rephrase item about comments
* Add license header
* Add item to concurrency checklist
2019-06-27 15:51:25 +03:00
151edeec3c
expression virtual column selector fix for expressions which produce array types ( #7958 )
...
* fix bug in multi-value string expression column selector
* more test
* imports!!
* fixes
2019-06-26 16:57:13 -07:00
5464c8938f
Add array_slice and array_unshift function expr ( #7950 )
...
* add array_slice and array_unshift function expr
* feedback address
2019-06-26 16:56:09 -07:00
d677c83ce4
Web console: Power up the data loader init step ( #7947 )
...
* Power up the data loader init step
* update snapshot
* normalize spec
* allow deselect
* added HDFS tile
* update border style
* text updates
* goodies
* new reset icon
2019-06-26 15:50:48 -07:00
bc1413e4e3
Bump commons-cli from 1.2 to 1.3.1 ( #7966 )
2019-06-26 08:05:13 -07:00
a171b4a399
Web-console: Add action column to segments view ( #7954 )
...
* add actions column to segments view
* add sements action column
2019-06-25 20:14:06 -07:00
9d925f5086
Adjust NOTICE files ( #7945 )
...
* Adjust NOTICE files
* remove commons-logging
* Remove lucene from derby
* more adjustment
2019-06-25 09:08:54 -07:00
b9c6a26c0e
Use ComplexMetrics.registerSerde() across the codebase ( #7925 )
...
* refactor complexmetric registerserde
* fix error
* feedback address
2019-06-25 11:39:04 +03:00
16aafd5788
[ImgBot] Optimize images ( #7873 )
...
*Total -- 10,997.25kb -> 7,160.16kb (34.89%)
/publications/radstack/figures/precompute.png -- 54.20kb -> 16.97kb (68.69%)
/web-console/favicon.png -- 4.41kb -> 1.61kb (63.58%)
/docs/img/indexing_service.png -- 47.37kb -> 21.96kb (53.64%)
/docs/img/segmentPropagation.png -- 62.94kb -> 29.85kb (52.57%)
/docs/content/tutorials/img/tutorial-quickstart-01.png -- 55.62kb -> 29.13kb (47.62%)
/docs/content/tutorials/img/tutorial-deletion-02.png -- 791.43kb -> 429.30kb (45.76%)
/docs/content/tutorials/img/tutorial-deletion-03.png -- 786.79kb -> 427.05kb (45.72%)
/docs/content/tutorials/img/tutorial-retention-00.png -- 135.06kb -> 75.88kb (43.82%)
/docs/content/tutorials/img/tutorial-batch-data-loader-10.png -- 77.23kb -> 43.47kb (43.71%)
/docs/content/tutorials/img/tutorial-batch-data-loader-01.png -- 97.03kb -> 55.16kb (43.15%)
/docs/content/tutorials/img/tutorial-batch-data-loader-07.png -- 79.49kb -> 45.44kb (42.84%)
/docs/content/tutorials/img/tutorial-retention-02.png -- 401.30kb -> 234.68kb (41.52%)
/docs/content/tutorials/img/tutorial-compaction-06.png -- 343.27kb -> 201.87kb (41.19%)
/docs/content/tutorials/img/tutorial-batch-data-loader-09.png -- 105.14kb -> 61.86kb (41.16%)
/docs/content/tutorials/img/tutorial-retention-06.png -- 227.57kb -> 134.35kb (40.97%)
/docs/content/tutorials/img/tutorial-compaction-04.png -- 304.83kb -> 180.04kb (40.94%)
/docs/content/tutorials/img/tutorial-compaction-02.png -- 273.18kb -> 162.67kb (40.45%)
/docs/content/tutorials/img/tutorial-query-05.png -- 85.03kb -> 50.64kb (40.44%)
/publications/radstack/figures/druid_vs_bigquery.png -- 155.44kb -> 92.85kb (40.27%)
/docs/content/tutorials/img/tutorial-kafka-02.png -- 122.51kb -> 73.93kb (39.65%)
/docs/content/tutorials/img/tutorial-deletion-01.png -- 70.37kb -> 42.56kb (39.52%)
/docs/content/tutorials/img/tutorial-batch-data-loader-06.png -- 103.50kb -> 62.79kb (39.33%)
/docs/content/tutorials/img/tutorial-batch-submit-task-01.png -- 111.25kb -> 67.73kb (39.12%)
/docs/content/tutorials/img/tutorial-query-03.png -- 103.60kb -> 63.51kb (38.69%)
/docs/content/tutorials/img/tutorial-query-04.png -- 105.79kb -> 64.87kb (38.69%)
/docs/content/tutorials/img/tutorial-batch-data-loader-11.png -- 130.20kb -> 81.34kb (37.53%)
/docs/content/tutorials/img/tutorial-query-07.png -- 122.52kb -> 76.79kb (37.32%)
/docs/content/tutorials/img/tutorial-kafka-01.png -- 133.12kb -> 83.47kb (37.3%)
/docs/content/tutorials/img/tutorial-query-06.png -- 127.55kb -> 80.28kb (37.06%)
/docs/content/tutorials/img/tutorial-batch-submit-task-02.png -- 133.07kb -> 84.06kb (36.83%)
/docs/content/tutorials/img/tutorial-retention-05.png -- 60.19kb -> 38.08kb (36.74%)
/docs/content/tutorials/img/tutorial-batch-data-loader-03.png -- 211.92kb -> 134.22kb (36.66%)
/docs/content/tutorials/img/tutorial-batch-data-loader-05.png -- 250.36kb -> 158.68kb (36.62%)
/publications/radstack/figures/radstack.png -- 16.80kb -> 10.67kb (36.48%)
/docs/content/tutorials/img/tutorial-batch-data-loader-08.png -- 158.59kb -> 101.49kb (36%)
/docs/content/tutorials/img/tutorial-batch-data-loader-04.png -- 255.10kb -> 163.33kb (35.97%)
/docs/content/tutorials/img/tutorial-query-02.png -- 126.92kb -> 81.42kb (35.85%)
/docs/content/tutorials/img/tutorial-compaction-01.png -- 53.86kb -> 34.87kb (35.25%)
/docs/img/druid-architecture.png -- 202.23kb -> 130.97kb (35.24%)
/docs/content/tutorials/img/tutorial-retention-01.png -- 52.69kb -> 34.35kb (34.81%)
/docs/img/druid-timeline.png -- 35.87kb -> 23.59kb (34.22%)
/docs/content/tutorials/img/tutorial-query-01.png -- 149.53kb -> 98.56kb (34.08%)
/docs/content/tutorials/img/tutorial-retention-04.png -- 65.91kb -> 43.57kb (33.89%)
/docs/content/tutorials/img/tutorial-compaction-08.png -- 42.24kb -> 28.08kb (33.53%)
/docs/content/tutorials/img/tutorial-compaction-07.png -- 39.17kb -> 26.06kb (33.47%)
/docs/content/tutorials/img/tutorial-compaction-03.png -- 39.17kb -> 26.13kb (33.3%)
/docs/content/tutorials/img/tutorial-compaction-05.png -- 38.85kb -> 25.96kb (33.17%)
/publications/demo/figures/throughput_vs_cardinality.png -- 73.49kb -> 49.31kb (32.9%)
/publications/radstack/figures/throughput_vs_cardinality.png -- 73.49kb -> 49.31kb (32.9%)
/publications/whitepaper/figures/throughput_vs_cardinality.png -- 73.49kb -> 49.31kb (32.9%)
/docs/content/tutorials/img/tutorial-retention-03.png -- 43.11kb -> 29.33kb (31.97%)
/publications/radstack/figures/throughput_vs_num_dims.png -- 72.86kb -> 49.72kb (31.76%)
/publications/whitepaper/figures/throughput_vs_num_dims.png -- 72.86kb -> 49.72kb (31.76%)
/publications/demo/figures/throughput_vs_num_dims.png -- 72.86kb -> 49.72kb (31.76%)
/publications/radstack/figures/joined.png -- 164.14kb -> 113.47kb (30.87%)
/docs/content/tutorials/img/tutorial-batch-data-loader-02.png -- 508.93kb -> 351.85kb (30.87%)
/publications/radstack/figures/imps_clicks.png -- 190.95kb -> 132.70kb (30.51%)
/publications/radstack/figures/shuffled.png -- 180.46kb -> 128.21kb (28.95%)
/publications/radstack/figures/pipeline.png -- 392.54kb -> 281.93kb (28.18%)
/docs/img/druid-manage-1.png -- 108.94kb -> 78.53kb (27.92%)
/publications/radstack/figures/throughput_vs_num_metrics.png -- 85.25kb -> 61.80kb (27.51%)
/publications/demo/figures/throughput_vs_num_metrics.png -- 85.25kb -> 61.80kb (27.51%)
/publications/whitepaper/figures/throughput_vs_num_metrics.png -- 85.25kb -> 61.80kb (27.51%)
/docs/img/druid-production.png -- 50.00kb -> 39.18kb (21.63%)
/docs/img/druid-dataflow-3.png -- 88.25kb -> 69.75kb (20.96%)
/publications/demo/figures/realtime_flow.png -- 51.12kb -> 40.61kb (20.56%)
/publications/demo/figures/realtime_timeline.png -- 36.15kb -> 29.24kb (19.12%)
/publications/demo/figures/tpch_scaling.png -- 43.21kb -> 34.97kb (19.08%)
/publications/demo/figures/caching.png -- 35.26kb -> 29.09kb (17.49%)
/dev/intellij-sdk-config.jpg -- 1,019.35kb -> 864.37kb (15.2%)
/docs/img/druid-column-types.png -- 101.53kb -> 91.17kb (10.2%)
/docs/img/druid-dataflow-2x.png -- 138.30kb -> 127.11kb (8.09%)
2019-06-24 21:27:48 -07:00
cd01a48eab
Web-console: add timed button ( #7912 )
...
* add refresh button
* update snapshots
* fix spacing
* add supervisors button
* modify query manager
* add icon
* update snapshots
* fix space
* stop refreshing when option selected
* small fixes
* add default value
* fix spelling mistake
* fix query-input
* rename class
2019-06-24 21:18:19 -07:00
6cc8802b8e
#7875 : Setting ACL on S3 task logs on similar lines as that of data segments pushed to S3 ( #7907 )
...
* #7875 : Setting ACL on S3 task logs on similar lines as that of data segment pushed to S3
* #7875 1. Extracting a method (which uploads a file to S3 setting appropriate access control list to the file being uploaded) and moving it to utils class. 2. Adding S3TaskLogsTest.java file to test acl (permissions) on the task log files pushed to S3.
* fixing checkstyle errors
* #7875 Incorporating review comments
2019-06-24 17:25:59 -06:00
0d5fbfa0eb
Add missing license pointer for Porter Stemmer ( #7941 )
...
* Add missing license pointer for Porter Stemmer
* add missing file
2019-06-24 12:21:40 -07:00
82b248cc17
Spotbugs: Enable MS_SHOULD_BE_FINAL ( #7946 )
2019-06-23 15:42:18 -07:00
35601bb7a0
Add finalizeAsBase64Binary option to FixedBucketsHistogramAggregatorFactory ( #7784 )
...
* Add finalizeAsBase64Binary option to FixedBucketsHistogramAggregatorFactory
* Add finalizeAsBase64Binary option to ApproximateHistogramFactory
* Update approx histogram doc
2019-06-21 18:00:19 -07:00
6c8f9482c7
Web console: prettier code ( #7939 )
...
* prettier code
* update tests
* scss also
* more ,
* update pachage json prettier config
2019-06-21 16:52:33 -07:00
183d5be7ec
fix spotbugs failure in Expr.java ( #7944 )
2019-06-21 14:49:22 -07:00
2bc8e7c0e8
more acurate keyword auto complete ( #7934 )
2019-06-20 21:14:54 -07:00
d046d5aa8d
Stalebot config adjustments. ( #7936 )
...
* Stalebot config adjustments.
- Different wordings for PRs and issues.
- Extend stale timeout for issues.
- Exempt "Proposal" label.
- Exempt issues in projects and issues with assignees.
* Fix copy/paste error.
2019-06-20 14:16:57 -07:00
ceade03213
Enable stalebot for issues ( #7927 )
...
* Enable stalebot for issues
* fix comments
* fix comments
* fix comments
2019-06-20 11:09:40 -07:00
48f20fe754
Add Spotbugs ( #7894 )
...
* Add Spotbugs
Exclude all the issues for now, so we can add them one by one.
(cherry picked from commit ceda4754dc8c703d1e0de85b48cd5f5409cfd5b7)
* Add additional rules to the list
* More rules
* More rules
* Add comments to the xml
* Move the spotbugs-exclude.xml to codestyle/
2019-06-20 21:06:52 +03:00
494b8ebe56
multi-value string column support for expressions ( #7588 )
...
* array support for expression language for multi-value string columns
* fix tests?
* fixes
* more tests
* fixes
* cleanup
* more better, more test
* ignore inspection
* license
* license fix
* inspection
* remove dumb import
* more better
* some comments
* add expr rewrite for arrayfn args for more magic, tests
* test stuff
* more tests
* fix test
* fix test
* castfunc can deal with arrays
* needs more empty array
* more tests, make cast to long array more forgiving
* refactor
* simplify ExprMacro Expr implementations with base classes in core
* oops
* more test
* use Shuttle for Parser.flatten, javadoc, cleanup
* fixes and more tests
* unused import
* fixes
* javadocs, cleanup, refactors
* fix imports
* more javadoc
* more javadoc
* more
* more javadocs, nonnullbydefault, minor refactor
* markdown fix
* adjustments
* more doc
* move initial filter out
* docs
* map empty arg lambda, apply function argument validation
* check function args at parse time instead of eval time
* more immutable
* more more immutable
* clarify grammar
* fix docs
* empty array is string test, we need a way to make arrays better maybe in the future, or define empty arrays as other types..
2019-06-19 13:57:37 -07:00
Gian Merlino
Clint Wylie
Himanshu
Khwunchai Jaengsawang
Eyal Yurman
Fokko Driesprong
Vadim Ogievetsky
Xue Yu
Benedict Jin
mcbrewster
Jihoon Son
Alexander Saydakov
Fokko Driesprong
Roman Leventov
Sashidhar Thallam
Jonathan Wei
Gian Merlino
Fangjin Yang
Clint Wylie