Benedict Jin
e1f94a5e26
Reduce the size of images with lossless compression ( #8358 )
2019-08-21 13:29:30 -07:00
Gian Merlino
d007477742
Docusaurus build framework + ingestion doc refresh. ( #8311 )
...
* Docusaurus build framework + ingestion doc refresh.
* stick to npm instead of yarn
* fix typos
* restore some _bin
* Adjustments.
* detect and fix redirect anchors
* update anchor lint
* Web-console: remove specific column filters (#8343 )
* add clear filter
* update tool kit
* remove usless check
* auto run
* add %
* Fix resource leak (#8337 )
* Fix resource leak
* Patch comments
* Enable Spotbugs NP_NONNULL_RETURN_VIOLATION (#8234 )
* Fixes from PR review.
* Fix more anchors.
* Preamble nix.
* Fix more anchors, headers
* clean up placeholder page
* add to website lint to travis config
* better broken link checking
* travis fix
* Fixed more broken links
* better redirects
* unfancy catch
* fix LGTM error
* link fixes
* fix md issues
* Addl fixes
2019-08-20 21:48:59 -07:00
mcbrewster
e4aa7fb268
Web-console: fix alerts from lgtm ( #8346 )
...
* fix alerts from lgtm
* remove unordered imports
* fix introduced alert
* move getExpanded to renderSchemaSelector
* use getDerivedStateFromProps
* use prevState
* add semi colons, remove unused imports
* fixes
2019-08-20 20:40:47 -07:00
mcbrewster
e64070b8bf
Web-console: remove specific column filters ( #8343 )
...
* add clear filter
* update tool kit
* remove usless check
* auto run
* add %
2019-08-19 19:54:18 -07:00
Vadim Ogievetsky
56e440383f
Web console: data loader native batch shuffle UI ( #8229 )
...
* data loader shuffle UI
* better support for inline firehose
* feedback changes
* make numShards mandatory sometimes
* edit context dialog fixes
* make auto form less agro
* download full log
* improve auto column detection
* add sample for example
2019-08-19 13:27:34 -07:00
mcbrewster
cae1361c32
Web-console: gate auto complete on current table and schema ( #8322 )
...
* gate auto complete on current table and schema
* reset defaults
* add static functions
* move completions to state
2019-08-17 09:34:36 -07:00
Jihoon Son
31af4eb9ad
Rename maxNumSubTasks to maxNumConcurrentSubTasks for native parallel index task ( #8324 )
2019-08-16 15:57:13 -07:00
Vadim Ogievetsky
0d69438395
Web console: make console's Explain more honest ( #8327 )
...
* fix structure
* update snapshots
2019-08-16 15:51:49 -07:00
mcbrewster
8924d285dc
Web-Console: add more side column functions to query view ( #8283 )
...
* small fixes
* run jest -u
* add trim
* add to groupby
* save
* add functionality to column tree menu
* remove history dialog
* rename file
* fixes
* add new values to time-menu
* add query dialog
* add more functions to collumn-tree menu
* add menu functions
* remove test
* update tests, fix extra 0s, clear in between time filters
* fixes
* add deffered
* save
* add alias's
* change menu style
* fix substring
* small fixes
* add auto run to run button
* move divider to a reasonable position
* fix auto expland
* run jest -u
* fix auto run
* prevent aggregate cooumn changes
* fix group by bug
* add quertAst to state
* ui fixes
* prevent filter on non existant ast
* add auto run to shows
* use handle run
* handle *
* add alias and tslint fix
2019-08-15 01:22:25 -07:00
mcbrewster
d1f286b7f4
fix no from clause error ( #8275 )
2019-08-08 21:42:52 -07:00
mcbrewster
03a37936ec
Web-Console: Column tree button fixes ( #8253 )
...
* small fixes
* run jest -u
* add trim
* remove trim, update package
* fix package-lock
2019-08-07 16:48:17 -07:00
Chi Cao Minh
05b44e3467
Speedup Travis CI jobs ( #8240 )
...
Reorganize Travis CI jobs into smaller faster (and more) jobs. Add
various maven options to skip unnecessary work and refactored Travis CI
job definitions to follow DRY.
Detailed changes:
.travis.yml
- Refactor build logic to get rid of copy-and-paste logic
- Skip static checks and enable parallelism for maven install
- Split static analysis into different jobs to ease triage
- Use "name" attribute instead of NAME environment variable
- Split "indexing" and "web console" out of "other modules test"
- Split 2 integration test jobs into multiple smaller jobs
build.sh
- Enable parallelism
- Disable more static checks
travis_script_integration.sh
travis_script_integration_part2.sh
integration-tests/README.md
- Use TestNG groups instead of shell scripts and move definition of jobs
into Travis CI yaml
integration-tests/pom.xml
- Show elapsed time of individual tests to aid in future rebalancing of
Travis CI integration test jobs run time
TestNGGroup.java
- Use TestNG groups to make it easy to have multiple Travis CI
integration test jobs. TestNG groups also make it easier to have an
"other" integration test group and make it less likely a test will
accidentally not be included in a CI job.
IT*Test.java
AbstractITBatchIndexTest.java
AbstractKafkaIndexerTest.java
- Add TestNG group
- Fix various IntelliJ inspection warnings
- Reduce scope of helper methods since the TestNG group annotation on
the class makes TestNG consider all public methods as test methods
pom.xml
- Allow enforce plugin to be run from command-line
- Bump resources plugin version so that "[debug] execute contextualize"
output is correctly suppressed by "mvn -q"
- Bump exec plugin version so that skip property is renamed from "skip"
to "exec.skip"
web-console/pom.xml
- Add property to allow disabling javascript-related work. This property
is overridden in Travis CI to speed up the jobs.
2019-08-07 09:52:42 -07:00
mcbrewster
e2d1d00fb8
Web-Console: Add show and copy actions to column tree ( #8251 )
...
* save
* add copy and show popup to column tree menu
* fixes
* nest css, uset functions
* fix copy state
* update package
* update package-lock
2019-08-06 23:58:00 -07:00
Vadim Ogievetsky
b9c68a5b7b
Web console: refactor home view, add tests ( #8247 )
...
* refactor home view
* updated mode button placement
2019-08-06 12:41:07 -07:00
mcbrewster
62da1efc0f
Web-Console: add dimensions to datasources icon ( #8232 )
...
* add dimensions to datasources icon
* fix test
* update snapshots
* save
* use table
* update snapshots
* rename to columns
* run jest -u
2019-08-06 00:04:37 -07:00
Vadim Ogievetsky
0235b338fc
Web console: celebrate array based groupBy by supporting resultAsArray in the console ( #8231 )
...
* teach table about resultAsArray
* use query result decoder
* fix snapshot
2019-08-05 18:54:39 -07:00
mcbrewster
5d0805dd48
Web-Console: change go to sql button to more button ( #8227 )
...
* change go to sql button
* rename to See in SQL view
* update snapshots
2019-08-05 14:12:16 -07:00
mcbrewster
ac856fe4c1
Web-Console: Adds edit-context-dialog ( #8228 )
...
* add edit query context
* remove console log
* add icon
* change to submit button
* fix c
* add stricter checking
* update snapshots
2019-08-04 07:18:08 -07:00
mcbrewster
5528dec4a4
Web-Console: stop log from making request after dialog close, implement query manager ( #8219 )
...
* stop logs from runnign after component unmount, use query managers
* address comments
* check if defined
2019-08-01 18:17:09 -07:00
mcbrewster
02c3a785a2
Web-Console: add go to task for datasources ( #8210 )
...
* add go to task for datasources
* general fixes
* use find
2019-08-01 18:15:22 -07:00
Vadim Ogievetsky
a0f88868e3
add timeout to capabilities check ( #8213 )
2019-08-01 08:37:02 -07:00
Vadim Ogievetsky
15dd3d7256
Web console: better action linking between views ( #8203 )
...
* better actions
* better action linking
2019-07-31 07:13:25 -07:00
Vadim Ogievetsky
645fca53d8
Web console: segment timeline ( #8202 )
...
* Add segment timeline chart
* fix file
* Fix bugs: no data handling & scaling problems
* resolve conflict
* changed package-lock
* do not show by default
* trust the interop
* stricter type fixes
* fix sasslint
2019-07-30 22:35:30 -07:00
Vadim Ogievetsky
ddec5ea82e
Web console: Improve data loader time column detection ( #8199 )
...
* better timestamp suggestion
* misc fixes
* update dependancies and licenses
* add indexer, update snapshots
* add explicit render types
* pass through auto refresh in lookup view
2019-07-30 17:54:39 -07:00
mcbrewster
4e60afc86e
Web-console: add Supervisor statistics table and show json query manager ( #8176 )
...
* add statistics table
* change error message
* add query managers
* update snapshots
* fixes
* add stricter types
* fix error type
* prettier fic
* fix undefined
* add typing
* fixe query manager
2019-07-30 12:53:46 -07:00
mcbrewster
f7abc300a8
Web-console: add loader to show-json, add status-dialog ( #8172 )
...
* add loader to show json, add status-dialog
* fix ordered import
* fix changes
* order inputs
* update snapshots
* fix bad merge conflicts
2019-07-30 08:08:36 -07:00
mcbrewster
a0270512a2
Web-console: add history menu to supervisors modal ( #8164 )
...
* Add history menu to supervisors dialog
* add scrolling
* change how tabs render
* remove copy button
* user query manager
2019-07-30 08:07:58 -07:00
Vadim Ogievetsky
771c04841e
remove husky hooks ( #8193 )
2019-07-29 19:32:16 -07:00
Vadim Ogievetsky
cc4450db12
Web console: add reindex (ingestSegment firehose) to the data loader ( #8181 )
...
* tidy up nulls
* standardize more on undefined
* updated licenses
* do not do heavy handed rendering
* reindex from druid
* tidy up
* add inline firehose
* add husky
* sass lint
* better suggestion
* fix script typo
* adjust time formats
* add missing time formats
* use term 'reindex'
* fix lodash.compact
2019-07-29 14:41:27 -07:00
Vadim Ogievetsky
0b3ede193e
Web console: adding Slack channel integration ( #8182 )
...
* adding slack channel integration
* update snapshots
2019-07-28 16:17:54 -07:00
Vadim Ogievetsky
8bd0f8c2ac
Web console: code quality improvements (null tidy up) ( #8162 )
...
* tidy up nulls
* standardize more on undefined
* updated licenses
* update snapshot
* do not do heavy handed rendering
* add placeholder to SQL view
* remove pointelss fragment
2019-07-27 01:46:37 -07:00
mcbrewster
ef9230f916
Web-console: Add continue to spec view ( #8144 )
...
* Add continue to spec view
* update spec when type selected
* remove redundancy
* fix mistakes
2019-07-25 14:48:26 -07:00
mcbrewster
8ba1f06632
Web-console: add lookups tile to home view ( #8124 )
...
* add lookups-tile
* add uninitailized state
* remove error:
2019-07-25 13:08:58 -07:00
Vadim Ogievetsky
2b2fcc0371
Web console: cleanup build, check licenses in test ( #8113 )
...
* cleanup build, check licenses
* cleanup filterMap type
* don't run license check twice
2019-07-19 22:59:07 -07:00
mcbrewster
01f3da6fda
Web Console: add Group by interval to segments view ( #7986 )
...
* add group by
* update snapshot
* fix spacing
* change design pattern
* rename interface
* add static function
* save
* add whereClause"
* add default page size
* add where to inner query
* snapshots
2019-07-19 11:25:25 -07:00
Roman Leventov
ceb969903f
Refactor SQLMetadataSegmentManager; Change contract of REST met… ( #7653 )
...
* Refactor SQLMetadataSegmentManager; Change contract of REST methods in DataSourcesResource
* Style fixes
* Unused imports
* Fix tests
* Fix style
* Comments
* Comment fix
* Remove unresolvable Javadoc references; address comments
* Add comments to ImmutableDruidDataSource
* Merge with master
* Fix bad web-console merge
* Fixes in api-reference.md
* Rename in DruidCoordinatorRuntimeParams
* Fix compilation
* Residual changes
2019-07-17 17:18:48 +03:00
Vadim Ogievetsky
b80f20f769
add missing dynamic coordinator configs ( #8090 )
2019-07-16 17:40:41 -07:00
Vadim Ogievetsky
d3a6753df9
Web console: update dependencies ( #8007 )
...
* update web console deps
* update license.yaml
* add tiny-warning
* do not sort all licenses
* fix snapshots
* add final licenses
* explicit mode
* webpack tweaks
* remove apache 2s
* fixed missing license
* added comments in script
* put in markers
* simpler script generator
* add copyrights
* more log
2019-07-16 09:22:12 -07:00
Vadim Ogievetsky
1712158734
added replicated size ( #8043 )
2019-07-10 08:29:05 -07:00
Vadim Ogievetsky
8493bd5c1c
Web console: added bulk supervisor actions ( #8028 )
...
* added bulk supervisor actions to the web console
* improve async action dialog
* fix tests
2019-07-09 17:31:23 -07:00
Vadim Ogievetsky
4f4cda3ec9
fix query input undo ( #8033 )
2019-07-06 09:21:53 -07:00
Vadim Ogievetsky
2de6cc3b30
fix segment table filter ( #8034 )
2019-07-06 09:21:28 -07:00
Vadim Ogievetsky
f16f13cf61
Web console: Improve data loader styling, enforce stricter TS types ( #8001 )
...
* add assets to auth exclude path
* add frame to tile page
* better empty filter state
* strict TS
* fix segments go to sql
* add unavailable segments
* factor out sugestable input
* fix tests
* update datasources sql
* no depricated extend
* add index spec to tuning configs
* fix scss lint
2019-06-30 19:33:16 -07:00
mcbrewster
f1270c14f8
Web-Console: add clipboard modal ( #7964 )
...
* add clipboard modal
* rename button
* remove console.log
* fix off by one
* update tests
* update snapshot
* fix casing
* update snapshot
2019-06-28 15:50:18 -07:00
Vadim Ogievetsky
d677c83ce4
Web console: Power up the data loader init step ( #7947 )
...
* Power up the data loader init step
* update snapshot
* normalize spec
* allow deselect
* added HDFS tile
* update border style
* text updates
* goodies
* new reset icon
2019-06-26 15:50:48 -07:00
mcbrewster
a171b4a399
Web-console: Add action column to segments view ( #7954 )
...
* add actions column to segments view
* add sements action column
2019-06-25 20:14:06 -07:00
Benedict Jin
16aafd5788
[ImgBot] Optimize images ( #7873 )
...
*Total -- 10,997.25kb -> 7,160.16kb (34.89%)
/publications/radstack/figures/precompute.png -- 54.20kb -> 16.97kb (68.69%)
/web-console/favicon.png -- 4.41kb -> 1.61kb (63.58%)
/docs/img/indexing_service.png -- 47.37kb -> 21.96kb (53.64%)
/docs/img/segmentPropagation.png -- 62.94kb -> 29.85kb (52.57%)
/docs/content/tutorials/img/tutorial-quickstart-01.png -- 55.62kb -> 29.13kb (47.62%)
/docs/content/tutorials/img/tutorial-deletion-02.png -- 791.43kb -> 429.30kb (45.76%)
/docs/content/tutorials/img/tutorial-deletion-03.png -- 786.79kb -> 427.05kb (45.72%)
/docs/content/tutorials/img/tutorial-retention-00.png -- 135.06kb -> 75.88kb (43.82%)
/docs/content/tutorials/img/tutorial-batch-data-loader-10.png -- 77.23kb -> 43.47kb (43.71%)
/docs/content/tutorials/img/tutorial-batch-data-loader-01.png -- 97.03kb -> 55.16kb (43.15%)
/docs/content/tutorials/img/tutorial-batch-data-loader-07.png -- 79.49kb -> 45.44kb (42.84%)
/docs/content/tutorials/img/tutorial-retention-02.png -- 401.30kb -> 234.68kb (41.52%)
/docs/content/tutorials/img/tutorial-compaction-06.png -- 343.27kb -> 201.87kb (41.19%)
/docs/content/tutorials/img/tutorial-batch-data-loader-09.png -- 105.14kb -> 61.86kb (41.16%)
/docs/content/tutorials/img/tutorial-retention-06.png -- 227.57kb -> 134.35kb (40.97%)
/docs/content/tutorials/img/tutorial-compaction-04.png -- 304.83kb -> 180.04kb (40.94%)
/docs/content/tutorials/img/tutorial-compaction-02.png -- 273.18kb -> 162.67kb (40.45%)
/docs/content/tutorials/img/tutorial-query-05.png -- 85.03kb -> 50.64kb (40.44%)
/publications/radstack/figures/druid_vs_bigquery.png -- 155.44kb -> 92.85kb (40.27%)
/docs/content/tutorials/img/tutorial-kafka-02.png -- 122.51kb -> 73.93kb (39.65%)
/docs/content/tutorials/img/tutorial-deletion-01.png -- 70.37kb -> 42.56kb (39.52%)
/docs/content/tutorials/img/tutorial-batch-data-loader-06.png -- 103.50kb -> 62.79kb (39.33%)
/docs/content/tutorials/img/tutorial-batch-submit-task-01.png -- 111.25kb -> 67.73kb (39.12%)
/docs/content/tutorials/img/tutorial-query-03.png -- 103.60kb -> 63.51kb (38.69%)
/docs/content/tutorials/img/tutorial-query-04.png -- 105.79kb -> 64.87kb (38.69%)
/docs/content/tutorials/img/tutorial-batch-data-loader-11.png -- 130.20kb -> 81.34kb (37.53%)
/docs/content/tutorials/img/tutorial-query-07.png -- 122.52kb -> 76.79kb (37.32%)
/docs/content/tutorials/img/tutorial-kafka-01.png -- 133.12kb -> 83.47kb (37.3%)
/docs/content/tutorials/img/tutorial-query-06.png -- 127.55kb -> 80.28kb (37.06%)
/docs/content/tutorials/img/tutorial-batch-submit-task-02.png -- 133.07kb -> 84.06kb (36.83%)
/docs/content/tutorials/img/tutorial-retention-05.png -- 60.19kb -> 38.08kb (36.74%)
/docs/content/tutorials/img/tutorial-batch-data-loader-03.png -- 211.92kb -> 134.22kb (36.66%)
/docs/content/tutorials/img/tutorial-batch-data-loader-05.png -- 250.36kb -> 158.68kb (36.62%)
/publications/radstack/figures/radstack.png -- 16.80kb -> 10.67kb (36.48%)
/docs/content/tutorials/img/tutorial-batch-data-loader-08.png -- 158.59kb -> 101.49kb (36%)
/docs/content/tutorials/img/tutorial-batch-data-loader-04.png -- 255.10kb -> 163.33kb (35.97%)
/docs/content/tutorials/img/tutorial-query-02.png -- 126.92kb -> 81.42kb (35.85%)
/docs/content/tutorials/img/tutorial-compaction-01.png -- 53.86kb -> 34.87kb (35.25%)
/docs/img/druid-architecture.png -- 202.23kb -> 130.97kb (35.24%)
/docs/content/tutorials/img/tutorial-retention-01.png -- 52.69kb -> 34.35kb (34.81%)
/docs/img/druid-timeline.png -- 35.87kb -> 23.59kb (34.22%)
/docs/content/tutorials/img/tutorial-query-01.png -- 149.53kb -> 98.56kb (34.08%)
/docs/content/tutorials/img/tutorial-retention-04.png -- 65.91kb -> 43.57kb (33.89%)
/docs/content/tutorials/img/tutorial-compaction-08.png -- 42.24kb -> 28.08kb (33.53%)
/docs/content/tutorials/img/tutorial-compaction-07.png -- 39.17kb -> 26.06kb (33.47%)
/docs/content/tutorials/img/tutorial-compaction-03.png -- 39.17kb -> 26.13kb (33.3%)
/docs/content/tutorials/img/tutorial-compaction-05.png -- 38.85kb -> 25.96kb (33.17%)
/publications/demo/figures/throughput_vs_cardinality.png -- 73.49kb -> 49.31kb (32.9%)
/publications/radstack/figures/throughput_vs_cardinality.png -- 73.49kb -> 49.31kb (32.9%)
/publications/whitepaper/figures/throughput_vs_cardinality.png -- 73.49kb -> 49.31kb (32.9%)
/docs/content/tutorials/img/tutorial-retention-03.png -- 43.11kb -> 29.33kb (31.97%)
/publications/radstack/figures/throughput_vs_num_dims.png -- 72.86kb -> 49.72kb (31.76%)
/publications/whitepaper/figures/throughput_vs_num_dims.png -- 72.86kb -> 49.72kb (31.76%)
/publications/demo/figures/throughput_vs_num_dims.png -- 72.86kb -> 49.72kb (31.76%)
/publications/radstack/figures/joined.png -- 164.14kb -> 113.47kb (30.87%)
/docs/content/tutorials/img/tutorial-batch-data-loader-02.png -- 508.93kb -> 351.85kb (30.87%)
/publications/radstack/figures/imps_clicks.png -- 190.95kb -> 132.70kb (30.51%)
/publications/radstack/figures/shuffled.png -- 180.46kb -> 128.21kb (28.95%)
/publications/radstack/figures/pipeline.png -- 392.54kb -> 281.93kb (28.18%)
/docs/img/druid-manage-1.png -- 108.94kb -> 78.53kb (27.92%)
/publications/radstack/figures/throughput_vs_num_metrics.png -- 85.25kb -> 61.80kb (27.51%)
/publications/demo/figures/throughput_vs_num_metrics.png -- 85.25kb -> 61.80kb (27.51%)
/publications/whitepaper/figures/throughput_vs_num_metrics.png -- 85.25kb -> 61.80kb (27.51%)
/docs/img/druid-production.png -- 50.00kb -> 39.18kb (21.63%)
/docs/img/druid-dataflow-3.png -- 88.25kb -> 69.75kb (20.96%)
/publications/demo/figures/realtime_flow.png -- 51.12kb -> 40.61kb (20.56%)
/publications/demo/figures/realtime_timeline.png -- 36.15kb -> 29.24kb (19.12%)
/publications/demo/figures/tpch_scaling.png -- 43.21kb -> 34.97kb (19.08%)
/publications/demo/figures/caching.png -- 35.26kb -> 29.09kb (17.49%)
/dev/intellij-sdk-config.jpg -- 1,019.35kb -> 864.37kb (15.2%)
/docs/img/druid-column-types.png -- 101.53kb -> 91.17kb (10.2%)
/docs/img/druid-dataflow-2x.png -- 138.30kb -> 127.11kb (8.09%)
2019-06-24 21:27:48 -07:00
mcbrewster
cd01a48eab
Web-console: add timed button ( #7912 )
...
* add refresh button
* update snapshots
* fix spacing
* add supervisors button
* modify query manager
* add icon
* update snapshots
* fix space
* stop refreshing when option selected
* small fixes
* add default value
* fix spelling mistake
* fix query-input
* rename class
2019-06-24 21:18:19 -07:00
Vadim Ogievetsky
6c8f9482c7
Web console: prettier code ( #7939 )
...
* prettier code
* update tests
* scss also
* more ,
* update pachage json prettier config
2019-06-21 16:52:33 -07:00
Vadim Ogievetsky
2bc8e7c0e8
more acurate keyword auto complete ( #7934 )
2019-06-20 21:14:54 -07:00