2019-01-31 20:26:41 -05:00
<!--
~ Licensed to the Apache Software Foundation (ASF) under one
~ or more contributor license agreements. See the NOTICE file
~ distributed with this work for additional information
~ regarding copyright ownership. The ASF licenses this file
~ to you under the Apache License, Version 2.0 (the
~ "License"); you may not use this file except in compliance
~ with the License. You may obtain a copy of the License at
~
~ http://www.apache.org/licenses/LICENSE-2.0
~
~ Unless required by applicable law or agreed to in writing,
~ software distributed under the License is distributed on an
~ "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
~ KIND, either express or implied. See the License for the
~ specific language governing permissions and limitations
~ under the License.
-->
# Apache Druid web console
This is the unified Druid web console that servers as a data management layer for Druid.
## How to watch and run for development
2020-10-03 11:21:44 -04:00
1. You need to be within the `web-console` directory
2019-01-31 20:26:41 -05:00
2. Install the modules with `npm install`
2020-10-09 10:51:59 -04:00
3. Run `npm run compile` to compile the scss files
4. Run `npm start` will start in development mode and will proxy druid requests to `localhost:8888`
2019-01-31 20:26:41 -05:00
2019-08-20 23:40:47 -04:00
**Note:** you can provide an environment variable to proxy to a different Druid host like so: `druid_host=1.2.3.4:8888 npm start`
**Note:** you can provide an environment variable use webpack-bundle-analyzer as a plugin in the build script or like so: `BUNDLE_ANALYZER_PLUGIN='TRUE' npm start`
2019-01-31 20:26:41 -05:00
2019-11-15 22:45:14 -05:00
To try the console in (say) coordinator mode you could run it as such:
`druid_host=localhost:8081 npm start`
2019-01-31 20:26:41 -05:00
## Description of the directory structure
A lot of the directory structure was created to preserve the existing console structure as much as possible.
As part of this repo:
2020-05-13 19:41:04 -04:00
- `assets/` - The images (and other assets) used within the console
- `e2e-tests/` - End-to-end tests for the console
2019-01-31 20:26:41 -05:00
- `lib/` - A place where some overrides to the react-table stylus files live, this is outside of the normal SCSS build system.
- `public/` - The compiled destination of the file powering this console
- `script/` - Some helper bash scripts for running this console
2019-08-22 12:09:37 -04:00
- `src/` - This directory (together with `lib` ) constitutes all the source code for this console
2019-01-31 20:26:41 -05:00
## List of non SQL data reading APIs used
```
GET /status
GET /druid/indexer/v1/supervisor?full
2019-05-23 19:47:23 -04:00
POST /druid/indexer/v1/worker
2019-01-31 20:26:41 -05:00
GET /druid/indexer/v1/workers
2019-11-08 11:21:53 -05:00
GET /druid/indexer/v1/tasks
2019-01-31 20:26:41 -05:00
GET /druid/coordinator/v1/loadqueue?simple
GET /druid/coordinator/v1/config
2019-07-17 10:18:48 -04:00
GET /druid/coordinator/v1/metadata/datasources?includeUnused
2019-01-31 20:26:41 -05:00
GET /druid/coordinator/v1/rules
GET /druid/coordinator/v1/config/compaction
GET /druid/coordinator/v1/tiers
```
2019-07-16 12:22:12 -04:00
## Updating the list of license files
From the web-console directory run `script/licenses`
2020-05-13 19:41:04 -04:00
## Running End-to-End Tests
From the web-console directory:
1. Build druid distribution: `script/druid build`
2. Start druid cluster: `script/druid start`
3. Run end-to-end tests: `npm run test-e2e`
4. Stop druid cluster: `script/druid stop`
2020-10-03 11:21:44 -04:00
If you already have a druid cluster running on the standard ports, the steps to build/start/stop a druid cluster can
be skipped.
2020-05-13 19:41:04 -04:00
### Debugging
#### Screenshots
`e2e-tests/util/debug.ts:saveScreenshotIfError()` is used to save a screenshot of the web console
2020-10-03 11:21:44 -04:00
when the test fails. For example, if `e2e-tests/tutorial-batch.spec.ts` fails, it will create
2020-05-13 19:41:04 -04:00
`load-data-from-local-disk-error-screenshot.png` .
#### Disabling Headless Mode
2020-10-03 11:21:44 -04:00
Disabling headless mode while running the tests can be helpful. This can be done via the `DRUID_E2E_TEST_HEADLESS`
environment variable, which defaults to `true` .
2020-05-13 19:41:04 -04:00
2020-10-03 11:21:44 -04:00
#### Running Against Alternate Web Console
2020-05-13 19:41:04 -04:00
2020-10-03 11:21:44 -04:00
The environment variable `DRUID_E2E_TEST_UNIFIED_CONSOLE_PORT` can be used to target a web console running on a
non-default port (i.e., not port `8888` ). For example, this environment variable can be used to target the
development mode of the web console (started via `npm start` ), which runs on port `18081` .