2012-10-24 03:39:51 -04:00
|
|
|
dist
|
|
|
|
|
target
|
|
|
|
|
*.iml
|
|
|
|
|
*.ipr
|
|
|
|
|
*.iws
|
|
|
|
|
*.tar.gz
|
|
|
|
|
*.swp
|
|
|
|
|
*.swo
|
2023-02-21 18:03:02 -05:00
|
|
|
*.pyc
|
2012-10-24 03:39:51 -04:00
|
|
|
.classpath
|
|
|
|
|
.idea
|
|
|
|
|
.project
|
2019-05-29 14:20:45 -04:00
|
|
|
.PVS-Studio
|
2012-10-31 01:21:55 -04:00
|
|
|
.settings/
|
Web console basic end-to-end-test (#9595)
Load data and query (i.e., automate
https://druid.apache.org/docs/latest/tutorials/tutorial-batch.html) to
have some basic checks ensuring the web console is wired up to druid
correctly.
The new end-to-end tests (tutorial-batch.spec.ts) are added to
`web-console/e2e-tests`. Within that directory:
- `components` represent the various tabs of the web console. Currently,
abstractions for `load data`, `ingestion`, `datasources`, and `query`
are implemented.
- `components/load-data/data-connector` contains abstractions for the
different data source options available to the data loader's `Connect`
step. Currently, only the `Local file` data source connector is
implemented.
- `components/load-data/config` contains abstractions for the different
configuration options available for each step of the data loader flow.
Currently, the `Configure Schema`, `Partition`, and `Publish` steps
have initial implementation of their configuration options.
- `util` contains various helper methods for the tests and does not
contain abstractions of the web console.
Changes to add the new tests to CI:
- `.travis.yml`: New "web console end-to-end tests" job
- `web-console/jest.*.js`: Refactor jest configurations to have
different flavors for unit tests and for end-to-end tests. In
particular, the latter adds a jest setup configuration to wait for the
web console to be ready (`web-console/e2e-tests/util/setup.ts`).
- `web-console/package.json`: Refactor run scripts to add new script for
running end-to-end tests.
- `web-console/script/druid`: Utility scripts for building, starting,
and stopping druid.
Other changes:
- `pom.xml`: Refactor various settings disable java static checks and to
disable java tests into two new maven profiles. Since the same
settings are used in several places (e.g., .travis.yml, Dockerfiles,
etc.), having them in maven profiles makes it more maintainable.
- `web-console/src/console-application.tsx`: Fix typo ("the the").
2020-04-09 15:38:09 -04:00
|
|
|
.vscode
|
2012-11-08 20:06:02 -05:00
|
|
|
*.log
|
2022-06-23 13:49:50 -04:00
|
|
|
.DS_Store
|
2013-09-13 18:20:39 -04:00
|
|
|
_site
|
2017-08-23 13:10:50 -04:00
|
|
|
dependency-reduced-pom.xml
|
2019-08-21 15:46:27 -04:00
|
|
|
LICENSE.BINARY
|
|
|
|
|
NOTICE.BINARY
|
2019-03-04 21:45:22 -05:00
|
|
|
README.BINARY
|
2019-05-10 00:29:26 -04:00
|
|
|
README
|
2021-11-22 08:34:26 -05:00
|
|
|
*.lock
|
2022-06-23 13:49:50 -04:00
|
|
|
.pmd
|
|
|
|
|
.pmdruleset.xml
|
2021-11-30 14:35:38 -05:00
|
|
|
.java-version
|
2021-12-06 20:03:12 -05:00
|
|
|
integration-tests/gen-scripts/
|
2022-09-06 14:16:50 -04:00
|
|
|
/bin/
|
Frame processing and channels. (#12848)
* Frame processing and channels.
Follow-up to #12745. This patch adds three new concepts:
1) Frame channels are interfaces for doing nonblocking reads and writes
of frames.
2) Frame processors are interfaces for doing nonblocking processing of
frames received from input channels and sent to output channels.
3) Cluster-by keys, which can be used for sorting or partitioning.
The patch also adds SuperSorter, a user of these concepts, both to
illustrate how they are used, and also because it is going to be useful
in future work.
Central classes:
- ReadableFrameChannel. Implementations include
BlockingQueueFrameChannel (in-memory channel that implements both interfaces),
ReadableFileFrameChannel (file-based channel),
ReadableByteChunksFrameChannel (byte-stream-based channel), and others.
- WritableFrameChannel. Implementations include BlockingQueueFrameChannel
and WritableStreamFrameChannel (byte-stream-based channel).
- ClusterBy, a sorting or partitioning key.
- FrameProcessor, nonblocking processor of frames. Implementations include
FrameChannelBatcher, FrameChannelMerger, and FrameChannelMuxer.
- FrameProcessorExecutor, an executor service that runs FrameProcessors.
- SuperSorter, a class that uses frame channels and processors to
do parallel external merge sort of any amount of data (as long as there
is enough disk space).
* Additional tests, fixes.
* Changes from review.
* Better implementation for ReadableInputStreamFrameChannel.
* Rename getFrameFileReference -> newFrameFileReference.
* Add InterruptedException to runIncrementally; add more tests.
* Cancellation adjustments.
* Review adjustments.
* Refactor BlockingQueueFrameChannel, rename doneReading and doneWriting to close.
* Additional changes from review.
* Additional changes.
* Fix test.
* Adjustments.
* Adjustments.
2022-08-05 00:29:04 -04:00
|
|
|
*.hprof
|
2022-12-16 16:33:50 -05:00
|
|
|
**/.ipynb_checkpoints/
|
2023-03-04 21:25:19 -05:00
|
|
|
*.pyc
|
