Giuseppe Martino
9c171e2b1f
Message rejection absolute date ( #8656 )
...
* Add option lateMessageRejectionStartDate
* Use option lateMessageRejectionStartDate
* Fix tests
* Add lateMessageRejectionStartDate to kafka indexing service
* Update tests kafka indexing service
* Fix tests for KafkaSupervisorTest
* Add lateMessageRejectionStartDate to KinesisSupervisorIOConfig
* Fix var name
* Update documentation
* Add check lateMessageRejectionStartDateTime and lateMessageRejectionPeriod, fails if both were specified.
2019-10-31 15:13:02 -07:00
Gian Merlino
e70b71c90f
Fix verify script. ( #8798 )
...
Accidentally missed some quote escaping in #8794 .
2019-10-30 23:30:01 -07:00
Gian Merlino
edb3b00d26
Startup scripts: verify Java 8 (exactly), improve port/java verification messages. ( #8794 )
...
* Startup scripts: verify Java 8 (exactly), improve port/java verification messages.
Java 11 compatibility isn't fully baked yet (users have reported various
issues on Java 11), so block startup with an error message unless Java 8
is found. Allow overriding this decision with an environment variable.
* Message adjustments.
2019-10-30 22:37:05 -07:00
yuanli
bca649e492
Case sensitive comparison of nonbinary string in MySQL metadata storage ( #8758 )
2019-10-30 20:48:08 -07:00
Vadim Ogievetsky
ed6be81d12
Web console: fix error when querying with grand totals ( #8795 )
...
* fix error when querying with grand totals
* also support object
* improve tests
2019-10-30 19:37:53 -07:00
Clint Wylie
3ff5e02237
remove select query ( #8739 )
...
* remove select query
* thanks teamcity
* oops
* oops
* add back a SelectQuery class that throws RuntimeExceptions linking to docs
* adjust text
* update docs per review
* deprecated
2019-10-30 19:29:56 -07:00
Jihoon Son
2363b61983
Asynchronous file copy in the shuffle of parallel indexing task ( #8783 )
2019-10-30 18:00:05 -07:00
Gian Merlino
7605c23354
Remove Tranquility configs and certain doc references. ( #8793 )
...
Since it hasn't received updates or community interest in a while, it makes sense
to de-emphasize it in the distribution and most documentation (outside of simple
mentions of its existence).
2019-10-30 16:30:16 -07:00
Gian Merlino
c922d2c3c9
Use bundled ZooKeeper in tutorials. ( #8792 )
2019-10-30 16:17:28 -07:00
Vadim Ogievetsky
929a8b6337
Web console: Support all possible metric types in the data loader ( #8785 )
...
* Support all possible metric types in the data loader
* added more sketches
2019-10-30 09:34:13 -07:00
Vadim Ogievetsky
a95e3d438e
Web console: Data loader user feedback changes ( #8770 )
...
* init fixes
* cleaning styling issues
* more conversion types
2019-10-29 08:42:51 -07:00
Roman Leventov
3e9723e3ce
Add an item to concurrency checklist about assertions in parall… ( #8701 )
...
Add an item to concurrency checklist about assertions in parallel threads and async code in tests
2019-10-29 11:38:04 +03:00
karthikbhat13
b8ceee4eee
Removed 'if' condition. ( #8768 )
2019-10-28 13:40:03 -07:00
Gian Merlino
aa81253cf4
Fix typos. ( #8767 )
2019-10-28 12:47:01 -07:00
Vadim Ogievetsky
11230dff52
Support HDFS firehose ( #8752 )
2019-10-28 08:22:20 -07:00
Vadim Ogievetsky
ec8ce74f1c
Web console: Better data loader flow ( #8763 )
...
* filter table
* go over the entire data loader flow
2019-10-28 08:08:46 -07:00
Gian Merlino
b65d2ac648
Add HDFS firehose ( #8754 )
...
* Add HDFS firehose.
* Tests, support for lists of paths.
* Fixups.
* Update list of firehoses.
* Wildcards is a word.
2019-10-28 08:07:38 -07:00
Vadim Ogievetsky
f9b94a5db1
Docs: remove self link ( #8760 )
...
This section links to itself in the description. I tried to follow that link and spit hot tea all over my monitor from laughter.
2019-10-27 22:33:22 -07:00
Vadim Ogievetsky
1b9d4ce811
Web console: Memoize all the functional components and improve transform step highlighting ( #8757 )
...
* Fix transform table
* memoize all components
* use named functions
2019-10-26 17:58:26 -07:00
Chi Cao Minh
ad615438f6
Fix Hadoop tutorial Dockerfile ( #8753 )
...
When following the instructions from Hadoop batch load tutorial in the
docs, building the Docker images fails with:
gzip: stdin: unexpected end of file
tar: Child returned status 1
tar: Error is not recoverable: exiting now
Updating nss allows the curl command for downloading Hadoop to succeed
while building the Docker image.
2019-10-25 17:58:40 -07:00
Vadim Ogievetsky
80be9462a6
Web console: Update versions and dependencies ( #8751 )
...
* update console version and deps
* bump script version
2019-10-25 17:53:06 -07:00
Vadim Ogievetsky
9eb68b1d53
Add version to canonical URL ( #8747 )
2019-10-25 12:46:39 -07:00
Vadim Ogievetsky
27127345b7
Add delimiter option for TSV parser ( #8741 )
2019-10-25 09:17:59 -07:00
Xiaobao
b9d10473a5
fix typo ( #8745 )
2019-10-25 19:21:56 +08:00
Clint Wylie
09f92818d4
update druid expression docs to indicate that array functions do not work at indexing time ( #8734 )
...
* update druid expression docs to indicate that array functions are not supported in transformSpec
* fix unrelated spelling check
2019-10-24 22:04:08 -07:00
Eyal Yurman
14e33428f0
Moving Average extention: Add Sum averagers ( #8511 )
...
* Add sum averagers.
* avoid casting double to long.
2019-10-24 16:37:24 -07:00
Vadim Ogievetsky
774ce3ce6d
add canonical to the docs ( #8731 )
2019-10-24 15:25:57 -07:00
Vadim Ogievetsky
efd669757e
fix save button ( #8732 )
2019-10-24 15:25:28 -07:00
Vadim Ogievetsky
cc3650ee3b
fix doc headers ( #8729 )
2019-10-24 11:17:39 -07:00
Evan Ren
fdbc4ae147
Web console: Button to pretty print Druid JSON query ( #8724 )
...
* Add button and functionality to pretty format Rune JSON
* Removed console log
* Fix lgtm error about updating state
* Update test snapshot
2019-10-23 20:24:47 -07:00
Vadim Ogievetsky
137c2a6025
Web console: disable data loader Submit button when submitting so as not to submit multiple times ( #8725 )
...
* disable Submit button when submitting so as not to submit twice
* also check in fn
2019-10-23 18:42:44 -07:00
Jihoon Son
094936ca03
Remove commit() method Firehose ( #8688 )
...
* Remove commit() method Firehose
* fix javadoc
2019-10-23 16:52:02 -07:00
Jihoon Son
2518478b20
Remove deprecated parameter for Checkpoint request ( #8707 )
...
* Remove deprecated parameter for Checkpoint request
* fix wrong doc
2019-10-23 16:51:16 -07:00
Vadim Ogievetsky
d9c9aef3d1
Druid Doctor ( #8672 )
...
* adding Druid doctor
* better meesage
* feedback changes
* add icons
* feedback fixes
* spelling
* add file.encoding check
* feedback changes
2019-10-23 16:50:08 -07:00
Clint Wylie
a8b674e00d
fix indexer when used with http inventory view ( #8723 )
2019-10-23 15:52:57 -07:00
Vadim Ogievetsky
3abd0c4a33
Web console: start transition to React hooks and functional components ( #8722 )
...
* do the easy stuff
* some more components
2019-10-23 09:43:02 -07:00
Jihoon Son
f5b9bf5525
Cluster-wide configuration for query vectorization ( #8657 )
...
* Cluster-wide configuration for query vectorization
* add doc
* fix build
* fix doc
* rename to QueryConfig and add javadoc
* fix checkstyle
* fix variable names
2019-10-23 21:44:28 +08:00
David Glasser
b453fda251
docs: clarify native batch ingestion w/ overlapping segments ( #8720 )
...
I was confused by a paragraph in the docs that I myself wrote!
2019-10-22 21:01:56 -07:00
Jad Naous
2ab43aa688
Update tutorial-kerberos-hadoop.md ( #8689 )
...
* Update tutorial-kerberos-hadoop.md
Fix up what looks like a bad merge.
* Update tutorial-kerberos-hadoop.md
Fix spelling issues
2019-10-22 14:40:41 -07:00
Nishant Bangarwa
48486a4535
Fix jackson property name for dropwizardemitterconfig ( #8691 )
...
Fix jackson property name and add test
Fix test
2019-10-22 14:40:19 -07:00
Abhishek Radhakrishnan
42cfe679f1
Update query result timestamp to match query intervals. ( #8717 )
2019-10-22 14:39:47 -07:00
Gian Merlino
bb4368baec
Fix PeriodGranularity.bucketStart for days that don't start with midnight. ( #8711 )
...
* Fix PeriodGranularity.bucketStart for days that don't start with midnight.
* Use more newspeak method.
2019-10-22 10:00:52 -07:00
Surekha
e919eccc4b
Update docs to add metadataSegment configs ( #8708 )
...
* Add metadataSegment configs to docs
* rearrange in alphabetical order
2019-10-22 01:19:36 -07:00
Kamal Gurala
3ed5f9698a
gcs prefix doc fix ( #8699 )
2019-10-21 08:29:54 -07:00
Surekha
98f59ddd7e
Add `sys.supervisors` table to system tables ( #8547 )
...
* Add supervisors table to SystemSchema
* Add docs
* fix checkstyle
* fix test
* fix CI
* Add comments
* Fix javadoc teamcity error
* comments
* fix links in docs
* fix links
* rename fullStatus query param to system and remove it from docs
2019-10-18 15:16:42 -07:00
Jonathan Wei
d88075237a
Add initial SQL support for non-expression sketch postaggs ( #8487 )
...
* Add initial SQL support for non-expression sketch postaggs
* Checkstyle, spotbugs
* checkstyle
* imports
* Update SQL docs
* Checkstyle
* Fix theta sketch operator docs
* PR comments
* Checkstyle fixes
* Add missing entries for HLL sketch module
* PR comments, add round param to HLL estimate operator, fix optional HLL param
2019-10-18 14:59:44 -07:00
Jihoon Son
30c15900be
Auto compaction based on parallel indexing ( #8570 )
...
* Auto compaction based on parallel indexing
* javadoc and doc
* typo
* update spell
* addressing comments
* address comments
* fix log
* fix build
* fix test
* increase default max input segment bytes per task
* fix test
2019-10-18 13:24:14 -07:00
Mohammad J. Khan
1ca859584f
Issue 8678 Non-coordinator services are repeatedly logging JsonMappingException when using druid-basic-security extension with an authenticator that has no users setup ( #8692 )
2019-10-18 11:09:53 -07:00
Chi Cao Minh
8b2afa5c49
Use targetRowsPerSegment for single-dim partitions ( #8624 )
...
When using single-dimension partitioning, use targetRowsPerSegment (if
specified) to size segments. Previously, single-dimension partitioning
would always size segments as close to the max size as possible.
Also, change single-dimension partitioning to allow partitions that have
a size equal to the target or max size. Previously, it would create
partitions up to 1 less than those limits.
Also, fix some IntelliJ inspection warnings in HadoopDruidIndexerConfig.
2019-10-17 15:55:12 -07:00
Mingming Qiu
2c758ef5ff
Support assign tasks to run on different categories of MiddleManagers ( #7066 )
...
* Support assign tasks to run on different tiers of MiddleManagers
* address comments
* address comments
* rename tier to category and docs
* doc
* fix doc
* fix spelling errors
* docs
2019-10-17 12:57:19 -07:00