b65d2ac648
Add HDFS firehose ( #8754 )
...
* Add HDFS firehose.
* Tests, support for lists of paths.
* Fixups.
* Update list of firehoses.
* Wildcards is a word.
2019-10-28 08:07:38 -07:00
f9b94a5db1
Docs: remove self link ( #8760 )
...
This section links to itself in the description. I tried to follow that link and spit hot tea all over my monitor from laughter.
2019-10-27 22:33:22 -07:00
1b9d4ce811
Web console: Memoize all the functional components and improve transform step highlighting ( #8757 )
...
* Fix transform table
* memoize all components
* use named functions
2019-10-26 17:58:26 -07:00
ad615438f6
Fix Hadoop tutorial Dockerfile ( #8753 )
...
When following the instructions from Hadoop batch load tutorial in the
docs, building the Docker images fails with:
gzip: stdin: unexpected end of file
tar: Child returned status 1
tar: Error is not recoverable: exiting now
Updating nss allows the curl command for downloading Hadoop to succeed
while building the Docker image.
2019-10-25 17:58:40 -07:00
80be9462a6
Web console: Update versions and dependencies ( #8751 )
...
* update console version and deps
* bump script version
2019-10-25 17:53:06 -07:00
9eb68b1d53
Add version to canonical URL ( #8747 )
2019-10-25 12:46:39 -07:00
27127345b7
Add delimiter option for TSV parser ( #8741 )
2019-10-25 09:17:59 -07:00
b9d10473a5
fix typo ( #8745 )
2019-10-25 19:21:56 +08:00
09f92818d4
update druid expression docs to indicate that array functions do not work at indexing time ( #8734 )
...
* update druid expression docs to indicate that array functions are not supported in transformSpec
* fix unrelated spelling check
2019-10-24 22:04:08 -07:00
14e33428f0
Moving Average extention: Add Sum averagers ( #8511 )
...
* Add sum averagers.
* avoid casting double to long.
2019-10-24 16:37:24 -07:00
774ce3ce6d
add canonical to the docs ( #8731 )
2019-10-24 15:25:57 -07:00
efd669757e
fix save button ( #8732 )
2019-10-24 15:25:28 -07:00
cc3650ee3b
fix doc headers ( #8729 )
2019-10-24 11:17:39 -07:00
fdbc4ae147
Web console: Button to pretty print Druid JSON query ( #8724 )
...
* Add button and functionality to pretty format Rune JSON
* Removed console log
* Fix lgtm error about updating state
* Update test snapshot
2019-10-23 20:24:47 -07:00
137c2a6025
Web console: disable data loader Submit button when submitting so as not to submit multiple times ( #8725 )
...
* disable Submit button when submitting so as not to submit twice
* also check in fn
2019-10-23 18:42:44 -07:00
094936ca03
Remove commit() method Firehose ( #8688 )
...
* Remove commit() method Firehose
* fix javadoc
2019-10-23 16:52:02 -07:00
2518478b20
Remove deprecated parameter for Checkpoint request ( #8707 )
...
* Remove deprecated parameter for Checkpoint request
* fix wrong doc
2019-10-23 16:51:16 -07:00
d9c9aef3d1
Druid Doctor ( #8672 )
...
* adding Druid doctor
* better meesage
* feedback changes
* add icons
* feedback fixes
* spelling
* add file.encoding check
* feedback changes
2019-10-23 16:50:08 -07:00
a8b674e00d
fix indexer when used with http inventory view ( #8723 )
2019-10-23 15:52:57 -07:00
3abd0c4a33
Web console: start transition to React hooks and functional components ( #8722 )
...
* do the easy stuff
* some more components
2019-10-23 09:43:02 -07:00
f5b9bf5525
Cluster-wide configuration for query vectorization ( #8657 )
...
* Cluster-wide configuration for query vectorization
* add doc
* fix build
* fix doc
* rename to QueryConfig and add javadoc
* fix checkstyle
* fix variable names
2019-10-23 21:44:28 +08:00
b453fda251
docs: clarify native batch ingestion w/ overlapping segments ( #8720 )
...
I was confused by a paragraph in the docs that I myself wrote!
2019-10-22 21:01:56 -07:00
2ab43aa688
Update tutorial-kerberos-hadoop.md ( #8689 )
...
* Update tutorial-kerberos-hadoop.md
Fix up what looks like a bad merge.
* Update tutorial-kerberos-hadoop.md
Fix spelling issues
2019-10-22 14:40:41 -07:00
48486a4535
Fix jackson property name for dropwizardemitterconfig ( #8691 )
...
Fix jackson property name and add test
Fix test
2019-10-22 14:40:19 -07:00
42cfe679f1
Update query result timestamp to match query intervals. ( #8717 )
2019-10-22 14:39:47 -07:00
bb4368baec
Fix PeriodGranularity.bucketStart for days that don't start with midnight. ( #8711 )
...
* Fix PeriodGranularity.bucketStart for days that don't start with midnight.
* Use more newspeak method.
2019-10-22 10:00:52 -07:00
e919eccc4b
Update docs to add metadataSegment configs ( #8708 )
...
* Add metadataSegment configs to docs
* rearrange in alphabetical order
2019-10-22 01:19:36 -07:00
3ed5f9698a
gcs prefix doc fix ( #8699 )
2019-10-21 08:29:54 -07:00
98f59ddd7e
Add `sys.supervisors` table to system tables ( #8547 )
...
* Add supervisors table to SystemSchema
* Add docs
* fix checkstyle
* fix test
* fix CI
* Add comments
* Fix javadoc teamcity error
* comments
* fix links in docs
* fix links
* rename fullStatus query param to system and remove it from docs
2019-10-18 15:16:42 -07:00
d88075237a
Add initial SQL support for non-expression sketch postaggs ( #8487 )
...
* Add initial SQL support for non-expression sketch postaggs
* Checkstyle, spotbugs
* checkstyle
* imports
* Update SQL docs
* Checkstyle
* Fix theta sketch operator docs
* PR comments
* Checkstyle fixes
* Add missing entries for HLL sketch module
* PR comments, add round param to HLL estimate operator, fix optional HLL param
2019-10-18 14:59:44 -07:00
30c15900be
Auto compaction based on parallel indexing ( #8570 )
...
* Auto compaction based on parallel indexing
* javadoc and doc
* typo
* update spell
* addressing comments
* address comments
* fix log
* fix build
* fix test
* increase default max input segment bytes per task
* fix test
2019-10-18 13:24:14 -07:00
1ca859584f
Issue 8678 Non-coordinator services are repeatedly logging JsonMappingException when using druid-basic-security extension with an authenticator that has no users setup ( #8692 )
2019-10-18 11:09:53 -07:00
8b2afa5c49
Use targetRowsPerSegment for single-dim partitions ( #8624 )
...
When using single-dimension partitioning, use targetRowsPerSegment (if
specified) to size segments. Previously, single-dimension partitioning
would always size segments as close to the max size as possible.
Also, change single-dimension partitioning to allow partitions that have
a size equal to the target or max size. Previously, it would create
partitions up to 1 less than those limits.
Also, fix some IntelliJ inspection warnings in HadoopDruidIndexerConfig.
2019-10-17 15:55:12 -07:00
2c758ef5ff
Support assign tasks to run on different categories of MiddleManagers ( #7066 )
...
* Support assign tasks to run on different tiers of MiddleManagers
* address comments
* address comments
* rename tier to category and docs
* doc
* fix doc
* fix spelling errors
* docs
2019-10-17 12:57:19 -07:00
d54d2e1627
Update segments.md ( #8693 )
...
Make bullet numbers clearer with parantheses, fix last reference to 2 being interpreted as a bullet point.
2019-10-17 11:55:23 -07:00
75527f09cd
implement FiniteFirehoseFactory in InlineFirehose ( #8682 )
...
* implement FiniteFirehoseFactory in InlineFirehose
* override isSplittable in InlineFirehoseFactory & improve tests
2019-10-16 19:28:55 -07:00
9f4e11df32
Update tutorial-rollup.md ( #8687 )
...
At this point there hasn't yet been an explanation in the tutorial of what "segments" are
2019-10-16 20:08:09 -06:00
89ce6384f5
More Kinesis resharding adjustments ( #8671 )
...
* More Kinesis resharding adjustments
* Fix TC inspection
* Fix comment'
* Adjust comment, small refactor
* Make repartition transition time configurable
* Add spellcheck exclusion
* Spelling fix
2019-10-15 23:19:17 -07:00
4046c86d62
Stateful auto compaction ( #8573 )
...
* Stateful auto compaction
* javaodc
* add removed test back
* fix test
* adding indexSpec to compactionState
* fix build
* add lastCompactionState
* address comments
* extract CompactionState
* fix doc
* fix build and test
* Add a task context to store compaction state; add javadoc
* fix it test
2019-10-15 22:57:42 -07:00
1a78a0c98a
Add credentials for ECS ( #8651 )
...
* Add credentials for ECS
* Fix import order
* Update S3 authentication methods table
* Update .spelling for new documentation
2019-10-12 09:12:14 -07:00
d87840d894
Minor updates to documentation. ( #8665 )
2019-10-12 09:11:03 -07:00
124efa85f6
Fix for RoundRobinStorageLocationSelectorStrategy not to pick the same storage location over and again ( #8634 )
...
* Fix for 8614: iterators returned by strategy don't share iteration state.
* Adding comments
2019-10-12 09:53:52 +08:00
6c609293b2
show full value in SQL view ( #8660 )
2019-10-10 14:16:11 -07:00
bba262a4c5
Fix resource leaks and suppress an incorrect LGTM alert ( #8589 )
...
* Fix resource leaks and suppress an incorrect alert
* Replace Guava's Files
2019-10-10 22:40:45 +03:00
4c215b417e
Web console: misc bug fixes and tidy up ( #8654 )
...
* fix updates
* fix status dialog
* fix scan query deserialization
* extract error message
* update snapshot
2019-10-10 10:52:46 -07:00
0c387c1d47
Fix Kinesis resharding issues ( #8644 )
...
* Fix Kinesis resharding issues
* PR comments
* Adjust metadata error message
* Remove unused method
* Use sha1 for shard id hashing
* Add metadata sanity check, add comment
* Only use shard ID hashing for group mapping
* Style fix
* Fix unused import
* update comment
* Fix teamcity inspection
2019-10-10 00:16:44 -07:00
96d8523ecb
Use hash of Segment IDs instead of a list of explicit segments in auto compaction ( #8571 )
...
* IOConfig for compaction task
* add javadoc, doc, unit test
* fix webconsole test
* add spelling
* address comments
* fix build and test
* address comments
2019-10-09 11:12:00 -07:00
526f04c47c
Fix missing jackson jars for hadoop ingestion ( #8652 )
...
* Fix missing jackson jars for hadoop ingestion
* PR comments
* pom ordering
* New approach
* Remove all jackson-core/mapper-asl exclusions from hdfs storage
2019-10-08 23:54:55 -07:00
8bda3afea4
fix spelling errors triggered by another doc PR ( #8653 )
2019-10-08 23:43:58 -07:00
b6b5517c20
Speed up ParallelIndexSupervisorTask tests ( #8633 )
...
Previously, some tests for ParallelIndexSupervisorTask were being run
twice unnecessarily.
2019-10-08 19:56:12 -07:00
Gian Merlino
Vadim Ogievetsky
Chi Cao Minh
Xiaobao
Clint Wylie
Eyal Yurman
Evan Ren
Jihoon Son
David Glasser
Jad Naous
Nishant Bangarwa
Abhishek Radhakrishnan
Surekha
Kamal Gurala
Jonathan Wei
Mohammad J. Khan
Mingming Qiu
Aditya
Mitch Lloyd
Sashidhar Thallam
Benedict Jin