Vadim Ogievetsky
ec8ce74f1c
Web console: Better data loader flow ( #8763 )
...
* filter table
* go over the entire data loader flow
2019-10-28 08:08:46 -07:00
Gian Merlino
b65d2ac648
Add HDFS firehose ( #8754 )
...
* Add HDFS firehose.
* Tests, support for lists of paths.
* Fixups.
* Update list of firehoses.
* Wildcards is a word.
2019-10-28 08:07:38 -07:00
Vadim Ogievetsky
f9b94a5db1
Docs: remove self link ( #8760 )
...
This section links to itself in the description. I tried to follow that link and spit hot tea all over my monitor from laughter.
2019-10-27 22:33:22 -07:00
Vadim Ogievetsky
1b9d4ce811
Web console: Memoize all the functional components and improve transform step highlighting ( #8757 )
...
* Fix transform table
* memoize all components
* use named functions
2019-10-26 17:58:26 -07:00
Chi Cao Minh
ad615438f6
Fix Hadoop tutorial Dockerfile ( #8753 )
...
When following the instructions from Hadoop batch load tutorial in the
docs, building the Docker images fails with:
gzip: stdin: unexpected end of file
tar: Child returned status 1
tar: Error is not recoverable: exiting now
Updating nss allows the curl command for downloading Hadoop to succeed
while building the Docker image.
2019-10-25 17:58:40 -07:00
Vadim Ogievetsky
80be9462a6
Web console: Update versions and dependencies ( #8751 )
...
* update console version and deps
* bump script version
2019-10-25 17:53:06 -07:00
Vadim Ogievetsky
9eb68b1d53
Add version to canonical URL ( #8747 )
2019-10-25 12:46:39 -07:00
Vadim Ogievetsky
27127345b7
Add delimiter option for TSV parser ( #8741 )
2019-10-25 09:17:59 -07:00
Xiaobao
b9d10473a5
fix typo ( #8745 )
2019-10-25 19:21:56 +08:00
Clint Wylie
09f92818d4
update druid expression docs to indicate that array functions do not work at indexing time ( #8734 )
...
* update druid expression docs to indicate that array functions are not supported in transformSpec
* fix unrelated spelling check
2019-10-24 22:04:08 -07:00
Eyal Yurman
14e33428f0
Moving Average extention: Add Sum averagers ( #8511 )
...
* Add sum averagers.
* avoid casting double to long.
2019-10-24 16:37:24 -07:00
Vadim Ogievetsky
774ce3ce6d
add canonical to the docs ( #8731 )
2019-10-24 15:25:57 -07:00
Vadim Ogievetsky
efd669757e
fix save button ( #8732 )
2019-10-24 15:25:28 -07:00
Vadim Ogievetsky
cc3650ee3b
fix doc headers ( #8729 )
2019-10-24 11:17:39 -07:00
Evan Ren
fdbc4ae147
Web console: Button to pretty print Druid JSON query ( #8724 )
...
* Add button and functionality to pretty format Rune JSON
* Removed console log
* Fix lgtm error about updating state
* Update test snapshot
2019-10-23 20:24:47 -07:00
Vadim Ogievetsky
137c2a6025
Web console: disable data loader Submit button when submitting so as not to submit multiple times ( #8725 )
...
* disable Submit button when submitting so as not to submit twice
* also check in fn
2019-10-23 18:42:44 -07:00
Jihoon Son
094936ca03
Remove commit() method Firehose ( #8688 )
...
* Remove commit() method Firehose
* fix javadoc
2019-10-23 16:52:02 -07:00
Jihoon Son
2518478b20
Remove deprecated parameter for Checkpoint request ( #8707 )
...
* Remove deprecated parameter for Checkpoint request
* fix wrong doc
2019-10-23 16:51:16 -07:00
Vadim Ogievetsky
d9c9aef3d1
Druid Doctor ( #8672 )
...
* adding Druid doctor
* better meesage
* feedback changes
* add icons
* feedback fixes
* spelling
* add file.encoding check
* feedback changes
2019-10-23 16:50:08 -07:00
Clint Wylie
a8b674e00d
fix indexer when used with http inventory view ( #8723 )
2019-10-23 15:52:57 -07:00
Vadim Ogievetsky
3abd0c4a33
Web console: start transition to React hooks and functional components ( #8722 )
...
* do the easy stuff
* some more components
2019-10-23 09:43:02 -07:00
Jihoon Son
f5b9bf5525
Cluster-wide configuration for query vectorization ( #8657 )
...
* Cluster-wide configuration for query vectorization
* add doc
* fix build
* fix doc
* rename to QueryConfig and add javadoc
* fix checkstyle
* fix variable names
2019-10-23 21:44:28 +08:00
David Glasser
b453fda251
docs: clarify native batch ingestion w/ overlapping segments ( #8720 )
...
I was confused by a paragraph in the docs that I myself wrote!
2019-10-22 21:01:56 -07:00
Jad Naous
2ab43aa688
Update tutorial-kerberos-hadoop.md ( #8689 )
...
* Update tutorial-kerberos-hadoop.md
Fix up what looks like a bad merge.
* Update tutorial-kerberos-hadoop.md
Fix spelling issues
2019-10-22 14:40:41 -07:00
Nishant Bangarwa
48486a4535
Fix jackson property name for dropwizardemitterconfig ( #8691 )
...
Fix jackson property name and add test
Fix test
2019-10-22 14:40:19 -07:00
Abhishek Radhakrishnan
42cfe679f1
Update query result timestamp to match query intervals. ( #8717 )
2019-10-22 14:39:47 -07:00
Gian Merlino
bb4368baec
Fix PeriodGranularity.bucketStart for days that don't start with midnight. ( #8711 )
...
* Fix PeriodGranularity.bucketStart for days that don't start with midnight.
* Use more newspeak method.
2019-10-22 10:00:52 -07:00
Surekha
e919eccc4b
Update docs to add metadataSegment configs ( #8708 )
...
* Add metadataSegment configs to docs
* rearrange in alphabetical order
2019-10-22 01:19:36 -07:00
Kamal Gurala
3ed5f9698a
gcs prefix doc fix ( #8699 )
2019-10-21 08:29:54 -07:00
Surekha
98f59ddd7e
Add `sys.supervisors` table to system tables ( #8547 )
...
* Add supervisors table to SystemSchema
* Add docs
* fix checkstyle
* fix test
* fix CI
* Add comments
* Fix javadoc teamcity error
* comments
* fix links in docs
* fix links
* rename fullStatus query param to system and remove it from docs
2019-10-18 15:16:42 -07:00
Jonathan Wei
d88075237a
Add initial SQL support for non-expression sketch postaggs ( #8487 )
...
* Add initial SQL support for non-expression sketch postaggs
* Checkstyle, spotbugs
* checkstyle
* imports
* Update SQL docs
* Checkstyle
* Fix theta sketch operator docs
* PR comments
* Checkstyle fixes
* Add missing entries for HLL sketch module
* PR comments, add round param to HLL estimate operator, fix optional HLL param
2019-10-18 14:59:44 -07:00
Jihoon Son
30c15900be
Auto compaction based on parallel indexing ( #8570 )
...
* Auto compaction based on parallel indexing
* javadoc and doc
* typo
* update spell
* addressing comments
* address comments
* fix log
* fix build
* fix test
* increase default max input segment bytes per task
* fix test
2019-10-18 13:24:14 -07:00
Mohammad J. Khan
1ca859584f
Issue 8678 Non-coordinator services are repeatedly logging JsonMappingException when using druid-basic-security extension with an authenticator that has no users setup ( #8692 )
2019-10-18 11:09:53 -07:00
Chi Cao Minh
8b2afa5c49
Use targetRowsPerSegment for single-dim partitions ( #8624 )
...
When using single-dimension partitioning, use targetRowsPerSegment (if
specified) to size segments. Previously, single-dimension partitioning
would always size segments as close to the max size as possible.
Also, change single-dimension partitioning to allow partitions that have
a size equal to the target or max size. Previously, it would create
partitions up to 1 less than those limits.
Also, fix some IntelliJ inspection warnings in HadoopDruidIndexerConfig.
2019-10-17 15:55:12 -07:00
Mingming Qiu
2c758ef5ff
Support assign tasks to run on different categories of MiddleManagers ( #7066 )
...
* Support assign tasks to run on different tiers of MiddleManagers
* address comments
* address comments
* rename tier to category and docs
* doc
* fix doc
* fix spelling errors
* docs
2019-10-17 12:57:19 -07:00
Jad Naous
d54d2e1627
Update segments.md ( #8693 )
...
Make bullet numbers clearer with parantheses, fix last reference to 2 being interpreted as a bullet point.
2019-10-17 11:55:23 -07:00
Aditya
75527f09cd
implement FiniteFirehoseFactory in InlineFirehose ( #8682 )
...
* implement FiniteFirehoseFactory in InlineFirehose
* override isSplittable in InlineFirehoseFactory & improve tests
2019-10-16 19:28:55 -07:00
Jad Naous
9f4e11df32
Update tutorial-rollup.md ( #8687 )
...
At this point there hasn't yet been an explanation in the tutorial of what "segments" are
2019-10-16 20:08:09 -06:00
Jonathan Wei
89ce6384f5
More Kinesis resharding adjustments ( #8671 )
...
* More Kinesis resharding adjustments
* Fix TC inspection
* Fix comment'
* Adjust comment, small refactor
* Make repartition transition time configurable
* Add spellcheck exclusion
* Spelling fix
2019-10-15 23:19:17 -07:00
Jihoon Son
4046c86d62
Stateful auto compaction ( #8573 )
...
* Stateful auto compaction
* javaodc
* add removed test back
* fix test
* adding indexSpec to compactionState
* fix build
* add lastCompactionState
* address comments
* extract CompactionState
* fix doc
* fix build and test
* Add a task context to store compaction state; add javadoc
* fix it test
2019-10-15 22:57:42 -07:00
Mitch Lloyd
1a78a0c98a
Add credentials for ECS ( #8651 )
...
* Add credentials for ECS
* Fix import order
* Update S3 authentication methods table
* Update .spelling for new documentation
2019-10-12 09:12:14 -07:00
Abhishek Radhakrishnan
d87840d894
Minor updates to documentation. ( #8665 )
2019-10-12 09:11:03 -07:00
Sashidhar Thallam
124efa85f6
Fix for RoundRobinStorageLocationSelectorStrategy not to pick the same storage location over and again ( #8634 )
...
* Fix for 8614: iterators returned by strategy don't share iteration state.
* Adding comments
2019-10-12 09:53:52 +08:00
Vadim Ogievetsky
6c609293b2
show full value in SQL view ( #8660 )
2019-10-10 14:16:11 -07:00
Benedict Jin
bba262a4c5
Fix resource leaks and suppress an incorrect LGTM alert ( #8589 )
...
* Fix resource leaks and suppress an incorrect alert
* Replace Guava's Files
2019-10-10 22:40:45 +03:00
Vadim Ogievetsky
4c215b417e
Web console: misc bug fixes and tidy up ( #8654 )
...
* fix updates
* fix status dialog
* fix scan query deserialization
* extract error message
* update snapshot
2019-10-10 10:52:46 -07:00
Jonathan Wei
0c387c1d47
Fix Kinesis resharding issues ( #8644 )
...
* Fix Kinesis resharding issues
* PR comments
* Adjust metadata error message
* Remove unused method
* Use sha1 for shard id hashing
* Add metadata sanity check, add comment
* Only use shard ID hashing for group mapping
* Style fix
* Fix unused import
* update comment
* Fix teamcity inspection
2019-10-10 00:16:44 -07:00
Jihoon Son
96d8523ecb
Use hash of Segment IDs instead of a list of explicit segments in auto compaction ( #8571 )
...
* IOConfig for compaction task
* add javadoc, doc, unit test
* fix webconsole test
* add spelling
* address comments
* fix build and test
* address comments
2019-10-09 11:12:00 -07:00
Jonathan Wei
526f04c47c
Fix missing jackson jars for hadoop ingestion ( #8652 )
...
* Fix missing jackson jars for hadoop ingestion
* PR comments
* pom ordering
* New approach
* Remove all jackson-core/mapper-asl exclusions from hdfs storage
2019-10-08 23:54:55 -07:00
Clint Wylie
8bda3afea4
fix spelling errors triggered by another doc PR ( #8653 )
2019-10-08 23:43:58 -07:00