7051230a41
SQL: Throttle metadata refreshes when they fail. ( #5328 )
2018-02-02 15:17:39 -08:00
222a13e401
Use httpRemote and not remoteHttp for using HTTP Tasks Mgmt ( #5334 )
2018-02-02 14:16:43 -06:00
de7f28e6d9
Fix some unemitted alerts in druid-basic-security. ( #5327 )
2018-02-02 11:39:21 -08:00
c9e7c0a817
Remove Escalator jetty http client escalation method ( #5322 )
2018-02-02 12:43:02 -06:00
7e02408510
Update versions to 0.13.0-SNAPSHOT. ( #5323 )
2018-02-02 12:06:38 -06:00
10b8540f80
CliCoordinator: LoadQueueTaskMaster should use an escalated http client. ( #5329 )
...
Also remove Guice annotations from LoadQueueTaskMaster, since it is
provided by CliCoordinator, so Guice does not need to know how to
build one directly.
2018-02-02 10:44:32 -06:00
4cd47de62f
add LookupExtractorFactory.destroy() method ( #5287 )
...
* add LookupExtractorFactory.destroy() method
* fix LookupReferencesManagerTest
2018-02-01 22:56:09 -08:00
ed47a1e1a9
Lookups: Inherit "injective" from registered lookups, improve docs. ( #5316 )
...
Code changes:
- In the lookup-based extractionFns, inherit injective property from
the lookup itself if not specified.
Doc changes:
- Add a "Query execution" section to the lookups doc explaining how
injective lookups and their optimizations work.
- Remove scary warnings against using registeredLookup extractionFns.
They are necessary and important since they work with filters and
function cascades -- two things that the dimension specs do not do.
They deserve to be first class citizens.
- Move the "registeredLookup" fn above the "lookup" fn. It's probably
more commonly used, so the docs read better this way.
2018-02-01 18:30:19 -08:00
1fffc681d2
fix RemoteTaskRunner terminating lazy workers below autoscaler minNumWorkers value ( #5310 )
...
* fix RemoteTaskRunner terminating lazy workers below autoscaler minNumWorkers value
* add comment
2018-02-01 17:57:01 +01:00
3a69b0e513
Handle nullable taskTypes for rolling upgrade ( #5309 )
2018-01-30 13:32:54 -08:00
64ee65856e
ApproximateHistogram: Skip nulls on input, and use more standard parsing code. ( #5308 )
2018-01-30 12:32:56 -08:00
be66d4b822
clean up intermediate_pushes directory for LocalDataSegmentPusher ( #5306 )
2018-01-30 12:33:06 -06:00
632e44c539
use reflection to call hadoop fs.rename to workaround different hadoop jar version in main and hdfs-storage extension class loader ( #5296 )
...
* use reflection to call hadoop fs.rename to workaround different hadoop jar version in main and hdfs-storage extension class loader
* find rename method recursively
2018-01-29 10:26:53 -08:00
a5ba31c230
Fix graphite whitelist converter to handle array dimensions ( #5269 )
...
* Fix graphite whitelist converter to handle array dimensions
* Fix ambari whitelist converter to handle array dimensions
2018-01-29 21:46:46 +05:30
2a892709e8
More memory limiting for HttpPostEmitter ( #5300 )
...
* More memory limiting for HttpPostEmitter
* Less aggressive large events test
* Fix tests
* Restrict batch queue size first, keep minimum of 2 queue items
2018-01-26 15:48:45 -08:00
59250cf19b
add taskType from announcement in HttpRemoteTaskRunnerWorkItem ( #5301 )
2018-01-26 15:47:35 -08:00
d6f47eaf76
reduce noise in the logs ( #5302 )
2018-01-26 13:10:02 -08:00
f6749f1229
Allow separate truststore conf for HttpEmitter ( #5298 )
...
* Fix HttpEmitter TLS support, allow separate truststore conf
* PR comment, fix tests
2018-01-26 10:46:06 -06:00
80419752b5
Add metamx emitter, http clients, and metrics packages to druid java-util ( #5289 )
...
* Add metamx java-util emitter, http clients, and metrics packages to druid java-util
* Remove metamx java-util from pom.xml files
* Checkstyle fixes
* Import fix
* TeamCity inspection fixes
* Use slf4j, move some version defs to master pom.xml
* Use parent jvm-attach-api and maven-surefire-plugin versions
* Add ] to log msg, suppress inspection
2018-01-24 22:10:36 +01:00
d54330be76
remove unnecessary log that pontetially take up lots of heap ( #5286 )
2018-01-24 11:30:51 -08:00
cc32640642
Update the example of the dimensionsSpec ( #5293 )
...
The example was outdated with the dateSpec
2018-01-24 11:28:54 -08:00
53e3c7d1b2
SQL: Add additional unsupported features to the docs. ( #5290 )
2018-01-24 11:27:47 -08:00
aca200fddb
Fix rewrite of queryPath for encoded joda intervals as query param on druid router ( #5274 )
...
* Fix rewrite of queryPath for encoded joda intervals as query param on druid router
* fix checkstyle
* fix comment
2018-01-24 02:20:07 +05:30
61e6878afd
Check Javadoc reference integrity ( #5279 )
2018-01-22 13:51:28 -08:00
a346bbc6f3
Enforce spacing around foreach colon with Checkstyle ( #5271 )
2018-01-22 11:48:51 -08:00
f99c27e9e0
Fix bugs in ImmutableRTree; Merge bytebuffer-collections module into druid-processing ( #5275 )
...
* Fix bugs in ImmutableRTree; optimize ImmmutableRTreeObjectStrategy.writeTo(); Merge bytebuffer-collections module into druid-processing
* Remove unused declaration
* Fix another bug
2018-01-23 00:49:59 +05:30
87c744ac1d
Add MethodParamPad, OneStatementPerLine and EmptyStatement Checkstyle checks ( #5272 )
2018-01-18 11:29:23 -08:00
d6932c1621
java-util version update + Add UnusedConnectionTimeout config. ( #5239 )
...
* java-util version update + Add UnusedConnectionTimeout config.
* warn if unusedConnectionTime >= readTimeout.
* Doc update + addressed comment.
* Use compareTo to compare duration.
* remove unused variable.
* addressed comments and default for unusedConnectionTimeout.
2018-01-17 15:54:18 -06:00
b6b12db8b4
do not include the index in toString ( #5268 )
2018-01-17 20:03:53 +01:00
2c9a881dec
Remove TODO implemented in pull/5165 ( #5262 )
2018-01-18 00:05:53 +05:30
ad6cdf5d09
Reuse IndexedInts returned from DimensionSelector.getRow() implementations ( #5172 )
...
* Reuse IndexedInts in DimensionSelector implementations
* Remove BaseObjectColumnValueSelector.getObject() doc
* typo
2018-01-17 16:01:26 +01:00
241efafbb2
Automatic compaction by coordinators ( #5102 )
...
* Automatic compaction by coordinator
* add links
* skip compaction for very recent segments if they are small
* fix finding search interval
* fix finding search interval
* fix TimelineHolder iteration
* add test for newestSegmentFirstPolicy
* add CompactionSegmentIterator
* add numTargetCompactionSegments
* add missing config
* fix skipping huge shards
* fix handling large number of segments per shard
* fix test failure
* change recursive call to loop
* fix logging
* fix build
* fix test failure
* address comments
* change dataSources type
* check running pendingTasks at each run
* fix test
* address comments
* fix build
* fix test
* address comments
* address comments
* add doc for segment size optimization
* address comment
2018-01-13 13:52:37 +09:00
a11049c82f
Fix APPROX_QUANTILE on outer groupBys. ( #5253 )
2018-01-12 12:01:32 -08:00
491f8cca81
fix timewarp query results when using timezones and crossing DST transitions ( #5157 )
...
* timewarp and timezones
changes:
* `TimewarpOperator` will now compensate for daylight savings time shifts between date translation ranges for queries using a `PeriodGranularity` with a timezone defined
* introduces a new abstract query type `TimeBucketedQuery` for all queries which have a `Granularity` (100% not attached to this name). `GroupByQuery`, `SearchQuery`, `SelectQuery`, `TimeseriesQuery`, and `TopNQuery` all extend `TimeBucke
tedQuery`, cutting down on some duplicate code and providing a mechanism for `TimewarpOperator` (and anything else) that needs to be aware of granularity
* move precondition check to TimeBucketedQuery, add Granularities.nullToAll, add getTimezone to TimeBucketQuery
* formatting
* more formatting
* unused import
* changes:
* add 'getGranularity' and 'getTimezone' to 'Query' interface
* merge 'TimeBucketedQuery' into 'BaseQuery'
* fixup tests from resulting serialization changes
* dedupe
* fix after merge
* suppress warning
2018-01-11 12:39:33 -08:00
3c69717202
Fix typo in configuration/index.md ( #5249 ) ( #5250 )
...
* Fix #5212 - typo in auth.md.
* Fix typo in configuration (#5249 )
* Add a backquote.
* Fix typo from HttpEmitterMonitor to HttpEmittingMonitor.
2018-01-11 18:29:12 +09:00
8877ce38d6
Enforce modifier order with Checkstyle ( #5246 )
2018-01-11 09:50:42 +01:00
3cc4a0ab19
Support for encryption of MySQL connections ( #5122 )
...
* Encrypting MySQL connections
* Update docs
* Make verifyServerCertificate a configurable parameter
* Change password parameter and doc update
* Make server certificate verification disabled by default
* Update tostring
* Update docs
* Add check for trust store passwords
* Add warning for null password
2018-01-10 11:33:54 -08:00
5d0619f5ce
Support retrying for PrefetchableTextFilesFirehoseFactory when prefetch is disabled ( #5162 )
...
* Add RetryingInputStream
* unnecessary exception
* fix PrefetchableTextFilesFirehoseFactoryTest
* Fix retrying on connection reset
* fix start offset
* fix checkstyle
* fix check connection reset
* address comments
* fix compile
* address comments
* address comments
2018-01-10 17:37:19 +01:00
7b8b0a96d6
IndexTask: Add summary stats line at the end. ( #5241 )
2018-01-10 14:06:54 +09:00
972b4d189a
Fix topN doc ( #5240 )
2018-01-09 20:10:13 -08:00
83c6c48bed
Fix state check bug in Kafka Index Task ( #5204 )
...
* fix state check for replacement task
* fix comments
* rebase with master
2018-01-08 18:01:36 -08:00
cdd374a417
Throw away rows with timestamps beyond long bounds in kafka indexing ( #5215 )
...
* Throw away rows with timestamps beyond long bounds in kafka indexing
* PR comments
2018-01-08 17:40:50 -06:00
9186547689
Exclude sketches-core from druid-sql ( #5223 )
2018-01-05 17:12:20 -06:00
02544f9197
Add missing auth doc links ( #5224 )
2018-01-05 16:23:13 -06:00
535ec437e9
Apply 'power of 2' optimization to BlockLayoutIndexedDoubleSupplier ( #5176 )
...
* Apply 'power of 2' optimization to BlockLayoutIndexedDoubleSupplier; slight optimization of buffer.get() in block layout indexed suppliers
* Fix byte order
2018-01-05 16:08:07 +09:00
a46d34daa2
HTTP based task/worker management. ( #5104 )
...
* just renaming of SegmentChangeRequestHistory etc
* additional change history refactoring changes
* WorkerTaskManager a replica of WorkerTaskMonitor
* HttpServerInventoryView refactoring to extract sync code and robustification
* Introducing HttpRemoteTaskRunner
* Additional Worker side updates
2018-01-04 19:19:35 -08:00
935ac646f4
Upgrade to Calcite 1.15.0 ( #5210 )
...
* Upgrade to Calcite 1.15.0
* Use Filtration.eternity()
2018-01-04 12:11:24 -08:00
5a8ea5f8ab
Fix #5212 - typo in auth.md. ( #5213 )
2018-01-04 12:09:42 -08:00
4cc31e4e7a
Update Zookeeper version ( #5184 )
2018-01-04 10:59:20 +08:00
579f9fbedf
Add IndexedInts.debugToString() and AbstractIndex.toString(); Add Sequence.toList() and limit() ( #5175 )
...
* Add IndexedInts.debugToString() and AbstractIndex.toString()
* Fix AppenderatorTest
2018-01-04 09:56:47 +09:00
Gian Merlino
Himanshu
Jonathan Wei
Clint Wylie
Jihoon Son
David Lim
Kevin Conaway
Fokko Driesprong
Nishant Bangarwa
Roman Leventov
Akash Dwivedi
Parag Jain
Kirill Kozlov
Shen Liu
Atul Mohan