bcff08826b
KafkaIndexTask: Treat null values as unparseable. ( #3453 )
2016-09-13 10:56:38 -07:00
df766b2bbd
Add dimension handling interface for ingestion and segment creation ( #3217 )
...
* Add dimension handling interface for ingestion and segment creation
* update javadocs for DimensionHandler/DimensionIndexer
* Move IndexIO row validation into DimensionHandler
* Fix null column skipping in mergerV9
* Add deprecation note for 'numeric_dims' filename pattern in IndexIO v8->v9 conversion
* Fix java7 test failure
2016-09-12 12:54:02 -07:00
146a17de48
KafkaIndexTask: allow pause to break out of retry loop ( #3401 )
2016-09-06 22:29:37 -06:00
5b1ae21bd1
retry calls to getStartTime ( #3429 )
2016-09-06 14:02:22 -07:00
ed924bf214
allow registrants to opt out of announcing themselves when registering as a chat handler ( #3360 )
2016-08-16 10:51:28 +05:30
8030f1cb67
Be more respectful of maxRowsInMemory. ( #3284 )
...
- Appenderator: Respect maxRowsInMemory across all sinks.
- KafkaIndexTask: Respect maxRowsInMemory across all partitions.
2016-07-26 15:02:35 -06:00
1d40df4bb7
fix kafka consumer concurrent access during shutdown ( #3193 )
2016-06-28 13:23:17 -07:00
ebf890fe79
Update master version to 0.9.2-SNAPSHOT. ( #3133 )
2016-06-13 13:10:38 -07:00
4faa298977
update kafka client for kafka indexing service to 0.9.0.1 ( #3109 )
2016-06-08 06:51:03 -07:00
a2290a8f05
support seamless config changes ( #3051 )
2016-06-03 13:50:19 -07:00
f6c39cc844
Kafka task minimum message time ( #3035 )
...
* add KafkaIndexTask support for minimumMessageTime
* add Kafka supervisor support for lateMessageRejectionPeriod
2016-05-31 11:37:00 -07:00
3ef24c03b3
Validate X-Druid-Task-Id header in request/response and support retrying on outdated TaskLocation information, add KafkaIndexTaskClient unit tests ( #3006 )
...
* validate X-Druid-Task-Id header in request and add header to response
* modify KafkaIndexTaskClient to take a TaskLocationProvider as the TaskLocation may not remain constant
2016-05-25 22:05:18 -07:00
15ccf451f9
Move QueryGranularity static fields to QueryGranularities ( #2980 )
...
* Move QueryGranularity static fields to QueryGranularityUtil
* Fixes #2979
* Add test showing #2979
* change name to QueryGranularities
2016-05-17 16:23:48 -07:00
b489f63698
Supervisor for KafkaIndexTask ( #2656 )
...
* supervisor for kafka indexing tasks
* cr changes
2016-05-04 23:13:13 -07:00
f8ddfb9a4b
Split SegmentInsertAction and SegmentTransactionalInsertAction for backwards compat. ( #2922 )
...
Fixes #2912 .
2016-05-04 13:54:34 -07:00
7641f2628f
add control and status endpoints to KafkaIndexTask ( #2730 )
2016-04-21 15:34:59 -07:00
08c784fbf6
KafkaIndexTask: Use a separate sequence per Kafka partition in order to make ( #2844 )
...
segment creation deterministic.
This means that each segment will contain data from just one Kafka
partition. So, users will probably not want to have a super high number
of Kafka partitions...
Fixes #2703 .
2016-04-18 22:29:52 -07:00
7e7a886f65
Move druid-api into the druid repo.
...
This is from druid-api-0.3.17, as of commit 51884f1d05d5512cacaf62cedfbb28c6ab2535cf
in the druid-api repo.
2016-03-24 11:04:34 -07:00
a59c9ee1b1
Support use of DimensionSchema class in DimensionsSpec
2016-03-21 13:12:04 -07:00
738dcd8cd9
Update version to 0.9.1-SNAPSHOT.
...
Fixes #2462
2016-03-17 10:34:20 -07:00
f22fb2c2cf
KafkaIndexTask.
...
Reads a specific offset range from specific partitions, and can use dataSource metadata
transactions to guarantee exactly-once ingestion.
Each task has a finite lifecycle, so it is expected that some process will be supervising
existing tasks and creating new ones when needed.
2016-03-10 18:41:43 -08:00
Gian Merlino
Jonathan Wei
David Lim
Charles Allen
jon-wei