dbaaa6af92
Make the TaskQueue big lock fair
2015-12-01 19:13:07 -08:00
1eb8211346
Add datasource and taskId to metrics emitted by peons
...
This PR adds the datasource and taskId to the jvm and sys metrics
emitted by the peons.
fix spelling
review comment
review comment
2015-12-01 23:20:59 +05:30
cd2cff24ff
Fix serde for FragmentSearchQuerySpec and add some tests.
2015-11-30 17:34:35 -08:00
7c91219130
adding more comments to why drops do not happen when there are no segments in db
2015-11-25 16:26:51 -06:00
bad96537a9
Merge pull request #2009 from jon-wei/multival_json_doc
...
Update data formats doc with info about JSON multi-value dimensions
2015-11-24 22:47:53 -08:00
78e07ea591
Merge pull request #2004 from navis/DRUID-2003
...
fixed #2003 ColumnSelectorBitmapIndexSelector throws NPE for dimension not supporting bitmap
2015-11-25 00:12:30 -06:00
95dca4440f
Update data formats doc with info about JSON multi-value dimensions
2015-11-24 14:38:06 -08:00
8e83d800d6
Merge pull request #1881 from gianm/restartable-tasks
...
Restorable indexing tasks
2015-11-23 21:14:37 -08:00
c73418c181
fixed #2003 ColumnSelectorBitmapIndexSelector throws NPE for dimension not supporting bitmap
2015-11-24 10:45:36 +09:00
13af260102
Merge pull request #1957 from metamx/skip-incremental-segment
...
Ability to skip Incremental Index during query using query context
2015-11-23 17:32:57 -08:00
f3185938a8
Merge pull request #1997 from gianm/fix-nullable-actions
...
Switch TaskActions from Optionals to nullable.
2015-11-23 16:02:40 -08:00
501dcb43fa
Some changes that make it possible to restart tasks on the same hardware.
...
This is done by killing and respawning the jvms rather than reconnecting to existing
jvms, for a couple reasons. One is that it lets you restore tasks after server reboots
too, and another is that it lets you upgrade all the software on a box at once by just
restarting everything.
The main changes are,
1) Add "canRestore" and "stopGracefully" methods to Tasks that say if a task can
stop gracefully, and actually do a graceful stop. RealtimeIndexTask is the only
one that currently implements this.
2) Add "stop" method to TaskRunners that attempts to do an orderly shutdown.
ThreadPoolTaskRunner- call stopGracefully on restorable tasks, wait for exit
ForkingTaskRunner- close output stream to restorable tasks, wait for exit
RemoteTaskRunner- do nothing special, we actually don't want to shutdown
3) Add "restore" method to TaskRunners that attempts to bootstrap tasks from last run.
Only ForkingTaskRunner does anything here. It maintains a "restore.json" file with
a list of restorable tasks.
4) Have the CliPeon's ExecutorLifecycle lock the task base directory to avoid a restored
task and a zombie old task from stomping on each other.
2015-11-23 11:22:08 -08:00
36569094ce
EventReceiverFirehose: Drain buffer when closed, until empty.
2015-11-20 19:12:59 -08:00
c0580bf063
Merge pull request #1928 from druid-io/new-compares
...
New comparisons for Druid
2015-11-20 16:40:59 -08:00
bec7dacd86
Merge pull request #1994 from himanshug/how_to_contrib_update
...
updating how to contribute guide
2015-11-20 10:33:34 -08:00
666d785787
Switch TaskActions from Optionals to nullable.
...
Deserialization of Optionals does not work quite right- they come back as actual
nulls, rather than absent Optionals. So these probably only ever worked for the local
task action client.
2015-11-20 09:14:07 -08:00
7a89b2e1a6
add numRows to segment metadata query response
2015-11-20 01:25:02 -06:00
5260783db4
updating how to contribute guide
2015-11-19 23:30:28 -06:00
6305dfe1b9
Merge pull request #1991 from himanshug/sketch_agg_upgrade
...
datasketches module updates
2015-11-19 13:16:14 -08:00
f99bad7988
reformat datasketches module to satisfy druid style guidelines
2015-11-19 01:07:03 -06:00
fde9df2720
update to sketches-core-0.2.2 .
...
adds support for "cardinality" aggregator.
do not create sketch per event at ingestion time to make realtime ingestion faster
2015-11-19 01:05:59 -06:00
24ba20c52f
Merge pull request #1979 from metamx/update-docker-stuff
...
switch integration tests docker image to Java 8 + cleanup
2015-11-18 23:24:05 -06:00
21c84b5ff7
Merge pull request #1896 from gianm/allocate-segment
...
SegmentAllocateAction (fixes #1515 )
2015-11-18 21:05:46 -08:00
d93640bfcb
Merge pull request #1974 from jon-wei/dim_order_merge
...
Allow IndexMerger to use non-lexicographic dim order when merging indexes
2015-11-18 19:51:34 -06:00
e52c156066
Merge pull request #1880 from gianm/rtr-adjust
...
RTR: Ensure that there is only one cleanup task scheduled for a worker at once.
2015-11-18 15:12:55 -08:00
60f649dab1
Ability to skip Incremental Index during query using query context
...
This PR adds adds the ability to skip incremental index when querying
results from realtime nodes. default behaviour is to include
incrementalIndex in queries.
review comment
2015-11-19 00:29:41 +05:30
e3e6159336
Merge pull request #1985 from metamx/FixLookupCacheKey
...
Change LookupExtractionFn cache key to be unique
2015-11-18 10:13:55 -08:00
7abe999418
Change LookupExtractionFn cache key to be unique
2015-11-17 18:02:40 -08:00
87c43fbf02
Merge pull request #1981 from rasahner/fixFormattingSchemaDesign
...
fix formatting in schema-design
2015-11-17 17:51:16 -08:00
7545ab7188
Merge pull request #1983 from metamx/fix-mysql-57
...
fix #1701 - MySQL 5.7 defaults break database character set check
2015-11-17 17:36:41 -08:00
ba41f37ce1
fix #1701 - MySQL 5.7 defaults break database character set check
2015-11-17 15:51:58 -08:00
8fcf2403e3
Merge pull request #1943 from metamx/realtime-caching
...
Enable caching on intermediate realtime persists
2015-11-17 15:06:43 -08:00
a4ed2ce2d1
fix formatting in schema-design
2015-11-17 16:50:53 -06:00
350fdbeec1
switch to Java 8 + cleanup
2015-11-17 13:35:06 -08:00
4afc62be29
Allow IndexMerger to use non-lexicographic dim order when merging indexes
2015-11-17 13:02:31 -08:00
8fa34ee671
Merge pull request #1973 from metamx/cachemonitor-optional-injection
...
CacheMonitor - make cache injection optional
2015-11-17 13:02:06 -08:00
9118b010c0
Merge pull request #1976 from noddi/feature/count-parameter-rules-history
...
Add count parameter to rules history endpoint.
2015-11-17 14:41:50 -06:00
dbe201aeed
Merge pull request #1929 from pjain1/jetty_threads
...
separate ingestion and query thread pool
2015-11-17 12:14:25 -08:00
6c498b7d4a
separate ingestion and query thread pool
2015-11-17 13:42:41 -06:00
b0a444eafc
Add count parameter to rules history endpoint.
2015-11-17 20:14:12 +01:00
d7eb2f717e
enable query caching on intermediate realtime persists
2015-11-17 10:58:00 -08:00
71376efd57
make cache injection optional
...
allows enabling the CacheMonitor for all index tasks, even if some don't
bind any cache instance.
2015-11-16 22:40:01 -08:00
0fb7e4e040
Merge pull request #1975 from gianm/query-to-strings
...
Better toString for groupBy, segmentMetadata queries.
2015-11-16 13:08:50 -08:00
57f213d536
Better toString for groupBy, segmentMetadata queries.
2015-11-16 12:54:59 -08:00
acc1a215c7
Merge pull request #1968 from metamx/fix-integration-tests
...
Fix ITUnionQueryTest failing on machines with less than 4 cores
2015-11-13 15:19:54 -08:00
4486b3fe8b
Fix ITUnionQueryTest failing on machines with 1 core
...
ITUnionQueryTest runs 4 realtime tasks and runs a unionQuery over them,
the worker is not able to run all the tasks concurrently on machines
with less cpu cores as it picks default worker capacity.
Explicitly specify worker capacity to avoid this.
2015-11-13 13:46:36 -08:00
46527a9610
Merge pull request #1954 from metamx/fix-stupid-aws-limit
...
EC2 autoscaler: avoid hitting aws filter limits
2015-11-13 10:52:35 -08:00
846bef3d7a
Merge pull request #1964 from metamx/update-docker-stuff
...
update integration-test docker instructions for docker-machine
2015-11-12 16:52:57 -08:00
bd7d2c9b3a
update integration-test docker instructions for docker-machine
2015-11-12 16:44:28 -08:00
353e568cbd
Merge pull request #1959 from jon-wei/indexadapter_getrows
...
Fix IncrementalIndexAdapter getRows() Iterable
2015-11-12 14:38:33 -08:00
Charles Allen
Nishant
Gian Merlino
Himanshu Gupta
Fangjin Yang
jon-wei
navis.ryu
Xavier Léauté
Xavier Léauté
sahner
Parag Jain
Bartosz Ługowski