Apache
/
druid
mirror of https://github.com/apache/druid.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
6,272 Commits 113 Branches 506 Tags 732 MiB
Commit Graph

6272 Commits

Author SHA1 Message Date
Fangjin Yang bec7dacd86 Merge pull request #1994 from himanshug/how_to_contrib_update 
updating how to contribute guide
 2015-11-20 10:33:34 -08:00
Gian Merlino 666d785787 Switch TaskActions from Optionals to nullable. 
Deserialization of Optionals does not work quite right- they come back as actual
nulls, rather than absent Optionals. So these probably only ever worked for the local
task action client.
 2015-11-20 09:14:07 -08:00
Himanshu Gupta 5260783db4 updating how to contribute guide 2015-11-19 23:30:28 -06:00
Fangjin Yang 6305dfe1b9 Merge pull request #1991 from himanshug/sketch_agg_upgrade 
datasketches module updates
 2015-11-19 13:16:14 -08:00
Himanshu Gupta f99bad7988 reformat datasketches module to satisfy druid style guidelines 2015-11-19 01:07:03 -06:00
Himanshu Gupta fde9df2720 update to sketches-core-0.2.2 . 
adds support for "cardinality" aggregator.
do not create sketch per event at ingestion time to make realtime ingestion faster
 2015-11-19 01:05:59 -06:00
Himanshu 24ba20c52f Merge pull request #1979 from metamx/update-docker-stuff 
switch integration tests docker image to Java 8 + cleanup
 2015-11-18 23:24:05 -06:00
Fangjin Yang 21c84b5ff7 Merge pull request #1896 from gianm/allocate-segment 
SegmentAllocateAction (fixes #1515)
 2015-11-18 21:05:46 -08:00
Himanshu d93640bfcb Merge pull request #1974 from jon-wei/dim_order_merge 
Allow IndexMerger to use non-lexicographic dim order when merging indexes
 2015-11-18 19:51:34 -06:00
Fangjin Yang e52c156066 Merge pull request #1880 from gianm/rtr-adjust 
RTR: Ensure that there is only one cleanup task scheduled for a worker at once.
 2015-11-18 15:12:55 -08:00
Nishant 60f649dab1 Ability to skip Incremental Index during query using query context 
This PR adds adds the ability to skip incremental index when querying
results from realtime nodes. default behaviour is to include
incrementalIndex in queries.

review comment
 2015-11-19 00:29:41 +05:30
Xavier Léauté e3e6159336 Merge pull request #1985 from metamx/FixLookupCacheKey 
Change LookupExtractionFn cache key to be unique
 2015-11-18 10:13:55 -08:00
Charles Allen 7abe999418 Change LookupExtractionFn cache key to be unique 2015-11-17 18:02:40 -08:00
Fangjin Yang 87c43fbf02 Merge pull request #1981 from rasahner/fixFormattingSchemaDesign 
fix formatting in schema-design
 2015-11-17 17:51:16 -08:00
Charles Allen 7545ab7188 Merge pull request #1983 from metamx/fix-mysql-57 
fix #1701 - MySQL 5.7 defaults break database character set check
 2015-11-17 17:36:41 -08:00
Xavier Léauté ba41f37ce1 fix #1701 - MySQL 5.7 defaults break database character set check 2015-11-17 15:51:58 -08:00
Charles Allen 8fcf2403e3 Merge pull request #1943 from metamx/realtime-caching 
Enable caching on intermediate realtime persists
 2015-11-17 15:06:43 -08:00
sahner a4ed2ce2d1 fix formatting in schema-design 2015-11-17 16:50:53 -06:00
Xavier Léauté 350fdbeec1 switch to Java 8 + cleanup 2015-11-17 13:35:06 -08:00
jon-wei 4afc62be29 Allow IndexMerger to use non-lexicographic dim order when merging indexes 2015-11-17 13:02:31 -08:00
Charles Allen 8fa34ee671 Merge pull request #1973 from metamx/cachemonitor-optional-injection 
CacheMonitor - make cache injection optional
 2015-11-17 13:02:06 -08:00
Himanshu 9118b010c0 Merge pull request #1976 from noddi/feature/count-parameter-rules-history 
Add count parameter to rules history endpoint.
 2015-11-17 14:41:50 -06:00
Charles Allen dbe201aeed Merge pull request #1929 from pjain1/jetty_threads 
separate ingestion and query thread pool
 2015-11-17 12:14:25 -08:00
Parag Jain 6c498b7d4a separate ingestion and query thread pool 2015-11-17 13:42:41 -06:00
Bartosz Ługowski b0a444eafc Add count parameter to rules history endpoint. 2015-11-17 20:14:12 +01:00
Xavier Léauté d7eb2f717e enable query caching on intermediate realtime persists 2015-11-17 10:58:00 -08:00
Xavier Léauté 71376efd57 make cache injection optional 
allows enabling the CacheMonitor for all index tasks, even if some don't
bind any cache instance.
 2015-11-16 22:40:01 -08:00
Xavier Léauté 0fb7e4e040 Merge pull request #1975 from gianm/query-to-strings 
Better toString for groupBy, segmentMetadata queries.
 2015-11-16 13:08:50 -08:00
Gian Merlino 57f213d536 Better toString for groupBy, segmentMetadata queries. 2015-11-16 12:54:59 -08:00
Charles Allen acc1a215c7 Merge pull request #1968 from metamx/fix-integration-tests 
Fix ITUnionQueryTest failing on machines with less than 4 cores
 2015-11-13 15:19:54 -08:00
Nishant 4486b3fe8b Fix ITUnionQueryTest failing on machines with 1 core 
ITUnionQueryTest runs 4 realtime tasks and runs a unionQuery over them,
the worker is not able to run all the tasks concurrently on machines
with less cpu cores as it picks default worker capacity.
Explicitly specify worker capacity to avoid this.
 2015-11-13 13:46:36 -08:00
Charles Allen 46527a9610 Merge pull request #1954 from metamx/fix-stupid-aws-limit 
EC2 autoscaler: avoid hitting aws filter limits
 2015-11-13 10:52:35 -08:00
Fangjin Yang 846bef3d7a Merge pull request #1964 from metamx/update-docker-stuff 
update integration-test docker instructions for docker-machine
 2015-11-12 16:52:57 -08:00
Xavier Léauté bd7d2c9b3a update integration-test docker instructions for docker-machine 2015-11-12 16:44:28 -08:00
Xavier Léauté 353e568cbd Merge pull request #1959 from jon-wei/indexadapter_getrows 
Fix IncrementalIndexAdapter getRows() Iterable
 2015-11-12 14:38:33 -08:00
jon-wei cdceaf2d26 Fix IncrementalIndexAdapter getRows() Iterable 2015-11-12 13:10:42 -08:00
Charles Allen af34e9c8cb Add the druid artifact version to metrics when emitted 2015-11-12 12:11:27 -08:00
Xavier Léauté ef74cd394c Merge pull request #1960 from binlijin/master 
optimize index merge
 2015-11-12 11:38:20 -08:00
Fangjin Yang 4f46d457f1 Merge pull request #1947 from noddi/feature/count-parameter-history-endpoints 
Add count parameter to history endpoints
 2015-11-12 10:23:44 -08:00
Fangjin Yang 148153b47c Merge pull request #1897 from himanshug/new_sketch_aggregation 
complex aggregator based on http://datasketches.github.io
 2015-11-12 09:01:01 -08:00
Himanshu Gupta 7788f7c2a1 update doc with new thetaSketch api 2015-11-12 00:04:34 -06:00
Himanshu Gupta 338f88b86b further simplifying the api, users just need to use thetaSketch as aggregator 2015-11-12 00:04:34 -06:00
Himanshu Gupta 88ae3c43f9 changing names to be explicit about theta sketch algorithm 
old names are still valid though so as to be backwards compatible for now
 2015-11-12 00:04:34 -06:00
Himanshu Gupta 6c6a38cedb adding datasketches aggregator to documentation 2015-11-12 00:04:33 -06:00
Himanshu Gupta 9c569be11e adding datasketches module to top level pom 2015-11-12 00:04:33 -06:00
Himanshu Gupta 817cf41f5c druid aggregators based on datasketches lib http://datasketches.github.io/ 2015-11-12 00:04:33 -06:00
Xavier Léauté 749ac12f88 EC2 autoscaler: avoid hitting aws filter limits 2015-11-11 20:28:06 -08:00
binlijin 286b8f8c6f optimize index merge 2015-11-12 11:08:54 +08:00
Fangjin Yang 465cbcf9a7 Merge pull request #1956 from metamx/remove-unused-imports 
Cleanup + remove unused imports
 2015-11-11 17:36:47 -08:00
Gian Merlino e4e5f0375b SegmentAllocateAction (fixes #1515) 
This is a feature meant to allow realtime tasks to work without being told upfront
what shardSpec they should use (so we can potentially publish a variable number
of segments per interval).

The idea is that there is a "pendingSegments" table in the metadata store that
tracks allocated segments. Each one has a segment id (the same segment id we know
and love) and is also part of a sequence.

The sequences are an idea from @cheddar that offers a way of doing replication.
If there are N tasks reading exactly the same data with exactly the same logic
(think Kafka tasks reading a fixed range of offsets) then you can place them
in the same sequence, and they will generate the same sequence of segments.
 2015-11-11 16:54:35 -08:00