Commit Graph

5627 Commits

Author SHA1 Message Date
Slim Bouguerra dda0790a60 Fix extractionFilter by implementing make matcher
Fix getBitmapIndex to consider the case were dim is null
Unit Test for exractionFn with empty result and null_column
UT for TopN queries with Extraction filter
refactor in Extractiuon fileter makematcher for realtime segment and clean code in b/processing/src/test/java/io/druid/query/groupby/GroupByQueryRunnerTest.java
fix to make sure that empty string are converted to null
2015-08-03 09:02:17 -05:00
Slim Bouguerra 65654ddbf9 adding documentation about extraction filter 2015-08-03 09:02:17 -05:00
Fangjin Yang 5478b5bef8 Merge pull request #1583 from KurtYoung/master
fix realtime index task json description in doc
2015-07-31 18:33:33 -07:00
Xavier Léauté 5790367f6a Merge pull request #1585 from guobingkun/fix_transient_error
Fix transient error in BrokerServerViewTest
2015-07-31 12:53:32 -07:00
Bingkun Guo 479b09c2dd fix transient error in BrokerServerViewTest 2015-07-31 13:33:55 -05:00
kete.yangkt 2b2bba8d59 fix realtime index task json description in doc 2015-07-31 13:59:58 +08:00
Fangjin Yang 335d0df401 Merge pull request #1582 from himanshug/fix_mysql_tutorial_ref
fix mysql references in tutorial docs
2015-07-30 20:20:08 -07:00
Himanshu Gupta 7ee509bcd0 fix mysql references in tutorial docs 2015-07-30 22:05:05 -05:00
Charles Allen 99c240d1eb Merge pull request #1580 from himanshug/update_druid_api
update druid-api to 0.3.9
2015-07-30 14:57:48 -07:00
Himanshu Gupta a9ee2a383f update druid-api to 0.3.9 2015-07-30 16:35:37 -05:00
Fangjin Yang f4567c995c Merge pull request #1572 from himanshug/cache_doc_update
update doc with useCache and populateCache flags
2015-07-28 11:50:13 -10:00
Fangjin Yang 22567946cf Merge pull request #1259 from metamx/queryTimeLookup
Query Time Lookup
2015-07-28 11:43:05 -10:00
Himanshu Gupta c17bc3fd74 update doc with useCache and populateCache flags 2015-07-28 15:46:22 -05:00
Charles Allen 5086490620 Merge pull request #1571 from druid-io/add-md
Add setup to metadata store page
2015-07-28 11:38:02 -07:00
fjy 9946eebc02 Add setup to metadata stoer page 2015-07-28 08:36:48 -10:00
Himanshu cc50217eb0 Merge pull request #1568 from metamx/detailedSegmentLoadingErrors
More detailed error logging on segment activities
2015-07-28 13:31:16 -05:00
Himanshu afa13783a5 Merge pull request #1567 from metamx/moreS3DataMoverLogging
More detailed logging of error message on S3DataSegmentMover
2015-07-28 13:31:01 -05:00
Charles Allen ba59f8afc4 Merge pull request #1550 from himanshug/optionally_log_all_requests
print *all* HTTP requests to log if configured
2015-07-28 11:19:36 -07:00
Charles Allen 86ede702b1 Add namespaced lookups as extensions
* Adds kafka, URI, and JDBC namespace defintions
* Add ability to explicitly rename using a "namespace" which is a particular data collection that is loaded on all realtime, historic nodes, and brokers. If any of these nodes has the namespace extension, ALL nodes have the namespace extension.
* Add namespace caching and populating (can be on heap or off heap)
* Add NamespaceExtractionCacheManager for handling caches
* Added ExtractionNamespace for handling metadata on the extraction namespaces
* Added ExtractionNamespaceUpdate for handling metadata related to updates
* Add extension which caches renames from a kafka stream (requires kafka8)
* Added README.md for the namespace kafka extension
* Added docs
* Added namespace/size, namespace/count, namespace/deltaTasksStarted metrics

Add static config for namespaces via `druid.query.extraction.namespace`
* This is a rebase of https://github.com/b-slim/druid/tree/static_config_only
2015-07-28 11:14:14 -07:00
Himanshu Gupta 90b475975e Log all the requests to debug level in logger io.druid.jetty.RequestLog 2015-07-28 12:56:04 -05:00
Fangjin Yang 6f65e6d3ef Merge pull request #1547 from pjain1/improve_overlord_test
add test to OverlordResourceTest
2015-07-28 07:35:48 -10:00
Xavier Léauté 4195deb41b Merge pull request #1563 from metamx/simplify-sequence-merging
simplify merging of results on broker
2015-07-28 09:56:28 -07:00
Fangjin Yang 0bd904fa36 Merge pull request #1569 from pdeva/patch-2
Specify dynamic dimension schema
2015-07-27 17:36:03 -10:00
pdeva ef0439229d Specify dynamic dimension schema
Document how druid can dynamically infer dimension columns
2015-07-27 20:20:53 -07:00
Charles Allen c492d4448d More detailed S3DataSegmentKiller error messages 2015-07-27 13:45:03 -07:00
Charles Allen fe7818ddd2 More detailed AzureDataSegmentKiller error messgaes 2015-07-27 13:44:59 -07:00
Charles Allen 3f901e7291 More detailed logging of error message on S3DataSegmentMover 2015-07-27 13:28:54 -07:00
Xavier Léauté 5fba5e035f Merge pull request #1564 from guobingkun/simple_change
Use IOUtils.toString in getTaskAsString()
2015-07-27 12:40:27 -07:00
Bingkun Guo f9a64f31f3 use IOUtils.toString in getTaskAsString 2015-07-27 13:53:30 -05:00
nishant efb6e0649e simplify merging of results on broker.
add benchmark

formatting and review comments

organize imports
2015-07-27 11:46:11 -07:00
Himanshu 5f1f4424eb Merge pull request #1552 from rasahner/doc-chathandler
remove references to chathandler type "announce"; it's the default
2015-07-27 12:36:27 -05:00
Xavier Léauté ccd46088b2 Merge pull request #1549 from himanshug/example_router_config
adding router config to examples/config
2015-07-27 10:15:48 -07:00
sahner 4801de62a2 make "announce" the chathandler default in realtime node,
remove doc references to chathandler type "announce" since it is the default now,
2015-07-27 12:14:28 -05:00
Fangjin Yang 27cd7730c8 Merge pull request #1561 from pdeva/patch-1
correct key name
2015-07-26 08:01:29 -10:00
pdeva 76bf8ccd8c correct key name 2015-07-25 21:58:37 -07:00
Fangjin Yang 60a27a9121 Merge pull request #1555 from metamx/convertSegmentDocs
Add convert.md to document conversion task
2015-07-25 08:25:03 -07:00
Charles Allen b9359b7531 Add convert.md to document conversion task 2015-07-24 17:37:49 -07:00
Himanshu Gupta 034e0a4f34 adding example config for starting middle manager 2015-07-24 16:57:12 -05:00
Charles Allen 68e50c2e9a Merge pull request #1553 from druid-io/schema-design
Added section on best practices for schema design and a few other edits
2015-07-24 14:18:18 -07:00
fjy 92293ef094 Added section on best practices for schema designa and a few other edits 2015-07-24 14:06:20 -07:00
Parag Jain 2e1b617346 add more tests 2015-07-24 15:12:08 -05:00
Himanshu Gupta 299367b0da adding router config to examples/config 2015-07-23 22:47:47 -05:00
Fangjin Yang 0b1e0ae0ca Merge pull request #1548 from himanshug/update_curator
update curator version to 2.8.0
2015-07-23 12:36:16 -07:00
Himanshu Gupta efef20e754 update curator version to 2.8.0
to get fix for https://issues.apache.org/jira/browse/CURATOR-168
2015-07-23 13:49:55 -05:00
Fangjin Yang a8411e31a0 Merge pull request #1544 from himanshug/combiner_doc
updating hadoop tuningConfig doc with useCombiner flag
2015-07-22 16:02:16 -07:00
Himanshu Gupta 119ec13d23 updating hadoop tuningConfig doc with useCombiner flag 2015-07-22 13:55:00 -05:00
Fangjin Yang e2ca556fa3 Merge pull request #1543 from mistercrunch/master
Documentation entry for Panoramix (a druid UI)
2015-07-21 19:00:11 -07:00
Maxime Beauchemin db4928e73b Documentation entry for Panormix (a druid UI) 2015-07-21 18:23:46 -07:00
Fangjin Yang ce5de2b7a7 Merge pull request #1541 from himanshug/fix_agg_test_helper
dont waste memory in storing all lines from input
2015-07-20 22:08:20 -07:00
Himanshu Gupta d11d9b6c45 dont waste memory in storing all lines from input
CharSource.readLines() reads all lines from input into a in-memory list
Since we need an iterator here, so this wastage can be easily prevented
2015-07-20 21:59:38 -05:00