Apache
/
druid
mirror of https://github.com/apache/druid.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
5,714 Commits 113 Branches 506 Tags 731 MiB
Commit Graph

5714 Commits

Author SHA1 Message Date
Charles Allen 5086490620 Merge pull request #1571 from druid-io/add-md 
Add setup to metadata store page
 2015-07-28 11:38:02 -07:00
fjy 9946eebc02 Add setup to metadata stoer page 2015-07-28 08:36:48 -10:00
Himanshu cc50217eb0 Merge pull request #1568 from metamx/detailedSegmentLoadingErrors 
More detailed error logging on segment activities
 2015-07-28 13:31:16 -05:00
Himanshu afa13783a5 Merge pull request #1567 from metamx/moreS3DataMoverLogging 
More detailed logging of error message on S3DataSegmentMover
 2015-07-28 13:31:01 -05:00
Charles Allen ba59f8afc4 Merge pull request #1550 from himanshug/optionally_log_all_requests 
print *all* HTTP requests to log if configured
 2015-07-28 11:19:36 -07:00
Charles Allen 86ede702b1 Add namespaced lookups as extensions 
* Adds kafka, URI, and JDBC namespace defintions
* Add ability to explicitly rename using a "namespace" which is a particular data collection that is loaded on all realtime, historic nodes, and brokers. If any of these nodes has the namespace extension, ALL nodes have the namespace extension.
* Add namespace caching and populating (can be on heap or off heap)
* Add NamespaceExtractionCacheManager for handling caches
* Added ExtractionNamespace for handling metadata on the extraction namespaces
* Added ExtractionNamespaceUpdate for handling metadata related to updates
* Add extension which caches renames from a kafka stream (requires kafka8)
* Added README.md for the namespace kafka extension
* Added docs
* Added namespace/size, namespace/count, namespace/deltaTasksStarted metrics

Add static config for namespaces via `druid.query.extraction.namespace`
* This is a rebase of https://github.com/b-slim/druid/tree/static_config_only
 2015-07-28 11:14:14 -07:00
Himanshu Gupta 90b475975e Log all the requests to debug level in logger io.druid.jetty.RequestLog 2015-07-28 12:56:04 -05:00
Fangjin Yang 6f65e6d3ef Merge pull request #1547 from pjain1/improve_overlord_test 
add test to OverlordResourceTest
 2015-07-28 07:35:48 -10:00
Xavier Léauté 4195deb41b Merge pull request #1563 from metamx/simplify-sequence-merging 
simplify merging of results on broker
 2015-07-28 09:56:28 -07:00
Fangjin Yang 0bd904fa36 Merge pull request #1569 from pdeva/patch-2 
Specify dynamic dimension schema
 2015-07-27 17:36:03 -10:00
pdeva ef0439229d Specify dynamic dimension schema 
Document how druid can dynamically infer dimension columns
 2015-07-27 20:20:53 -07:00
Charles Allen c492d4448d More detailed S3DataSegmentKiller error messages 2015-07-27 13:45:03 -07:00
Charles Allen fe7818ddd2 More detailed AzureDataSegmentKiller error messgaes 2015-07-27 13:44:59 -07:00
Charles Allen 3f901e7291 More detailed logging of error message on S3DataSegmentMover 2015-07-27 13:28:54 -07:00
Xavier Léauté 5fba5e035f Merge pull request #1564 from guobingkun/simple_change 
Use IOUtils.toString in getTaskAsString()
 2015-07-27 12:40:27 -07:00
Bingkun Guo f9a64f31f3 use IOUtils.toString in getTaskAsString 2015-07-27 13:53:30 -05:00
nishant efb6e0649e simplify merging of results on broker. 
add benchmark

formatting and review comments

organize imports
 2015-07-27 11:46:11 -07:00
Himanshu 5f1f4424eb Merge pull request #1552 from rasahner/doc-chathandler 
remove references to chathandler type "announce"; it's the default
 2015-07-27 12:36:27 -05:00
Xavier Léauté ccd46088b2 Merge pull request #1549 from himanshug/example_router_config 
adding router config to examples/config
 2015-07-27 10:15:48 -07:00
sahner 4801de62a2 make "announce" the chathandler default in realtime node, 
remove doc references to chathandler type "announce" since it is the default now,
 2015-07-27 12:14:28 -05:00
Fangjin Yang 27cd7730c8 Merge pull request #1561 from pdeva/patch-1 
correct key name
 2015-07-26 08:01:29 -10:00
pdeva 76bf8ccd8c correct key name 2015-07-25 21:58:37 -07:00
Fangjin Yang 60a27a9121 Merge pull request #1555 from metamx/convertSegmentDocs 
Add convert.md to document conversion task
 2015-07-25 08:25:03 -07:00
Charles Allen b9359b7531 Add convert.md to document conversion task 2015-07-24 17:37:49 -07:00
Himanshu Gupta 034e0a4f34 adding example config for starting middle manager 2015-07-24 16:57:12 -05:00
Charles Allen 68e50c2e9a Merge pull request #1553 from druid-io/schema-design 
Added section on best practices for schema design and a few other edits
 2015-07-24 14:18:18 -07:00
fjy 92293ef094 Added section on best practices for schema designa and a few other edits 2015-07-24 14:06:20 -07:00
Parag Jain 2e1b617346 add more tests 2015-07-24 15:12:08 -05:00
Himanshu Gupta 299367b0da adding router config to examples/config 2015-07-23 22:47:47 -05:00
Fangjin Yang 0b1e0ae0ca Merge pull request #1548 from himanshug/update_curator 
update curator version to 2.8.0
 2015-07-23 12:36:16 -07:00
Himanshu Gupta efef20e754 update curator version to 2.8.0 
to get fix for https://issues.apache.org/jira/browse/CURATOR-168
 2015-07-23 13:49:55 -05:00
Fangjin Yang a8411e31a0 Merge pull request #1544 from himanshug/combiner_doc 
updating hadoop tuningConfig doc with useCombiner flag
 2015-07-22 16:02:16 -07:00
Himanshu Gupta 119ec13d23 updating hadoop tuningConfig doc with useCombiner flag 2015-07-22 13:55:00 -05:00
Fangjin Yang e2ca556fa3 Merge pull request #1543 from mistercrunch/master 
Documentation entry for Panoramix (a druid UI)
 2015-07-21 19:00:11 -07:00
Maxime Beauchemin db4928e73b Documentation entry for Panormix (a druid UI) 2015-07-21 18:23:46 -07:00
Fangjin Yang ce5de2b7a7 Merge pull request #1541 from himanshug/fix_agg_test_helper 
dont waste memory in storing all lines from input
 2015-07-20 22:08:20 -07:00
Himanshu Gupta d11d9b6c45 dont waste memory in storing all lines from input 
CharSource.readLines() reads all lines from input into a in-memory list
Since we need an iterator here, so this wastage can be easily prevented
 2015-07-20 21:59:38 -05:00
Fangjin Yang 97242356b4 Merge pull request #1480 from guobingkun/kill_task_test 
Unit tests for KillTask and MetadataTaskStorage
 2015-07-20 16:31:45 -07:00
Fangjin Yang 0481c8ca26 Merge pull request #1406 from zhaown/fix-breaking-while-exceeding-max-intermediate-rows 
Fix breaking while exceeding max intermediate rows.
 2015-07-20 13:41:22 -07:00
Fangjin Yang c4ed8fee56 Merge pull request #1472 from himanshug/combiner 
Use Combiner to merge InputRows at the Mapper during Hadoop Batch Ingestion
 2015-07-20 13:33:10 -07:00
Himanshu Gupta 0eec1bbee2 json serde tests for HadoopTuningConfig 2015-07-20 12:01:53 -05:00
Himanshu Gupta f836c3a7ac adding flag useCombiner to hadoop tuning config that can be used to add a 
hadoop combiner to hadoop batch ingestion to do merges on the mappers if possible
 2015-07-20 12:01:53 -05:00
Himanshu Gupta 4ef484048a take control of InputRow serde between Mapper/Reducer in Hadoop Indexing 
This allows for arbitrary InputFormat while hadoop batch ingestion that
can return records of value type other than Text
 2015-07-20 12:01:53 -05:00
Himanshu Gupta f7a92db332 generic byte[] serde for InputRow 2015-07-20 12:01:53 -05:00
Himanshu Gupta 0439e8ec23 adding serde methods for intermediate aggregation object to ComplexMetricSerde 
This provides the alternative to using ComplexMetricSerde.getObjectStrategy()
and using the serde methods from ObjectStrategy as that usage pattern is deprecated.
 2015-07-20 12:01:53 -05:00
Fangjin Yang 020827349e Merge pull request #1539 from mvfast/cdh_workaround 
Cdh workaround
 2015-07-20 09:16:42 -07:00
Qi Wang 7211791585 add workaround for cdh 2015-07-19 14:11:47 -07:00
Fangjin Yang ce295a02cf Merge pull request #1538 from himanshug/reco_hadoop_cp 
recommend druid-hdfs-storage and hadoop dependencies to be in the classpath
 2015-07-18 22:10:51 -07:00
zhaown 524b05f073 Fix breaking while exceeding max intermediate rows. 2015-07-19 10:41:53 +08:00
Himanshu Gupta dd95ef77c0 recommend druid-hdfs-storage and hadoop dependencies to be in the classpath instead of added as an extension 2015-07-18 16:18:12 -05:00