Commit Graph

5683 Commits

Author SHA1 Message Date
Fangjin Yang a8411e31a0 Merge pull request #1544 from himanshug/combiner_doc
updating hadoop tuningConfig doc with useCombiner flag
2015-07-22 16:02:16 -07:00
Himanshu Gupta 119ec13d23 updating hadoop tuningConfig doc with useCombiner flag 2015-07-22 13:55:00 -05:00
Fangjin Yang e2ca556fa3 Merge pull request #1543 from mistercrunch/master
Documentation entry for Panoramix (a druid UI)
2015-07-21 19:00:11 -07:00
Maxime Beauchemin db4928e73b Documentation entry for Panormix (a druid UI) 2015-07-21 18:23:46 -07:00
Fangjin Yang ce5de2b7a7 Merge pull request #1541 from himanshug/fix_agg_test_helper
dont waste memory in storing all lines from input
2015-07-20 22:08:20 -07:00
Himanshu Gupta d11d9b6c45 dont waste memory in storing all lines from input
CharSource.readLines() reads all lines from input into a in-memory list
Since we need an iterator here, so this wastage can be easily prevented
2015-07-20 21:59:38 -05:00
Fangjin Yang 97242356b4 Merge pull request #1480 from guobingkun/kill_task_test
Unit tests for KillTask and MetadataTaskStorage
2015-07-20 16:31:45 -07:00
Fangjin Yang 0481c8ca26 Merge pull request #1406 from zhaown/fix-breaking-while-exceeding-max-intermediate-rows
Fix breaking while exceeding max intermediate rows.
2015-07-20 13:41:22 -07:00
Fangjin Yang c4ed8fee56 Merge pull request #1472 from himanshug/combiner
Use Combiner to merge InputRows at the Mapper during Hadoop Batch Ingestion
2015-07-20 13:33:10 -07:00
Himanshu Gupta 0eec1bbee2 json serde tests for HadoopTuningConfig 2015-07-20 12:01:53 -05:00
Himanshu Gupta f836c3a7ac adding flag useCombiner to hadoop tuning config that can be used to add a
hadoop combiner to hadoop batch ingestion to do merges on the mappers if possible
2015-07-20 12:01:53 -05:00
Himanshu Gupta 4ef484048a take control of InputRow serde between Mapper/Reducer in Hadoop Indexing
This allows for arbitrary InputFormat while hadoop batch ingestion that
can return records of value type other than Text
2015-07-20 12:01:53 -05:00
Himanshu Gupta f7a92db332 generic byte[] serde for InputRow 2015-07-20 12:01:53 -05:00
Himanshu Gupta 0439e8ec23 adding serde methods for intermediate aggregation object to ComplexMetricSerde
This provides the alternative to using ComplexMetricSerde.getObjectStrategy()
and using the serde methods from ObjectStrategy as that usage pattern is deprecated.
2015-07-20 12:01:53 -05:00
Fangjin Yang 020827349e Merge pull request #1539 from mvfast/cdh_workaround
Cdh workaround
2015-07-20 09:16:42 -07:00
Qi Wang 7211791585 add workaround for cdh 2015-07-19 14:11:47 -07:00
Fangjin Yang ce295a02cf Merge pull request #1538 from himanshug/reco_hadoop_cp
recommend druid-hdfs-storage and hadoop dependencies to be in the classpath
2015-07-18 22:10:51 -07:00
zhaown 524b05f073 Fix breaking while exceeding max intermediate rows. 2015-07-19 10:41:53 +08:00
Himanshu Gupta dd95ef77c0 recommend druid-hdfs-storage and hadoop dependencies to be in the classpath instead of added as an extension 2015-07-18 16:18:12 -05:00
Xavier Léauté 6e8da5de86 Merge pull request #1441 from metamx/queryResourceFlusher
Add flush prior to close on output stream in QueryResource
2015-07-17 16:32:52 -07:00
Fangjin Yang 0655e61d61 Merge pull request #1507 from rasahner/feature-IntTestConfig
integration-tests: add ability to get configuration information from a file
2015-07-17 16:23:54 -07:00
Charles Allen e051e93d19 Merge pull request #1518 from RealROI/more-azure-features
Azure Blob Store support for Firehose and Indexing Service Logs
2015-07-17 16:10:22 -07:00
Zak Kristjanson 0bda7af52c Add more support for Azure Blob Store
Azure Blob Store support for Task Logs and a firehose for data ingestion
2015-07-17 15:38:21 -07:00
sahner df5bc8974f add ability to get configuration information from a file 2015-07-17 10:19:42 -05:00
Fangjin Yang e21195f987 Merge pull request #1469 from guobingkun/table_config
Inconsistent property names for "druid.metadata.storage.tables.xxx"
2015-07-17 07:43:19 -07:00
Himanshu 19af3bc9bc Merge pull request #1535 from metamx/alphanum-docs-tests
Update alphanumeric sort docs + more tests / examples
2015-07-16 22:09:41 -05:00
Xavier Léauté 2c464ad936 correct reference in docs + more tests / examples 2015-07-16 19:50:05 -07:00
Xavier Léauté 9616c10b1d remove import static 2015-07-16 17:46:21 -07:00
Xavier Léauté c1308203b8 Merge pull request #1532 from metamx/fixTopNDimExtractionDoubleApply
Fix TopN dimension extractions being applied twice
2015-07-16 13:39:02 -07:00
Xavier Léauté 3a0793aaf9 Merge pull request #1533 from metamx/extraCheckGroupByDimExtraction
Add more unit tests for group by
2015-07-15 21:09:00 -07:00
Charles Allen 7d0b77c261 Add more unit tests for group by 2015-07-15 20:15:21 -07:00
Charles Allen 4b1bd29424 Merge pull request #1534 from metamx/fix-histogram-cachekey
fix histogram aggregator cache key
2015-07-15 18:32:52 -07:00
Fangjin Yang 6e4108c29b Merge pull request #1530 from sherry-q/ingestion-doc-fix
Fix Doc data-formats.md
2015-07-15 18:01:17 -07:00
Xavier Léauté a15a2c4047 fix histogram aggregator cache key 2015-07-15 17:33:36 -07:00
Charles Allen 9092c665b7 Fix TopN dimension extractions being applied twice 2015-07-15 16:58:15 -07:00
Xavier Léauté 850460446d Merge pull request #1531 from druid-io/fix-ver
Fix versions in tutorials
2015-07-15 16:22:39 -07:00
fjy 0074138bb9 fix versions in tutorials 2015-07-15 16:18:16 -07:00
Shiyu Qiu bec8e8e23a fix doc data-formats.md 2015-07-15 17:13:33 -05:00
Charles Allen 456ad9ffba Merge pull request #1529 from metamx/update-versions
inrement version
2015-07-15 13:25:31 -07:00
Xavier Léauté 4cfb00bc8a inrement version 2015-07-15 13:09:05 -07:00
Fangjin Yang a4cb0332fb Merge pull request #1524 from metamx/peonShutdown
Make CliPeon run shutdown hooks properly
2015-07-15 10:09:33 -07:00
Fangjin Yang 6ea99ddc2c Merge pull request #1526 from metamx/execsMigration
Move lots of executor service creation to Execs
2015-07-15 08:48:55 -07:00
Fangjin Yang 44d63e4f7e Merge pull request #1528 from solimant/master
fix #1525 - typo: "HadoopBatchIndexer"
2015-07-14 21:07:19 -07:00
Tim 3b692fb6f7 fix #1525 - typo: "HadoopBatchIndexer" 2015-07-14 20:48:24 -07:00
Fangjin Yang ab705504ef Merge pull request #1527 from metamx/integrationTestDocChange
Minor change to integration-tests README formatting
2015-07-14 17:03:11 -07:00
Charles Allen 80a18243dd Minor change to integration-tests README formatting 2015-07-14 17:01:06 -07:00
Charles Allen 9400c473a8 Remove comments 2015-07-14 16:21:36 -07:00
Charles Allen 92d5c250ab Remove comment 2015-07-14 16:20:36 -07:00
Charles Allen 5eadd395e2 Move lots of executor service creation to Execs 2015-07-14 15:38:49 -07:00
Charles Allen 2b87ad307d Make CliPeon run shutdown hooks properly
* Also make jetty threads daemon
2015-07-14 15:15:26 -07:00