5628 Commits

Author SHA1 Message Date
Himanshu Gupta
d11d9b6c45 dont waste memory in storing all lines from input
CharSource.readLines() reads all lines from input into a in-memory list
Since we need an iterator here, so this wastage can be easily prevented
2015-07-20 21:59:38 -05:00
Fangjin Yang
97242356b4 Merge pull request #1480 from guobingkun/kill_task_test
Unit tests for KillTask and MetadataTaskStorage
2015-07-20 16:31:45 -07:00
Fangjin Yang
0481c8ca26 Merge pull request #1406 from zhaown/fix-breaking-while-exceeding-max-intermediate-rows
Fix breaking while exceeding max intermediate rows.
2015-07-20 13:41:22 -07:00
Fangjin Yang
c4ed8fee56 Merge pull request #1472 from himanshug/combiner
Use Combiner to merge InputRows at the Mapper during Hadoop Batch Ingestion
2015-07-20 13:33:10 -07:00
Himanshu Gupta
0eec1bbee2 json serde tests for HadoopTuningConfig 2015-07-20 12:01:53 -05:00
Himanshu Gupta
f836c3a7ac adding flag useCombiner to hadoop tuning config that can be used to add a
hadoop combiner to hadoop batch ingestion to do merges on the mappers if possible
2015-07-20 12:01:53 -05:00
Himanshu Gupta
4ef484048a take control of InputRow serde between Mapper/Reducer in Hadoop Indexing
This allows for arbitrary InputFormat while hadoop batch ingestion that
can return records of value type other than Text
2015-07-20 12:01:53 -05:00
Himanshu Gupta
f7a92db332 generic byte[] serde for InputRow 2015-07-20 12:01:53 -05:00
Himanshu Gupta
0439e8ec23 adding serde methods for intermediate aggregation object to ComplexMetricSerde
This provides the alternative to using ComplexMetricSerde.getObjectStrategy()
and using the serde methods from ObjectStrategy as that usage pattern is deprecated.
2015-07-20 12:01:53 -05:00
Fangjin Yang
020827349e Merge pull request #1539 from mvfast/cdh_workaround
Cdh workaround
2015-07-20 09:16:42 -07:00
Qi Wang
7211791585 add workaround for cdh 2015-07-19 14:11:47 -07:00
Fangjin Yang
ce295a02cf Merge pull request #1538 from himanshug/reco_hadoop_cp
recommend druid-hdfs-storage and hadoop dependencies to be in the classpath
2015-07-18 22:10:51 -07:00
zhaown
524b05f073 Fix breaking while exceeding max intermediate rows. 2015-07-19 10:41:53 +08:00
Himanshu Gupta
dd95ef77c0 recommend druid-hdfs-storage and hadoop dependencies to be in the classpath instead of added as an extension 2015-07-18 16:18:12 -05:00
Xavier Léauté
6e8da5de86 Merge pull request #1441 from metamx/queryResourceFlusher
Add flush prior to close on output stream in QueryResource
2015-07-17 16:32:52 -07:00
Fangjin Yang
0655e61d61 Merge pull request #1507 from rasahner/feature-IntTestConfig
integration-tests: add ability to get configuration information from a file
2015-07-17 16:23:54 -07:00
Charles Allen
e051e93d19 Merge pull request #1518 from RealROI/more-azure-features
Azure Blob Store support for Firehose and Indexing Service Logs
2015-07-17 16:10:22 -07:00
Zak Kristjanson
0bda7af52c Add more support for Azure Blob Store
Azure Blob Store support for Task Logs and a firehose for data ingestion
2015-07-17 15:38:21 -07:00
sahner
df5bc8974f add ability to get configuration information from a file 2015-07-17 10:19:42 -05:00
Fangjin Yang
e21195f987 Merge pull request #1469 from guobingkun/table_config
Inconsistent property names for "druid.metadata.storage.tables.xxx"
2015-07-17 07:43:19 -07:00
Himanshu
19af3bc9bc Merge pull request #1535 from metamx/alphanum-docs-tests
Update alphanumeric sort docs + more tests / examples
2015-07-16 22:09:41 -05:00
Xavier Léauté
2c464ad936 correct reference in docs + more tests / examples 2015-07-16 19:50:05 -07:00
Xavier Léauté
9616c10b1d remove import static 2015-07-16 17:46:21 -07:00
Xavier Léauté
c1308203b8 Merge pull request #1532 from metamx/fixTopNDimExtractionDoubleApply
Fix TopN dimension extractions being applied twice
2015-07-16 13:39:02 -07:00
Xavier Léauté
3a0793aaf9 Merge pull request #1533 from metamx/extraCheckGroupByDimExtraction
Add more unit tests for group by
2015-07-15 21:09:00 -07:00
Charles Allen
7d0b77c261 Add more unit tests for group by 2015-07-15 20:15:21 -07:00
Charles Allen
4b1bd29424 Merge pull request #1534 from metamx/fix-histogram-cachekey
fix histogram aggregator cache key
2015-07-15 18:32:52 -07:00
Fangjin Yang
6e4108c29b Merge pull request #1530 from sherry-q/ingestion-doc-fix
Fix Doc data-formats.md
2015-07-15 18:01:17 -07:00
Xavier Léauté
a15a2c4047 fix histogram aggregator cache key 2015-07-15 17:33:36 -07:00
Charles Allen
9092c665b7 Fix TopN dimension extractions being applied twice 2015-07-15 16:58:15 -07:00
Xavier Léauté
850460446d Merge pull request #1531 from druid-io/fix-ver
Fix versions in tutorials
2015-07-15 16:22:39 -07:00
fjy
0074138bb9 fix versions in tutorials 2015-07-15 16:18:16 -07:00
Shiyu Qiu
bec8e8e23a fix doc data-formats.md 2015-07-15 17:13:33 -05:00
Charles Allen
456ad9ffba Merge pull request #1529 from metamx/update-versions
inrement version
2015-07-15 13:25:31 -07:00
Xavier Léauté
4cfb00bc8a inrement version 2015-07-15 13:09:05 -07:00
Fangjin Yang
a4cb0332fb Merge pull request #1524 from metamx/peonShutdown
Make CliPeon run shutdown hooks properly
2015-07-15 10:09:33 -07:00
Fangjin Yang
6ea99ddc2c Merge pull request #1526 from metamx/execsMigration
Move lots of executor service creation to Execs
2015-07-15 08:48:55 -07:00
Fangjin Yang
44d63e4f7e Merge pull request #1528 from solimant/master
fix #1525 - typo: "HadoopBatchIndexer"
2015-07-14 21:07:19 -07:00
Tim
3b692fb6f7 fix #1525 - typo: "HadoopBatchIndexer" 2015-07-14 20:48:24 -07:00
Fangjin Yang
ab705504ef Merge pull request #1527 from metamx/integrationTestDocChange
Minor change to integration-tests README formatting
2015-07-14 17:03:11 -07:00
Charles Allen
80a18243dd Minor change to integration-tests README formatting 2015-07-14 17:01:06 -07:00
Charles Allen
9400c473a8 Remove comments 2015-07-14 16:21:36 -07:00
Charles Allen
92d5c250ab Remove comment 2015-07-14 16:20:36 -07:00
Charles Allen
5eadd395e2 Move lots of executor service creation to Execs 2015-07-14 15:38:49 -07:00
Charles Allen
2b87ad307d Make CliPeon run shutdown hooks properly
* Also make jetty threads daemon
2015-07-14 15:15:26 -07:00
Fangjin Yang
62ce73ce59 Merge pull request #1522 from gianm/dependency-docs
Clearer language around external dependencies in tutorials.
2015-07-14 14:08:03 -07:00
Gian Merlino
183f51fe58 Clearer language around external dependencies in tutorials. 2015-07-14 10:50:45 -07:00
Fangjin Yang
798c3320d0 Merge pull request #1475 from himanshug/derby_in_examples
for example/tutorial, use derby instead of mysql
2015-07-14 10:18:21 -07:00
Fangjin Yang
da8e86146e Merge pull request #1505 from metamx/improve-test
Modify test to check for multiple shards for same interval
2015-07-14 08:50:47 -07:00
Fangjin Yang
3f7ba58227 Merge pull request #1504 from metamx/fix-1447
fix for #1447
2015-07-14 08:50:08 -07:00