2a76bdc60a
Abstractify hadoopy indexer configuration.
...
* Moves many items to JobHelper
* Remove dependencies of these functions on HadoopDruidIndexerConfig in favor of more general items
* Changes functionalities of some of the path methods to always return a path with scheme
* Adds retry to uploads
* Change output loadSpec determining from using outputFS.getClass().getName() to using outputFS.getScheme()
2015-06-08 10:53:27 -07:00
92d7316ed8
Merge pull request #1414 from metamx/timeout2TIMEOUT
...
Replace "timeout" with QueryContextKeys.TIMEOUT
2015-06-02 17:11:09 -07:00
1c4d42bc15
Replace "timeout" with QueryContextKeys.TIMEOUT
2015-06-02 14:49:21 -07:00
224886ab52
Merge pull request #1370 from metamx/dimExtractionOptimizations
...
Add optimizations for ExtractionFn by enabling MANY_TO_ONE vs ONE_TO_ONE codepaths
2015-06-02 13:25:19 -07:00
f48db09e35
Add optimizations for ExtractionFn by enabling MANY_TO_ONE vs ONE_TO_ONE codepaths
...
* Also adds LookupExtractionFn and MapLookupExtractor which takes in an explicit mapping of renames
* Add injective to javascript extraction fn
2015-06-02 12:22:56 -07:00
ab34862353
Merge pull request #1408 from druid-io/rename-links
...
Update links to point to druid-io
2015-05-31 13:38:32 -07:00
74d8840414
Change tranquility links
2015-05-31 10:59:38 -07:00
39c55b417e
Merge pull request #1405 from himanshug/fix_doc
...
in batch ingestion metadataUpdateSpec->type is derby, mysql etc
2015-05-29 20:42:21 -07:00
be4ecc4b91
in batch ingestion metadataUpdateSpec->type is derby, mysql etc and not metadata
2015-05-29 22:16:18 -05:00
24306d20b6
Merge pull request #1344 from himanshug/change_tutorial_file_names
...
change all docs/content/*.md filenames to only have lowercase and dashes
2015-05-29 19:37:04 -07:00
96103e1227
remove whirr from documentation
2015-05-29 20:55:42 -05:00
d2346b6834
shorten links and file names
...
* remove redundant parts in file names
* delete unsupported "Druid-Personal-Demo-Cluster"
2015-05-29 20:55:42 -05:00
8edc2aaca3
renaming all *.md filenames to only have lowercase and dashes
...
so that they are editable on case-insensitive os as well
2015-05-29 20:55:42 -05:00
20fdb627d9
Merge pull request #1399 from druid-io/overlap-check
...
Add schema check for overlap between dimension and metric names
2015-05-29 09:39:22 -07:00
185c99deec
Add schema check for overlap between dimension and metric names
2015-05-28 22:18:08 -07:00
069fc25528
Merge pull request #1402 from metamx/IndexMergerTests
...
Add more IndexMergerTests
2015-05-28 21:15:18 -07:00
ac9057c00e
Merge pull request #1401 from metamx/ec2-public-ip
...
flag to enable public IP in EC2 autoscaling
2015-05-28 20:21:32 -07:00
55292bba13
Add more IndexMergerTests
2015-05-28 18:18:20 -07:00
d834a974ba
flag to enable public IP in EC2-VPC autoscaling
2015-05-28 18:14:12 -07:00
2fb2b6ce6b
Merge pull request #1397 from druid-io/fix-index-task-slow
...
Make the index task use indexmerger and not indexmaker
2015-05-28 17:14:48 -07:00
13c402d5d6
Merge pull request #1400 from metamx/groupByCheckForNullDimSpec
...
Add checkin GroupByQuery for null DimensionSpec in dimension list
2015-05-28 15:48:30 -07:00
1ebe622c7d
Add checkin GroupByQuery for null DimensionSpec in dimension list
2015-05-28 14:55:34 -07:00
bb1145ef56
Make the index task use indexmerger and not indexmaker
2015-05-28 13:34:57 -07:00
f588a95f36
Merge pull request #1396 from druid-io/minewhat-master
...
druid production architecture diagram
2015-05-27 17:08:44 -07:00
5812b3dd5c
druid production architecture diagram
2015-05-27 17:06:24 -07:00
fe286d28d1
Merge pull request #1395 from druid-io/new-logs
...
Additional schema validations and better logs for common extensions
2015-05-27 17:01:13 -07:00
be2a35188e
Additional schema validations and better logs for common extensions
2015-05-27 16:25:02 -07:00
f9c624c7db
Merge pull request #1361 from mrijke/groupby-limithavingorder-unittest
...
GroupBy Query with Having/Limit/Orderingspec inconsistencies (UnitTest)
2015-05-27 14:49:18 -07:00
1a3f04f0ed
Merge pull request #1354 from metamx/multi-valued-dimension-compression
...
Enabling compression for multiValued dimension
2015-05-26 23:43:53 -07:00
55092d225c
Merge pull request #1392 from metamx/fixRoaringConciseExtractionFilter
...
Fix roaring extraction filter on empty values
2015-05-26 14:33:29 -07:00
fd64c24e43
Fix roaring extraction filter on empty values
2015-05-26 13:54:18 -07:00
81415282aa
Enabling compression for multiValued dimension
...
Add test and refactoring
Add benchmark tests
2015-05-27 00:09:14 +05:30
600b30566c
Merge pull request #1385 from metamx/brokenDimExtractionFilter
...
Fix for breaking Dimension Extraction Filter on empty filter
2015-05-25 09:51:17 -07:00
e97d22a10a
Fix Extraction Filter cast problems for empty results
2015-05-22 15:20:11 -07:00
e1399b7ce4
Add unit test to show breaking Dimension Extraction Filter
2015-05-22 15:02:11 -07:00
cd6df1feba
Merge pull request #1384 from gbuisson/patch-1
...
added clj-druid to query libraries (clojure)
2015-05-22 16:16:50 -04:00
c1b1752595
Merge pull request #1383 from metamx/psql-transient
...
retry transient exceptions for PostgreSQL, fixes #1382
2015-05-22 13:01:53 -07:00
75c092ccb1
Merge pull request #1375 from metamx/MetricManipulatorFnInstances
...
Modify MetricManipulatorFns to use instanced classes
2015-05-22 15:56:47 -04:00
042653ebcb
Modify MetricManipulatorFns to use instanced classes
2015-05-22 12:38:38 -07:00
490c97b041
Merge pull request #1381 from himanshug/fix_seg_metadata_regression
...
Fixing the regression caused by #1172
2015-05-22 15:26:29 -04:00
6b23e02d2b
retry transient exceptions for PostgreSQL, fixes #1382
2015-05-22 14:47:27 -04:00
723df735e9
force eagerness of processing of SegmentMetadata queries on the processing executor by converting the Sequence into List
2015-05-22 13:46:26 -05:00
5852b64852
adding UT for SegmentMetadata bySegment query which catches following regression caused by commit 55ebf0cfdf
...
it fails when we issue the SegmentMetadataQuery by setting {"bySegment" : true} in context with exception -
java.lang.ClassCastException: io.druid.query.Result cannot be cast to io.druid.query.metadata.metadata.SegmentAnalysis
at io.druid.query.metadata.SegmentMetadataQueryQueryToolChest$4.compare(SegmentMetadataQueryQueryToolChest.java:222) ~[druid-processing-0.7.3-SNAPSHOT.jar:0.7.3-SNAPSHOT]
at com.google.common.collect.NullsFirstOrdering.compare(NullsFirstOrdering.java:44) ~[guava-16.0.1.jar:?]
at com.metamx.common.guava.MergeIterator$1.compare(MergeIterator.java:46) ~[java-util-0.27.0.jar:?]
at com.metamx.common.guava.MergeIterator$1.compare(MergeIterator.java:42) ~[java-util-0.27.0.jar:?]
at java.util.PriorityQueue.siftUpUsingComparator(PriorityQueue.java:649) ~[?:1.7.0_80]
2015-05-22 13:45:54 -05:00
da0cc32bc8
Revert commit 55ebf0cfdf
...
which caused following regression
it fails when we issue the SegmentMetadataQuery by setting {"bySegment" : true} in context with exception -
java.lang.ClassCastException: io.druid.query.Result cannot be cast to io.druid.query.metadata.metadata.SegmentAnalysis
at io.druid.query.metadata.SegmentMetadataQueryQueryToolChest$4.compare(SegmentMetadataQueryQueryToolChest.java:222) ~[druid-processing-0.7.3-SNAPSHOT.jar:0.7.3-SNAPSHOT]
at com.google.common.collect.NullsFirstOrdering.compare(NullsFirstOrdering.java:44) ~[guava-16.0.1.jar:?]
at com.metamx.common.guava.MergeIterator$1.compare(MergeIterator.java:46) ~[java-util-0.27.0.jar:?]
at com.metamx.common.guava.MergeIterator$1.compare(MergeIterator.java:42) ~[java-util-0.27.0.jar:?]
at java.util.PriorityQueue.siftUpUsingComparator(PriorityQueue.java:649) ~[?:1.7.0_80]
2015-05-22 13:39:34 -05:00
9e90dc0055
added clj-druid to query libraries (clojure)
2015-05-22 17:49:31 +02:00
4466e77b25
Merge pull request #1371 from guobingkun/unit_test
...
Unit test for IndexGeneratorJob
2015-05-22 10:34:24 -04:00
5ad5d7d18b
Merge pull request #1379 from flowbehappy/fix-hadoop-ha
...
bug fix: hdfs task log and indexing task not work properly with Hadoop HA
2015-05-22 09:14:50 -04:00
fae86e83ad
Merge pull request #1367 from metamx/hadoopTaskAbstraction
...
Abstractify HadoopTask
2015-05-21 13:25:51 -07:00
07659f30ab
bug fix: hdfs task log and indexing task not work properly with Hadoop HA
2015-05-21 20:49:42 +08:00
82da479464
Fix for GroupBy with Having+Limit+Orderspec
...
* Inverted function arguments to compose postProcFn for GroupBy queries
with havingspec + limitspec.
* Replaced query.getLimitSpec() with null in GroupByQueryToolChest's
mergeGroupByResults
* Added unittest to verify functionality
2015-05-19 18:35:48 +02:00
Charles Allen
Xavier Léauté
fjy
Himanshu Gupta
Xavier Léauté
janakg
nishant
cheddar
gbuisson
flow
Maarten Rijke