Commit Graph

6085 Commits

Author SHA1 Message Date
Himanshu Gupta b9740a727b unit test for IngestSegmentFirehose 2015-10-01 16:06:04 -05:00
Charles Allen bdae0cb135 Update httpcomponents and aws-sdk 2015-10-01 13:28:46 -07:00
Himanshu Gupta 9006e255ef fixing the link to chunkPeriod doc 2015-10-01 13:03:46 -05:00
Xavier Léauté faf4c865d5 update R / Python clients 2015-10-01 13:42:09 -04:00
Fangjin Yang 4da1575680 Merge pull request #1792 from gianm/groupby-hyperunique-postagg-test
GroupByQueryRunnerTest for hyperUnique finalizing post aggregators
2015-10-01 09:07:56 -04:00
Gian Merlino 774765dc40 GroupByQueryRunnerTest for hyperUnique finalizing post aggregators 2015-10-01 00:09:29 -04:00
Gian Merlino e3bb93e8c7 Revert "Merge pull request #1781 from dclim/nested-groupby-multiple-same-aggregator-fix-v2"
This reverts commit dae488b7c0, reversing
changes made to 397be4b897.
2015-10-01 00:05:59 -04:00
Fangjin Yang dae488b7c0 Merge pull request #1781 from dclim/nested-groupby-multiple-same-aggregator-fix-v2
Fix failure in nested groupBy with multiple aggregators with same fie…
2015-09-30 22:28:34 -04:00
dclim 8e20a1e1f3 Use DoubleSumAggregatorFactory instead of CountAggregatorFactory, add test for non-integers 2015-09-30 17:11:39 -06:00
David Lim 70ae5ca922 Fix failure in nested groupBy with multiple aggregators with same fieldName
Version 2 - Throws an exception if an outer query references an
aggregator that doesn't exist in the inner query, and then uses the
inner query aggregator names to form the columns for the intermediate
incremental index.

Also deleted all the getRequiredColumns() methods which are no longer
being used.

We do something wacky by adding an aggregator factory for the post
aggregators when building the intermediate incremental index, otherwise
queries on post aggregate results fail because the data isn't in the
incremental index.

Closes #1419
2015-09-30 15:43:11 -06:00
Fangjin Yang 397be4b897 Merge pull request #1790 from druid-io/kafka-extraction-namespace-pomCleanup
Cleanup kafka-extraction-namespace
2015-09-30 16:01:48 -04:00
Charles Allen bc22d4ff6c Cleanup kafka-extraction-namespace
Remove extra build defines in kafka-extraction-namespace's pom.xml
2015-09-30 11:33:04 -07:00
Charles Allen 8199ecf1a4 Merge pull request #1782 from jon-wei/smq_cachekey
Add analysisTypes to SegmentMetadataQuery cache key
2015-09-29 15:51:35 -07:00
jon-wei 41ff271339 Add analysisTypes to SegmentMetadataQuery cache key 2015-09-29 14:33:35 -07:00
Charles Allen 2d847ad654 Merge pull request #1730 from metamx/union-queries-fix
fix #1727 - Union bySegment queries fix
2015-09-29 12:23:25 -07:00
Charles Allen eb48a9eb81 Merge pull request #1784 from dclim/documentation-fixes
Minor documentation fixes for CONTRIBUTING.md
2015-09-29 11:53:35 -07:00
Xavier Léauté ff5e3b7e7d Merge pull request #1783 from gianm/smq-lci-caching
Separate ListColumnIncluderator cache key parts with nul bytes
2015-09-29 14:27:33 -04:00
dclim a58df303be Minor documentation fixes for CONTRIBUTING.md 2015-09-29 12:22:35 -06:00
Nishant 573aa96bd6 fix #1727 - Union bySegment queries fix
Fixes #1727.
revert to doing merging for results for union queries on broker.

revert unrelated changes

Add test for union query runner

Add test

remove unused imports

fix imports

fix renamed file

fix test

update docs.
2015-09-29 23:32:36 +05:30
Gian Merlino 62d4ced4dd Separate ListColumnIncluderator cache key parts with nul bytes 2015-09-29 13:59:58 -04:00
Charles Allen d2e400f063 Merge pull request #1740 from metamx/validate-locks
fix #1715
2015-09-29 09:38:42 -07:00
Xavier Léauté 25bbc0b923 Merge pull request #1778 from gianm/redirect-fixes
Redirect fixes
2015-09-25 09:54:48 -07:00
Gian Merlino 348172203f OverlordRedirectInfo: Fix ability to detect that there is no leader. 2015-09-25 09:30:09 -07:00
Gian Merlino 696f5336e0 Merge pull request #1777 from pjain1/fail_realtime
fail task if finishjob throws any exception
2015-09-25 09:00:02 -07:00
Parag Jain b630720164 fail task if finishjob throws any exception
add realtime task failure test
2015-09-25 10:55:45 -05:00
Gian Merlino 906e99d631 RedirectFilter: User agents are more likely to preserve method on 307. 2015-09-25 08:54:23 -07:00
Gian Merlino 4c72dabce9 Merge pull request #1776 from dclim/update-twitter-example
Modified the Twitter firehose to process more properties
2015-09-25 07:45:31 -07:00
David Lim f42f6247ee Modified the Twitter firehose to process more properties
Add dimensions such as screen name, retweet and verified booleans,
source, location, and originator information to support additional
analytics.
2015-09-25 00:21:15 -06:00
Fangjin Yang d60610ced3 Merge pull request #1775 from gianm/retry-table-creation
SQLMetadataConnector: Retry table creation, in case something goes wrong.
2015-09-24 22:24:03 -07:00
Fangjin Yang aa9d90355e Merge pull request #1772 from gianm/fix-overlord-startup
RemoteTaskRunner: Fix for starting an overlord before any workers ever existed.
2015-09-24 21:55:03 -07:00
Gian Merlino 3aba401ee0 SQLMetadataConnector: Retry table creation, in case something goes wrong.
Also rejigger table creation methods to not take a DBI. It's already available
inside the connector, and everyone was just using that one anyway.
2015-09-24 21:39:36 -07:00
Fangjin Yang 9dfc74bb4e Merge pull request #1774 from himanshug/merge_task_updates
update doc about aggregation field in merge task and a null check
2015-09-24 21:29:30 -07:00
Gian Merlino 63bf021077 RemoteTaskRunner: Fix for starting an overlord before any workers ever existed. 2015-09-24 21:15:36 -07:00
Himanshu Gupta 6e550d5346 update doc about aggregation field in merge task and a null check 2015-09-24 22:25:07 -05:00
Nishant b638400acb fix #1715
fixes #1715
- TaskLockBox has a set of active tasks
- lock requests throws exception for if they are from a task not in
active task set.
- TaskQueue is responsible for updating the active task set on
tasklockbox

fix #1715

fixes #1715
- TaskLockBox has a set of active tasks
- lock requests throws exception for if they are from a task not in
active task set.
- TaskQueue is responsible for updating the active task set on
tasklockbox

review comment

remove duplicate line

use ISE instead

organise imports
2015-09-24 10:06:50 +05:30
Fangjin Yang a5718ee8b7 Merge pull request #1764 from metamx/enableLogging
Enable logging for memcached in factory
2015-09-23 16:53:58 -07:00
Fangjin Yang 5dd5fc7221 Merge pull request #1767 from metamx/revertDirectToMasterCommit
Revert "Update README.md"
2015-09-22 20:54:30 -07:00
Charles Allen f4fa153f1a Revert "Update README.md"
This reverts commit f46d140fd3.
2015-09-22 20:38:12 -07:00
Fangjin Yang f46d140fd3 Update README.md
Add Gitter Badge
2015-09-22 20:30:21 -07:00
Xavier Léauté 2cb0fb4669 Merge pull request #1753 from jon-wei/segmentmetadataquery_flags
Allow SegmentMetadataQuery to skip cardinality and size calculations
2015-09-22 14:52:28 -07:00
jon-wei e6a6284ebd Allow SegmentMetadataQuery to skip cardinality and size calculations 2015-09-22 13:51:55 -07:00
Charles Allen 4308aa93e2 Add meter metrics for memcached 2015-09-22 12:50:54 -07:00
Charles Allen 46ba60f10f Enable logging for memcached in factory 2015-09-22 11:13:47 -07:00
Xavier Léauté 1c86eac9e1 Merge pull request #1760 from metamx/memcached082Updates
Update memcached client for better concurrency in metrics.
2015-09-22 10:59:43 -07:00
Xavier Léauté 35caa753aa Merge pull request #1761 from gianm/local-path-for-hadoop
LocalDataSegmentPusher: Fix for Hadoop + relative paths.
2015-09-22 08:57:44 -07:00
Gian Merlino 4efbe649a3 LocalDataSegmentPusher: Fix for Hadoop + relative paths. 2015-09-22 07:44:12 -07:00
Charles Allen e6f07a832d Update memcached client for better concurrency in metrics. Also fixes another injection problem 2015-09-22 07:40:24 -07:00
Himanshu 63a3a4a254 Merge pull request #1763 from metamx/server-metrics-fixes
fix NPE and duplicate metric keys
2015-09-22 09:39:01 -05:00
Xavier Léauté 0fe9aeb3d6 fix NPE and duplicate metric keys 2015-09-21 22:50:49 -07:00
Himanshu 61b0743943 Merge pull request #1748 from metamx/forkingJavaOptionsWithQuotes
Allow ForkingTaskRunner javaOpts to have quoted arguments which contain spaces
2015-09-21 21:03:00 -05:00