Commit Graph

5950 Commits

Author SHA1 Message Date
Xavier Léauté e797d222c7 Merge pull request #1806 from himanshug/fix_index_exceeded_msg
Fix index exceeded msg to give maxRowCount as well
2015-10-07 14:04:56 -07:00
Charles Allen 020a706ac4 Merge pull request #1800 from metamx/hybrid-cache
Hybrid L1/L2 cache
2015-10-06 15:18:07 -07:00
Xavier Léauté b11c0859e8 hybrid l1/l2 cache to combine local and remote cache 2015-10-06 14:32:08 -07:00
Himanshu Gupta 2737fd83f5 in the IndexSizeExceededException put maxRowCount to confirm if it is correctly picked up from configuration 2015-10-06 15:23:14 -05:00
Himanshu Gupta 8654732ef6 make IndexSizeExceededException constructor take formatString and arguments than just fixed String
like ISE, IAE etc
2015-10-06 13:44:22 -05:00
Fangjin Yang b5737a233a Merge pull request #1801 from guobingkun/clientInfoResource
Fix ClientInfoResource
2015-10-06 07:53:44 -07:00
Xavier Léauté d8a1dd8d68 Merge pull request #1765 from metamx/brokerCpuMetrics
Add CPUTimeMetricQueryRunner to ClientQuerySegmentWalker
2015-10-05 10:51:30 -07:00
Charles Allen 2bc4aed1e5 Add CPUTimeMetricQueryRunner to ClientQuerySegmentWalker 2015-10-05 10:09:22 -07:00
Bingkun Guo 57c8e56451 Fix ClientInfoResource
Fix ClientInfoResource so that it doesn't return empty list for overshadowed segments
2015-10-02 14:12:55 -05:00
Himanshu 166c4fcf46 Merge pull request #1795 from metamx/announcerTestTransactions
Try and make AnnouncerTest a bit more predictable
2015-10-02 13:04:33 -05:00
Nishant 42e971d1c1 Merge pull request #1797 from himanshug/fix_ingest_segment_firehose_ut
ingest segment firehose ut
2015-10-02 21:57:22 +05:30
Charles Allen 7d635a2ce2 Try and make AnnouncerTest a bit more predictable 2015-10-02 09:19:40 -07:00
Xavier Léauté e5b3226b62 Merge pull request #1793 from himanshug/fix_chunking_link
fixing the link to chunkPeriod doc
2015-10-02 10:10:11 -04:00
Himanshu 8871e94be2 Merge pull request #1798 from metamx/rollbackAWSSDK
Update httpcomponents and aws-sdk
2015-10-02 00:02:35 -05:00
Xavier Léauté 5db4c5a089 move cache bindings into a dedicated module 2015-10-02 00:29:05 -04:00
Charles Allen 261465fac2 Merge pull request #1794 from metamx/update-libraries
update R / Python clients
2015-10-01 15:34:04 -07:00
Himanshu Gupta e2b16ab281 update java-util dep version 2015-10-01 16:06:04 -05:00
Himanshu Gupta b9740a727b unit test for IngestSegmentFirehose 2015-10-01 16:06:04 -05:00
Charles Allen bdae0cb135 Update httpcomponents and aws-sdk 2015-10-01 13:28:46 -07:00
Himanshu Gupta 9006e255ef fixing the link to chunkPeriod doc 2015-10-01 13:03:46 -05:00
Xavier Léauté faf4c865d5 update R / Python clients 2015-10-01 13:42:09 -04:00
Fangjin Yang 4da1575680 Merge pull request #1792 from gianm/groupby-hyperunique-postagg-test
GroupByQueryRunnerTest for hyperUnique finalizing post aggregators
2015-10-01 09:07:56 -04:00
Gian Merlino 774765dc40 GroupByQueryRunnerTest for hyperUnique finalizing post aggregators 2015-10-01 00:09:29 -04:00
Gian Merlino e3bb93e8c7 Revert "Merge pull request #1781 from dclim/nested-groupby-multiple-same-aggregator-fix-v2"
This reverts commit dae488b7c0, reversing
changes made to 397be4b897.
2015-10-01 00:05:59 -04:00
Fangjin Yang dae488b7c0 Merge pull request #1781 from dclim/nested-groupby-multiple-same-aggregator-fix-v2
Fix failure in nested groupBy with multiple aggregators with same fie…
2015-09-30 22:28:34 -04:00
dclim 8e20a1e1f3 Use DoubleSumAggregatorFactory instead of CountAggregatorFactory, add test for non-integers 2015-09-30 17:11:39 -06:00
David Lim 70ae5ca922 Fix failure in nested groupBy with multiple aggregators with same fieldName
Version 2 - Throws an exception if an outer query references an
aggregator that doesn't exist in the inner query, and then uses the
inner query aggregator names to form the columns for the intermediate
incremental index.

Also deleted all the getRequiredColumns() methods which are no longer
being used.

We do something wacky by adding an aggregator factory for the post
aggregators when building the intermediate incremental index, otherwise
queries on post aggregate results fail because the data isn't in the
incremental index.

Closes #1419
2015-09-30 15:43:11 -06:00
Fangjin Yang 397be4b897 Merge pull request #1790 from druid-io/kafka-extraction-namespace-pomCleanup
Cleanup kafka-extraction-namespace
2015-09-30 16:01:48 -04:00
Charles Allen bc22d4ff6c Cleanup kafka-extraction-namespace
Remove extra build defines in kafka-extraction-namespace's pom.xml
2015-09-30 11:33:04 -07:00
Charles Allen 8199ecf1a4 Merge pull request #1782 from jon-wei/smq_cachekey
Add analysisTypes to SegmentMetadataQuery cache key
2015-09-29 15:51:35 -07:00
jon-wei 41ff271339 Add analysisTypes to SegmentMetadataQuery cache key 2015-09-29 14:33:35 -07:00
Charles Allen 2d847ad654 Merge pull request #1730 from metamx/union-queries-fix
fix #1727 - Union bySegment queries fix
2015-09-29 12:23:25 -07:00
Charles Allen eb48a9eb81 Merge pull request #1784 from dclim/documentation-fixes
Minor documentation fixes for CONTRIBUTING.md
2015-09-29 11:53:35 -07:00
Xavier Léauté ff5e3b7e7d Merge pull request #1783 from gianm/smq-lci-caching
Separate ListColumnIncluderator cache key parts with nul bytes
2015-09-29 14:27:33 -04:00
dclim a58df303be Minor documentation fixes for CONTRIBUTING.md 2015-09-29 12:22:35 -06:00
Nishant 573aa96bd6 fix #1727 - Union bySegment queries fix
Fixes #1727.
revert to doing merging for results for union queries on broker.

revert unrelated changes

Add test for union query runner

Add test

remove unused imports

fix imports

fix renamed file

fix test

update docs.
2015-09-29 23:32:36 +05:30
Gian Merlino 62d4ced4dd Separate ListColumnIncluderator cache key parts with nul bytes 2015-09-29 13:59:58 -04:00
Charles Allen d2e400f063 Merge pull request #1740 from metamx/validate-locks
fix #1715
2015-09-29 09:38:42 -07:00
Xavier Léauté 25bbc0b923 Merge pull request #1778 from gianm/redirect-fixes
Redirect fixes
2015-09-25 09:54:48 -07:00
Gian Merlino 348172203f OverlordRedirectInfo: Fix ability to detect that there is no leader. 2015-09-25 09:30:09 -07:00
Gian Merlino 696f5336e0 Merge pull request #1777 from pjain1/fail_realtime
fail task if finishjob throws any exception
2015-09-25 09:00:02 -07:00
Parag Jain b630720164 fail task if finishjob throws any exception
add realtime task failure test
2015-09-25 10:55:45 -05:00
Gian Merlino 906e99d631 RedirectFilter: User agents are more likely to preserve method on 307. 2015-09-25 08:54:23 -07:00
Gian Merlino 4c72dabce9 Merge pull request #1776 from dclim/update-twitter-example
Modified the Twitter firehose to process more properties
2015-09-25 07:45:31 -07:00
David Lim f42f6247ee Modified the Twitter firehose to process more properties
Add dimensions such as screen name, retweet and verified booleans,
source, location, and originator information to support additional
analytics.
2015-09-25 00:21:15 -06:00
Fangjin Yang d60610ced3 Merge pull request #1775 from gianm/retry-table-creation
SQLMetadataConnector: Retry table creation, in case something goes wrong.
2015-09-24 22:24:03 -07:00
Fangjin Yang aa9d90355e Merge pull request #1772 from gianm/fix-overlord-startup
RemoteTaskRunner: Fix for starting an overlord before any workers ever existed.
2015-09-24 21:55:03 -07:00
Gian Merlino 3aba401ee0 SQLMetadataConnector: Retry table creation, in case something goes wrong.
Also rejigger table creation methods to not take a DBI. It's already available
inside the connector, and everyone was just using that one anyway.
2015-09-24 21:39:36 -07:00
Fangjin Yang 9dfc74bb4e Merge pull request #1774 from himanshug/merge_task_updates
update doc about aggregation field in merge task and a null check
2015-09-24 21:29:30 -07:00
Gian Merlino 63bf021077 RemoteTaskRunner: Fix for starting an overlord before any workers ever existed. 2015-09-24 21:15:36 -07:00