Charles Allen
7e61216287
Update to guice 4.0
...
- Mark a lot of `@Provides` methods as final since guice 4.0 disallows overriding them
2015-08-10 13:57:18 -07:00
Charles Allen
9dd18de1a5
Merge pull request #1596 from metamx/console-artifact
...
make console a maven dependency instead of filedump
2015-08-04 15:28:45 -07:00
Xavier Léauté
07ee1acca2
make console a maven dependency instead of filedump
2015-08-04 09:49:34 -07:00
Fangjin Yang
b05be0a104
Merge pull request #1593 from metamx/run-tests-offline
...
Fix test so that it can run offline
2015-08-04 09:23:40 -07:00
Nishant
f490547faf
Fix test so that it can run offline too
...
Test was getting stuck for me when I tried to run it offline while
resolving the host. creating unresolved SocketAddress works around
this.
2015-08-03 23:37:04 +05:30
Bingkun Guo
479b09c2dd
fix transient error in BrokerServerViewTest
2015-07-31 13:33:55 -05:00
Fangjin Yang
22567946cf
Merge pull request #1259 from metamx/queryTimeLookup
...
Query Time Lookup
2015-07-28 11:43:05 -10:00
Charles Allen
ba59f8afc4
Merge pull request #1550 from himanshug/optionally_log_all_requests
...
print *all* HTTP requests to log if configured
2015-07-28 11:19:36 -07:00
Charles Allen
86ede702b1
Add namespaced lookups as extensions
...
* Adds kafka, URI, and JDBC namespace defintions
* Add ability to explicitly rename using a "namespace" which is a particular data collection that is loaded on all realtime, historic nodes, and brokers. If any of these nodes has the namespace extension, ALL nodes have the namespace extension.
* Add namespace caching and populating (can be on heap or off heap)
* Add NamespaceExtractionCacheManager for handling caches
* Added ExtractionNamespace for handling metadata on the extraction namespaces
* Added ExtractionNamespaceUpdate for handling metadata related to updates
* Add extension which caches renames from a kafka stream (requires kafka8)
* Added README.md for the namespace kafka extension
* Added docs
* Added namespace/size, namespace/count, namespace/deltaTasksStarted metrics
Add static config for namespaces via `druid.query.extraction.namespace`
* This is a rebase of https://github.com/b-slim/druid/tree/static_config_only
2015-07-28 11:14:14 -07:00
Himanshu Gupta
90b475975e
Log all the requests to debug level in logger io.druid.jetty.RequestLog
2015-07-28 12:56:04 -05:00
nishant
efb6e0649e
simplify merging of results on broker.
...
add benchmark
formatting and review comments
organize imports
2015-07-27 11:46:11 -07:00
Xavier Léauté
6e8da5de86
Merge pull request #1441 from metamx/queryResourceFlusher
...
Add flush prior to close on output stream in QueryResource
2015-07-17 16:32:52 -07:00
Fangjin Yang
e21195f987
Merge pull request #1469 from guobingkun/table_config
...
Inconsistent property names for "druid.metadata.storage.tables.xxx"
2015-07-17 07:43:19 -07:00
Fangjin Yang
a4cb0332fb
Merge pull request #1524 from metamx/peonShutdown
...
Make CliPeon run shutdown hooks properly
2015-07-15 10:09:33 -07:00
Charles Allen
92d5c250ab
Remove comment
2015-07-14 16:20:36 -07:00
Charles Allen
5eadd395e2
Move lots of executor service creation to Execs
2015-07-14 15:38:49 -07:00
Charles Allen
2b87ad307d
Make CliPeon run shutdown hooks properly
...
* Also make jetty threads daemon
2015-07-14 15:15:26 -07:00
Fangjin Yang
da8e86146e
Merge pull request #1505 from metamx/improve-test
...
Modify test to check for multiple shards for same interval
2015-07-14 08:50:47 -07:00
Fangjin Yang
3f7ba58227
Merge pull request #1504 from metamx/fix-1447
...
fix for #1447
2015-07-14 08:50:08 -07:00
Himanshu
1affdf7bec
Merge pull request #1502 from samjhecht/poll-alerting
...
add alert on errors polling for rules
2015-07-13 18:37:37 -05:00
samjhecht
fc438e5a72
add alert on errors polling for rules
...
reset retrystarttime after alerting
2015-07-13 09:03:51 -07:00
Himanshu
725086cc89
Merge pull request #1506 from gianm/realtime-plumber-nulls
...
Consider null inputRows and parse errors as unparseable during realtime ingestion.
2015-07-13 10:12:12 -05:00
Gian Merlino
9068bcd062
Consider null inputRows and parse errors as unparseable during realtime ingestion.
...
Also, harmonize exception handling between the RealtimeIndexTask and the RealtimeManager.
Conditions other than null inputRows and parse errors bubble up in both.
2015-07-11 20:40:03 -07:00
Himanshu
e9b627bf55
Merge pull request #1476 from pjain1/improved_tests
...
all the review comments have been taken care of, so merging.
2015-07-09 16:25:30 -05:00
Nishant
1766341648
Modify test to check for multiple shards for same interval
...
Modify test to check for multiple shards for same interval.
2015-07-09 20:35:31 +05:30
Parag Jain
58cc3954ff
improved coordinator and datasourceresource tests
2015-07-09 09:46:54 -05:00
Nishant
5fe27fe4ad
fix for #1447
...
fixes #1447
2015-07-09 19:05:48 +05:30
Nishant
184b12bee8
fix groupBy caching to work with renamed aggregators
...
Issue - while storing results in cache we store the event map which
contains aggregator names mapped to values. Now when someone fire same
query after renaming aggs, the cache key will be same but the event
will contain metric values mapped to older names which leads to wrong
results.
Fix - modify cache to not store raw event but the actual list of values
only.
review comments + fix dimension renaming
review comment
2015-07-09 11:48:26 +05:30
Nishant
fe36f7f852
emit alert for DB polling error
2015-07-07 19:51:36 +05:30
Fangjin Yang
d846f3ced6
Merge pull request #1498 from rasahner/doc_localFirehose
...
say explicitly that local firehose searches dirs recursively for files
2015-07-05 15:34:36 -07:00
sahner
acd20e8c00
say explicitly that local firehose searches directories recursively for files
2015-07-05 14:46:44 -05:00
Charles Allen
f2919b98b1
Merge pull request #1471 from metamx/direct-client-metrics
...
add query/node/time metrics to DirectDruidClient
2015-06-30 22:06:44 -07:00
Bingkun Guo
4a0ae7d8d5
Fix inconsistent druid property names for "druid.metadata.storage.tables.xxx" between document and code
2015-06-29 10:12:30 -05:00
Himanshu
8172bdff1c
Merge pull request #1468 from guobingkun/fix_npe_for_storage_action_handler
...
Fix npe thrown from SQLMetadataStorageActionHandler
2015-06-29 09:57:51 -05:00
Xavier Léauté
28fa1642b9
add node time metrics to DirectDruidClient
2015-06-26 17:57:44 -07:00
Charles Allen
fbcac10e00
Remove metrics emitting from caching clustered client
2015-06-26 10:49:13 -07:00
Bingkun Guo
e4e18b17b5
fix npe thrown from getEntry() and getStatus() SQLMetadataStorageActionHandler due to a non-exist entryId
2015-06-26 10:40:56 -05:00
Xavier Léauté
0c85c8c60a
Merge pull request #1462 from pjain1/validate_rules
...
tieredReplicants can be null
2015-06-24 13:29:27 -07:00
Parag Jain
ff738ace05
converting null tieredeplicants to default and not allowing empty ones
2015-06-24 14:55:12 -05:00
Fangjin Yang
0c13fd8018
Merge pull request #1450 from metamx/cache-key-distribution
...
Fix bad distribution of cache keys across cache nodes
2015-06-22 17:58:15 -07:00
Himanshu
34c8f4c3da
Merge pull request #1437 from metamx/limitUsedSegmentInterval
...
Add start and end bounds to getUsedSegmentsForInterval
2015-06-22 14:11:38 -05:00
Charles Allen
8d91c8d399
Add start and end bounds to getUsedSegmentsForInterval
...
* Add unit tests
* Add javadoc for methods in IndexerMetadataStorageCoordinator
2015-06-22 11:46:53 -07:00
Xavier Léauté
f1951b253c
Fix bad distribution of cache keys across nodes
...
With the existing hash function some nodes could end up with 3 times the
number of keys as others. The following changes improve that to roughly
less than 5% differences across nodes.
- switch from fnv-1a to murmur3_128 hash
- increase repetitions for ketama algorithm
- test to analyze distribution
Also updates spymemcached for recent bugfixes
2015-06-19 15:30:35 -07:00
Xavier Léauté
d276d2c90b
Merge pull request #1444 from druid-io/logging-improvement
...
Separate bootstrap threads from loading threads on historical startup
2015-06-17 15:24:07 -07:00
Eric Tschetter
06c97b6d7d
Separate out the "bootstrapping" threads from the "loading" threads.
...
It is highly recommended to keep loading threads single threaded. There can be benefits to having multiple bootstrapping threads, though. Those bootstrapping threads shouldn't be kept alive for the whole life of the process, however.
Also, adjust some logging and do some code cleanup.
2015-06-17 14:58:28 -07:00
Fangjin Yang
0539e0073d
Merge pull request #1442 from guobingkun/broker_server_view_test
...
Unit test for BrokerServerView
2015-06-16 19:45:20 -07:00
Eric Tschetter
1aad7ce521
Add a bit more information to the mapping logging logic.
2015-06-16 19:33:38 -07:00
Bingkun Guo
446d01cc53
Unit test for BrokerServerView
2015-06-16 15:20:32 -05:00
Charles Allen
69bbe21512
Add flush prior to close on output stream in QueryResource
2015-06-16 11:40:56 -07:00
Xavier Léauté
9cf8662aeb
Merge pull request #1427 from guobingkun/fix_issue_1016
...
Fix duplicate extension loading issue described in #1016
2015-06-10 14:42:24 -07:00