Fangjin Yang
dfe3be0f6d
Merge pull request #1689 from metamx/lz4TranscoderUpdate
...
Update LZ4Transcoder to match Compressed strategy factory type.
2015-08-29 12:31:59 -07:00
Charles Allen
413c0d1c9e
Update LZ4Transcoder to match Compressed strategy factory type.
2015-08-28 19:19:48 -07:00
Gian Merlino
940e1aa3eb
Replace funky imports with standard ones.
...
1) Lots of Guava imports were not coming from the actual Guava
2) junit.framework.Assert should be org.junit.Assert
2015-08-28 18:02:05 -07:00
Himanshu
ceaa49ec4f
Merge pull request #1681 from gianm/ingest-segment-overlapping
...
Fix overlapping segments in IngestSegmentFirehose, DatasourceInputFormat
2015-08-28 11:12:51 -05:00
Gian Merlino
e575ef2b20
Remove unused Indexer interface.
2015-08-28 08:40:47 -07:00
Gian Merlino
414a6fb477
Fix overlapping segments in IngestSegmentFirehose, DatasourceInputFormat.
...
Fixes #1678 . IngestSegmentFirehose (and its users) need to remember which
windows of which segments should actually be read, based on a timeline.
2015-08-28 07:32:41 -07:00
Himanshu Gupta
2e0dd1d792
adding UTs and addressing review comments to
...
firehoseV2 addition to Realtime[Manager|Plumber],
essential segment metadata persist support,
kafka-simple-consumer-firehose extension patch
2015-08-27 20:50:46 -05:00
lvjq
2237a8cf0f
kafka 8 simple consumer firehose
2015-08-27 20:50:46 -05:00
Charles Allen
10af233b37
Merge pull request #1622 from metamx/smile-eventreceiverfirehose
...
Support for JSON Smile format for EventReceiverFirehoseFactory
2015-08-27 10:42:25 -07:00
Gian Merlino
5b67ec6cda
Merge pull request #1672 from metamx/derbyRule
...
Migrate TestDerbyConnector to a JUnit @Rule
2015-08-26 22:56:18 -07:00
Charles Allen
e38cf54bc8
Migrate TestDerbyConnector to a JUnit @Rule
2015-08-26 21:47:40 -07:00
Xavier Léauté
e9237611c5
Merge pull request #1668 from metamx/cachingClusteredClientCodeCleanup1
...
Code cleanup for CachingClusteredClientTest
2015-08-26 17:13:55 -07:00
Xavier Léauté
c325b194c0
Merge pull request #1661 from pjain1/poll_rules
...
Poll rules immediately after change
2015-08-25 13:46:55 -07:00
Charles Allen
85aeda834c
Code cleanup for CachingClusteredClientTest
2015-08-25 12:49:55 -07:00
Gian Merlino
2bf9a70bfa
Consolidate SQL retrying by moving logic into the connectors.
...
Also change boolean removeLock to void addLock in MetadataStorageActionHandler.
2015-08-25 12:42:29 -07:00
Parag Jain
073c32f01b
Poll rules immediately after change
2015-08-24 16:08:25 -05:00
Fangjin Yang
e3964cd9f6
Merge pull request #1653 from metamx/fix-success-flag
...
fix success flag emitted in router query metrics
2015-08-21 07:56:57 -07:00
Nishant
6d85a62ed2
fix success flag emitted in router query metrics
2015-08-21 12:25:57 +05:30
Nishant
e6b20db62d
Support for JSON Smile format for EventReceiverFirehoseFactory
...
Support for Smile format for EventReceiverFireshoseFactory.
would help in decreasing network load on middle managers ingesting high
data volumes.
review comments
2015-08-20 19:52:45 +05:30
Fangjin Yang
6a0389297c
Merge pull request #1634 from metamx/IrcFirehoseFixes
...
Allow IrcFirehoseFactory to shutdown cleanly
2015-08-18 21:06:34 -07:00
Xavier Léauté
3b2e41e42a
update for next release
2015-08-18 17:16:46 -07:00
Charles Allen
cd2c3776f8
Allow IrcFirehoseFactory to shutdown cleanly
2015-08-17 13:24:41 -07:00
Himanshu Gupta
4d4aa8bfc6
refactor IngestSegmentFirehoseFactory so that IngestSegmentFirehose becomes reusable
...
Conflicts:
indexing-service/src/main/java/io/druid/indexing/firehose/IngestSegmentFirehoseFactory.java
2015-08-14 14:44:22 -05:00
Charles Allen
db19d2d547
Revert "Update to guice 4.0"
2015-08-14 09:26:07 -07:00
Charles Allen
be89105621
Merge pull request #1602 from metamx/more-code-cleanup
...
Some perf Improvements in Broker
2015-08-11 13:51:49 -07:00
Charles Allen
7e61216287
Update to guice 4.0
...
- Mark a lot of `@Provides` methods as final since guice 4.0 disallows overriding them
2015-08-10 13:57:18 -07:00
Nishant
b33c644da0
avoid unnecessary call to MultipleSpecificSegmentSpec.getIntervals()
...
avoid unnecessary call to MultipleSpecificSegmentSpec.getIntervals()
profiling shows it took upto 6-12% of cpu time in
JodaUtils.condenseIntervals
2015-08-06 13:51:17 +05:30
Charles Allen
9dd18de1a5
Merge pull request #1596 from metamx/console-artifact
...
make console a maven dependency instead of filedump
2015-08-04 15:28:45 -07:00
Xavier Léauté
07ee1acca2
make console a maven dependency instead of filedump
2015-08-04 09:49:34 -07:00
Fangjin Yang
b05be0a104
Merge pull request #1593 from metamx/run-tests-offline
...
Fix test so that it can run offline
2015-08-04 09:23:40 -07:00
Nishant
f490547faf
Fix test so that it can run offline too
...
Test was getting stuck for me when I tried to run it offline while
resolving the host. creating unresolved SocketAddress works around
this.
2015-08-03 23:37:04 +05:30
Bingkun Guo
479b09c2dd
fix transient error in BrokerServerViewTest
2015-07-31 13:33:55 -05:00
Fangjin Yang
22567946cf
Merge pull request #1259 from metamx/queryTimeLookup
...
Query Time Lookup
2015-07-28 11:43:05 -10:00
Charles Allen
ba59f8afc4
Merge pull request #1550 from himanshug/optionally_log_all_requests
...
print *all* HTTP requests to log if configured
2015-07-28 11:19:36 -07:00
Charles Allen
86ede702b1
Add namespaced lookups as extensions
...
* Adds kafka, URI, and JDBC namespace defintions
* Add ability to explicitly rename using a "namespace" which is a particular data collection that is loaded on all realtime, historic nodes, and brokers. If any of these nodes has the namespace extension, ALL nodes have the namespace extension.
* Add namespace caching and populating (can be on heap or off heap)
* Add NamespaceExtractionCacheManager for handling caches
* Added ExtractionNamespace for handling metadata on the extraction namespaces
* Added ExtractionNamespaceUpdate for handling metadata related to updates
* Add extension which caches renames from a kafka stream (requires kafka8)
* Added README.md for the namespace kafka extension
* Added docs
* Added namespace/size, namespace/count, namespace/deltaTasksStarted metrics
Add static config for namespaces via `druid.query.extraction.namespace`
* This is a rebase of https://github.com/b-slim/druid/tree/static_config_only
2015-07-28 11:14:14 -07:00
Himanshu Gupta
90b475975e
Log all the requests to debug level in logger io.druid.jetty.RequestLog
2015-07-28 12:56:04 -05:00
nishant
efb6e0649e
simplify merging of results on broker.
...
add benchmark
formatting and review comments
organize imports
2015-07-27 11:46:11 -07:00
Xavier Léauté
6e8da5de86
Merge pull request #1441 from metamx/queryResourceFlusher
...
Add flush prior to close on output stream in QueryResource
2015-07-17 16:32:52 -07:00
Fangjin Yang
e21195f987
Merge pull request #1469 from guobingkun/table_config
...
Inconsistent property names for "druid.metadata.storage.tables.xxx"
2015-07-17 07:43:19 -07:00
Charles Allen
456ad9ffba
Merge pull request #1529 from metamx/update-versions
...
inrement version
2015-07-15 13:25:31 -07:00
Xavier Léauté
4cfb00bc8a
inrement version
2015-07-15 13:09:05 -07:00
Fangjin Yang
a4cb0332fb
Merge pull request #1524 from metamx/peonShutdown
...
Make CliPeon run shutdown hooks properly
2015-07-15 10:09:33 -07:00
Charles Allen
92d5c250ab
Remove comment
2015-07-14 16:20:36 -07:00
Charles Allen
5eadd395e2
Move lots of executor service creation to Execs
2015-07-14 15:38:49 -07:00
Charles Allen
2b87ad307d
Make CliPeon run shutdown hooks properly
...
* Also make jetty threads daemon
2015-07-14 15:15:26 -07:00
Fangjin Yang
da8e86146e
Merge pull request #1505 from metamx/improve-test
...
Modify test to check for multiple shards for same interval
2015-07-14 08:50:47 -07:00
Fangjin Yang
3f7ba58227
Merge pull request #1504 from metamx/fix-1447
...
fix for #1447
2015-07-14 08:50:08 -07:00
Himanshu
1affdf7bec
Merge pull request #1502 from samjhecht/poll-alerting
...
add alert on errors polling for rules
2015-07-13 18:37:37 -05:00
samjhecht
fc438e5a72
add alert on errors polling for rules
...
reset retrystarttime after alerting
2015-07-13 09:03:51 -07:00
Himanshu
725086cc89
Merge pull request #1506 from gianm/realtime-plumber-nulls
...
Consider null inputRows and parse errors as unparseable during realtime ingestion.
2015-07-13 10:12:12 -05:00