Apache/druid
1
0
Fork 0
mirror of https://github.com/apache/druid.git synced 2025-02-10 12:05:00 +00:00
Code Issues Packages Projects Releases Wiki Activity
7,270 Commits 116 Branches 507 Tags
Commit Graph

2722 Commits

Author SHA1 Message Date
Fangjin Yang
6605a60ef0 Merge pull request #1747 from jon-wei/realtime_corrupt_sink_fix 
Account for potential gaps in hydrants in sink initialization, hydrant swapping (e.g. h0, h1, h4)
 2015-09-18 15:22:50 -07:00
jon-wei
9f6bb03ef4 Account for potential gaps in hydrants in sink initialization, hydrant swapping (e.g. h0, h1, h4) 2015-09-18 14:53:37 -07:00
Xavier Léauté
df4c8a3aa5 balance memcached cache across multiple connections 2015-09-18 09:52:16 -07:00
Himanshu Gupta
a7b1cacbbf make NumberedShardSpec "elastic" and UTs 2015-09-17 08:38:48 -05:00
Gian Merlino
9705c5139b Merge pull request #1732 from jon-wei/segmentmeta 
Add support for a configurable default segment history period for segmentMetadata queries and GET /datasources/<datasourceName> lookups
 2015-09-16 12:36:25 -07:00
Himanshu Gupta
74f4572bd4 Lazily deserialize "parser" to InputRowParser in DataSchema 
so that user hadoop related InputRowParsers are created only when needed
this allows overlord to accept a HadoopIndexTask with a hadoopy InputRowParser
and not fail because hadoopy InputRowParser might need hadoop libraries
 2015-09-16 10:58:13 -05:00
Xavier Léauté
b464da438c Merge pull request #1688 from metamx/moreMemcachedMetrics 
More memcached metrics
 2015-09-15 15:33:51 -07:00
jon-wei
193fb4fdfc Add support for a configurable default segment history period for segmentMetadata queries and GET /datasources/<datasourceName> lookups 2015-09-14 19:41:42 -07:00
Himanshu
5ff92664f8 Merge pull request #1696 from metamx/cpuTimeReporting 
Add CPU time to metrics for segment scanning.
 2015-09-14 10:53:55 -05:00
Himanshu Gupta
ebdb612933 composing emitter module to use multiple emitters together 2015-09-09 16:45:50 -05:00
Charles Allen
5813856819 More memcached metrics 2015-09-08 13:34:58 -07:00
Charles Allen
fcf5cae81d Add CPU time to metrics for segment scanning. 2015-09-08 13:34:19 -07:00
Gian Merlino
062a47fba4 Modify Plumbers in these ways, 
1) Persist using Committer instead of Runnable. (Although the metadata object
   is ignored in this patch)

2) Remove the getSink method.

3) Plumbers are now responsible for time-based and hydrant-full-based periodic
   committing. (FireChief, RealtimeIndexTask, and IndexTask used to do this)
 2015-09-03 11:13:06 -07:00
Nishant
e79572b4bc Merge pull request #1637 from metamx/peonPlaysNiceOnShutdown 
Make jetty scheduler threads daemon thread
 2015-09-03 00:03:20 +05:30
Nishant
0096e6a0a0 Merge pull request #1658 from metamx/cleanupJDBCExtractionNamespaceTest 
Hopefully add better timeouts and ordering to JDBCExtractionNamespaceTest
 2015-09-02 23:49:49 +05:30
nishant
0835e12f2a add endpoint to fetch rule history for all datasources. 
review comments

Review comment

fix compilation
 2015-08-31 14:05:52 +05:30
Fangjin Yang
dfe3be0f6d Merge pull request #1689 from metamx/lz4TranscoderUpdate 
Update LZ4Transcoder to match Compressed strategy factory type.
 2015-08-29 12:31:59 -07:00
Charles Allen
413c0d1c9e Update LZ4Transcoder to match Compressed strategy factory type. 2015-08-28 19:19:48 -07:00
Gian Merlino
940e1aa3eb Replace funky imports with standard ones. 
1) Lots of Guava imports were not coming from the actual Guava
2) junit.framework.Assert should be org.junit.Assert
 2015-08-28 18:02:05 -07:00
Himanshu
ceaa49ec4f Merge pull request #1681 from gianm/ingest-segment-overlapping 
Fix overlapping segments in IngestSegmentFirehose, DatasourceInputFormat
 2015-08-28 11:12:51 -05:00
Gian Merlino
e575ef2b20 Remove unused Indexer interface. 2015-08-28 08:40:47 -07:00
Gian Merlino
414a6fb477 Fix overlapping segments in IngestSegmentFirehose, DatasourceInputFormat. 
Fixes #1678. IngestSegmentFirehose (and its users) need to remember which
windows of which segments should actually be read, based on a timeline.
 2015-08-28 07:32:41 -07:00
Himanshu Gupta
2e0dd1d792 adding UTs and addressing review comments to 
firehoseV2 addition to Realtime[Manager|Plumber],
essential segment metadata persist support,
kafka-simple-consumer-firehose extension patch
 2015-08-27 20:50:46 -05:00
lvjq
2237a8cf0f kafka 8 simple consumer firehose 2015-08-27 20:50:46 -05:00
Charles Allen
10af233b37 Merge pull request #1622 from metamx/smile-eventreceiverfirehose 
Support for JSON Smile format for EventReceiverFirehoseFactory
 2015-08-27 10:42:25 -07:00
Charles Allen
ac8e32b58e Hopefully add better timeouts and ordering to JDBCExtractionNamespaceTest 2015-08-26 23:05:51 -07:00
Gian Merlino
5b67ec6cda Merge pull request #1672 from metamx/derbyRule 
Migrate TestDerbyConnector to a JUnit @Rule
 2015-08-26 22:56:18 -07:00
Charles Allen
e38cf54bc8 Migrate TestDerbyConnector to a JUnit @Rule 2015-08-26 21:47:40 -07:00
Xavier Léauté
e9237611c5 Merge pull request #1668 from metamx/cachingClusteredClientCodeCleanup1 
Code cleanup for CachingClusteredClientTest
 2015-08-26 17:13:55 -07:00
Xavier Léauté
c325b194c0 Merge pull request #1661 from pjain1/poll_rules 
Poll rules immediately after change
 2015-08-25 13:46:55 -07:00
Charles Allen
85aeda834c Code cleanup for CachingClusteredClientTest 2015-08-25 12:49:55 -07:00
Gian Merlino
2bf9a70bfa Consolidate SQL retrying by moving logic into the connectors. 
Also change boolean removeLock to void addLock in MetadataStorageActionHandler.
 2015-08-25 12:42:29 -07:00
Parag Jain
073c32f01b Poll rules immediately after change 2015-08-24 16:08:25 -05:00
Fangjin Yang
e3964cd9f6 Merge pull request #1653 from metamx/fix-success-flag 
fix success flag emitted in router query metrics
 2015-08-21 07:56:57 -07:00
Nishant
6d85a62ed2 fix success flag emitted in router query metrics 2015-08-21 12:25:57 +05:30
Nishant
e6b20db62d Support for JSON Smile format for EventReceiverFirehoseFactory 
Support for Smile format for EventReceiverFireshoseFactory.
would help in decreasing network load on middle managers ingesting high
data volumes.

review comments
 2015-08-20 19:52:45 +05:30
Fangjin Yang
6a0389297c Merge pull request #1634 from metamx/IrcFirehoseFixes 
Allow IrcFirehoseFactory to shutdown cleanly
 2015-08-18 21:06:34 -07:00
Xavier Léauté
3b2e41e42a update for next release 2015-08-18 17:16:46 -07:00
Charles Allen
13773865cf Make jetty scheduler threads daemon thread 2015-08-18 13:08:19 -07:00
Charles Allen
cd2c3776f8 Allow IrcFirehoseFactory to shutdown cleanly 2015-08-17 13:24:41 -07:00
Himanshu Gupta
4d4aa8bfc6 refactor IngestSegmentFirehoseFactory so that IngestSegmentFirehose becomes reusable 
Conflicts:
	indexing-service/src/main/java/io/druid/indexing/firehose/IngestSegmentFirehoseFactory.java
 2015-08-14 14:44:22 -05:00
Charles Allen
db19d2d547 Revert "Update to guice 4.0" 2015-08-14 09:26:07 -07:00
Charles Allen
be89105621 Merge pull request #1602 from metamx/more-code-cleanup 
Some perf Improvements in Broker
 2015-08-11 13:51:49 -07:00
Charles Allen
7e61216287 Update to guice 4.0 
- Mark a lot of `@Provides` methods as final since guice 4.0 disallows overriding them
 2015-08-10 13:57:18 -07:00
Nishant
b33c644da0 avoid unnecessary call to MultipleSpecificSegmentSpec.getIntervals() 
avoid unnecessary call to MultipleSpecificSegmentSpec.getIntervals()
profiling shows it took upto 6-12% of cpu time in
JodaUtils.condenseIntervals
 2015-08-06 13:51:17 +05:30
Charles Allen
9dd18de1a5 Merge pull request #1596 from metamx/console-artifact 
make console a maven dependency instead of filedump
 2015-08-04 15:28:45 -07:00
Xavier Léauté
07ee1acca2 make console a maven dependency instead of filedump 2015-08-04 09:49:34 -07:00
Fangjin Yang
b05be0a104 Merge pull request #1593 from metamx/run-tests-offline 
Fix test so that it can run offline
 2015-08-04 09:23:40 -07:00
Nishant
f490547faf Fix test so that it can run offline too 
Test was getting stuck for me when I tried to run it offline while
resolving the host. creating unresolved SocketAddress works around
this.
 2015-08-03 23:37:04 +05:30
Bingkun Guo
479b09c2dd fix transient error in BrokerServerViewTest 2015-07-31 13:33:55 -05:00