2533 Commits

Author	SHA1	Message	Date
Charles Allen	cd2c3776f8	Allow IrcFirehoseFactory to shutdown cleanly	2015-08-17 13:24:41 -07:00
Himanshu Gupta	4d4aa8bfc6	refactor IngestSegmentFirehoseFactory so that IngestSegmentFirehose becomes reusable ... Conflicts: indexing-service/src/main/java/io/druid/indexing/firehose/IngestSegmentFirehoseFactory.java	2015-08-14 14:44:22 -05:00
Charles Allen	db19d2d547	Revert "Update to guice 4.0"	2015-08-14 09:26:07 -07:00
Charles Allen	be89105621	Merge pull request #1602 from metamx/more-code-cleanup ... Some perf Improvements in Broker	2015-08-11 13:51:49 -07:00
Charles Allen	7e61216287	Update to guice 4.0 ... - Mark a lot of `@Provides` methods as final since guice 4.0 disallows overriding them	2015-08-10 13:57:18 -07:00
Nishant	b33c644da0	avoid unnecessary call to MultipleSpecificSegmentSpec.getIntervals() ... avoid unnecessary call to MultipleSpecificSegmentSpec.getIntervals() profiling shows it took upto 6-12% of cpu time in JodaUtils.condenseIntervals	2015-08-06 13:51:17 +05:30
Charles Allen	9dd18de1a5	Merge pull request #1596 from metamx/console-artifact ... make console a maven dependency instead of filedump	2015-08-04 15:28:45 -07:00
Xavier Léauté	07ee1acca2	make console a maven dependency instead of filedump	2015-08-04 09:49:34 -07:00
Fangjin Yang	b05be0a104	Merge pull request #1593 from metamx/run-tests-offline ... Fix test so that it can run offline	2015-08-04 09:23:40 -07:00
Nishant	f490547faf	Fix test so that it can run offline too ... Test was getting stuck for me when I tried to run it offline while resolving the host. creating unresolved SocketAddress works around this.	2015-08-03 23:37:04 +05:30
Bingkun Guo	479b09c2dd	fix transient error in BrokerServerViewTest	2015-07-31 13:33:55 -05:00
Fangjin Yang	22567946cf	Merge pull request #1259 from metamx/queryTimeLookup ... Query Time Lookup	2015-07-28 11:43:05 -10:00
Charles Allen	ba59f8afc4	Merge pull request #1550 from himanshug/optionally_log_all_requests ... print *all* HTTP requests to log if configured	2015-07-28 11:19:36 -07:00
Charles Allen	86ede702b1	Add namespaced lookups as extensions ... * Adds kafka, URI, and JDBC namespace defintions * Add ability to explicitly rename using a "namespace" which is a particular data collection that is loaded on all realtime, historic nodes, and brokers. If any of these nodes has the namespace extension, ALL nodes have the namespace extension. * Add namespace caching and populating (can be on heap or off heap) * Add NamespaceExtractionCacheManager for handling caches * Added ExtractionNamespace for handling metadata on the extraction namespaces * Added ExtractionNamespaceUpdate for handling metadata related to updates * Add extension which caches renames from a kafka stream (requires kafka8) * Added README.md for the namespace kafka extension * Added docs * Added namespace/size, namespace/count, namespace/deltaTasksStarted metrics Add static config for namespaces via `druid.query.extraction.namespace` * This is a rebase of https://github.com/b-slim/druid/tree/static_config_only	2015-07-28 11:14:14 -07:00
Himanshu Gupta	90b475975e	Log all the requests to debug level in logger io.druid.jetty.RequestLog	2015-07-28 12:56:04 -05:00
nishant	efb6e0649e	simplify merging of results on broker. ... add benchmark formatting and review comments organize imports	2015-07-27 11:46:11 -07:00
Xavier Léauté	6e8da5de86	Merge pull request #1441 from metamx/queryResourceFlusher ... Add flush prior to close on output stream in QueryResource	2015-07-17 16:32:52 -07:00
Fangjin Yang	e21195f987	Merge pull request #1469 from guobingkun/table_config ... Inconsistent property names for "druid.metadata.storage.tables.xxx"	2015-07-17 07:43:19 -07:00
Charles Allen	456ad9ffba	Merge pull request #1529 from metamx/update-versions ... inrement version	2015-07-15 13:25:31 -07:00
Xavier Léauté	4cfb00bc8a	inrement version	2015-07-15 13:09:05 -07:00
Fangjin Yang	a4cb0332fb	Merge pull request #1524 from metamx/peonShutdown ... Make CliPeon run shutdown hooks properly	2015-07-15 10:09:33 -07:00
Charles Allen	92d5c250ab	Remove comment	2015-07-14 16:20:36 -07:00
Charles Allen	5eadd395e2	Move lots of executor service creation to Execs	2015-07-14 15:38:49 -07:00
Charles Allen	2b87ad307d	Make CliPeon run shutdown hooks properly ... * Also make jetty threads daemon	2015-07-14 15:15:26 -07:00
Fangjin Yang	da8e86146e	Merge pull request #1505 from metamx/improve-test ... Modify test to check for multiple shards for same interval	2015-07-14 08:50:47 -07:00
Fangjin Yang	3f7ba58227	Merge pull request #1504 from metamx/fix-1447 ... fix for #1447	2015-07-14 08:50:08 -07:00
Himanshu	1affdf7bec	Merge pull request #1502 from samjhecht/poll-alerting ... add alert on errors polling for rules	2015-07-13 18:37:37 -05:00
samjhecht	fc438e5a72	add alert on errors polling for rules ... reset retrystarttime after alerting	2015-07-13 09:03:51 -07:00
Himanshu	725086cc89	Merge pull request #1506 from gianm/realtime-plumber-nulls ... Consider null inputRows and parse errors as unparseable during realtime ingestion.	2015-07-13 10:12:12 -05:00
Gian Merlino	9068bcd062	Consider null inputRows and parse errors as unparseable during realtime ingestion. ... Also, harmonize exception handling between the RealtimeIndexTask and the RealtimeManager. Conditions other than null inputRows and parse errors bubble up in both.	2015-07-11 20:40:03 -07:00
Himanshu	e9b627bf55	Merge pull request #1476 from pjain1/improved_tests ... all the review comments have been taken care of, so merging.	2015-07-09 16:25:30 -05:00
Nishant	1766341648	Modify test to check for multiple shards for same interval ... Modify test to check for multiple shards for same interval.	2015-07-09 20:35:31 +05:30
Parag Jain	58cc3954ff	improved coordinator and datasourceresource tests	2015-07-09 09:46:54 -05:00
Nishant	5fe27fe4ad	fix for #1447 ... fixes #1447	2015-07-09 19:05:48 +05:30
Nishant	184b12bee8	fix groupBy caching to work with renamed aggregators ... Issue - while storing results in cache we store the event map which contains aggregator names mapped to values. Now when someone fire same query after renaming aggs, the cache key will be same but the event will contain metric values mapped to older names which leads to wrong results. Fix - modify cache to not store raw event but the actual list of values only. review comments + fix dimension renaming review comment	2015-07-09 11:48:26 +05:30
Nishant	fe36f7f852	emit alert for DB polling error	2015-07-07 19:51:36 +05:30
Fangjin Yang	d846f3ced6	Merge pull request #1498 from rasahner/doc_localFirehose ... say explicitly that local firehose searches dirs recursively for files	2015-07-05 15:34:36 -07:00
sahner	acd20e8c00	say explicitly that local firehose searches directories recursively for files	2015-07-05 14:46:44 -05:00
Charles Allen	f2919b98b1	Merge pull request #1471 from metamx/direct-client-metrics ... add query/node/time metrics to DirectDruidClient	2015-06-30 22:06:44 -07:00
Bingkun Guo	4a0ae7d8d5	Fix inconsistent druid property names for "druid.metadata.storage.tables.xxx" between document and code	2015-06-29 10:12:30 -05:00
Himanshu	8172bdff1c	Merge pull request #1468 from guobingkun/fix_npe_for_storage_action_handler ... Fix npe thrown from SQLMetadataStorageActionHandler	2015-06-29 09:57:51 -05:00
Xavier Léauté	28fa1642b9	add node time metrics to DirectDruidClient	2015-06-26 17:57:44 -07:00
Charles Allen	fbcac10e00	Remove metrics emitting from caching clustered client	2015-06-26 10:49:13 -07:00
Bingkun Guo	e4e18b17b5	fix npe thrown from getEntry() and getStatus() SQLMetadataStorageActionHandler due to a non-exist entryId	2015-06-26 10:40:56 -05:00
Xavier Léauté	0c85c8c60a	Merge pull request #1462 from pjain1/validate_rules ... tieredReplicants can be null	2015-06-24 13:29:27 -07:00
Parag Jain	ff738ace05	converting null tieredeplicants to default and not allowing empty ones	2015-06-24 14:55:12 -05:00
Fangjin Yang	0c13fd8018	Merge pull request #1450 from metamx/cache-key-distribution ... Fix bad distribution of cache keys across cache nodes	2015-06-22 17:58:15 -07:00
Himanshu	34c8f4c3da	Merge pull request #1437 from metamx/limitUsedSegmentInterval ... Add start and end bounds to getUsedSegmentsForInterval	2015-06-22 14:11:38 -05:00
Charles Allen	8d91c8d399	Add start and end bounds to getUsedSegmentsForInterval ... * Add unit tests * Add javadoc for methods in IndexerMetadataStorageCoordinator	2015-06-22 11:46:53 -07:00
Xavier Léauté	f1951b253c	Fix bad distribution of cache keys across nodes ... With the existing hash function some nodes could end up with 3 times the number of keys as others. The following changes improve that to roughly less than 5% differences across nodes. - switch from fnv-1a to murmur3_128 hash - increase repetitions for ketama algorithm - test to analyze distribution Also updates spymemcached for recent bugfixes	2015-06-19 15:30:35 -07:00
Xavier Léauté	0a5bb909a2	[maven-release-plugin] prepare for next development iteration	2015-06-18 17:35:19 -07:00
Xavier Léauté	59c6b2b279	[maven-release-plugin] prepare release druid-0.8.0-rc1	2015-06-18 17:35:14 -07:00
Xavier Léauté	d276d2c90b	Merge pull request #1444 from druid-io/logging-improvement ... Separate bootstrap threads from loading threads on historical startup	2015-06-17 15:24:07 -07:00
Eric Tschetter	06c97b6d7d	Separate out the "bootstrapping" threads from the "loading" threads. ... It is highly recommended to keep loading threads single threaded. There can be benefits to having multiple bootstrapping threads, though. Those bootstrapping threads shouldn't be kept alive for the whole life of the process, however. Also, adjust some logging and do some code cleanup.	2015-06-17 14:58:28 -07:00
Fangjin Yang	0539e0073d	Merge pull request #1442 from guobingkun/broker_server_view_test ... Unit test for BrokerServerView	2015-06-16 19:45:20 -07:00
Eric Tschetter	1aad7ce521	Add a bit more information to the mapping logging logic.	2015-06-16 19:33:38 -07:00
Bingkun Guo	446d01cc53	Unit test for BrokerServerView	2015-06-16 15:20:32 -05:00
Charles Allen	69bbe21512	Add flush prior to close on output stream in QueryResource	2015-06-16 11:40:56 -07:00
Xavier Léauté	9cf8662aeb	Merge pull request #1427 from guobingkun/fix_issue_1016 ... Fix duplicate extension loading issue described in #1016	2015-06-10 14:42:24 -07:00
Bingkun Guo	bdf4d541e3	Fix issue #1016 that if user specifies extension coordinates, the local extensions will be loaded twice, ... which could cause Guice duplicate binding errors. Add unit test to replicate duplicate extension issue. Update documents. Add an package accessible getter for loadersMap for testing only. Notice that extensions explicitly specified in druid.extensions.coordinates have a higher priority than ones included in the classpath. Extension modules that don't have a canonical class name will be ignored.	2015-06-10 15:48:03 -05:00
Xavier Léauté	e5937482bc	Merge pull request #1431 from pjain1/coordinator_ut ... Druid Coordinator test	2015-06-10 07:24:39 -07:00
Parag Jain	b72e6fd51a	Druid Coordinator Unit test	2015-06-09 13:51:01 -05:00
Bingkun Guo	22607d19be	Make AbstractHttpClientProvider contents lazily instantiated	2015-06-08 09:53:26 -05:00
Bingkun Guo	1646f650b6	Unit tests for LoadQueuePeon and SegmentLoaderLocalCacheManager, JavaDoc for LoadPeonCallback	2015-06-04 17:28:22 -05:00
Himanshu	f81a0d9210	Merge pull request #1425 from guobingkun/guice_fix ... Anyways, @guobingkun , if possible, can you please test proposed change and send another PR to fix #1016 . but that doesn't necessarily hold this PR, so I'm merging this.	2015-06-04 14:43:26 -05:00
Himanshu	f44f7f07de	Merge pull request #1424 from pjain1/validate_rules ... Check lower bound of replicant values for rules	2015-06-04 14:16:50 -05:00
Parag Jain	1030899cdf	Check lower bound of replicant values for rules	2015-06-04 13:47:43 -05:00
Bingkun Guo	dc26350480	Separate overwrite of Guice modules into 2 steps so that extension modules can overwrite cli modules	2015-06-04 09:57:56 -05:00
nishant	21864a9407	reduce test runtime ... fix check fix test	2015-06-04 08:35:12 +05:30
Charles Allen	1c4d42bc15	Replace "timeout" with QueryContextKeys.TIMEOUT	2015-06-02 14:49:21 -07:00
fjy	185c99deec	Add schema check for overlap between dimension and metric names	2015-05-28 22:18:08 -07:00
fjy	be2a35188e	Additional schema validations and better logs for common extensions	2015-05-27 16:25:02 -07:00
Charles Allen	051c3ccede	Add futures to SQLMetadataSegmentManager and SQLMetadataRuleManager	2015-05-15 16:08:22 -07:00
Xavier Léauté	3c3db7229c	Merge pull request #1355 from himanshug/long_max_min_aggregators ... Long max/min aggregators	2015-05-13 12:08:11 -07:00
Himanshu Gupta	d0ec945129	adding aliases doubleMax and doubleMin for max and min respectively ... renamed all [Max/Min]*.java to [DoubleMax/DoubleMin]*.java and created [Max/Min]AggregatorFactory.java which can be removed when we dont need the min/max aggregator type backward compatibility	2015-05-13 09:25:41 -05:00
fjy	7a6acf5c1b	update pom to 0.8	2015-05-11 19:41:58 -06:00
Fangjin Yang	a2dc58cd2d	Merge pull request #1345 from pjain1/unit_test_warn_fix ... fix warn msg and some unit tests	2015-05-08 08:06:20 -07:00
Parag Jain	01448d264c	Fix warn msg and added some unit tests	2015-05-07 17:10:05 -05:00
Fangjin Yang	7608bf5799	Merge pull request #1342 from guobingkun/unit_test ... Fix a potential issue in DeterminePartitionsJob, and two unit tests, reformat code	2015-05-05 09:24:23 -07:00
Bingkun Guo	1ee550dd91	Fix a potential issue in DeterminePartitionsJob by making HadoopDruidIndexerConfig non-static, and two unit tests for DeterminPartitionsJob and LocalDataSegmentKiller	2015-05-04 20:00:29 -07:00
Gian Merlino	e69d82a2b4	Realtime: Delay firehose connection until job is started. ... Some firehoses (like the Kafka firehose) acquire input resources when they connect, so it helps to delay this until after plumber.startJob() runs.	2015-05-04 10:54:07 -07:00
Gian Merlino	8eb441ec08	RealtimeManager: Include partitionNum in chief thread name.	2015-05-04 10:53:48 -07:00
Charles Allen	27e25fe513	fix IRCFirehoseFactory json name/nick mismatch ... * Now it is nick as per wikipedia example	2015-05-01 12:35:44 -07:00
Fangjin Yang	15ed308a4b	Merge pull request #1322 from himanshug/fix_audit_tbl_idx ... fixing the typo for audit table (type, created_date) index creation	2015-04-30 13:22:04 -07:00
fjy	a7f9bb1a1e	Additional coordinator logs to figure out when racey things might be happening	2015-04-30 08:26:52 -07:00
Himanshu Gupta	4aa9381f6a	fixing the typo for audit table (type, created_date) index creation	2015-04-29 17:09:35 -05:00
nishant	6e84caf3d5	Proxy Requests from coordinator to overlord ... Add unit test and support https scheme review comments	2015-04-29 20:58:26 +05:30
Charles Allen	062a413ccd	Fix DruidNodeTest for ipv6 only hosts	2015-04-28 13:11:47 -07:00
Xavier Léauté	721505c017	Merge pull request #1208 from druid-io/rework-metrics ... Schemaless metrics + additional metrics for things we care about	2015-04-27 15:04:54 -07:00
fjy	963e5765bf	Schemaless metrics + additional metrics for things we care about	2015-04-27 13:39:40 -07:00
nishant	958b34e0c2	fix exception during timeboundary ... Fix Exception during time boundary query where results can be represented as integers	2015-04-23 20:32:35 +05:30
Fangjin Yang	1addbe163a	Merge pull request #1295 from anubhgup/master ... Fix type of values in sql update.	2015-04-17 20:26:17 -07:00
Anubhav Gupta	4c240da4e9	Fix type of values in sql update.	2015-04-17 18:44:49 -07:00
fjy	d260515a43	update druid-api version	2015-04-17 14:58:35 -07:00
Xavier Léauté	ea5572d001	Merge pull request #1271 from metamx/strictErrorChecking ... Add stricter checking for potential coding errors	2015-04-15 15:21:41 -07:00
Charles Allen	abdeaa0746	Add stricter checking for potential coding errors ... Can use via `mvn clean compile test-compile -P strict'	2015-04-15 14:52:25 -07:00
Xavier Léauté	3a3046ccf3	add support for dimension compression ... - compression for single-value dimensions using CompressedVSizeIntsIndexedSupplier - makes dimension compression configurable via IndexSpec - IndexSpec also enables configuring bitmap and metric compression	2015-04-14 10:44:18 -07:00
Xavier Léauté	44e23a8267	Merge pull request #1224 from metamx/alert-improve ... skip raising false alert when the coordinator looses leadership	2015-04-07 10:11:34 -07:00
Fangjin Yang	208e307915	Merge pull request #1251 from metamx/uriSegmentLoaders ... Revert "Revert "Overhaul of SegmentPullers to add consistency and retries""	2015-03-30 17:43:51 -07:00
fjy	aea7f9d192	[maven-release-plugin] prepare for next development iteration	2015-03-30 16:35:24 -07:00
fjy	060d7aef03	[maven-release-plugin] prepare release druid-0.7.1	2015-03-30 16:35:20 -07:00
Charles Allen	1c6cbea89c	Revert "Revert "Overhaul of SegmentPullers to add consistency and retries"" ... This reverts commit f904bc7858.	2015-03-30 13:40:04 -07:00
Fangjin Yang	f904bc7858	Revert "Overhaul of SegmentPullers to add consistency and retries"	2015-03-30 13:15:50 -07:00
Charles Allen	6d407e8677	Add URI handling to SegmentPullers ... * Requires https://github.com/druid-io/druid-api/pull/37 * Requires https://github.com/metamx/java-util/pull/22 * Moves the puller logic to use a more standard workflow going through java-util helpers instead of re-writing the handlers for each impl * General workflow goes like this: 1) LoadSpec makes sure the correct Puller is called with the correct parameters. 2) The Puller sets up general information like how to make an InputStream, how to find a file name (for .gz files for example), and when to retry. 3) CompressionUtils does most of the heavy lifting when it can	2015-03-30 12:33:23 -07:00
Fangjin Yang	e5653f0752	Merge pull request #1190 from vigiglobe/master ... Fix NPE when partionNumber 0 does not exist.	2015-03-26 13:25:39 -07:00
Xavier Léauté	2c58e355fd	Merge pull request #1239 from metamx/log4j2forRealz ... Exclude log4j from curator dependencies in favor of log4j-1.2-api	2015-03-26 13:21:13 -07:00
Charles Allen	9cd6c08e96	Exclude log4j from curator dependencies in favor of log4j-1.2-api	2015-03-26 13:05:12 -07:00
Xavier Léauté	47cc11829d	Merge pull request #1240 from himanshug/async_query_forwarding_servlet_router_fix ... adding router numMaxThread configuration for ProxyServlet HttpClient executor	2015-03-26 10:15:44 -07:00
msprunck	942c17a2aa	Remove timeline chunk count assumptions. ... * Replace with generic iterables	2015-03-24 22:40:49 +01:00
Himanshu Gupta	b131a4fd3b	adding router numMaxThread configuration for ProxyServlet HttpClient executor	2015-03-23 21:58:01 -05:00
nishantmonu51	3b894f9fb9	add ut for TierSelectorStrategies ... fix test	2015-03-24 08:18:28 +05:30
Xavier Léauté	23528299c9	Merge pull request #1235 from druid-io/comments-update ... Minor update to zk comments to make it more clear what is happening	2015-03-23 14:02:08 -07:00
fjy	a0ce1caaf8	minor update to zk comments to make it more clear what is happening	2015-03-23 11:47:43 -07:00
Himanshu Gupta	b5b32dbcb4	in test explicitly setting maxThreads for ProxyServlet to work around https://tickets.puppetlabs.com/browse/TK-152	2015-03-23 12:27:19 -05:00
fjy	b389cfe404	[maven-release-plugin] prepare for next development iteration	2015-03-19 12:38:17 -07:00
fjy	60e7d543cc	[maven-release-plugin] prepare release druid-0.7.1-rc1	2015-03-19 12:38:13 -07:00
nishantmonu51	21cd75bcf6	improve alert ... skip doing false alert when the coordinator looses leadership	2015-03-18 09:42:22 +05:30
Fangjin Yang	8d0dfd9af1	Merge pull request #1221 from metamx/AnnounceIdUUID ... Change announcement ID to a UUID instead of Timestamp	2015-03-17 15:38:53 -07:00
Charles Allen	79b1443cc3	Change announcement ID to a UUID instead of Timestamp ... * Also add a UUIDUtils to the common package	2015-03-17 15:34:04 -07:00
nishantmonu51	f9821d242f	also log author ip address in audit log	2015-03-17 23:15:15 +05:30
cheddar	526a386f50	Merge pull request #1193 from metamx/reduce-test-verbosity ... move test output to file for cleaner build logs	2015-03-12 15:42:34 -07:00
nishantmonu51	3ec4a30ab5	initial commit ... review comments more refactoring and cleaning of redundant code add UT + docs + more refactoring fixes + review comments more cleanup end points to fetch history review comments remove unnecessary changes review comments rename header name review comments + add test for MetadataRulesManager review comments docs	2015-03-12 22:50:29 +05:30
Xavier Léauté	fc613771d2	move test output to file for cleaner build logs ... - removes the need for special test log4j2.xml	2015-03-11 17:56:19 -07:00
Xavier Léauté	9f242ed1ba	Merge pull request #1182 from druid-io/better-docs ... Rework the druid docs and fix many mistakes	2015-03-10 14:23:38 -07:00
fjy	064d65a009	rework the druid docs and fix many mistakes	2015-03-10 14:19:19 -07:00
Xavier Léauté	ef842b2eae	add test coverage	2015-03-09 14:32:13 -07:00
Xavier Léauté	e161021902	Merge pull request #1171 from druid-io/fix-rt-task ... Add more metrics and fail when realtime tasks fail to persist and merge	2015-03-06 16:42:23 -08:00
fjy	86a0a3cab8	add more metrics and fail when realtime tasks fail to persist and merge	2015-03-06 11:00:34 -08:00
Himanshu Gupta	956361dbbd	Refactoring: Moved BaseJettyServerInitializer.java to JettyServerInitUtils.java and changed it from abstract class to a utils class containing static methods ... And, moved jetty stuff to its own package io.druid.server.initialization.jetty	2015-03-05 19:33:27 -06:00
Himanshu Gupta	a8648d8f3d	feature to add servlet filters in a druid node via extension modules	2015-03-03 22:35:02 -06:00
Fangjin Yang	d8e199a3f5	Merge pull request #1161 from himanshug/zk_ood_updates ... Fix to maintain correctness when out-of-order ZK updates are received	2015-03-03 14:42:31 -08:00
Himanshu Gupta	dda2a62ff5	on receiving ZK ADD/UPDATE events, get latest data from zookeeper instead of taking it from the event which might be stale due to event coming out of order etc	2015-03-03 16:21:56 -06:00
Fangjin Yang	9578304d6f	Merge pull request #1130 from housejester/jde-building ... Various improvements to the tutorial and building experience.	2015-03-02 14:48:32 -08:00
Fangjin Yang	e8605c63a9	Merge pull request #1150 from himanshug/broker-parallel-chunk-process ... interval chunk query runner now processes individual chunk in a threadpool	2015-03-02 13:50:23 -08:00
Himanshu Gupta	29039fd541	interval chunk query runner now processes individual chunk in a thread pool and prints metrics query/time per chunk	2015-03-02 15:45:09 -06:00
Fangjin Yang	a76a24742b	Merge pull request #1149 from himanshug/broker-get-datasource-update ... updating ClientInfoResource.getDatasource() with a full flag	2015-03-02 13:28:27 -08:00
Himanshu Gupta	a39f4f8bf4	updating ClientInfoResource.getDatasource() with a full flag to return all the served intervals for given data source along with the dimension and metric information	2015-03-02 14:18:52 -06:00
Xavier Léauté	17743b94f3	Cleanup router servlet + tests for gzip proxying ... - Uses method overrides instead of modified Jetty code, now that ProxyServlet provides enough method hooks for proper overrides. This means we may also benefit from any Jetty ProxyServlet fixes - Adds test for async proxy servlet to make sure gzip encoding is properly proxied. - Router now proxies POST requests for requests that are not Druid queries, by only treating /druid/v2/* endpoints as queries.	2015-03-02 11:36:15 -08:00
Fangjin Yang	c21086b6a8	Merge pull request #1113 from metamx/fix1111 ... Make Realtime queries not submit to thread pools for the master merger	2015-02-27 11:13:25 -08:00
James Estes	9cb5d9bd00	Various improvements to the tutorial and building experience. ... - Improve geo ip download stability - Retry default geo ip download if corrupt - Clarify docs on building & where to get artifact	2015-02-25 18:49:16 -07:00
Xavier Léauté	b633111c76	Merge pull request #1156 from druid-io/fix-log ... Print better messages when there are problems with ingestion	2015-02-25 17:02:46 -08:00
fjy	9a3ed353dc	Have a more meaningful message when events are dropped or unparseable	2015-02-25 16:59:46 -08:00
Himanshu Gupta	2192d0cb57	UTs for server	2015-02-25 15:45:58 -08:00
Xavier Léauté	69ba802abb	Merge pull request #1109 from metamx/fixAnnouncerTest ... Make the Announcer closing and unannouncing atomic.	2015-02-25 15:24:18 -08:00
Xavier Léauté	aa9dbb773d	Merge pull request #1153 from metamx/announcerTestForWaitingFix ... Use forWaiting() in AnnouncerTest	2015-02-24 21:48:54 -08:00
Charles Allen	29a3522708	Use forWaiting() in AnnouncerTest ... * Helps reduce random failures in unit test on slow systems	2015-02-24 08:35:07 -08:00
Xavier Léauté	b167dcf82c	[maven-release-plugin] prepare for next development iteration	2015-02-23 14:28:06 -08:00
Xavier Léauté	e81ac2ba43	[maven-release-plugin] prepare release druid-0.7.0	2015-02-23 14:27:58 -08:00
Fangjin Yang	25db9abb7f	Merge pull request #1138 from metamx/better-default-hostname ... Better default hostname	2015-02-18 17:37:34 -08:00
Xavier Léauté	53d2b961c5	default to canonical hostname instead of localhost	2015-02-18 16:44:48 -08:00
fjy	3fab045b2d	Go through and fix mistakes in tutorials and docs	2015-02-17 15:21:16 -08:00
cheddar	2a45501393	Merge pull request #1110 from metamx/move-to-sonatype ... Move Druid release artifacts to Sonatype	2015-02-17 11:54:16 -08:00
extpvaan	b42b41cca7	Bind value of column "partitioned" as boolean, as it is defined in the "create table" ddl.	2015-02-17 10:22:10 -08:00
Fangjin Yang	2593864c52	Merge pull request #1126 from gianm/md-insert-or-update-tx ... Use jdbi inTransaction for SQLMetadataConnector's insertOrUpdate.	2015-02-16 08:23:05 -08:00
Gian Merlino	e00de8c19f	Use jdbi inTransaction for SQLMetadataConnector's insertOrUpdate. ... This fixes an issue where failed transactions were not properly rolled back.	2015-02-16 07:42:43 -08:00
Xavier Léauté	78df7f6165	Move Druid release artifacts to Sonatype ... - Switch to using Druid parent POM - Add required fields for Sonatype - Common plugin versions and settings have been moved to the parent pom - Cleanup artifacts and POMs for consistent formatting - Remove org.hyperic.sigar dependency and update docs to reflect necessary jars to add at runtime when sigar is needed	2015-02-13 14:26:31 -08:00
fjy	d29740ed9f	[maven-release-plugin] prepare for next development iteration	2015-02-12 16:16:00 -08:00
fjy	211fd15b7e	[maven-release-plugin] prepare release druid-0.7.0-rc3	2015-02-12 16:15:56 -08:00
Fangjin Yang	90bc62eb5c	Merge pull request #1108 from metamx/improve-groupby-perf ... Improve groupby by removing conversion to case insensitive row	2015-02-12 11:45:20 -08:00
Charles Allen	bd500fcf4b	Make the Announcer closing and unannouncing atomic.	2015-02-11 19:47:04 -08:00
Charles Allen	e116600c7f	Make Realtime queries not submit to thread pools for the master merger ... Fix https://github.com/druid-io/druid/issues/1111	2015-02-11 15:47:40 -08:00
nishantmonu51	15cf432b74	remove conversion to case insensitive row ... this is not required after death to casing in 0.7	2015-02-11 19:40:36 +05:30
Charles Allen	d51b37cfd5	Remove QueryResource's ObjectMapper::copy() in favor of using the injected ObjectMapper directly ... * Workaround for https://github.com/FasterXML/jackson-databind/issues/696	2015-02-10 16:50:23 -08:00
Xavier Léauté	31e248736d	Merge pull request #1106 from druid-io/update-http-client ... Update http client to 1.0.0	2015-02-10 13:37:27 -08:00
fjy	708759e1e0	Update http-client to 1.0.0	2015-02-10 13:36:47 -08:00
Fangjin Yang	1418cbb0e9	Merge pull request #1103 from metamx/fix-request-time ... fix change in request/time meaning introduced by d2c729a, fixes #1102	2015-02-09 17:23:05 -08:00
Xavier Léauté	2db3144f04	fix change in request/time meaning introduced by d2c729a, fixed #1102	2015-02-09 16:41:30 -08:00
Fangjin Yang	040e771da2	Merge pull request #1099 from metamx/console_cleanup ... console cleanup	2015-02-08 09:06:05 -08:00
Tarek Rached	f47f0d51c7	removed unecessary logging ... fixed simplifyInterval logic	2015-02-06 21:13:25 -08:00
Tarek Rached	a0fc20fc09	better regex for durations	2015-02-06 17:02:31 -08:00
Tarek Rached	dae91e5894	fixed links back to old console	2015-02-04 14:21:46 -08:00
fjy	1f12c5b2f1	[maven-release-plugin] prepare for next development iteration	2015-02-03 12:06:49 -08:00
fjy	e82d431be7	[maven-release-plugin] prepare release druid-0.7.0-rc2	2015-02-03 12:06:41 -08:00
Xavier Léauté	4eff269536	Merge pull request #1079 from druid-io/cleanup-deps ... Remove non friendly dependencies from Druid	2015-02-03 11:56:41 -08:00
Xavier Léauté	ffb180e29d	Merge pull request #1080 from metamx/fix-cost-balancer-strategy ... fix integer value overflow and add test	2015-02-03 11:45:03 -08:00
nishantmonu51	6da6b9eeda	fix integer value overflow and add test	2015-02-03 11:39:30 -08:00
fjy	3e5d338c8e	Remove non friendly dependencies from Druid	2015-02-03 11:36:08 -08:00
Eric Tschetter	42eba986ce	Towards consistent null handling ... This commit also includes 1) the addition of a context parameter on timeseries queries that allows it to ignore empty buckets instead of generating results for them 2) A cleanup of an unused method on an interface	2015-02-02 12:53:07 -08:00
Fangjin Yang	92e616de11	Merge pull request #1077 from metamx/remove-unused-imports ... remove unused imports	2015-02-02 10:45:27 -08:00
nishantmonu51	ba932bb1f2	remove unused imports	2015-02-02 21:53:39 +05:30
fjy	d05032b98a	towards a community led druid	2015-01-31 20:57:36 -08:00
Fangjin Yang	b94b24c46e	Merge pull request #1072 from metamx/common-aws-config ... Common AWS module + consistent credential chain for both S3 and auto-scaling	2015-01-30 14:41:24 -08:00
Fangjin Yang	14837d7808	Merge pull request #1075 from metamx/fix-test-timeout ... increase test timeouts on DruidClusterBridgeTest	2015-01-30 14:31:32 -08:00
Xavier Léauté	cd7e768640	increase test timeouts on DruidClusterBridgeTest	2015-01-30 13:18:35 -08:00
fjy	bc1405bee0	fix worker status path announcement with indexer zk config	2015-01-30 12:26:08 -08:00
Xavier Léauté	f00872c41b	move common AWS related classes into a separate module	2015-01-29 13:55:49 -08:00
Fangjin Yang	2d96b62e6c	Merge pull request #1066 from metamx/fix-background-caching-ordering ... fix background caching not preserving result order	2015-01-28 06:09:17 +08:00
Xavier Léauté	59c1907322	add test for out-of-order background-caching execution	2015-01-27 13:38:08 -08:00
fjy	cd9ba1f852	fix serde bug	2015-01-27 18:47:36 +08:00
Xavier Léauté	b334d7973d	fix background caching not preserving result order	2015-01-26 09:59:18 -08:00
Xavier Léauté	26c5c2193f	fix BatchServerInventoryViewTest test timeout	2015-01-20 17:14:57 -08:00
fjy	1f94de22c6	[maven-release-plugin] prepare for next development iteration	2015-01-20 14:23:55 -08:00
fjy	17476edc31	[maven-release-plugin] prepare release druid-0.7.0-rc1	2015-01-20 14:23:51 -08:00
Xavier Léauté	5a2030c49b	Merge pull request #1059 from druid-io/remove-test ... Remove test rejection policy - it has no place anywhere	2015-01-20 13:39:46 -08:00
fjy	1ff5829d6d	remove test rejection policy	2015-01-20 13:22:30 -08:00
Charles Allen	3d27747f7e	Upgrade to log4j2 ... Default behavior is as before. Added documentation for how to enable synchronous logging for select chatty classes: * io.druid.client.ServerInventoryView * io.druid.client.BatchServerInventoryView * io.druid.curator.inventory.CuratorInventoryManager * com.metamx.http.client.pool.ChannelResourceFactory	2015-01-20 12:35:18 -08:00
Fangjin Yang	91a79dbf95	Merge pull request #1031 from metamx/ingestmetadata-query ... DataSourceMetadata query	2015-01-19 21:55:35 -08:00
Fangjin Yang	56bad2114a	Merge pull request #1054 from metamx/increase-test-wait-time ... use waiting multiple when waiting in AnnouncerTest	2015-01-19 11:03:35 -08:00
Xavier Léauté	b5f0d119f1	use waiting multiple when waiting in AnnouncerTest	2015-01-19 10:19:13 -08:00
fjy	52f65b1273	Fix a small bug where an NPE can occur if a closeable is not present	2015-01-17 15:23:01 -08:00
fjy	38c155e143	Merge branch 'master' of https://github.com/druid-io/druid	2015-01-16 13:14:49 -08:00
Fangjin Yang	b4041c13e5	Merge pull request #1029 from metamx/fixChainedExecutionQueryRunnerTest ... Address spurious test failures	2015-01-16 13:08:32 -08:00
Xavier Léauté	6bc6e71b0d	Add messages to catch spurious test failures	2015-01-15 16:49:43 -08:00
fjy	f7ea308b25	fix minor error output problem	2015-01-15 15:57:45 -08:00
Fangjin Yang	5bfcc43377	Merge pull request #1008 from metamx/stringConversionJavaUtilUpdate ... Update all String conversions to and from byte[] to use the java-util StringUtils functions	2015-01-15 13:50:27 -08:00
nishantmonu51	c7452b75f6	Merge branch 'master' into ingestmetadata-query	2015-01-15 18:00:31 +05:30
fjy	021a7de759	Add retry capabilities for realtime logic	2015-01-13 14:30:49 -08:00
fjy	84cc32ba32	Add more logging for when ingestion may be throttled	2015-01-08 14:51:46 -08:00
Charles Allen	c1295202ff	Allow background caching run after the futures are finished	2015-01-07 13:23:34 -08:00
Charles Allen	f6fbb733b8	Added a few places where tests were using Object instead of Module	2015-01-05 13:47:25 -08:00
Fangjin Yang	852e863425	Merge pull request #981 from druid-io/strictModuleTyping ... Use Module instead of generic Object in Guice related items	2015-01-05 12:43:20 -08:00
Fangjin Yang	ab0ddc0d7c	Merge pull request #998 from drcrallen/zkConfigJackson ... Change zk configs to use Jackson injection instead of Skife	2015-01-05 12:42:40 -08:00
Charles Allen	b1b5c9099e	Update all String conversions to and from byte[] to use the java-util StringUtils functions ... * Speedup of GroupBy with javaScript filters by ~10% * Requires https://github.com/metamx/java-util/pull/15	2015-01-05 11:22:32 -08:00
Charles Allen	81fdc791e0	Add memory hinting and concurrency helpers in CachingClusteredClient	2015-01-02 15:54:26 -08:00
Charles Allen	65286a24e0	Change zk configs to use Jackson injection instead of Skife ... * Also added generic config testing class JsonConfigTesterBase	2014-12-29 10:36:12 -08:00
Xavier Léauté	574ab3017c	fix test timeout	2014-12-23 16:25:38 -08:00
Fangjin Yang	bf4b52384c	Merge pull request #988 from drcrallen/queryErrorFixer ... Fix NPE in QueryResource on bad query	2014-12-22 23:16:59 -08:00
Charles Allen	458236c8fd	Add simple unit tests for QueryResource	2014-12-22 21:53:58 -08:00
Charles Allen	4338af0e3f	Fix NPE in QueryResource on bad query	2014-12-22 12:59:47 -08:00
Gian Merlino	badc09e85c	Disable checkGzExists in the default GzipFilter. ... It is unhelpful because we don't actually have any precomputed .gz resources, and checking for them inside jars is expensive.	2014-12-22 12:45:48 -05:00
Charles Allen	7c8d4a7433	Use Module instead of generic Object in Guice related items	2014-12-19 10:54:06 -08:00
Charles Allen	a0b2a63d7f	Fix deadlock in DirectDruidClient	2014-12-16 18:34:30 -08:00
fjy	e9238161cd	fix broken test	2014-12-15 18:12:44 -08:00
Charles Allen	242edd14e5	Add deprecated smile media type for backwards compatability during upgrades	2014-12-15 18:00:10 -08:00
Charles Allen	a520835972	Merge pull request #957 from metamx/fix-gzip-encoding ... fix gzip compression	2014-12-15 13:20:36 -08:00
Xavier Léauté	e166260f80	more inventory logs	2014-12-15 13:19:47 -08:00
fjy	9c6e32fc3f	address cr	2014-12-15 13:06:36 -08:00
fjy	61101bee6c	more logs for CIM	2014-12-15 12:57:40 -08:00
Fangjin Yang	b3fe91bb50	Merge pull request #830 from metamx/union-merge-on-historical ... Union merge on historical	2014-12-15 13:36:47 -07:00
Fangjin Yang	31cda0b830	Merge pull request #958 from metamx/fix-router-service-discovery ... fix router discovering brokers with default names	2014-12-15 13:35:39 -07:00
Xavier Léauté	77bf5da317	fix typo	2014-12-15 10:07:51 -08:00
Charles Allen	3c33118f3a	Merge pull request #962 from metamx/add-broker-loadstatus ... add loadstatus endpoint for serverView status	2014-12-12 17:13:48 -08:00
Charles Allen	ca8300a461	Replace AppendableByteArrayInputStream in DirectDruidClient ... * Replace with SequenceInputStream fueled by an enumeration of ChannelBufferInputStream which directly wrap the response context ChannelBuffer * Added zero-length byte array when DirectDruidClient is done. This prevents an odd race condition on `done`.	2014-12-12 14:01:13 -08:00
Xavier Léauté	4b5282d224	add loadstatus endpoint for serverView status	2014-12-12 13:18:31 -08:00
Xavier Léauté	352480ac77	make method protected to prevent accidental usage ... - add documentation as to why	2014-12-11 15:20:36 -08:00
Xavier Léauté	3abf348d2c	fix router discovering brokers with default names	2014-12-11 12:16:44 -08:00
nishantmonu51	7ad03087c0	Merge branch 'master' into ingestmetadata-query	2014-12-11 16:54:38 +05:30
nishantmonu51	32b4f55b8a	review comments refactoring	2014-12-11 16:33:14 +05:30
Xavier Léauté	eb661d3130	/status replaces /health	2014-12-10 17:35:05 -08:00
Xavier Léauté	0de56efe5c	fix gzip compression ... - fixes compression not working for POST requests - router now forwards raw bytes instead of decompressing - cleanded up router servlet initialization - add test for gzip on get and post methods - use Jersey annotation when possible in QueryResource	2014-12-10 17:30:17 -08:00
Xavier Léauté	7878d391bd	use first available port for JettyTest	2014-12-10 12:53:11 -08:00
Charles Allen	6f6cc463b0	Merge pull request #950 from metamx/fix-bysegment-serde ... Fix bySegment metrics de-serialization	2014-12-10 12:42:40 -08:00
Xavier Léauté	5f3f4e0a60	prevent /status from redirect, fixes #953	2014-12-10 11:32:22 -08:00
Xavier Léauté	7853e801d5	fixes for bySegment queries and caching ... - prevent bySegment queries from getting cached - avoid computing cache keys if not populating or using cache - avoid computing cache data when not populating cache	2014-12-10 10:57:48 -08:00
nishantmonu51	3763357f6e	Ingest metadata query implementation	2014-12-10 19:44:00 +05:30
Xavier Léauté	c44242f0af	add comment about de-serialing bySegment	2014-12-09 17:02:24 -08:00
Xavier Léauté	a7da9aed9f	fix metrics de-serialization for bySegment results	2014-12-09 17:02:23 -08:00
fjy	7620dfbd1a	fix broken ut	2014-12-09 15:43:07 -08:00
Fangjin Yang	d6d3ec6846	Merge pull request #948 from metamx/ingestion-docs ... Redocumenting ingestion	2014-12-09 15:30:03 -07:00
nishantmonu51	1a1b0e6f23	merge from master and review comments	2014-12-09 13:16:45 +05:30