Commit Graph

1832 Commits

Author SHA1 Message Date
fjy 904c9049a7 [maven-release-plugin] prepare release druid-0.6.114 2014-05-20 13:22:48 -07:00
fjy f0c40709cd fix coordinator dynamic configs 2014-05-20 13:20:43 -07:00
fjy 783f8fcc99 [maven-release-plugin] prepare for next development iteration 2014-05-20 12:47:33 -07:00
fjy def12c03bd [maven-release-plugin] prepare release druid-0.6.113 2014-05-20 12:47:29 -07:00
fjy 37dca4d437 make sure the dynamic config has at least 1 thread 2014-05-20 12:45:35 -07:00
fjy e5454b47f1 [maven-release-plugin] prepare for next development iteration 2014-05-20 10:49:00 -07:00
fjy bcffb92181 [maven-release-plugin] prepare release druid-0.6.112 2014-05-20 10:48:53 -07:00
fjy dd59b58208 [maven-release-plugin] prepare for next development iteration 2014-05-19 21:17:09 -07:00
fjy 511aca9ea8 [maven-release-plugin] prepare release druid-0.6.111 2014-05-19 21:17:04 -07:00
Xavier Léauté 2786c68411 fix file casing 2014-05-19 20:22:13 -07:00
fjy d0f87b0cf6 fix broken move test 2014-05-19 18:29:09 -07:00
Gian Merlino a7760af65a Merge pull request #553 from metamx/snapshot-coordinator
Snapshot coordinator state before running anything
2014-05-19 18:24:19 -07:00
fjy 1addea4dbe more code review comments 2014-05-19 17:52:34 -07:00
Xavier Léauté 5a065a8785 fix BatchServerInventoryViewTest waitForSync() logic 2014-05-19 17:43:00 -07:00
fjy 1b6e816c28 Merge pull request #544 from metamx/java-8-fix-tests
Make tests pass with Java 8
2014-05-19 18:11:52 -06:00
fjy 6126dd4231 fix more code review comments 2014-05-19 17:04:26 -07:00
Xavier Léauté 9ec7c71e0f fix compilation error with updated druid-api 2014-05-19 14:06:23 -07:00
fjy 7879f38ccc fix according to code review 2014-05-19 13:35:23 -07:00
fjy 5ee3f5c9d3 snapshot coordinator state before running 2014-05-18 22:32:20 -07:00
Xavier Léauté 20c4fbc98d [maven-release-plugin] prepare for next development iteration 2014-05-16 16:34:19 -07:00
Xavier Léauté 4abcf3e16a [maven-release-plugin] prepare release druid-0.6.110 2014-05-16 16:34:12 -07:00
fjy 68618ffc75 fix another code review comment 2014-05-16 15:38:46 -07:00
fjy 389319dd6e fix for code review comments 2014-05-16 15:32:58 -07:00
fjy 09ad32c5c5 fix race condition with merge and persist and sink adding
Conflicts:
	indexing-service/src/main/java/io/druid/indexing/common/task/IndexTask.java
	server/src/main/java/io/druid/segment/realtime/RealtimeManager.java
	server/src/main/java/io/druid/segment/realtime/plumber/RealtimePlumber.java
2014-05-16 15:21:09 -07:00
nishantmonu51 b4a791a035 add comment for ignoring test and add test for thread stucking 2014-05-16 19:48:12 +05:30
fjy da285d8665 [maven-release-plugin] prepare for next development iteration 2014-05-15 16:44:36 -07:00
fjy b7009c9102 [maven-release-plugin] prepare release druid-0.6.109 2014-05-15 16:44:32 -07:00
fjy 6db0cd623f ignore jetty exception test for now 2014-05-15 16:42:48 -07:00
fjy 43853a1d9e Merge pull request #545 from metamx/union-query-fix
Union query fix
2014-05-15 17:17:46 -06:00
fjy 01d0234b46 Merge branch 'master' of github.com:metamx/druid 2014-05-15 14:23:26 -07:00
fjy 6098cff37a clean up event receiver firehose factory 2014-05-15 14:23:13 -07:00
nishantmonu51 ddc36c89cc union query fix and a broken test 2014-05-15 23:10:40 +05:30
fjy 793bc3539b Merge pull request #538 from metamx/fix-jetty-exception-handling
fix jetty threads getting stuck
2014-05-15 10:55:46 -06:00
Xavier Léauté 088c60cf3d always use ByteCountingLRUMap.remove() to remove 2014-05-14 22:48:41 -07:00
fjy c57a18d6b6 Merge branch 'master' of github.com:metamx/druid 2014-05-12 11:38:55 -07:00
fjy 32eee959c3 fix backwards compat issue 2014-05-12 11:38:46 -07:00
nishantmonu51 26569f4b7f fix jetty threads getting stuck
Fix Jetty threads getting stuck on exceptions
2014-05-10 02:12:19 +05:30
nishantmonu51 17e994f2e4 review comment 2014-05-09 23:53:25 +05:30
nishantmonu51 6be6337ab0 remove initial delay from polling
remove initial delay from polling in coordinator, this will help in the
cases when the pollDuration is set to higher than coordinator
startDelay.
2014-05-09 23:33:00 +05:30
fjy 48ae84ed56 [maven-release-plugin] prepare for next development iteration 2014-05-07 12:40:14 -07:00
fjy 27f7c45e91 [maven-release-plugin] prepare release druid-0.6.108 2014-05-07 12:40:10 -07:00
fjy 42994cebcd [maven-release-plugin] prepare for next development iteration 2014-05-07 11:25:50 -07:00
fjy 2bf5c3831d [maven-release-plugin] prepare release druid-0.6.107 2014-05-07 11:25:45 -07:00
fjy e7da1bb9ce fix injection problems with server select strategies 2014-05-07 10:13:05 -07:00
fjy 1100d2f2a1 rename configs to make a bit more sense 2014-05-06 14:52:50 -07:00
fjy b6fb4245aa Merge branch 'master' into new-schema
Conflicts:
	indexing-hadoop/src/main/java/io/druid/indexer/HadoopDriverConfig.java
	indexing-hadoop/src/main/java/io/druid/indexer/HadoopDruidIndexerConfig.java
	indexing-hadoop/src/main/java/io/druid/indexer/HadoopDruidIndexerConfigBuilder.java
	pom.xml
	server/src/main/java/io/druid/segment/realtime/RealtimeManager.java
	server/src/main/java/io/druid/segment/realtime/firehose/EventReceiverFirehoseFactory.java
2014-05-06 14:32:51 -07:00
fjy ad54f150ec fix broken UT with bad api version 2014-05-06 13:51:22 -07:00
fjy 0ee2323875 Merge pull request #399 from metamx/multithread-costbalancer
Multithread costbalancer
2014-05-06 14:18:07 -06:00
fjy 79e6d4eb56 Merge pull request #528 from metamx/union-query-source
Union query source
2014-05-06 14:13:33 -06:00
nishantmonu51 66450ca6ed review comments
remove toShortString
minor other changes
2014-05-07 00:54:17 +05:30
Gian Merlino 6f3f5c6e99 [maven-release-plugin] prepare for next development iteration 2014-05-06 11:28:39 -07:00
Gian Merlino a5a875e1ed [maven-release-plugin] prepare release druid-0.6.106 2014-05-06 11:28:34 -07:00
fjy 544c0f08f6 Merge pull request #459 from metamx/move-firehose
Move the event receiver firehose such that standalone realtime nodes can use it
2014-05-05 17:09:43 -06:00
fjy 42c2fcb6b4 Merge pull request #518 from metamx/server-select
Smarter server selection at the broker level
2014-05-05 17:09:15 -06:00
fjy 9615c5e428 Merge pull request #519 from metamx/more-endpoints
Add more endpoints, fixes #517
2014-05-05 17:09:02 -06:00
nishantmonu51 f2725994b7 refactor method 2014-05-05 19:57:32 +05:30
Himadri Singh 0b9191b876 limit on balancer compute threads
max being no. of processors - 1
2014-05-05 17:26:44 +05:30
Himadri Singh cae4363f66 small perf test 2014-05-05 17:13:12 +05:30
nishantmonu51 477e01daf7 review comments 2014-05-02 15:21:06 +05:30
fjy e0bce3168c [maven-release-plugin] prepare for next development iteration 2014-05-01 15:09:01 -07:00
fjy dd0004b759 [maven-release-plugin] prepare release druid-0.6.105 2014-05-01 15:08:57 -07:00
nishantmonu51 728a606d32 Add support for union queries 2014-05-01 01:54:52 +05:30
fjy 015000ee8f [maven-release-plugin] prepare for next development iteration 2014-04-30 13:16:24 -07:00
fjy eae7d55dce [maven-release-plugin] prepare release druid-0.6.104 2014-04-30 13:16:20 -07:00
fjy 46eedd7a95 Merge pull request #526 from metamx/fix-race-ingestion
Fix FileNotFound in realtime nodes
2014-04-30 14:10:41 -06:00
nishantmonu51 faa74ce2cb hasSwapped properly check
protect check for hasSwapped.
2014-05-01 01:38:03 +05:30
nishantmonu51 ff56573910 Fix race
Fix race in ingestion that can cause FNF,
Properly check for partitionNum
shutdown persistExecutor
2014-05-01 01:34:58 +05:30
fjy 7700001e27 [maven-release-plugin] prepare for next development iteration 2014-04-30 10:45:20 -07:00
fjy 1e639792bf [maven-release-plugin] prepare release druid-0.6.103 2014-04-30 10:45:14 -07:00
fjy 3fd651c235 fix the rule again, update docs, and prepare for next release 2014-04-30 10:43:30 -07:00
fjy 9ad0da0794 [maven-release-plugin] prepare for next development iteration 2014-04-30 10:26:38 -07:00
fjy 5b7b29b61b [maven-release-plugin] prepare release druid-0.6.102 2014-04-30 10:26:34 -07:00
fjy 159c3361b8 Merge pull request #524 from metamx/fix-router2
Small fixes to router
2014-04-30 11:21:45 -06:00
fjy 68242950f7 make coordinator routing smarter and period load rule explicit 2014-04-30 10:17:40 -07:00
fjy 9bc6436176 Add more endpoints, fixes #517 2014-04-28 15:55:03 -07:00
fjy e90eb4b83a add custom tier selector 2014-04-28 15:31:15 -07:00
fjy 3c3daf452e Smarter server selection at the router level 2014-04-28 13:58:10 -07:00
Himadri Singh ca1e951e17 druid header 2014-04-28 18:00:51 +05:30
fjy e30accbbf5 reducing bloat 2014-04-25 15:25:54 -07:00
fjy a33c2f7880 clean up firehose module and introduce parsers module 2014-04-25 14:20:02 -07:00
fjy 171d20d52d Merge branch 'move-firehose' of github.com:metamx/druid into move-firehose 2014-04-25 14:13:19 -07:00
fjy eef034ca7e Merge branch 'master' of github.com:metamx/druid into move-firehose 2014-04-25 14:13:08 -07:00
fjy 76e0a48527 Merge branch 'master' into new-schema
Conflicts:
	indexing-hadoop/src/main/java/io/druid/indexer/DbUpdaterJob.java
	indexing-hadoop/src/test/java/io/druid/indexer/HadoopDruidIndexerConfigTest.java
	indexing-service/src/main/java/io/druid/indexing/common/task/HadoopIndexTask.java
	server/src/main/java/io/druid/segment/realtime/plumber/RealtimePlumber.java
	server/src/main/java/io/druid/segment/realtime/plumber/RealtimePlumberSchool.java
2014-04-25 14:03:28 -07:00
Xavier Léauté f88cb13ccb [maven-release-plugin] prepare for next development iteration 2014-04-24 17:27:58 -07:00
Xavier Léauté b8c14ba061 [maven-release-plugin] prepare release druid-0.6.101 2014-04-24 17:27:46 -07:00
Xavier Léauté 5d105e7598 fix stupid cache config bug 2014-04-24 17:13:04 -07:00
fjy 5e98275251 [maven-release-plugin] prepare for next development iteration 2014-04-24 11:47:52 -07:00
fjy 35dc96e946 [maven-release-plugin] prepare release druid-0.6.100 2014-04-24 11:47:47 -07:00
fjy 7f0319a8ae fix NPE 2014-04-23 16:51:12 -07:00
fjy bec171fea9 [maven-release-plugin] prepare for next development iteration 2014-04-22 17:10:33 -07:00
fjy 67972ca5c5 [maven-release-plugin] prepare release druid-0.6.99 2014-04-22 17:10:27 -07:00
fjy 2d1f33e59f Merge pull request #500 from metamx/batch-ingestion-fixes
Batch ingestion fixes
2014-04-22 17:59:24 -06:00
nishantmonu51 0d8c1ffe54 review comments and add partitioner 2014-04-23 03:30:30 +05:30
fjy 22fba22522 remove whitespace 2014-04-22 13:07:12 -07:00
fjy d1b035a8b9 use emitting logger for query resource 2014-04-22 12:59:24 -07:00
xvrl d17abedae3 Merge pull request #499 from metamx/fix-pull-from-cache
Fix pull from cache
2014-04-22 11:19:57 -07:00
nishantmonu51 9d762b87ce Add diff values, to test another path in merging 2014-04-22 23:25:17 +05:30
fjy cde93d810c fix server metrics to avoid NaN and Infinity 2014-04-22 10:26:46 -07:00
nishantmonu51 65c71a40bb fix more issues and add test
1) Add test for caching and calculation of dependent post-aggs for
TimeSeries and TopN
2) Fix more NPEs while calculating dependent postAggs, passing
baseHolder was wrong as it does not contain post-aggs during computing
dependent ones.
2014-04-22 22:05:17 +05:30
fjy bed8860fd4 [maven-release-plugin] prepare for next development iteration 2014-04-21 22:34:43 -07:00
fjy 594bb65ba6 [maven-release-plugin] prepare release druid-0.6.98 2014-04-21 22:34:38 -07:00
fjy 357cd66f66 [maven-release-plugin] prepare for next development iteration 2014-04-21 22:26:28 -07:00
fjy 93ed56f680 [maven-release-plugin] prepare release druid-0.6.97 2014-04-21 22:26:23 -07:00
fjy 310073685d [maven-release-plugin] prepare for next development iteration 2014-04-21 12:16:39 -07:00
fjy 1778d9adf4 [maven-release-plugin] prepare release druid-0.6.96 2014-04-21 12:16:35 -07:00
fjy 65db875d68 [maven-release-plugin] prepare for next development iteration 2014-04-18 17:44:36 -07:00
fjy 2d3eebe995 [maven-release-plugin] prepare release druid-0.6.95 2014-04-18 17:44:32 -07:00
fjy e3fbbff237 clean up code 2014-04-18 17:41:47 -07:00
nishantmonu51 68e8cda2da fix post aggregator 2014-04-19 04:24:07 +05:30
Gian Merlino 265ac37cdc [maven-release-plugin] prepare for next development iteration 2014-04-18 11:53:43 -07:00
Gian Merlino 5162864731 [maven-release-plugin] prepare release druid-0.6.94 2014-04-18 11:53:38 -07:00
fjy a520a2dde0 handle null request uris 2014-04-17 18:13:03 -07:00
fjy 1fcb3e01c3 [maven-release-plugin] prepare for next development iteration 2014-04-17 15:30:30 -07:00
fjy e9b77c4434 [maven-release-plugin] prepare release druid-0.6.93 2014-04-17 15:30:26 -07:00
Xavier Léauté 6a52112034 let broker populate cache lazily 2014-04-17 14:40:05 -07:00
Xavier Léauté 943b6ed12c add comments 2014-04-17 09:48:08 -07:00
nishantmonu51 5f61d0396c Ignore test 2014-04-17 22:09:48 +05:30
nishantmonu51 7765c96a39 Add test to test Jetty request timeouts 2014-04-17 20:36:28 +05:30
fjy 66a8ff9390 [maven-release-plugin] prepare for next development iteration 2014-04-16 11:40:35 -07:00
fjy 6621c4f321 [maven-release-plugin] prepare release druid-0.6.92 2014-04-16 11:40:30 -07:00
fjy b26a40aeaf [maven-release-plugin] prepare for next development iteration 2014-04-16 11:26:34 -07:00
fjy 8ee8927267 [maven-release-plugin] prepare release druid-0.6.91 2014-04-16 11:26:28 -07:00
fjy c6274762b7 throw ISE when no servers found at all 2014-04-16 10:27:34 -07:00
fjy 6306e87a96 avoid copying bytes 2014-04-16 10:14:15 -07:00
fjy 51e2da9d8d use a separate annotation for the router, less confusing 2014-04-16 10:08:58 -07:00
fjy 24a0268036 cleanup code in router and add forwarding for get requests 2014-04-16 09:36:18 -07:00
fjy 6893282a65 [maven-release-plugin] prepare for next development iteration 2014-04-15 14:26:57 -07:00
fjy 7e9166d20c [maven-release-plugin] prepare release druid-0.6.90 2014-04-15 14:26:53 -07:00
fjy 508cf6a4f7 Merge branch 'master' of github.com:metamx/druid 2014-04-15 14:23:58 -07:00
fjy 9b06b6aa58 misc fixes for router 2014-04-15 14:23:54 -07:00
fjy 228be3acb0 Merge pull request #467 from metamx/optimize-postAgg-calculation
Optimize post agg calculation
2014-04-15 15:18:01 -06:00
nishantmonu51 cd1c1d2615 fix casing issue when parsing event 2014-04-15 23:32:54 +05:30
fjy 6f1f21cfd6 Merge pull request #476 from metamx/non-blocking-persist-n-merge
Non blocking persist n merge
2014-04-15 10:58:47 -06:00
fjy f6de38a87c Merge pull request #480 from metamx/compute-cache-monitor
enable cache monitor on computes by default
2014-04-15 10:51:54 -06:00
nishantmonu51 3172383e56 modify comment 2014-04-15 12:55:40 +05:30
Xavier Léauté 16bffe0588 default cache size to zero 2014-04-14 16:23:54 -07:00
fjy a46c4592b4 a few cleanups 2014-04-14 09:53:29 -07:00
nishantmonu51 595ad7d21d rename thread 2014-04-11 12:34:17 +05:30
nishantmonu51 db60353cac persist-n-merge in separate pool
persist-n-merge in separate pool, do not block intermediate persists
2014-04-11 12:18:11 +05:30
fjy db5f04c84d [maven-release-plugin] prepare for next development iteration 2014-04-10 15:39:41 -07:00
fjy 87ef64f577 [maven-release-plugin] prepare release druid-0.6.89 2014-04-10 15:39:36 -07:00
fjy b273f1b101 [maven-release-plugin] prepare for next development iteration 2014-04-10 12:56:20 -07:00
fjy 9019990d94 [maven-release-plugin] prepare release druid-0.6.88 2014-04-10 12:56:16 -07:00
fjy 0904436d2f actually emit query stats 2014-04-10 12:54:27 -07:00
fjy 57bf8faa82 [maven-release-plugin] prepare for next development iteration 2014-04-10 11:33:06 -07:00
fjy 20c7b73269 [maven-release-plugin] prepare release druid-0.6.87 2014-04-10 11:33:02 -07:00
fjy 6742223c26 fix another missing log 2014-04-10 11:26:53 -07:00
fjy 8e143adadf address code review comments 2014-04-10 11:13:11 -07:00
fjy 88c592ccaa add more meaningful request logging 2014-04-10 10:37:25 -07:00
Xavier Léauté 69a8723f18 fix npe in CachingQueryRunner 2014-04-09 17:04:42 -07:00
xvrl c05f169171 Merge pull request #458 from metamx/stream-cache
use and populate cache at compute node level
2014-04-09 10:42:26 -07:00
fjy e867c93422 turn down too much logging; gp 2014-04-09 09:55:12 -07:00
nishantmonu51 ea8b2dffd5 Add chatHandlerResource 2014-04-09 14:25:18 +05:30
Xavier Léauté 19d6aec396 address code review comments 2014-04-08 17:21:01 -07:00
Xavier Léauté 60b95dabad CachePopulatingQueryRunner -> CachingQueryRunner
Populate and use cache at compute node level
2014-04-08 17:14:17 -07:00
Xavier Léauté 3e6ffbd5ac populate cache on sequence close 2014-04-08 17:14:17 -07:00
fjy 6209803d50 [maven-release-plugin] prepare for next development iteration 2014-04-08 16:27:44 -07:00
fjy ac9d20af47 [maven-release-plugin] prepare release druid-0.6.86 2014-04-08 16:27:40 -07:00
fjy dd8e9e2930 fix concurrent modification exceptions in local cache 2014-04-08 16:23:24 -07:00
fjy 29c3db92b5 [maven-release-plugin] prepare for next development iteration 2014-04-08 11:44:45 -07:00
fjy d16ff98ef3 [maven-release-plugin] prepare release druid-0.6.85 2014-04-08 11:44:40 -07:00
nishantmonu51 2c8682a1b6 avoid using Math.abs
review comment on - c6f5311
To avoid overflow issues and unnecessary calls to Math.abs.
2014-04-08 21:58:54 +05:30
nishantmonu51 f726e52e3b fix test 2014-04-08 20:09:44 +05:30
nishantmonu51 12991a959a actually fix it 2014-04-08 20:08:21 +05:30
nishantmonu51 c6f531168f fix hash based partition - boundary case Integer.MIN 2014-04-08 20:07:22 +05:30
nishantmonu51 22c3296aa3 Merge branch 'master' into optimize-postAgg-calculation
Conflicts:
	server/src/test/java/io/druid/client/CachingClusteredClientTest.java
2014-04-08 03:35:56 +05:30
nishantmonu51 c322f44863 time series post Aggregation improved
move post aggregation to finalise results
2014-04-08 03:17:15 +05:30
fjy 8e3bcc8fc3 [maven-release-plugin] prepare for next development iteration 2014-04-07 14:38:55 -07:00
fjy e1e81cfeac [maven-release-plugin] prepare release druid-0.6.84 2014-04-07 14:38:51 -07:00
nishantmonu51 4bb36dd453 fix tests 2014-04-08 02:37:57 +05:30
fjy bfb66691b9 [maven-release-plugin] prepare for next development iteration 2014-04-07 12:45:28 -07:00
fjy f612b7cc64 [maven-release-plugin] prepare release druid-0.6.83 2014-04-07 12:45:20 -07:00
fjy f5dc75ef82 Merge pull request #464 from metamx/fix-context
Fix context to be backwards compatible with String values
2014-04-07 11:54:17 -06:00
fjy dda09633be make query id a bit more readable 2014-04-07 10:53:43 -07:00
fjy 40c14c9a3c fix case with no request params 2014-04-06 12:43:40 -07:00
fjy f0e9d6fd83 fix query forwarding 2014-04-06 12:41:39 -07:00
fjy 4d6174ebf2 be able to set maxPendingPersists in plumber 2014-04-06 09:47:37 -07:00
fjy 1267fbb7f5 fix context to be backwards compat 2014-04-06 09:20:58 -07:00
fjy 1843316db6 commonalize event receiver firehose 2014-04-03 20:46:36 -07:00
fjy 8138d96f9d [maven-release-plugin] prepare for next development iteration 2014-04-03 17:21:14 -07:00
fjy 4619e498c3 [maven-release-plugin] prepare release druid-0.6.82 2014-04-03 17:21:10 -07:00
fjy d9062d91fa fix endpoint bugs and more docs 2014-04-03 17:01:33 -07:00
fjy edba3ba40e [maven-release-plugin] prepare for next development iteration 2014-04-02 22:24:36 -07:00
fjy 0f0e525a75 [maven-release-plugin] prepare release druid-0.6.81 2014-04-02 22:24:32 -07:00
fjy b0bf08554a fix broken build 2014-04-02 22:22:42 -07:00
nishantmonu51 d6eebce998 Revert "Merge pull request #457 from metamx/stream-cache"
This reverts commit 5fae4d9abc, reversing
changes made to 43a0554179.
2014-04-03 10:38:43 +05:30
fjy 133c624f69 [maven-release-plugin] prepare for next development iteration 2014-04-02 21:33:10 -07:00
fjy 4e2ac3234c [maven-release-plugin] prepare release druid-0.6.79 2014-04-02 21:33:05 -07:00
fjy ea9f31bbe0 learn to math and prepare for next release 2014-04-02 21:31:17 -07:00
fjy 6bab22ef71 [maven-release-plugin] prepare for next development iteration 2014-04-02 21:08:18 -07:00
fjy 93e19b62e6 [maven-release-plugin] prepare release druid-0.6.78 2014-04-02 21:08:14 -07:00
fjy f185d215e1 fix jetty default thread pool size for jetty 9 and prepare for next release 2014-04-02 21:01:07 -07:00
fjy 6cd5a76983 [maven-release-plugin] prepare for next development iteration 2014-04-02 17:33:26 -07:00
fjy d1e7b98177 [maven-release-plugin] prepare release druid-0.6.77 2014-04-02 17:33:19 -07:00
fjy 7547e989f0 Merge pull request #456 from metamx/processing-threads-default
more sensible defaults
2014-04-02 18:25:43 -06:00
fjy 5fae4d9abc Merge pull request #457 from metamx/stream-cache
Populate cache without materializing results first
2014-04-02 18:07:36 -06:00
fjy 43a0554179 Merge pull request #455 from metamx/async
Asynchronous servlet for query forwarding
2014-04-02 18:05:49 -06:00
Xavier Léauté 458a873505 make test reflect the fact that resulting sequence is not consumed yet 2014-04-02 15:37:54 -07:00
Xavier Léauté ee34415470 populate cache without materializing results 2014-04-02 15:32:14 -07:00
Xavier Léauté f3cc316e66 create utiliy class for getMaxDirectMemory 2014-04-02 15:27:34 -07:00
fjy 85ffce25a6 fix code review comments 2014-04-02 14:56:00 -07:00
Xavier Léauté ee97fb98bc more sensible defaults for single core machines 2014-04-02 14:24:08 -07:00
fjy eaec0e3ab2 cleanup 2014-04-01 17:56:25 -07:00
fjy 6952eb7878 asynch servlet for query forwarding 2014-04-01 17:51:28 -07:00
Xavier Léauté 74c5d9889b [maven-release-plugin] prepare for next development iteration 2014-03-31 16:07:31 -07:00
Xavier Léauté 0845cc4078 [maven-release-plugin] prepare release druid-0.6.76 2014-03-31 16:07:25 -07:00
fjy 50b6888210 Merge pull request #450 from metamx/fix-cache-population
Fix cache population
2014-03-31 12:26:37 -06:00
nishantmonu51 05f3f7d49e review comments - remove instance of check 2014-03-29 03:06:53 +05:30
fjy c5fbb67d94 more endpoint cleanup 2014-03-28 14:31:30 -07:00
fjy 676671e575 new endpoints 2014-03-28 13:55:44 -07:00
nishantmonu51 af470223f1 add test 2014-03-28 22:39:29 +05:30
nishantmonu51 ccf72bfdf8 Fix cache population simple way 2014-03-28 14:14:46 +05:30
fjy 652506d1bd [maven-release-plugin] prepare for next development iteration 2014-03-27 18:03:55 -07:00
fjy 7fa62cd9c7 [maven-release-plugin] prepare release druid-0.6.75 2014-03-27 18:03:51 -07:00
fjy 21e54d8060 rename var to be less confusing 2014-03-27 15:48:37 -07:00
fjy bc4bc277f2 Merge pull request #447 from metamx/fix-configmanager
Move db specific things from ConfigManager into DbConnector
2014-03-27 16:47:03 -06:00
fjy 366872ffe9 Merge pull request #446 from liquidm/add_druiddirectclient_logging
add url logging to DirectDruidClient for debugging purposes
2014-03-27 16:41:03 -06:00
Xavier Léauté 6e18ff7ed4 use prepared statement instead of string interpolation 2014-03-27 12:41:30 -07:00
Hagen Rother d6f4cf3733 add changes as suggested by cheddar 2014-03-27 19:46:53 +01:00
Hagen Rother 6fb3e61a98 add url logging to DirectDruidClient for debugging purposes 2014-03-27 19:38:53 +01:00
fjy 7e54c6a359 [maven-release-plugin] prepare for next development iteration 2014-03-25 13:43:25 -07:00
fjy 0baf95098d [maven-release-plugin] prepare release druid-0.6.74 2014-03-25 13:43:21 -07:00
nishantmonu51 3ba67946a3 review comments - remove unused import and extract out constants 2014-03-25 23:03:13 +05:30
nishantmonu51 fe7a184096 review comments 2014-03-25 17:02:36 +05:30
nishantmonu51 0ba72ffb2b merge from master 2014-03-25 15:43:05 +05:30
nishantmonu51 1c5d2b6dc5 review comments 2014-03-25 13:27:30 +05:30
nishantmonu51 6a34c09e05 Merge branch 'master' into compute-populate-cache 2014-03-25 13:23:00 +05:30
fjy 60c204afeb Merge pull request #433 from metamx/router-node
Client-side tier-aware query runner
2014-03-24 16:17:59 -06:00
fjy 75ec8bed9a address code review comments 2014-03-24 14:53:30 -07:00
fjy fcd7522596 Merge branch 'master' into router-node 2014-03-24 13:43:52 -07:00
fjy b0790783b7 Merge pull request #436 from metamx/better-context
Extend context to able to take more sophisticated objects than just strings
2014-03-24 14:40:45 -06:00
fjy de83677165 more logging at initialization 2014-03-24 13:40:04 -07:00
fjy e523bfc237 [maven-release-plugin] prepare for next development iteration 2014-03-21 11:07:40 -07:00
fjy 6fbc3b15a7 [maven-release-plugin] prepare release druid-0.6.73 2014-03-21 11:07:34 -07:00
fjy 7f8211ecc7 extend context to use map string object instead of map string string 2014-03-20 13:41:45 -07:00
nishantmonu51 69e9b7a6c5 merge changes from master 2014-03-20 20:23:58 +05:30
nishantmonu51 9079a17df0 Add headers 2014-03-20 19:44:36 +05:30
fjy a96dfc7742 clean up failure scenarios 2014-03-19 10:30:52 -07:00
fjy 76ef9d192c add tests 2014-03-18 13:47:53 -07:00
fjy ab2524ba0a add router node 2014-03-18 13:44:29 -07:00
fjy 03851101f0 [maven-release-plugin] prepare for next development iteration 2014-03-18 08:12:51 -07:00
fjy 508d892ba1 [maven-release-plugin] prepare release druid-0.6.72 2014-03-18 08:12:44 -07:00
nishantmonu51 32ad26210d Fix backwards compatibilty constant post aggregator 2014-03-18 20:34:49 +05:30
fjy 294f15d624 [maven-release-plugin] prepare for next development iteration 2014-03-17 21:44:17 -07:00
fjy 199efa049a [maven-release-plugin] prepare release druid-0.6.71 2014-03-17 21:44:11 -07:00
fjy 1d1ec1d855 clean up some defaults and prepare for next release 2014-03-17 21:41:34 -07:00
Xavier Léauté b9fe12977e [maven-release-plugin] prepare for next development iteration 2014-03-17 13:57:10 -07:00
Xavier Léauté 0276223db1 [maven-release-plugin] prepare release druid-0.6.70 2014-03-17 13:57:06 -07:00
fjy 2adcf07f5f Merge branch 'master' into new-schema
Conflicts:
	indexing-hadoop/src/main/java/io/druid/indexer/DetermineHashedPartitionsJob.java
	indexing-service/src/main/java/io/druid/indexing/common/task/RealtimeIndexTask.java
	indexing-service/src/test/java/io/druid/indexing/common/task/TaskSerdeTest.java
	processing/src/test/java/io/druid/segment/TestIndex.java
	server/src/main/java/io/druid/segment/realtime/RealtimeManager.java
	server/src/main/java/io/druid/segment/realtime/plumber/RealtimePlumberSchool.java
2014-03-17 10:59:31 -07:00
nishantmonu51 468e8e0b31 Memcache changes 2014-03-17 18:54:30 +05:30
fjy 8e5cbca2ee [maven-release-plugin] prepare for next development iteration 2014-03-14 15:16:55 -07:00
fjy 852d167eaf [maven-release-plugin] prepare release druid-0.6.69 2014-03-14 15:16:50 -07:00
fjy f1da044cfa fix another breaking endpoint in druid coordinator 2014-03-14 15:15:08 -07:00
fjy 7a2d0850e3 [maven-release-plugin] prepare for next development iteration 2014-03-14 15:06:54 -07:00
fjy 2646b5421b [maven-release-plugin] prepare release druid-0.6.68 2014-03-14 15:06:50 -07:00
fjy f525361c3d fix broken tests and prepare for next release 2014-03-14 15:05:07 -07:00
fjy 454a240525 [maven-release-plugin] prepare for next development iteration 2014-03-14 10:59:27 -07:00
fjy 6e9bc9acab [maven-release-plugin] prepare release druid-0.6.66 2014-03-14 10:59:23 -07:00
fjy b4f1591260 clean up examples, finish paper 2014-03-13 18:52:08 -07:00
fjy a6fc82e267 Merge pull request #428 from metamx/fix-bytesboundedLinkedQueue
fix concurrency issues in bytesboundedlinkedqueue
2014-03-12 13:30:53 -06:00
nishantmonu51 f10ac73eef fix concurrency issues 2014-03-12 20:54:05 +05:30
Xavier Léauté b15b544429 make defaults more explicit 2014-03-11 12:39:08 -07:00
Xavier Léauté 44f9b9cec9 add readBufferSize option to memcached client config 2014-03-11 10:37:23 -07:00
Xavier Léauté 8baac724c3 add comments 2014-03-11 09:59:05 -07:00
Xavier Léauté b5d9876b77 allow disabling of memcached op-queue limit, default to disabled 2014-03-11 09:56:45 -07:00
fjy 34957ee471 [maven-release-plugin] prepare for next development iteration 2014-03-10 15:05:48 -07:00
fjy 35297572ed [maven-release-plugin] prepare release druid-0.6.65 2014-03-10 15:05:43 -07:00
fjy 369156fe80 [maven-release-plugin] prepare for next development iteration 2014-03-10 13:26:38 -07:00
fjy ba3806fcc2 [maven-release-plugin] prepare release druid-0.6.64 2014-03-10 13:26:34 -07:00
fjy 3ef75031c3 Merge pull request #423 from tucksaun/fix-kill-task-local-storage
Adds LocalDataSegmentKiller to allow KillTask for local storage
2014-03-07 13:45:39 -07:00
fjy 228cfa95bd Merge pull request #371 from N3TWORK/subquery
Subquery functionality for Group By queries
2014-03-07 13:41:56 -07:00
Tugdual Saunier 7dbcc74510 Adds LocalDataSegmentKiller to allow KillTask for local storage 2014-03-07 12:30:00 +00:00
Yuval Oren 5601c51ae6 finalize variables and optimize imports 2014-03-06 15:03:43 -08:00
Yuval Oren 4b63645802 Merge branch 'master' into subquery
Conflicts:
	processing/src/main/java/io/druid/query/BaseQuery.java
	processing/src/main/java/io/druid/query/groupby/GroupByQueryQueryToolChest.java
	processing/src/test/java/io/druid/query/QueryRunnerTestHelper.java
	processing/src/test/java/io/druid/query/topn/TopNQueryRunnerTest.java
2014-03-06 13:33:59 -08:00
fjy 00c5a708a2 [maven-release-plugin] prepare for next development iteration 2014-03-06 12:55:11 -08:00
fjy 9599832c58 [maven-release-plugin] prepare release druid-0.6.63 2014-03-06 12:55:06 -08:00
fjy 14a5149419 minor javascript problem 2014-03-06 12:43:28 -08:00
fjy e27b2fa7cb Merge branch 'master' of github.com:metamx/druid 2014-03-06 11:57:14 -08:00
fjy 1e9e61f786 fix some broken coordinator endpoints 2014-03-06 11:57:08 -08:00
fjy 1745aa744b Merge pull request #417 from metamx/fix-caching-bug
Fix caching bug and add CachingClusteredClient tests
2014-03-06 11:41:51 -07:00
Himadri Singh 625c78aae5 comments 2014-03-06 11:06:38 +05:30
Himadri Singh dc8ae1d20e revert 2014-03-06 10:46:48 +05:30
Himadri Singh d773a6ca24 One CostBalancerStrategy 2014-03-06 10:35:12 +05:30
Xavier Léauté 9fc5cca663 add disable populate / use cache tests 2014-03-05 14:07:15 -08:00
Xavier Léauté fffb58f6e8 add CachingClusteredClient tests 2014-03-05 14:07:15 -08:00
Xavier Léauté 427014d0a0 cosmetics 2014-03-05 14:07:15 -08:00
Xavier Léauté 5b4c04510f fix populateCache flag not working 2014-03-05 14:07:15 -08:00
Gian Merlino 70db460f97 Blocking Executors and maxPendingPersists, oh my!
- Execs.newBlockingSingleThreaded can now accept capacity = 0.
- Changed default maxPendingPersists from 2 to 0.
- Fixed serde of maxPendingPersists in RealtimeIndexTasks.
2014-03-05 10:55:12 -08:00
fjy 5db00afb37 clean up and default values 2014-03-04 14:38:27 -08:00
fjy c4c4d80336 make local testing pass 2014-03-03 14:52:43 -08:00
fjy 46b9ac78e7 Merge branch 'master' into new-schema
Conflicts:
	indexing-hadoop/src/test/java/io/druid/indexer/HadoopDruidIndexerConfigTest.java
	pom.xml
	publications/whitepaper/druid.pdf
	publications/whitepaper/druid.tex
2014-03-03 14:48:15 -08:00
nishantmonu51 40aa6ecaef fix npe queryID 2014-03-01 04:32:27 +05:30
nishantmonu51 e54949ca98 make queryIDProvider a singleton 2014-02-28 12:19:07 +05:30
fjy bf2ddda897 unit tests passing after more refactoring 2014-02-27 15:21:09 -08:00
fjy 37a79dd4cb [maven-release-plugin] prepare for next development iteration 2014-02-27 11:52:40 -08:00
fjy 8cdd0e3d53 [maven-release-plugin] prepare release druid-0.6.62 2014-02-27 11:52:35 -08:00
fjy bddf7b2908 fix naming problems 2014-02-27 11:50:51 -08:00
fjy 9502212b12 Merge pull request #403 from metamx/Query_id-for-metrics
add queryID to query context and request_logs
2014-02-27 12:44:05 -07:00
nishantmonu51 0701b1534d review comments queryID changes, add wait time for realtime node queries 2014-02-27 14:39:25 +05:30
fjy d57974d58b Merge pull request #407 from metamx/restore-task
Restore task
2014-02-26 19:18:58 -07:00
fjy 3d850aa260 Merge pull request #400 from tucksaun/feat-postgresql-support
Improving PostgreSQL support
2014-02-26 09:57:50 -07:00
Xavier Léauté 2f61035585 add restore task 2014-02-25 13:41:40 -08:00
nishantmonu51 b480d8f543 review comments 2014-02-25 03:09:44 +05:30
fjy 246ada63c5 fix interval load rule 2014-02-24 12:55:20 -08:00
nishantmonu51 373501a06d add queryID to query context and request_logs 2014-02-24 16:11:33 +05:30
fjy 7b0b90a860 Merge branch 'master' of github.com:metamx/druid into new-schema 2014-02-20 16:12:31 -08:00
fjy 5d2367f0fd unit tests pass at this point 2014-02-20 15:52:12 -08:00
fjy ef6208d192 Merge pull request #390 from metamx/bard-oome-fix
APP-2782 Bard oome fix
2014-02-19 19:52:56 -07:00
fjy 20cac8c506 not compiling yet but close 2014-02-19 15:54:27 -08:00
Himadri Singh a049188d23 minor changes from review 2014-02-19 09:13:47 +05:30
fjy 4b7c76762d unit tests passingn at this point, finished rt port maybe 2014-02-18 15:14:38 -08:00
Tugdual Saunier 4b67dbff5f Optimize DbSegmentPublisher.publishSegment 2014-02-17 18:11:15 +00:00
Tugdual Saunier 4dce007577 Use DbConnector.isPostgreSQL everywhere we used getDatabaseProductName before 2014-02-17 18:11:15 +00:00
Himadri Singh 5d729570c1 millis converted. 2014-02-17 15:00:58 +05:30
Himadri Singh 9b6fe2d003 Removed CostBalancerStrategy, made default = 1 thread 2014-02-17 14:57:05 +05:30
Himadri Singh bec264bdf7 Dynamic Config 2014-02-17 14:25:40 +05:30
fjy c57cf6ab4d [maven-release-plugin] prepare for next development iteration 2014-02-14 15:24:15 -08:00
fjy 44755cc91c [maven-release-plugin] prepare release druid-0.6.61 2014-02-14 15:24:11 -08:00
fjy f5affb6b5a [maven-release-plugin] prepare for next development iteration 2014-02-14 15:09:30 -08:00
fjy 189376f495 [maven-release-plugin] prepare release druid-0.6.60 2014-02-14 15:09:26 -08:00
fjy ef648b85f5 fix broken priority queries 2014-02-14 15:05:30 -08:00
fjy 3979eb270c Revert "Revert "Merge branch 'determine-partitions-improvements'""
This reverts commit 189b3e2b9b.
2014-02-14 12:58:56 -08:00
fjy a8c4362d72 rejiggering druid api 2014-02-14 12:57:52 -08:00
fjy 189b3e2b9b Revert "Merge branch 'determine-partitions-improvements'"
This reverts commit 7ad228ceb5, reversing
changes made to 9c55e2b779.
2014-02-14 12:47:34 -08:00
nishantmonu51 78eddc50ee add checks for elements larger than capacity and account for the size of element being added 2014-02-15 00:12:21 +05:30
Himadri Singh 5af414c93c configurable thread count 2014-02-14 13:09:24 +05:30
Xavier Léauté 4b902aed23 fix typo 2014-02-13 23:25:11 -08:00
Himadri Singh 7dae293b5f fixes to comments 2014-02-14 12:42:46 +05:30
Himadri Singh 6e0590f97b Test udpate 2014-02-13 19:10:08 +05:30
Himadri Singh c2604657ed Extracted common methods 2014-02-13 19:04:54 +05:30
Himadri Singh a8d8d1ea06 Costbalancer Multithread 2014-02-13 18:58:45 +05:30
fjy 82fd35726f [maven-release-plugin] prepare for next development iteration 2014-02-12 20:03:00 -08:00
fjy cc1b91636f [maven-release-plugin] prepare release druid-0.6.59 2014-02-12 20:02:55 -08:00
fjy a986166b9c prepare for next release 2014-02-12 20:01:05 -08:00
fjy 60e950fad8 fix backwards compat issue with master 2014-02-12 20:00:43 -08:00
nishantmonu51 7ad228ceb5 Merge branch 'determine-partitions-improvements'
Conflicts:
	pom.xml
2014-02-12 10:51:26 +05:30
Hagen Rother b4eea282b6 consider errors in reading from firehose as unparsable 2014-02-11 16:00:13 +01:00
nishantmonu51 f8d8290a1e add newline at the end of file 2014-02-10 15:44:28 +05:30
nishantmonu51 ec2a32acfc review comments 2014-02-10 12:53:36 +05:30
Jae Hyeon Bae dca965a35a curator 2.4.0 and Announcer logging lines are added regarding infos of reinstating 2014-02-09 22:26:18 -08:00
fjy b7a78680b2 [maven-release-plugin] prepare for next development iteration 2014-02-07 13:06:23 -08:00
fjy cc6886646e [maven-release-plugin] prepare release druid-0.6.58 2014-02-07 13:06:18 -08:00
fjy 555f434fa6 [maven-release-plugin] prepare for next development iteration 2014-02-07 11:56:41 -08:00
fjy 371f2bb941 [maven-release-plugin] prepare release druid-0.6.57 2014-02-07 11:56:34 -08:00
nishantmonu51 dc097081a6 remove writeOpQueueFactory
for writeQueueFactory the buffer of the element is nulled by memcache
before remove is called, thus we are not able to determine the size of
element while removing, We can potentially work around this by adding a
wrapper to keep track of size but that will have its extra overhead,
Also verified from the heap dump that the growing queue was the queue
for opQueue.
2014-02-07 20:00:25 +05:30
nishantmonu51 db93e45bef minor fix 2014-02-07 17:52:52 +05:30
nishantmonu51 61d99bb8f2 change byte size config to long 2014-02-07 16:56:15 +05:30
nishantmonu51 d27274463b add separate putLock and takeLocks + test 2014-02-07 16:52:07 +05:30
Yuval Oren bd11309593 Merge branch 'master' into subquery 2014-02-06 15:36:29 -08:00
Xavier Léauté df0d81baa8 fix local cache byte counting on object removal 2014-02-06 14:28:14 -08:00