Apache
/
druid
mirror of https://github.com/apache/druid.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
4,961 Commits 113 Branches 505 Tags 731 MiB
Commit Graph

2181 Commits

Author SHA1 Message Date
Xavier Léauté 2d4f1889e8 completely async request proxying + jetty update 2014-07-25 16:22:43 -07:00
fjy fc95a79abd add query priorities to metric emission 2014-07-25 16:10:55 -07:00
fjy 45e443bedb a few slight tweaks and bumping up curator version 2014-07-25 16:07:40 -07:00
fjy bb5c5b3ce7 fix config with broker select and add docs 2014-07-25 10:50:41 -07:00
Xavier Léauté 85f739797f remove debug println 2014-07-24 16:49:09 -07:00
Xavier Léauté 03efbb0e02 default query timeout to server idle timeout 2014-07-22 16:59:27 -07:00
Xavier Léauté 00f086665c default async timeout to server idle timeout 2014-07-22 16:55:21 -07:00
fjy 09e2f13ffc adding missing header 2014-07-22 10:12:47 -07:00
fjy 8f2fc595ee allow router to override selection based on config 2014-07-22 10:12:02 -07:00
fjy 1de0f89718 [maven-release-plugin] prepare for next development iteration 2014-07-18 11:55:50 -07:00
fjy 39bff5c1c2 [maven-release-plugin] prepare release druid-0.6.130 2014-07-18 11:55:46 -07:00
fjy 9e303527f2 [maven-release-plugin] prepare for next development iteration 2014-07-18 11:17:56 -07:00
fjy ea04022772 [maven-release-plugin] prepare release druid-0.6.129 2014-07-18 11:17:52 -07:00
nishantmonu51 4ce12470a1 Add way to skip determine partitions for index task 
Add a way to skip determinePartitions for IndexTask by manually
specifying numShards.
 2014-07-18 18:52:15 +05:30
fjy d8b8826c2e Merge branch 'cleanup-ingest' of github.com:metamx/druid into cleanup-ingest 
Conflicts:
	server/src/test/java/io/druid/realtime/firehose/CombiningFirehoseFactoryTest.java
 2014-07-17 20:26:11 -07:00
fjy 291f4c00ae Merge branch 'master' of github.com:metamx/druid into cleanup-ingest 2014-07-17 20:24:59 -07:00
nishantmonu51 0e0454a34c switch reingest task to noop & fix compilation 
switch back to noop task, its confusing to have a reinvest task that
does nothing.
fix compilation
 2014-07-18 06:50:58 +05:30
Xavier Léauté 95a09c04bf log errors in asyncForwardingServlet 2014-07-17 16:22:30 -07:00
fjy 465ac77b82 fix broken UT 2014-07-17 14:39:52 -07:00
fjy 76f096e667 Merge branch 'master' of github.com:metamx/druid into cleanup-ingest 2014-07-17 14:38:54 -07:00
fjy 8ef380b3f9 Merge pull request #638 from metamx/rejigger-cache 
Rejiggering the cache
 2014-07-17 15:19:23 -06:00
fjy ef325f15ff update pom and fix broken UT 2014-07-17 13:47:59 -07:00
fjy ba978d8b79 some minor cleanups to ingest firehose 2014-07-17 13:05:59 -07:00
fjy bc650a1c80 Merge pull request #627 from metamx/druid-firehose 
Functionality to ingest a Druid segment and change the schema
 2014-07-17 13:41:16 -06:00
fjy b70a6b1061 address code review comments 2014-07-16 13:52:06 -07:00
fjy de8cb55260 Merge branch 'master' into rejigger-cache 
Conflicts:
	pom.xml
 2014-07-16 13:37:20 -07:00
nishantmonu51 b74845e942 fix test 
committed it by mistake.
 2014-07-16 09:39:51 +05:30
fjy 27c4750780 fix infinite loop in test 2014-07-15 16:00:56 -07:00
fjy bdfeccd092 doc and timeout fix 2014-07-15 15:57:58 -07:00
fjy 2f90bfcf9a rejiggering the cache for groupBy and select 2014-07-15 12:12:33 -07:00
nishantmonu51 f5f05e3a9b Sync changes from branch new-ingestion PR #599 
Sync and Resolve Conflicts
 2014-07-11 16:15:10 +05:30
nishantmonu51 a12688bc8b fix partitionNum calculation & remove extra sorting 2014-07-10 12:21:27 +05:30
nishantmonu51 fa43049240 review comments & pom changes 2014-07-10 11:48:46 +05:30
nishantmonu51 a1a5e4254f CombiningFirehoseFactory 
can be used to ingest data from multiple sources.
 2014-07-08 21:14:48 +05:30
nishantmonu51 36fc85736c Add ShardSpec Lookup 
Optimize choosing shardSpec for Hash Partitions
 2014-07-08 18:01:31 +05:30
jisookim0513 c4397bd65a fixed merge conflicts 2014-07-07 11:26:11 -07:00
fjy c1cd9ff2ce fix broken rename of rejection policies 2014-07-02 23:41:37 -06:00
fjy 255504727a Merge pull request #615 from metamx/push-bootstrapped-sinks 
push sinks after bootstrap. fix #570
 2014-06-20 11:45:19 -06:00
fjy b978eb33f1 minor fix for cleanup of historical cache file 2014-06-20 10:42:03 -07:00
nishantmonu51 a4003966b2 push sinks after bootstrap. fix #570 2014-06-20 21:45:30 +05:30
xvrl 12ee17c4d2 Merge pull request #614 from metamx/delay-drop 
add an optional delay for how long it takes to drop a segment, fixes all...
 2014-06-19 22:38:26 -07:00
jisookim0513 0244172ccb change missigSegments to a static variable 2014-06-19 18:22:36 -07:00
jisookim0513 4e2b5b743f add more unit tests 2014-06-19 18:18:58 -07:00
jisookim0513 bdb35e2d7e fix retry logic and change the default value of retry to 0 2014-06-19 17:50:50 -07:00
fjy fc36bfbc6d remove pointless exception 2014-06-19 16:49:50 -07:00
fjy 2aab2a0cd9 address cr 2014-06-19 16:48:43 -07:00
fjy b313601a3b add an optional delay for how long it takes to drop a segment, fixes all manners of inconsistent issues 2014-06-19 16:32:38 -07:00
fjy 4c40e71e54 address cr 2014-06-19 14:48:46 -07:00
fjy a870fe5cbe inject column config 2014-06-19 14:47:57 -07:00
Xavier Léauté 09346b0a3c make column cache configurable 2014-06-19 14:43:03 -07:00
jisookim0513 8e85097999 fix header so it passes the entire context 2014-06-19 14:38:11 -07:00
jisookim0513 35e080bbc1 fix concurrency issue with the map; introduce new exception; add incomplete retry query runner test 2014-06-19 14:14:54 -07:00
jisookim0513 8515a11787 change the signature of run() 2014-06-18 18:05:09 -07:00
jisookim0513 f4b1dc032b change the way to use RetryQueryRunnerConfig 2014-06-18 17:15:04 -07:00
jisookim0513 00856f0fec add retry feature on broker side; modify QueryRunner inferface and tests 2014-06-18 16:55:33 -07:00
fjy 0bc1915067 Merge pull request #578 from metamx/new-guava 
Update guava, java-util, and druid-api
 2014-06-18 14:23:32 -06:00
Gian Merlino 7c7d170e78 [maven-release-plugin] prepare for next development iteration 2014-06-18 10:53:40 -07:00
Gian Merlino a52a1d3929 [maven-release-plugin] prepare release druid-0.6.128 2014-06-18 10:53:36 -07:00
Gian Merlino 9532beb05c [maven-release-plugin] prepare for next development iteration 2014-06-17 17:29:31 -07:00
Gian Merlino e3dcbde07d [maven-release-plugin] prepare release druid-0.6.127 2014-06-17 17:29:27 -07:00
Gian Merlino a658afe902 [maven-release-plugin] prepare for next development iteration 2014-06-17 13:01:01 -07:00
Gian Merlino 4e875b8084 [maven-release-plugin] prepare release druid-0.6.126 2014-06-17 13:00:54 -07:00
fjy 3dbf475784 fix linux test failures 2014-06-17 11:05:36 -07:00
fjy 8a13e34c50 fix broken ut 2014-06-17 10:31:50 -07:00
xvrl d3ed08e8ea Merge pull request #609 from metamx/fix-bridge 
fix bridge test
 2014-06-17 10:26:57 -07:00
fjy d1c4627032 fix bridge test 2014-06-17 10:18:46 -07:00
Xavier Léauté 4a835a9f0f fix initialization test static state dependency 2014-06-17 10:07:20 -07:00
Gian Merlino 964f12b7d6 [maven-release-plugin] prepare for next development iteration 2014-06-16 16:56:44 -07:00
Gian Merlino 4e184e3793 [maven-release-plugin] prepare release druid-0.6.125 2014-06-16 16:56:37 -07:00
Gian Merlino ef7e786b96 [maven-release-plugin] prepare for next development iteration 2014-06-16 16:38:08 -07:00
Gian Merlino 96be9faec7 [maven-release-plugin] prepare release druid-0.6.124 2014-06-16 16:37:59 -07:00
fjy c2149f8a00 add more tests for time boundary and caching 2014-06-16 15:32:28 -07:00
fjy a71f7152a5 fix broken UT 2014-06-16 14:53:26 -07:00
nishantmonu51 2d03888a2c Merge branch 'master' into offheap-incremental-index 
Conflicts:
	processing/src/main/java/io/druid/query/groupby/GroupByQueryHelper.java

processing/src/main/java/io/druid/query/groupby/GroupByQueryQueryToolChe
st.java

processing/src/main/java/io/druid/segment/incremental/IncrementalIndex.j
ava
 2014-06-16 20:43:17 +05:30
nishantmonu51 0629be622c remove unnecessary changes & fix index closing subquery 2014-06-16 18:50:49 +05:30
Xavier Léauté a5c533dcab [maven-release-plugin] prepare for next development iteration 2014-06-13 15:17:00 -07:00
Xavier Léauté 903f1a695f [maven-release-plugin] prepare release druid-0.6.123 2014-06-13 15:16:36 -07:00
fjy 0fd57dbc75 [maven-release-plugin] prepare for next development iteration 2014-06-13 15:05:18 -07:00
fjy bcc6e77919 [maven-release-plugin] prepare release druid-0.6.122 2014-06-13 15:05:14 -07:00
Xavier Léauté b7b28ad2f9 [maven-release-plugin] rollback the release of druid-0.6.122 2014-06-13 15:03:03 -07:00
Xavier Léauté 695a2946a9 [maven-release-plugin] prepare for next development iteration 2014-06-13 15:01:13 -07:00
Xavier Léauté 83b2434cad [maven-release-plugin] prepare release druid-0.6.122 2014-06-13 15:01:09 -07:00
Xavier Léauté bd18fef474 [maven-release-plugin] rollback the release of druid-0.6.122 2014-06-13 14:57:31 -07:00
Xavier Léauté 1159e2e415 [maven-release-plugin] prepare release druid-0.6.122 2014-06-13 14:56:12 -07:00
Xavier Léauté 6505f82053 [maven-release-plugin] rollback the release of druid-0.6.122 2014-06-13 14:54:23 -07:00
Xavier Léauté f6d319dac2 [maven-release-plugin] prepare for next development iteration 2014-06-13 14:46:08 -07:00
Xavier Léauté 394d0cfbca [maven-release-plugin] prepare release druid-0.6.122 2014-06-13 14:45:43 -07:00
fjy 332ba3ef20 fix bad merge 2014-06-13 11:36:36 -07:00
fjy 4cc0353be2 Merge branch 'master' of github.com:metamx/druid into new-guava 2014-06-13 11:30:07 -07:00
fjy 5bd4ad3f0f address code review 2014-06-13 11:29:49 -07:00
fjy a63cda3281 Merge branch 'master' into new-guava 
Conflicts:
	server/src/main/java/io/druid/server/QueryResource.java
 2014-06-13 10:08:10 -07:00
nishantmonu51 49d3bd94da Merge branch 'master' into offheap-incremental-index 2014-06-13 15:39:34 +05:30
nishantmonu51 0ddaf4c307 fix race while index closing and querying 2014-06-13 15:36:57 +05:30
Xavier Léauté b2419b1530 fix missing return statement 2014-06-12 17:09:21 -07:00
Xavier Léauté 8f7c82d351 avoid closing yielder prematurely 2014-06-12 16:00:06 -07:00
nishantmonu51 025814cfff Merge branch 'master' into offheap-incremental-index 
Conflicts:
	processing/src/main/java/io/druid/query/GroupByParallelQueryRunner.java

processing/src/main/java/io/druid/query/groupby/GroupByQueryRunnerFactor
y.java

processing/src/main/java/io/druid/segment/incremental/IncrementalIndexSt
orageAdapter.java
 2014-06-12 20:02:27 +05:30
nishantmonu51 a7e19ad892 configure buffer sizes 2014-06-12 19:32:37 +05:30
xvrl ada2d92c16 Merge pull request #576 from metamx/query-cancellation 
Query cancellation & timeout
 2014-06-11 12:18:43 -07:00
Xavier Léauté ababbcadfd fix package groupId 2014-06-10 15:01:44 -07:00
xvrl 1b5095ac57 Merge pull request #588 from metamx/resolve-validator 
add dependencies for validator error
 2014-06-10 14:05:29 -07:00
Xavier Léauté 1fb9b21cf0 async servlet delete support + cleanup 2014-06-10 10:36:39 -07:00
Xavier Léauté b84884ab76 remove methods used only for testing 2014-06-10 10:36:39 -07:00
Xavier Léauté d0f9c438f8 proper query cancellation tests 2014-06-10 10:36:38 -07:00
Xavier Léauté 855c66c9ad less stack traces when cancelling queries 2014-06-10 10:36:38 -07:00
Xavier Léauté d01f272a7a forward cancellation in direct druid client 2014-06-10 10:36:38 -07:00
Xavier Léauté d2c729adec return proper json errors to propagate query cancellation and timeout 2014-06-10 10:36:38 -07:00
Xavier Léauté def62c74f8 properly remove completed queries from query manager 2014-06-10 10:36:38 -07:00
Xavier Léauté 4f1e157639 pass through errors from computes in DirectDruidClient 2014-06-10 10:36:38 -07:00
Xavier Léauté d6f38827db initial query cancellation commit 2014-06-10 10:36:28 -07:00
fjy 5380f14905 add header 2014-06-09 16:13:57 -07:00
fjy a3e86f7094 Merge branch 'master' into new-init 
Conflicts:
	examples/config/historical/runtime.properties
	examples/config/overlord/runtime.properties
	examples/config/realtime/runtime.properties
 2014-06-09 16:01:53 -07:00
fjy 7233fce50c refactor examples to use global runtime 2014-06-09 15:59:44 -07:00
fjy d3f2faef92 address code review 2014-06-09 15:32:22 -07:00
fjy 55f1e2e2a7 add dependencies for validator error 2014-06-06 14:19:55 -07:00
nishantmonu51 5ef660f6d1 improve mem usage for getLoadStatus 2014-06-06 00:23:34 +05:30
nishantmonu51 ab31300513 remove duplicate code 2014-06-05 23:16:38 +05:30
nishantmonu51 03e1fb6f3f reduce memory usage for end points 
do not copy entire segments when not needed,
reduces memory pressure on the coordinator when no. of segments is
large enough.
 2014-06-05 23:14:51 +05:30
fjy 46ef5c4560 [maven-release-plugin] prepare for next development iteration 2014-06-05 10:03:31 -07:00
fjy 0265ae9ac0 [maven-release-plugin] prepare release druid-0.6.121 2014-06-05 10:03:26 -07:00
nishantmonu51 5bdc4a761a close IncrementalIndex properly and free up buffer 2014-06-05 19:41:43 +05:30
nishantmonu51 6265613bb9 Merge branch 'master' into offheap-incremental-index 2014-06-05 17:42:57 +05:30
nishantmonu51 01e8a713b6 unit tests passing with offheap-indexing 2014-06-05 17:42:53 +05:30
Gian Merlino 1d9675c044 Merge pull request #583 from metamx/fix-filtered-server-view 
fix memory issues in FilteredServerView
 2014-06-04 23:57:39 -07:00
Xavier Léauté 6e23ea457b fix memory issues in FilteredServerView 2014-06-04 23:54:37 -07:00
fjy e8aef86458 [maven-release-plugin] prepare for next development iteration 2014-06-04 20:22:31 -07:00
fjy 033f81ca64 [maven-release-plugin] prepare release druid-0.6.120 2014-06-04 20:22:14 -07:00
Gian Merlino 3325f6d6ed [maven-release-plugin] prepare for next development iteration 2014-06-04 17:56:20 -07:00
Gian Merlino 6309ab1973 [maven-release-plugin] prepare release druid-0.6.119 2014-06-04 17:56:15 -07:00
fjy 4524863db1 [maven-release-plugin] prepare for next development iteration 2014-06-04 16:49:49 -07:00
fjy 37c6ece150 [maven-release-plugin] prepare release druid-0.6.118 2014-06-04 16:49:44 -07:00
fjy 2d95780d12 [maven-release-plugin] prepare for next development iteration 2014-06-04 09:45:11 -07:00
fjy 30ce0ab99c [maven-release-plugin] prepare release druid-0.6.117 2014-06-04 09:45:06 -07:00
fjy 77ec4df797 update guava, java-util, and druid-api 2014-06-03 13:43:38 -07:00
fjy 8340a1b0a1 Properties module can now take multiple properties files 2014-06-03 10:34:38 -07:00
fjy f7c4d6a24a fix bug with loadqueue endpoint 2014-06-03 10:28:22 -07:00
fjy abe26a7f2e change default merge size to 500mb instead of 1g 2014-06-02 12:48:57 -07:00
fjy 1407b49da1 [maven-release-plugin] prepare for next development iteration 2014-06-02 10:53:47 -07:00
fjy f91ecf20f3 [maven-release-plugin] prepare release druid-0.6.116 2014-06-02 10:53:43 -07:00
fjy 49f03b808d fix default value for max segments to merge 2014-06-02 10:20:13 -07:00
fjy ee60183df7 [maven-release-plugin] prepare for next development iteration 2014-05-29 17:26:55 -07:00
fjy d13a354ffb [maven-release-plugin] prepare release druid-0.6.115 2014-05-29 17:26:49 -07:00
Xavier Léauté ea7eaba735 require default predicate in ServerInventoryViews 2014-05-29 17:09:34 -07:00
Xavier Léauté f32aee7804 make it explicit it's a concurrent map 2014-05-29 17:01:45 -07:00
Xavier Léauté d6f58bdced filtered batch inventory view tests 2014-05-29 15:42:57 -07:00
Xavier Léauté f30d58ad31 filter out segment callbacks not related to given filter 2014-05-29 15:42:57 -07:00
Xavier Léauté d98a10a7d8 FilteredServerView 2014-05-29 15:42:57 -07:00
fjy 7be93a770a make all firehoses work with tasks, add a lot more documentation about configuration 2014-05-28 16:33:59 -07:00
Xavier Léauté 347815cf27 preserve segment order when pulling from cache 2014-05-27 13:56:58 -07:00
fjy 5ce80068d2 [maven-release-plugin] prepare for next development iteration 2014-05-20 13:22:52 -07:00
fjy 904c9049a7 [maven-release-plugin] prepare release druid-0.6.114 2014-05-20 13:22:48 -07:00
fjy f0c40709cd fix coordinator dynamic configs 2014-05-20 13:20:43 -07:00
fjy 783f8fcc99 [maven-release-plugin] prepare for next development iteration 2014-05-20 12:47:33 -07:00
fjy def12c03bd [maven-release-plugin] prepare release druid-0.6.113 2014-05-20 12:47:29 -07:00
fjy 37dca4d437 make sure the dynamic config has at least 1 thread 2014-05-20 12:45:35 -07:00
fjy e5454b47f1 [maven-release-plugin] prepare for next development iteration 2014-05-20 10:49:00 -07:00
fjy bcffb92181 [maven-release-plugin] prepare release druid-0.6.112 2014-05-20 10:48:53 -07:00
fjy dd59b58208 [maven-release-plugin] prepare for next development iteration 2014-05-19 21:17:09 -07:00
fjy 511aca9ea8 [maven-release-plugin] prepare release druid-0.6.111 2014-05-19 21:17:04 -07:00
Xavier Léauté 2786c68411 fix file casing 2014-05-19 20:22:13 -07:00
fjy d0f87b0cf6 fix broken move test 2014-05-19 18:29:09 -07:00
Gian Merlino a7760af65a Merge pull request #553 from metamx/snapshot-coordinator 
Snapshot coordinator state before running anything
 2014-05-19 18:24:19 -07:00
fjy 1addea4dbe more code review comments 2014-05-19 17:52:34 -07:00
Xavier Léauté 5a065a8785 fix BatchServerInventoryViewTest waitForSync() logic 2014-05-19 17:43:00 -07:00
fjy 1b6e816c28 Merge pull request #544 from metamx/java-8-fix-tests 
Make tests pass with Java 8
 2014-05-19 18:11:52 -06:00
fjy 6126dd4231 fix more code review comments 2014-05-19 17:04:26 -07:00
Xavier Léauté 9ec7c71e0f fix compilation error with updated druid-api 2014-05-19 14:06:23 -07:00
fjy 7879f38ccc fix according to code review 2014-05-19 13:35:23 -07:00
fjy 5ee3f5c9d3 snapshot coordinator state before running 2014-05-18 22:32:20 -07:00
Xavier Léauté 20c4fbc98d [maven-release-plugin] prepare for next development iteration 2014-05-16 16:34:19 -07:00
Xavier Léauté 4abcf3e16a [maven-release-plugin] prepare release druid-0.6.110 2014-05-16 16:34:12 -07:00
fjy 68618ffc75 fix another code review comment 2014-05-16 15:38:46 -07:00
fjy 389319dd6e fix for code review comments 2014-05-16 15:32:58 -07:00
fjy 09ad32c5c5 fix race condition with merge and persist and sink adding 
Conflicts:
	indexing-service/src/main/java/io/druid/indexing/common/task/IndexTask.java
	server/src/main/java/io/druid/segment/realtime/RealtimeManager.java
	server/src/main/java/io/druid/segment/realtime/plumber/RealtimePlumber.java
 2014-05-16 15:21:09 -07:00
nishantmonu51 b4a791a035 add comment for ignoring test and add test for thread stucking 2014-05-16 19:48:12 +05:30
fjy da285d8665 [maven-release-plugin] prepare for next development iteration 2014-05-15 16:44:36 -07:00
fjy b7009c9102 [maven-release-plugin] prepare release druid-0.6.109 2014-05-15 16:44:32 -07:00
fjy 6db0cd623f ignore jetty exception test for now 2014-05-15 16:42:48 -07:00
fjy 43853a1d9e Merge pull request #545 from metamx/union-query-fix 
Union query fix
 2014-05-15 17:17:46 -06:00
fjy 01d0234b46 Merge branch 'master' of github.com:metamx/druid 2014-05-15 14:23:26 -07:00
fjy 6098cff37a clean up event receiver firehose factory 2014-05-15 14:23:13 -07:00
nishantmonu51 ddc36c89cc union query fix and a broken test 2014-05-15 23:10:40 +05:30
fjy 793bc3539b Merge pull request #538 from metamx/fix-jetty-exception-handling 
fix jetty threads getting stuck
 2014-05-15 10:55:46 -06:00
Xavier Léauté 088c60cf3d always use ByteCountingLRUMap.remove() to remove 2014-05-14 22:48:41 -07:00
fjy c57a18d6b6 Merge branch 'master' of github.com:metamx/druid 2014-05-12 11:38:55 -07:00
fjy 32eee959c3 fix backwards compat issue 2014-05-12 11:38:46 -07:00
nishantmonu51 26569f4b7f fix jetty threads getting stuck 
Fix Jetty threads getting stuck on exceptions
 2014-05-10 02:12:19 +05:30
nishantmonu51 17e994f2e4 review comment 2014-05-09 23:53:25 +05:30
nishantmonu51 6be6337ab0 remove initial delay from polling 
remove initial delay from polling in coordinator, this will help in the
cases when the pollDuration is set to higher than coordinator
startDelay.
 2014-05-09 23:33:00 +05:30
fjy 48ae84ed56 [maven-release-plugin] prepare for next development iteration 2014-05-07 12:40:14 -07:00
fjy 27f7c45e91 [maven-release-plugin] prepare release druid-0.6.108 2014-05-07 12:40:10 -07:00
fjy 42994cebcd [maven-release-plugin] prepare for next development iteration 2014-05-07 11:25:50 -07:00
fjy 2bf5c3831d [maven-release-plugin] prepare release druid-0.6.107 2014-05-07 11:25:45 -07:00
fjy e7da1bb9ce fix injection problems with server select strategies 2014-05-07 10:13:05 -07:00
fjy 1100d2f2a1 rename configs to make a bit more sense 2014-05-06 14:52:50 -07:00
fjy b6fb4245aa Merge branch 'master' into new-schema 
Conflicts:
	indexing-hadoop/src/main/java/io/druid/indexer/HadoopDriverConfig.java
	indexing-hadoop/src/main/java/io/druid/indexer/HadoopDruidIndexerConfig.java
	indexing-hadoop/src/main/java/io/druid/indexer/HadoopDruidIndexerConfigBuilder.java
	pom.xml
	server/src/main/java/io/druid/segment/realtime/RealtimeManager.java
	server/src/main/java/io/druid/segment/realtime/firehose/EventReceiverFirehoseFactory.java
 2014-05-06 14:32:51 -07:00
fjy ad54f150ec fix broken UT with bad api version 2014-05-06 13:51:22 -07:00
fjy 0ee2323875 Merge pull request #399 from metamx/multithread-costbalancer 
Multithread costbalancer
 2014-05-06 14:18:07 -06:00
fjy 79e6d4eb56 Merge pull request #528 from metamx/union-query-source 
Union query source
 2014-05-06 14:13:33 -06:00
nishantmonu51 66450ca6ed review comments 
remove toShortString
minor other changes
 2014-05-07 00:54:17 +05:30
Gian Merlino 6f3f5c6e99 [maven-release-plugin] prepare for next development iteration 2014-05-06 11:28:39 -07:00
Gian Merlino a5a875e1ed [maven-release-plugin] prepare release druid-0.6.106 2014-05-06 11:28:34 -07:00
fjy 544c0f08f6 Merge pull request #459 from metamx/move-firehose 
Move the event receiver firehose such that standalone realtime nodes can use it
 2014-05-05 17:09:43 -06:00
fjy 42c2fcb6b4 Merge pull request #518 from metamx/server-select 
Smarter server selection at the broker level
 2014-05-05 17:09:15 -06:00
fjy 9615c5e428 Merge pull request #519 from metamx/more-endpoints 
Add more endpoints, fixes #517
 2014-05-05 17:09:02 -06:00
nishantmonu51 f2725994b7 refactor method 2014-05-05 19:57:32 +05:30
Himadri Singh 0b9191b876 limit on balancer compute threads 
max being no. of processors - 1
 2014-05-05 17:26:44 +05:30
Himadri Singh cae4363f66 small perf test 2014-05-05 17:13:12 +05:30
nishantmonu51 477e01daf7 review comments 2014-05-02 15:21:06 +05:30
fjy e0bce3168c [maven-release-plugin] prepare for next development iteration 2014-05-01 15:09:01 -07:00
fjy dd0004b759 [maven-release-plugin] prepare release druid-0.6.105 2014-05-01 15:08:57 -07:00
nishantmonu51 728a606d32 Add support for union queries 2014-05-01 01:54:52 +05:30
fjy 015000ee8f [maven-release-plugin] prepare for next development iteration 2014-04-30 13:16:24 -07:00
fjy eae7d55dce [maven-release-plugin] prepare release druid-0.6.104 2014-04-30 13:16:20 -07:00
fjy 46eedd7a95 Merge pull request #526 from metamx/fix-race-ingestion 
Fix FileNotFound in realtime nodes
 2014-04-30 14:10:41 -06:00
nishantmonu51 faa74ce2cb hasSwapped properly check 
protect check for hasSwapped.
 2014-05-01 01:38:03 +05:30
nishantmonu51 ff56573910 Fix race 
Fix race in ingestion that can cause FNF,
Properly check for partitionNum
shutdown persistExecutor
 2014-05-01 01:34:58 +05:30
fjy 7700001e27 [maven-release-plugin] prepare for next development iteration 2014-04-30 10:45:20 -07:00
fjy 1e639792bf [maven-release-plugin] prepare release druid-0.6.103 2014-04-30 10:45:14 -07:00
fjy 3fd651c235 fix the rule again, update docs, and prepare for next release 2014-04-30 10:43:30 -07:00
fjy 9ad0da0794 [maven-release-plugin] prepare for next development iteration 2014-04-30 10:26:38 -07:00
fjy 5b7b29b61b [maven-release-plugin] prepare release druid-0.6.102 2014-04-30 10:26:34 -07:00
fjy 159c3361b8 Merge pull request #524 from metamx/fix-router2 
Small fixes to router
 2014-04-30 11:21:45 -06:00
fjy 68242950f7 make coordinator routing smarter and period load rule explicit 2014-04-30 10:17:40 -07:00
fjy 9bc6436176 Add more endpoints, fixes #517 2014-04-28 15:55:03 -07:00
fjy e90eb4b83a add custom tier selector 2014-04-28 15:31:15 -07:00
fjy 3c3daf452e Smarter server selection at the router level 2014-04-28 13:58:10 -07:00
Himadri Singh ca1e951e17 druid header 2014-04-28 18:00:51 +05:30
fjy e30accbbf5 reducing bloat 2014-04-25 15:25:54 -07:00
fjy a33c2f7880 clean up firehose module and introduce parsers module 2014-04-25 14:20:02 -07:00
fjy 171d20d52d Merge branch 'move-firehose' of github.com:metamx/druid into move-firehose 2014-04-25 14:13:19 -07:00
fjy eef034ca7e Merge branch 'master' of github.com:metamx/druid into move-firehose 2014-04-25 14:13:08 -07:00
fjy 76e0a48527 Merge branch 'master' into new-schema 
Conflicts:
	indexing-hadoop/src/main/java/io/druid/indexer/DbUpdaterJob.java
	indexing-hadoop/src/test/java/io/druid/indexer/HadoopDruidIndexerConfigTest.java
	indexing-service/src/main/java/io/druid/indexing/common/task/HadoopIndexTask.java
	server/src/main/java/io/druid/segment/realtime/plumber/RealtimePlumber.java
	server/src/main/java/io/druid/segment/realtime/plumber/RealtimePlumberSchool.java
 2014-04-25 14:03:28 -07:00
Xavier Léauté f88cb13ccb [maven-release-plugin] prepare for next development iteration 2014-04-24 17:27:58 -07:00
Xavier Léauté b8c14ba061 [maven-release-plugin] prepare release druid-0.6.101 2014-04-24 17:27:46 -07:00
Xavier Léauté 5d105e7598 fix stupid cache config bug 2014-04-24 17:13:04 -07:00
fjy 5e98275251 [maven-release-plugin] prepare for next development iteration 2014-04-24 11:47:52 -07:00
fjy 35dc96e946 [maven-release-plugin] prepare release druid-0.6.100 2014-04-24 11:47:47 -07:00
fjy 7f0319a8ae fix NPE 2014-04-23 16:51:12 -07:00
fjy bec171fea9 [maven-release-plugin] prepare for next development iteration 2014-04-22 17:10:33 -07:00
fjy 67972ca5c5 [maven-release-plugin] prepare release druid-0.6.99 2014-04-22 17:10:27 -07:00
fjy 2d1f33e59f Merge pull request #500 from metamx/batch-ingestion-fixes 
Batch ingestion fixes
 2014-04-22 17:59:24 -06:00
nishantmonu51 0d8c1ffe54 review comments and add partitioner 2014-04-23 03:30:30 +05:30
fjy 22fba22522 remove whitespace 2014-04-22 13:07:12 -07:00
fjy d1b035a8b9 use emitting logger for query resource 2014-04-22 12:59:24 -07:00
xvrl d17abedae3 Merge pull request #499 from metamx/fix-pull-from-cache 
Fix pull from cache
 2014-04-22 11:19:57 -07:00
nishantmonu51 9d762b87ce Add diff values, to test another path in merging 2014-04-22 23:25:17 +05:30
fjy cde93d810c fix server metrics to avoid NaN and Infinity 2014-04-22 10:26:46 -07:00
nishantmonu51 65c71a40bb fix more issues and add test 
1) Add test for caching and calculation of dependent post-aggs for
TimeSeries and TopN
2) Fix more NPEs while calculating dependent postAggs, passing
baseHolder was wrong as it does not contain post-aggs during computing
dependent ones.
 2014-04-22 22:05:17 +05:30
fjy bed8860fd4 [maven-release-plugin] prepare for next development iteration 2014-04-21 22:34:43 -07:00
fjy 594bb65ba6 [maven-release-plugin] prepare release druid-0.6.98 2014-04-21 22:34:38 -07:00
fjy 357cd66f66 [maven-release-plugin] prepare for next development iteration 2014-04-21 22:26:28 -07:00
fjy 93ed56f680 [maven-release-plugin] prepare release druid-0.6.97 2014-04-21 22:26:23 -07:00
fjy 310073685d [maven-release-plugin] prepare for next development iteration 2014-04-21 12:16:39 -07:00
fjy 1778d9adf4 [maven-release-plugin] prepare release druid-0.6.96 2014-04-21 12:16:35 -07:00
fjy 65db875d68 [maven-release-plugin] prepare for next development iteration 2014-04-18 17:44:36 -07:00
fjy 2d3eebe995 [maven-release-plugin] prepare release druid-0.6.95 2014-04-18 17:44:32 -07:00
fjy e3fbbff237 clean up code 2014-04-18 17:41:47 -07:00
nishantmonu51 68e8cda2da fix post aggregator 2014-04-19 04:24:07 +05:30
Gian Merlino 265ac37cdc [maven-release-plugin] prepare for next development iteration 2014-04-18 11:53:43 -07:00
Gian Merlino 5162864731 [maven-release-plugin] prepare release druid-0.6.94 2014-04-18 11:53:38 -07:00
fjy a520a2dde0 handle null request uris 2014-04-17 18:13:03 -07:00
fjy 1fcb3e01c3 [maven-release-plugin] prepare for next development iteration 2014-04-17 15:30:30 -07:00
fjy e9b77c4434 [maven-release-plugin] prepare release druid-0.6.93 2014-04-17 15:30:26 -07:00
Xavier Léauté 6a52112034 let broker populate cache lazily 2014-04-17 14:40:05 -07:00
Xavier Léauté 943b6ed12c add comments 2014-04-17 09:48:08 -07:00
nishantmonu51 5f61d0396c Ignore test 2014-04-17 22:09:48 +05:30
nishantmonu51 7765c96a39 Add test to test Jetty request timeouts 2014-04-17 20:36:28 +05:30
fjy 66a8ff9390 [maven-release-plugin] prepare for next development iteration 2014-04-16 11:40:35 -07:00
fjy 6621c4f321 [maven-release-plugin] prepare release druid-0.6.92 2014-04-16 11:40:30 -07:00
fjy b26a40aeaf [maven-release-plugin] prepare for next development iteration 2014-04-16 11:26:34 -07:00
fjy 8ee8927267 [maven-release-plugin] prepare release druid-0.6.91 2014-04-16 11:26:28 -07:00
fjy c6274762b7 throw ISE when no servers found at all 2014-04-16 10:27:34 -07:00
fjy 6306e87a96 avoid copying bytes 2014-04-16 10:14:15 -07:00
fjy 51e2da9d8d use a separate annotation for the router, less confusing 2014-04-16 10:08:58 -07:00
fjy 24a0268036 cleanup code in router and add forwarding for get requests 2014-04-16 09:36:18 -07:00
fjy 6893282a65 [maven-release-plugin] prepare for next development iteration 2014-04-15 14:26:57 -07:00
fjy 7e9166d20c [maven-release-plugin] prepare release druid-0.6.90 2014-04-15 14:26:53 -07:00
fjy 508cf6a4f7 Merge branch 'master' of github.com:metamx/druid 2014-04-15 14:23:58 -07:00
fjy 9b06b6aa58 misc fixes for router 2014-04-15 14:23:54 -07:00
fjy 228be3acb0 Merge pull request #467 from metamx/optimize-postAgg-calculation 
Optimize post agg calculation
 2014-04-15 15:18:01 -06:00
nishantmonu51 cd1c1d2615 fix casing issue when parsing event 2014-04-15 23:32:54 +05:30
fjy 6f1f21cfd6 Merge pull request #476 from metamx/non-blocking-persist-n-merge 
Non blocking persist n merge
 2014-04-15 10:58:47 -06:00
fjy f6de38a87c Merge pull request #480 from metamx/compute-cache-monitor 
enable cache monitor on computes by default
 2014-04-15 10:51:54 -06:00
nishantmonu51 3172383e56 modify comment 2014-04-15 12:55:40 +05:30
Xavier Léauté 16bffe0588 default cache size to zero 2014-04-14 16:23:54 -07:00
fjy a46c4592b4 a few cleanups 2014-04-14 09:53:29 -07:00
nishantmonu51 595ad7d21d rename thread 2014-04-11 12:34:17 +05:30
nishantmonu51 db60353cac persist-n-merge in separate pool 
persist-n-merge in separate pool, do not block intermediate persists
 2014-04-11 12:18:11 +05:30
fjy db5f04c84d [maven-release-plugin] prepare for next development iteration 2014-04-10 15:39:41 -07:00
fjy 87ef64f577 [maven-release-plugin] prepare release druid-0.6.89 2014-04-10 15:39:36 -07:00
fjy b273f1b101 [maven-release-plugin] prepare for next development iteration 2014-04-10 12:56:20 -07:00
fjy 9019990d94 [maven-release-plugin] prepare release druid-0.6.88 2014-04-10 12:56:16 -07:00
fjy 0904436d2f actually emit query stats 2014-04-10 12:54:27 -07:00
fjy 57bf8faa82 [maven-release-plugin] prepare for next development iteration 2014-04-10 11:33:06 -07:00
fjy 20c7b73269 [maven-release-plugin] prepare release druid-0.6.87 2014-04-10 11:33:02 -07:00
fjy 6742223c26 fix another missing log 2014-04-10 11:26:53 -07:00
fjy 8e143adadf address code review comments 2014-04-10 11:13:11 -07:00
fjy 88c592ccaa add more meaningful request logging 2014-04-10 10:37:25 -07:00
Xavier Léauté 69a8723f18 fix npe in CachingQueryRunner 2014-04-09 17:04:42 -07:00
xvrl c05f169171 Merge pull request #458 from metamx/stream-cache 
use and populate cache at compute node level
 2014-04-09 10:42:26 -07:00
fjy e867c93422 turn down too much logging; gp 2014-04-09 09:55:12 -07:00
nishantmonu51 ea8b2dffd5 Add chatHandlerResource 2014-04-09 14:25:18 +05:30
Xavier Léauté 19d6aec396 address code review comments 2014-04-08 17:21:01 -07:00
Xavier Léauté 60b95dabad CachePopulatingQueryRunner -> CachingQueryRunner 
Populate and use cache at compute node level
 2014-04-08 17:14:17 -07:00
Xavier Léauté 3e6ffbd5ac populate cache on sequence close 2014-04-08 17:14:17 -07:00
fjy 6209803d50 [maven-release-plugin] prepare for next development iteration 2014-04-08 16:27:44 -07:00
fjy ac9d20af47 [maven-release-plugin] prepare release druid-0.6.86 2014-04-08 16:27:40 -07:00
fjy dd8e9e2930 fix concurrent modification exceptions in local cache 2014-04-08 16:23:24 -07:00
fjy 29c3db92b5 [maven-release-plugin] prepare for next development iteration 2014-04-08 11:44:45 -07:00
fjy d16ff98ef3 [maven-release-plugin] prepare release druid-0.6.85 2014-04-08 11:44:40 -07:00
nishantmonu51 2c8682a1b6 avoid using Math.abs 
review comment on - c6f5311
To avoid overflow issues and unnecessary calls to Math.abs.
 2014-04-08 21:58:54 +05:30
nishantmonu51 f726e52e3b fix test 2014-04-08 20:09:44 +05:30
nishantmonu51 12991a959a actually fix it 2014-04-08 20:08:21 +05:30
nishantmonu51 c6f531168f fix hash based partition - boundary case Integer.MIN 2014-04-08 20:07:22 +05:30
nishantmonu51 22c3296aa3 Merge branch 'master' into optimize-postAgg-calculation 
Conflicts:
	server/src/test/java/io/druid/client/CachingClusteredClientTest.java
 2014-04-08 03:35:56 +05:30
nishantmonu51 c322f44863 time series post Aggregation improved 
move post aggregation to finalise results
 2014-04-08 03:17:15 +05:30
fjy 8e3bcc8fc3 [maven-release-plugin] prepare for next development iteration 2014-04-07 14:38:55 -07:00
fjy e1e81cfeac [maven-release-plugin] prepare release druid-0.6.84 2014-04-07 14:38:51 -07:00
nishantmonu51 4bb36dd453 fix tests 2014-04-08 02:37:57 +05:30
fjy bfb66691b9 [maven-release-plugin] prepare for next development iteration 2014-04-07 12:45:28 -07:00
fjy f612b7cc64 [maven-release-plugin] prepare release druid-0.6.83 2014-04-07 12:45:20 -07:00
fjy f5dc75ef82 Merge pull request #464 from metamx/fix-context 
Fix context to be backwards compatible with String values
 2014-04-07 11:54:17 -06:00
fjy dda09633be make query id a bit more readable 2014-04-07 10:53:43 -07:00
fjy 40c14c9a3c fix case with no request params 2014-04-06 12:43:40 -07:00
fjy f0e9d6fd83 fix query forwarding 2014-04-06 12:41:39 -07:00
fjy 4d6174ebf2 be able to set maxPendingPersists in plumber 2014-04-06 09:47:37 -07:00
fjy 1267fbb7f5 fix context to be backwards compat 2014-04-06 09:20:58 -07:00
fjy 1843316db6 commonalize event receiver firehose 2014-04-03 20:46:36 -07:00
fjy 8138d96f9d [maven-release-plugin] prepare for next development iteration 2014-04-03 17:21:14 -07:00
fjy 4619e498c3 [maven-release-plugin] prepare release druid-0.6.82 2014-04-03 17:21:10 -07:00
fjy d9062d91fa fix endpoint bugs and more docs 2014-04-03 17:01:33 -07:00
fjy edba3ba40e [maven-release-plugin] prepare for next development iteration 2014-04-02 22:24:36 -07:00
fjy 0f0e525a75 [maven-release-plugin] prepare release druid-0.6.81 2014-04-02 22:24:32 -07:00
fjy b0bf08554a fix broken build 2014-04-02 22:22:42 -07:00
nishantmonu51 d6eebce998 Revert "Merge pull request #457 from metamx/stream-cache" 
This reverts commit 5fae4d9abc, reversing
changes made to 43a0554179.
 2014-04-03 10:38:43 +05:30
fjy 133c624f69 [maven-release-plugin] prepare for next development iteration 2014-04-02 21:33:10 -07:00
fjy 4e2ac3234c [maven-release-plugin] prepare release druid-0.6.79 2014-04-02 21:33:05 -07:00
fjy ea9f31bbe0 learn to math and prepare for next release 2014-04-02 21:31:17 -07:00
fjy 6bab22ef71 [maven-release-plugin] prepare for next development iteration 2014-04-02 21:08:18 -07:00
fjy 93e19b62e6 [maven-release-plugin] prepare release druid-0.6.78 2014-04-02 21:08:14 -07:00
fjy f185d215e1 fix jetty default thread pool size for jetty 9 and prepare for next release 2014-04-02 21:01:07 -07:00
fjy 6cd5a76983 [maven-release-plugin] prepare for next development iteration 2014-04-02 17:33:26 -07:00
fjy d1e7b98177 [maven-release-plugin] prepare release druid-0.6.77 2014-04-02 17:33:19 -07:00
fjy 7547e989f0 Merge pull request #456 from metamx/processing-threads-default 
more sensible defaults
 2014-04-02 18:25:43 -06:00
fjy 5fae4d9abc Merge pull request #457 from metamx/stream-cache 
Populate cache without materializing results first
 2014-04-02 18:07:36 -06:00
fjy 43a0554179 Merge pull request #455 from metamx/async 
Asynchronous servlet for query forwarding
 2014-04-02 18:05:49 -06:00
Xavier Léauté 458a873505 make test reflect the fact that resulting sequence is not consumed yet 2014-04-02 15:37:54 -07:00
Xavier Léauté ee34415470 populate cache without materializing results 2014-04-02 15:32:14 -07:00
Xavier Léauté f3cc316e66 create utiliy class for getMaxDirectMemory 2014-04-02 15:27:34 -07:00
fjy 85ffce25a6 fix code review comments 2014-04-02 14:56:00 -07:00
Xavier Léauté ee97fb98bc more sensible defaults for single core machines 2014-04-02 14:24:08 -07:00
fjy eaec0e3ab2 cleanup 2014-04-01 17:56:25 -07:00
fjy 6952eb7878 asynch servlet for query forwarding 2014-04-01 17:51:28 -07:00
Xavier Léauté 74c5d9889b [maven-release-plugin] prepare for next development iteration 2014-03-31 16:07:31 -07:00
Xavier Léauté 0845cc4078 [maven-release-plugin] prepare release druid-0.6.76 2014-03-31 16:07:25 -07:00
fjy 50b6888210 Merge pull request #450 from metamx/fix-cache-population 
Fix cache population
 2014-03-31 12:26:37 -06:00
nishantmonu51 05f3f7d49e review comments - remove instance of check 2014-03-29 03:06:53 +05:30
fjy c5fbb67d94 more endpoint cleanup 2014-03-28 14:31:30 -07:00
fjy 676671e575 new endpoints 2014-03-28 13:55:44 -07:00
nishantmonu51 af470223f1 add test 2014-03-28 22:39:29 +05:30
nishantmonu51 ccf72bfdf8 Fix cache population simple way 2014-03-28 14:14:46 +05:30
fjy 652506d1bd [maven-release-plugin] prepare for next development iteration 2014-03-27 18:03:55 -07:00
fjy 7fa62cd9c7 [maven-release-plugin] prepare release druid-0.6.75 2014-03-27 18:03:51 -07:00
fjy 21e54d8060 rename var to be less confusing 2014-03-27 15:48:37 -07:00
fjy bc4bc277f2 Merge pull request #447 from metamx/fix-configmanager 
Move db specific things from ConfigManager into DbConnector
 2014-03-27 16:47:03 -06:00
fjy 366872ffe9 Merge pull request #446 from liquidm/add_druiddirectclient_logging 
add url logging to DirectDruidClient for debugging purposes
 2014-03-27 16:41:03 -06:00
Xavier Léauté 6e18ff7ed4 use prepared statement instead of string interpolation 2014-03-27 12:41:30 -07:00
Hagen Rother d6f4cf3733 add changes as suggested by cheddar 2014-03-27 19:46:53 +01:00
Hagen Rother 6fb3e61a98 add url logging to DirectDruidClient for debugging purposes 2014-03-27 19:38:53 +01:00
fjy 7e54c6a359 [maven-release-plugin] prepare for next development iteration 2014-03-25 13:43:25 -07:00
fjy 0baf95098d [maven-release-plugin] prepare release druid-0.6.74 2014-03-25 13:43:21 -07:00
nishantmonu51 3ba67946a3 review comments - remove unused import and extract out constants 2014-03-25 23:03:13 +05:30
nishantmonu51 fe7a184096 review comments 2014-03-25 17:02:36 +05:30
nishantmonu51 0ba72ffb2b merge from master 2014-03-25 15:43:05 +05:30
nishantmonu51 1c5d2b6dc5 review comments 2014-03-25 13:27:30 +05:30
nishantmonu51 6a34c09e05 Merge branch 'master' into compute-populate-cache 2014-03-25 13:23:00 +05:30
fjy 60c204afeb Merge pull request #433 from metamx/router-node 
Client-side tier-aware query runner
 2014-03-24 16:17:59 -06:00
fjy 75ec8bed9a address code review comments 2014-03-24 14:53:30 -07:00
fjy fcd7522596 Merge branch 'master' into router-node 2014-03-24 13:43:52 -07:00
fjy b0790783b7 Merge pull request #436 from metamx/better-context 
Extend context to able to take more sophisticated objects than just strings
 2014-03-24 14:40:45 -06:00
fjy de83677165 more logging at initialization 2014-03-24 13:40:04 -07:00
fjy e523bfc237 [maven-release-plugin] prepare for next development iteration 2014-03-21 11:07:40 -07:00
fjy 6fbc3b15a7 [maven-release-plugin] prepare release druid-0.6.73 2014-03-21 11:07:34 -07:00
fjy 7f8211ecc7 extend context to use map string object instead of map string string 2014-03-20 13:41:45 -07:00
nishantmonu51 69e9b7a6c5 merge changes from master 2014-03-20 20:23:58 +05:30
nishantmonu51 9079a17df0 Add headers 2014-03-20 19:44:36 +05:30
fjy a96dfc7742 clean up failure scenarios 2014-03-19 10:30:52 -07:00
fjy 76ef9d192c add tests 2014-03-18 13:47:53 -07:00
fjy ab2524ba0a add router node 2014-03-18 13:44:29 -07:00
fjy 03851101f0 [maven-release-plugin] prepare for next development iteration 2014-03-18 08:12:51 -07:00
fjy 508d892ba1 [maven-release-plugin] prepare release druid-0.6.72 2014-03-18 08:12:44 -07:00
nishantmonu51 32ad26210d Fix backwards compatibilty constant post aggregator 2014-03-18 20:34:49 +05:30
fjy 294f15d624 [maven-release-plugin] prepare for next development iteration 2014-03-17 21:44:17 -07:00
fjy 199efa049a [maven-release-plugin] prepare release druid-0.6.71 2014-03-17 21:44:11 -07:00
fjy 1d1ec1d855 clean up some defaults and prepare for next release 2014-03-17 21:41:34 -07:00
Xavier Léauté b9fe12977e [maven-release-plugin] prepare for next development iteration 2014-03-17 13:57:10 -07:00
Xavier Léauté 0276223db1 [maven-release-plugin] prepare release druid-0.6.70 2014-03-17 13:57:06 -07:00
fjy 2adcf07f5f Merge branch 'master' into new-schema 
Conflicts:
	indexing-hadoop/src/main/java/io/druid/indexer/DetermineHashedPartitionsJob.java
	indexing-service/src/main/java/io/druid/indexing/common/task/RealtimeIndexTask.java
	indexing-service/src/test/java/io/druid/indexing/common/task/TaskSerdeTest.java
	processing/src/test/java/io/druid/segment/TestIndex.java
	server/src/main/java/io/druid/segment/realtime/RealtimeManager.java
	server/src/main/java/io/druid/segment/realtime/plumber/RealtimePlumberSchool.java
 2014-03-17 10:59:31 -07:00
nishantmonu51 468e8e0b31 Memcache changes 2014-03-17 18:54:30 +05:30
fjy 8e5cbca2ee [maven-release-plugin] prepare for next development iteration 2014-03-14 15:16:55 -07:00
fjy 852d167eaf [maven-release-plugin] prepare release druid-0.6.69 2014-03-14 15:16:50 -07:00
fjy f1da044cfa fix another breaking endpoint in druid coordinator 2014-03-14 15:15:08 -07:00
fjy 7a2d0850e3 [maven-release-plugin] prepare for next development iteration 2014-03-14 15:06:54 -07:00
fjy 2646b5421b [maven-release-plugin] prepare release druid-0.6.68 2014-03-14 15:06:50 -07:00
fjy f525361c3d fix broken tests and prepare for next release 2014-03-14 15:05:07 -07:00
fjy 454a240525 [maven-release-plugin] prepare for next development iteration 2014-03-14 10:59:27 -07:00
fjy 6e9bc9acab [maven-release-plugin] prepare release druid-0.6.66 2014-03-14 10:59:23 -07:00
fjy b4f1591260 clean up examples, finish paper 2014-03-13 18:52:08 -07:00
fjy a6fc82e267 Merge pull request #428 from metamx/fix-bytesboundedLinkedQueue 
fix concurrency issues in bytesboundedlinkedqueue
 2014-03-12 13:30:53 -06:00
nishantmonu51 f10ac73eef fix concurrency issues 2014-03-12 20:54:05 +05:30
Xavier Léauté b15b544429 make defaults more explicit 2014-03-11 12:39:08 -07:00
Xavier Léauté 44f9b9cec9 add readBufferSize option to memcached client config 2014-03-11 10:37:23 -07:00
Xavier Léauté 8baac724c3 add comments 2014-03-11 09:59:05 -07:00
Xavier Léauté b5d9876b77 allow disabling of memcached op-queue limit, default to disabled 2014-03-11 09:56:45 -07:00
fjy 34957ee471 [maven-release-plugin] prepare for next development iteration 2014-03-10 15:05:48 -07:00
fjy 35297572ed [maven-release-plugin] prepare release druid-0.6.65 2014-03-10 15:05:43 -07:00
fjy 369156fe80 [maven-release-plugin] prepare for next development iteration 2014-03-10 13:26:38 -07:00
fjy ba3806fcc2 [maven-release-plugin] prepare release druid-0.6.64 2014-03-10 13:26:34 -07:00
fjy 3ef75031c3 Merge pull request #423 from tucksaun/fix-kill-task-local-storage 
Adds LocalDataSegmentKiller to allow KillTask for local storage
 2014-03-07 13:45:39 -07:00
fjy 228cfa95bd Merge pull request #371 from N3TWORK/subquery 
Subquery functionality for Group By queries
 2014-03-07 13:41:56 -07:00
Tugdual Saunier 7dbcc74510 Adds LocalDataSegmentKiller to allow KillTask for local storage 2014-03-07 12:30:00 +00:00
Yuval Oren 5601c51ae6 finalize variables and optimize imports 2014-03-06 15:03:43 -08:00
Yuval Oren 4b63645802 Merge branch 'master' into subquery 
Conflicts:
	processing/src/main/java/io/druid/query/BaseQuery.java
	processing/src/main/java/io/druid/query/groupby/GroupByQueryQueryToolChest.java
	processing/src/test/java/io/druid/query/QueryRunnerTestHelper.java
	processing/src/test/java/io/druid/query/topn/TopNQueryRunnerTest.java
 2014-03-06 13:33:59 -08:00
fjy 00c5a708a2 [maven-release-plugin] prepare for next development iteration 2014-03-06 12:55:11 -08:00
fjy 9599832c58 [maven-release-plugin] prepare release druid-0.6.63 2014-03-06 12:55:06 -08:00
fjy 14a5149419 minor javascript problem 2014-03-06 12:43:28 -08:00
fjy e27b2fa7cb Merge branch 'master' of github.com:metamx/druid 2014-03-06 11:57:14 -08:00
fjy 1e9e61f786 fix some broken coordinator endpoints 2014-03-06 11:57:08 -08:00
fjy 1745aa744b Merge pull request #417 from metamx/fix-caching-bug 
Fix caching bug and add CachingClusteredClient tests
 2014-03-06 11:41:51 -07:00
Himadri Singh 625c78aae5 comments 2014-03-06 11:06:38 +05:30
Himadri Singh dc8ae1d20e revert 2014-03-06 10:46:48 +05:30
Himadri Singh d773a6ca24 One CostBalancerStrategy 2014-03-06 10:35:12 +05:30
Xavier Léauté 9fc5cca663 add disable populate / use cache tests 2014-03-05 14:07:15 -08:00
Xavier Léauté fffb58f6e8 add CachingClusteredClient tests 2014-03-05 14:07:15 -08:00
Xavier Léauté 427014d0a0 cosmetics 2014-03-05 14:07:15 -08:00
Xavier Léauté 5b4c04510f fix populateCache flag not working 2014-03-05 14:07:15 -08:00
Gian Merlino 70db460f97 Blocking Executors and maxPendingPersists, oh my! 
- Execs.newBlockingSingleThreaded can now accept capacity = 0.
- Changed default maxPendingPersists from 2 to 0.
- Fixed serde of maxPendingPersists in RealtimeIndexTasks.
 2014-03-05 10:55:12 -08:00
fjy 5db00afb37 clean up and default values 2014-03-04 14:38:27 -08:00
fjy c4c4d80336 make local testing pass 2014-03-03 14:52:43 -08:00
fjy 46b9ac78e7 Merge branch 'master' into new-schema 
Conflicts:
	indexing-hadoop/src/test/java/io/druid/indexer/HadoopDruidIndexerConfigTest.java
	pom.xml
	publications/whitepaper/druid.pdf
	publications/whitepaper/druid.tex
 2014-03-03 14:48:15 -08:00
nishantmonu51 40aa6ecaef fix npe queryID 2014-03-01 04:32:27 +05:30
nishantmonu51 e54949ca98 make queryIDProvider a singleton 2014-02-28 12:19:07 +05:30
fjy bf2ddda897 unit tests passing after more refactoring 2014-02-27 15:21:09 -08:00
fjy 37a79dd4cb [maven-release-plugin] prepare for next development iteration 2014-02-27 11:52:40 -08:00
fjy 8cdd0e3d53 [maven-release-plugin] prepare release druid-0.6.62 2014-02-27 11:52:35 -08:00
fjy bddf7b2908 fix naming problems 2014-02-27 11:50:51 -08:00
fjy 9502212b12 Merge pull request #403 from metamx/Query_id-for-metrics 
add queryID to query context and request_logs
 2014-02-27 12:44:05 -07:00
nishantmonu51 0701b1534d review comments queryID changes, add wait time for realtime node queries 2014-02-27 14:39:25 +05:30
fjy d57974d58b Merge pull request #407 from metamx/restore-task 
Restore task
 2014-02-26 19:18:58 -07:00
fjy 3d850aa260 Merge pull request #400 from tucksaun/feat-postgresql-support 
Improving PostgreSQL support
 2014-02-26 09:57:50 -07:00
Xavier Léauté 2f61035585 add restore task 2014-02-25 13:41:40 -08:00
nishantmonu51 b480d8f543 review comments 2014-02-25 03:09:44 +05:30
fjy 246ada63c5 fix interval load rule 2014-02-24 12:55:20 -08:00
nishantmonu51 373501a06d add queryID to query context and request_logs 2014-02-24 16:11:33 +05:30
fjy 7b0b90a860 Merge branch 'master' of github.com:metamx/druid into new-schema 2014-02-20 16:12:31 -08:00
fjy 5d2367f0fd unit tests pass at this point 2014-02-20 15:52:12 -08:00
fjy ef6208d192 Merge pull request #390 from metamx/bard-oome-fix 
APP-2782 Bard oome fix
 2014-02-19 19:52:56 -07:00
fjy 20cac8c506 not compiling yet but close 2014-02-19 15:54:27 -08:00
Himadri Singh a049188d23 minor changes from review 2014-02-19 09:13:47 +05:30
fjy 4b7c76762d unit tests passingn at this point, finished rt port maybe 2014-02-18 15:14:38 -08:00
Tugdual Saunier 4b67dbff5f Optimize DbSegmentPublisher.publishSegment 2014-02-17 18:11:15 +00:00
Tugdual Saunier 4dce007577 Use DbConnector.isPostgreSQL everywhere we used getDatabaseProductName before 2014-02-17 18:11:15 +00:00
Himadri Singh 5d729570c1 millis converted. 2014-02-17 15:00:58 +05:30
Himadri Singh 9b6fe2d003 Removed CostBalancerStrategy, made default = 1 thread 2014-02-17 14:57:05 +05:30
Himadri Singh bec264bdf7 Dynamic Config 2014-02-17 14:25:40 +05:30
fjy c57cf6ab4d [maven-release-plugin] prepare for next development iteration 2014-02-14 15:24:15 -08:00
fjy 44755cc91c [maven-release-plugin] prepare release druid-0.6.61 2014-02-14 15:24:11 -08:00
fjy f5affb6b5a [maven-release-plugin] prepare for next development iteration 2014-02-14 15:09:30 -08:00
fjy 189376f495 [maven-release-plugin] prepare release druid-0.6.60 2014-02-14 15:09:26 -08:00
fjy ef648b85f5 fix broken priority queries 2014-02-14 15:05:30 -08:00
fjy 3979eb270c Revert "Revert "Merge branch 'determine-partitions-improvements'"" 
This reverts commit 189b3e2b9b.
 2014-02-14 12:58:56 -08:00
fjy a8c4362d72 rejiggering druid api 2014-02-14 12:57:52 -08:00
fjy 189b3e2b9b Revert "Merge branch 'determine-partitions-improvements'" 
This reverts commit 7ad228ceb5, reversing
changes made to 9c55e2b779.
 2014-02-14 12:47:34 -08:00
nishantmonu51 78eddc50ee add checks for elements larger than capacity and account for the size of element being added 2014-02-15 00:12:21 +05:30
Himadri Singh 5af414c93c configurable thread count 2014-02-14 13:09:24 +05:30
Xavier Léauté 4b902aed23 fix typo 2014-02-13 23:25:11 -08:00
Himadri Singh 7dae293b5f fixes to comments 2014-02-14 12:42:46 +05:30
Himadri Singh 6e0590f97b Test udpate 2014-02-13 19:10:08 +05:30
Himadri Singh c2604657ed Extracted common methods 2014-02-13 19:04:54 +05:30
Himadri Singh a8d8d1ea06 Costbalancer Multithread 2014-02-13 18:58:45 +05:30
fjy 82fd35726f [maven-release-plugin] prepare for next development iteration 2014-02-12 20:03:00 -08:00
fjy cc1b91636f [maven-release-plugin] prepare release druid-0.6.59 2014-02-12 20:02:55 -08:00
fjy a986166b9c prepare for next release 2014-02-12 20:01:05 -08:00
fjy 60e950fad8 fix backwards compat issue with master 2014-02-12 20:00:43 -08:00
nishantmonu51 7ad228ceb5 Merge branch 'determine-partitions-improvements' 
Conflicts:
	pom.xml
 2014-02-12 10:51:26 +05:30
Hagen Rother b4eea282b6 consider errors in reading from firehose as unparsable 2014-02-11 16:00:13 +01:00
nishantmonu51 f8d8290a1e add newline at the end of file 2014-02-10 15:44:28 +05:30
nishantmonu51 ec2a32acfc review comments 2014-02-10 12:53:36 +05:30
Jae Hyeon Bae dca965a35a curator 2.4.0 and Announcer logging lines are added regarding infos of reinstating 2014-02-09 22:26:18 -08:00
fjy b7a78680b2 [maven-release-plugin] prepare for next development iteration 2014-02-07 13:06:23 -08:00
fjy cc6886646e [maven-release-plugin] prepare release druid-0.6.58 2014-02-07 13:06:18 -08:00
fjy 555f434fa6 [maven-release-plugin] prepare for next development iteration 2014-02-07 11:56:41 -08:00
fjy 371f2bb941 [maven-release-plugin] prepare release druid-0.6.57 2014-02-07 11:56:34 -08:00
nishantmonu51 dc097081a6 remove writeOpQueueFactory 
for writeQueueFactory the buffer of the element is nulled by memcache
before remove is called, thus we are not able to determine the size of
element while removing, We can potentially work around this by adding a
wrapper to keep track of size but that will have its extra overhead,
Also verified from the heap dump that the growing queue was the queue
for opQueue.
 2014-02-07 20:00:25 +05:30
nishantmonu51 db93e45bef minor fix 2014-02-07 17:52:52 +05:30
nishantmonu51 61d99bb8f2 change byte size config to long 2014-02-07 16:56:15 +05:30
nishantmonu51 d27274463b add separate putLock and takeLocks + test 2014-02-07 16:52:07 +05:30
Yuval Oren bd11309593 Merge branch 'master' into subquery 2014-02-06 15:36:29 -08:00
Xavier Léauté df0d81baa8 fix local cache byte counting on object removal 2014-02-06 14:28:14 -08:00
fjy 0f6af72ea4 Merge branch 'master' into new-schema 2014-02-06 12:46:13 -08:00
fjy af48273369 fix bug with dynamic configs in coordinator not working 2014-02-06 11:19:05 -08:00
nishantmonu51 7bbb6ba063 support for bounding operation queue by the byte size 2014-02-06 23:33:32 +05:30
nishantmonu51 aee574c772 review comments 2014-02-05 17:05:06 +05:30
fjy 056e82a516 [maven-release-plugin] prepare for next development iteration 2014-02-04 15:23:34 -08:00
fjy 0ea45b590f [maven-release-plugin] prepare release druid-0.6.56 2014-02-04 15:23:30 -08:00
fjy badc7b2e3f fix bug with load throttling and more tests 2014-02-04 15:21:45 -08:00
nishantmonu51 bacc72415f correct locking and partitionsSpec 2014-02-05 03:17:47 +05:30
fjy fc4cd79125 [maven-release-plugin] prepare for next development iteration 2014-02-03 16:47:50 -08:00
fjy 4d52e20fe1 [maven-release-plugin] prepare release druid-0.6.55 2014-02-03 16:47:46 -08:00
fjy 8b398533cb fix more bugs with determining what is assignable and what is not 2014-02-03 16:45:59 -08:00
fjy 46571ddf69 [maven-release-plugin] prepare for next development iteration 2014-02-03 16:35:02 -08:00
fjy cebb46a259 [maven-release-plugin] prepare release druid-0.6.54 2014-02-03 16:34:57 -08:00
fjy f4b6165307 fix bugs with finding indexing workers to assign 2014-02-03 16:33:06 -08:00
fjy d4eba49722 remove debug printing 2014-02-03 16:16:46 -08:00
Yuval Oren 689191c5ad Merge branch 'master' into subquery 2014-02-03 14:52:50 -08:00
fjy 14d0e54327 first commit 2014-02-03 14:15:03 -08:00
fjy 21d518e15c [maven-release-plugin] prepare for next development iteration 2014-01-31 16:32:25 -08:00
fjy 84f434d9f4 [maven-release-plugin] prepare release druid-0.6.53 2014-01-31 16:32:21 -08:00
fjy 019be5c3b0 update jquery 2014-01-31 12:37:37 -08:00
nishantmonu51 82b748ad43 review comments 2014-01-31 20:19:33 +05:30
nishantmonu51 7ca87d59df Determine partitions using cardinality 2014-01-31 00:49:11 +05:30
Yuval Oren e9cf935518 Fixed realtime querying after subquery changes 2014-01-27 18:58:25 -08:00
Yuval Oren 1c0b818cb2 Merge branch 'master' into subquery 2014-01-27 14:57:14 -08:00
fjy 7a116bf784 backwards compatibility fix for rules serde 2014-01-27 20:47:11 +08:00
nishantmonu51 7800dac7f7 backwards compatibility fix 2014-01-26 20:34:43 +08:00
fjy 158a725985 fix backwards compat issues 2014-01-26 20:07:09 +08:00
fjy 8ab0636f5c fix coord resource 2014-01-26 20:04:04 +08:00
Yuval Oren c99e468ccd Merge branch 'master' into subquery 2014-01-24 16:48:35 -08:00
fjy 0c789412bb add a workaround for jackson bug where jacksoninject fails when a null value is passed through json creator annotated constructor 2014-01-25 07:07:27 +08:00
Yuval Oren f2c1f798b9 Fix subquery merge issues 2014-01-24 15:03:48 -08:00
Yuval Oren cd719eab3c Merge branch 'master' into subquery 2014-01-24 14:42:41 -08:00
fjy facc9c51d3 fix max pending persists 2014-01-25 05:34:41 +08:00
fjy f3e1cbc423 fix according to code review 2014-01-21 16:26:28 -08:00
fjy d3bc077ecd Merge branch 'master' into az 2014-01-21 10:47:57 -08:00
fjy 2ff86984da fix broken ut 2014-01-21 10:47:45 -08:00
fjy 908e9e377c Merge branch 'master' into az 
Conflicts:
	server/src/main/java/io/druid/server/coordinator/DruidCoordinator.java
 2014-01-21 10:41:40 -08:00
fjy 1057e2e165 Merge pull request #319 from metamx/select 
A Select Query for Druid
 2014-01-20 15:31:25 -08:00
fjy 3ff4cc2371 remove some accidentally committed code 2014-01-20 15:16:17 -08:00
fjy e2ea2ec7fd Merge branch 'master' into az 
Conflicts:
	server/src/main/java/io/druid/server/coordinator/DruidCoordinator.java
	server/src/main/java/io/druid/server/http/CoordinatorResource.java
	server/src/test/java/io/druid/client/DirectDruidClientTest.java
 2014-01-20 15:10:13 -08:00
fjy c93f896092 Merge branch 'master' into select 
Conflicts:
	server/src/main/java/io/druid/segment/realtime/plumber/RealtimePlumberSchool.java
 2014-01-20 13:26:51 -08:00
fjy 215584891e Merge branch 'master' into moar-endpoints 2014-01-20 13:06:45 -08:00
fjy 6404967994 fixes 2014-01-20 13:05:05 -08:00
fjy c1f0027a36 Merge pull request #361 from metamx/worker-oome-fix 
Worker oome fix
 2014-01-20 11:34:45 -08:00
fjy 3cba0c8ff2 more endpoints for getting info out of druid 2014-01-17 17:52:27 -08:00
fjy 57e022f446 [maven-release-plugin] prepare for next development iteration 2014-01-17 15:53:54 -08:00
fjy 6540b2a58e [maven-release-plugin] prepare release druid-0.6.52 2014-01-17 15:53:50 -08:00
nishantmonu51 3fb72aff93 rename maxPendingPersistBatches to maxPendingPersists 2014-01-17 12:59:21 +05:30
nishantmonu51 3db33c3268 review comments 2014-01-17 12:51:10 +05:30
nishantmonu51 fb819abd6f make maxPendingPersistPeriod configurable 2014-01-17 11:01:55 +05:30
nishantmonu51 6f5e1afbff add blocking mechanism after 2 pending persist batches 2014-01-17 03:01:04 +05:30