fjy
1fb6107a37
fix the case where RTR does not clean up a completed task on startup
2013-08-15 13:09:02 -07:00
cheddar
0c5a906a1b
Merge branch 'master' of github.com:metamx/druid
2013-08-14 17:34:22 -07:00
cheddar
ba5ed4c9d4
1) Fix bug with NPE thrown when requesting a dimension on a GroupBy query that is not dictionary encoded
2013-08-14 17:34:11 -07:00
Gian Merlino
a0fcd02b3c
[maven-release-plugin] prepare for next development iteration
2013-08-14 17:03:40 -07:00
Gian Merlino
b6c445c726
[maven-release-plugin] prepare release druid-0.5.40
2013-08-14 17:03:28 -07:00
fjy
36d02ab943
[maven-release-plugin] prepare for next development iteration
2013-08-14 14:05:49 -07:00
fjy
8c841e90a4
[maven-release-plugin] prepare release druid-0.5.39
2013-08-14 14:05:39 -07:00
fjy
fc1018bc3f
revert removal of master loadstatus
2013-08-14 14:02:47 -07:00
fjy
761a411b16
[maven-release-plugin] prepare for next development iteration
2013-08-14 10:13:50 -07:00
fjy
4dd727d974
[maven-release-plugin] prepare release druid-0.5.38
2013-08-14 10:13:34 -07:00
cheddar
c0624d9591
Merge branch 'master' of github.com:metamx/druid
2013-08-14 10:04:04 -07:00
cheddar
a7ef5b8b70
1) Fix bug with SingleSegmentLoader.StorageLocation keeping track of its storage size incorrectly. Add unit test ftw.
2013-08-14 10:03:47 -07:00
cheddar
7ebe053ac1
Fix bug with segment loader counting thingie
2013-08-14 09:37:22 -07:00
cheddar
4791d0466d
Merge pull request #198 from metamx/loadBalancer
...
Improve runtime of segment distribution algorithm
2013-08-13 18:47:43 -07:00
cheddar
c2305a82f9
Merge pull request #209 from zanox/kafka-protobuf
...
Kafka protobuf
2013-08-13 18:38:27 -07:00
fjy
9870cab855
[maven-release-plugin] prepare for next development iteration
2013-08-13 17:21:56 -07:00
fjy
e4c998cfef
[maven-release-plugin] prepare release druid-0.5.37
2013-08-13 17:21:46 -07:00
fjy
85ee8bb267
port realtime to guice
2013-08-13 17:08:45 -07:00
cheddar
145e08682c
1) Add check in ServerManagerTest to make sure that the Segment has been "checked out" before the factory ever sees it.
...
2) Some code readability changes to ReferenceCountingSegment
2013-08-13 17:01:24 -07:00
cheddar
a5855fb749
1) Fix ServerManager to make sure that it "checks out" the Segment before it starts processing
2013-08-13 14:51:14 -07:00
cheddar
28c7e78a91
1) Fix ReferenceCountingSegmentTest to actually work again
2013-08-13 14:28:44 -07:00
fjy
41347c82bb
fix broken server manager tests
2013-08-13 12:07:45 -07:00
fjy
070d822345
fix broken UT
2013-08-13 12:01:24 -07:00
fjy
08318af7f7
Merge branch 'master' of github.com:metamx/druid
2013-08-13 11:54:32 -07:00
fjy
13e522c8a7
update the server manager unit tests to check for the case where a segment may be accessed in toYield calls before an increment occurs
2013-08-13 11:53:41 -07:00
Gian Merlino
246bd0fbaa
[maven-release-plugin] prepare for next development iteration
2013-08-13 07:27:24 -07:00
Gian Merlino
a2e9441693
[maven-release-plugin] prepare release druid-0.5.36
2013-08-13 07:27:18 -07:00
fjy
d4fc069e01
[maven-release-plugin] prepare for next development iteration
2013-08-12 18:58:14 -07:00
fjy
dd8c96c734
[maven-release-plugin] prepare release druid-0.5.35
2013-08-12 18:58:06 -07:00
cheddar
bb18b162ab
1) Include new version of java-util to fix issue with resources not getting closed when an exception is thrown sometimes
...
2) Whitespace changes to GroupByQueryEngine
2013-08-12 17:57:30 -07:00
Gian Merlino
8d7a4f4493
Retries for S3TaskLogs, S3DataSegmentPusher
2013-08-12 14:27:34 -07:00
fjy
1f4e0ea40c
[maven-release-plugin] prepare for next development iteration
2013-08-12 13:21:29 -07:00
fjy
1c2ad4f08c
[maven-release-plugin] prepare release druid-0.5.34
2013-08-12 13:21:21 -07:00
fjy
a39eb65edb
change summary of segment failures to one per line
2013-08-12 13:15:35 -07:00
fjy
dd20950f8a
adding missing continue
2013-08-12 13:07:29 -07:00
fjy
2ec2957207
clean up the error reporting code according to code review
2013-08-12 13:04:48 -07:00
fjy
0c360c05c2
better handling of exceptions during startup
2013-08-12 12:56:59 -07:00
fjy
2f728f3478
fix zk coord to not fail during startup exceptions
2013-08-12 11:33:42 -07:00
Jan Rudert
3f32ef7bbc
Merge branch 'master' of github.com:metamx/druid into kafka-protobuf
2013-08-12 17:42:40 +02:00
jan
55267ca0e4
removed @author tags
2013-08-11 13:44:13 +02:00
Dhruv Parthasarathy
01db89ac6e
fixed issue with web console. Cleaned up code
2013-08-09 00:33:40 -07:00
fjy
68a3f1ab79
[maven-release-plugin] prepare for next development iteration
2013-08-08 22:15:04 -07:00
fjy
ce5679554d
[maven-release-plugin] prepare release druid-0.5.33
2013-08-08 22:14:55 -07:00
fjy
a190269faa
fix druid master segments getting stuck bug
2013-08-08 22:06:41 -07:00
Dhruv Parthasarathy
fc5e15f72b
merged changes with master
2013-08-08 18:11:33 -07:00
Dhruv Parthasarathy
abe347efd3
merged with master
2013-08-08 17:21:57 -07:00
Dhruv Parthasarathy
764863d6f5
made volatile. fixed parens
2013-08-08 16:40:10 -07:00
Dhruv Parthasarathy
8a8ea5d028
removed test annotation from profiler
2013-08-08 16:38:24 -07:00
Dhruv Parthasarathy
01b35ec819
all tests passed. Ready for merge
2013-08-08 16:23:26 -07:00
Dhruv Parthasarathy
eed9e1b373
merged with master
2013-08-08 16:14:06 -07:00
Dhruv Parthasarathy
0b24ea710c
fixed paths
2013-08-08 16:10:31 -07:00
Dhruv Parthasarathy
3a298681e4
fixed formatting
2013-08-07 10:59:54 -07:00
Dhruv Parthasarathy
c4f0e4d96d
fixed with Erics feedback
2013-08-07 10:53:37 -07:00
fjy
ddc2e87c4c
[maven-release-plugin] prepare for next development iteration
2013-08-06 21:21:28 -07:00
fjy
ffbcd18cdc
[maven-release-plugin] prepare release druid-0.5.32
2013-08-06 21:21:18 -07:00
fjy
4617d37e28
[maven-release-plugin] prepare for next development iteration
2013-08-06 21:08:02 -07:00
fjy
53b248dc28
[maven-release-plugin] prepare release druid-0.5.31
2013-08-06 21:07:52 -07:00
Gian Merlino
99a3de1597
[maven-release-plugin] prepare for next development iteration
2013-08-06 17:41:58 -07:00
Gian Merlino
c0ccfd66ea
[maven-release-plugin] prepare release druid-0.5.30
2013-08-06 17:41:51 -07:00
fjy
930b089f7f
[maven-release-plugin] prepare for next development iteration
2013-08-06 16:20:37 -07:00
fjy
dd5f5ae49b
[maven-release-plugin] prepare release druid-0.5.29
2013-08-06 16:20:29 -07:00
fjy
5f292143e0
disable merging segments with linear shard spec
2013-08-06 16:17:49 -07:00
Dhruv Parthasarathy
f31ee552d0
fixed with fj comments
2013-08-06 15:03:07 -07:00
Dhruv Parthasarathy
0d5b222f8f
removed SlickGrid :(
2013-08-06 14:30:35 -07:00
Dhruv Parthasarathy
6124ecd9cb
fied some tests
2013-08-06 14:26:08 -07:00
cheddar
eee1efdcb5
Merge branch 'master' into guice
...
Conflicts:
client/src/main/java/com/metamx/druid/client/DruidServerConfig.java
indexing-service/src/main/java/com/metamx/druid/indexing/common/index/ChatHandlerProvider.java
indexing-service/src/main/java/com/metamx/druid/indexing/coordinator/TaskMasterLifecycle.java
indexing-service/src/main/java/com/metamx/druid/indexing/worker/executor/ExecutorNode.java
indexing-service/src/test/java/com/metamx/druid/indexing/coordinator/TaskLifecycleTest.java
2013-08-06 13:33:31 -07:00
cheddar
51f648ec11
1) Rename QueryToolChestModule back
2013-08-06 12:05:56 -07:00
cheddar
69f7831d82
1) Rename QueryToolChestModule because there was a case sensitivity issue, grrr
2013-08-06 12:04:04 -07:00
cheddar
9f71d42314
1) Broker works with Guice
...
2) Extract ServerViewModule to handle various ServerView thingies
3) Extract QueryToolChestModule and QueryRunnerFactoryModule to reuse code for configuration of Query stuff
4) Extract QueryJettyServerInitializer to reuse between Historical and Broker nodes
5) Remove ClientMain, BrokerMain and BrokerNode
2013-08-06 12:01:52 -07:00
Dhruv Parthasarathy
ebba2d66a3
results good
2013-08-06 11:46:18 -07:00
Dhruv Parthasarathy
e40d5b55ef
testing speed for one run
2013-08-06 11:40:49 -07:00
Gian Merlino
ba847bff32
[maven-release-plugin] prepare for next development iteration
2013-08-05 19:58:40 -07:00
Gian Merlino
7101d9ad2e
[maven-release-plugin] prepare release druid-0.5.28
2013-08-05 19:58:34 -07:00
fjy
db695f49c2
[maven-release-plugin] prepare for next development iteration
2013-08-05 18:26:20 -07:00
fjy
c22e5b7ee0
[maven-release-plugin] prepare release druid-0.5.27
2013-08-05 18:26:10 -07:00
fjy
8ff0b53df4
[maven-release-plugin] prepare for next development iteration
2013-08-05 18:00:46 -07:00
fjy
1d3729906d
[maven-release-plugin] prepare release druid-0.5.26
2013-08-05 18:00:36 -07:00
fjy
90e082463b
[maven-release-plugin] prepare for next development iteration
2013-08-05 16:10:19 -07:00
fjy
eb276d34d7
[maven-release-plugin] prepare release druid-0.5.25
2013-08-05 16:10:11 -07:00
Dhruv Parthasarathy
575dfe3679
replication working too
2013-08-05 14:51:58 -07:00
fjy
a95d9c46e2
[maven-release-plugin] prepare for next development iteration
2013-08-05 14:47:35 -07:00
fjy
8e1f4d3256
[maven-release-plugin] prepare release druid-0.5.24
2013-08-05 14:47:26 -07:00
Dhruv Parthasarathy
1045aac4b8
finished profiling here
2013-08-05 13:53:40 -07:00
cheddar
d64bc2f762
1) Eliminate Old mains() that aren't needed anymore.
2013-08-05 13:33:43 -07:00
Dhruv Parthasarathy
540c4885d7
fixes to make profiler work
2013-08-05 12:36:43 -07:00
fjy
fbb1211cbc
[maven-release-plugin] prepare for next development iteration
2013-08-05 11:44:36 -07:00
fjy
22a90d36b7
[maven-release-plugin] prepare release druid-0.5.23
2013-08-05 11:44:28 -07:00
Jan Rudert
7195637a41
use same hadoop version as druid master (0.20.2)
2013-08-05 09:16:57 +02:00
Dhruv Parthasarathy
1c19fb4a02
changed number of replicants
2013-08-02 17:41:47 -07:00
cheddar
d66af7625c
1) Eliminate the need for SingleSegmentLoader
...
2) Setup the configuration glue for ServerInventoryViews and DataSegmentAnnouncer
3) Make processes run and work again!
2013-08-02 17:05:01 -07:00
cheddar
2361e0112a
Make it all compile again...
2013-08-02 10:14:46 -07:00
Jan Rudert
37ab5ef28b
Merge branch 'master' of github.com:metamx/druid into HEAD
2013-08-02 09:23:19 +02:00
Dhruv Parthasarathy
6f6a335a40
adding profiling for 55k servers
2013-08-01 23:38:44 -07:00
Dhruv Parthasarathy
9f17e8fc43
all working
2013-08-01 21:01:02 -07:00
Dhruv Parthasarathy
696b04020b
wrote regression test
2013-08-01 18:28:48 -07:00
fjy
584ccac833
move scanning of workers and tasks into RTR start, simplify bootstrap, make tests better
2013-08-01 17:50:05 -07:00
Dhruv Parthasarathy
6f28eac995
fixed problem of balancer ignoring home server
2013-08-01 17:28:32 -07:00
Dhruv Parthasarathy
cd3b62e123
fix to runtime params
2013-08-01 17:01:50 -07:00
cheddar
9e78bb38f5
Merge branch 'master' into guice
...
Conflicts:
client/src/main/java/com/metamx/druid/QueryableNode.java
client/src/main/java/com/metamx/druid/client/ServerInventoryView.java
client/src/main/java/com/metamx/druid/coordination/SingleDataSegmentAnnouncer.java
client/src/main/java/com/metamx/druid/initialization/CuratorDiscoveryConfig.java
client/src/main/java/com/metamx/druid/query/MetricsEmittingExecutorService.java
indexing-hadoop/src/test/java/com/metamx/druid/indexer/HadoopDruidIndexerConfigTest.java
indexing-service/src/main/java/com/metamx/druid/indexing/common/TaskToolbox.java
indexing-service/src/main/java/com/metamx/druid/indexing/coordinator/http/IndexerCoordinatorNode.java
indexing-service/src/main/java/com/metamx/druid/indexing/worker/executor/ExecutorNode.java
indexing-service/src/main/java/com/metamx/druid/indexing/worker/http/WorkerNode.java
pom.xml
server/src/main/java/com/metamx/druid/coordination/ServerManager.java
server/src/main/java/com/metamx/druid/coordination/ZkCoordinator.java
server/src/main/java/com/metamx/druid/db/DatabaseRuleManager.java
server/src/main/java/com/metamx/druid/db/DatabaseSegmentManager.java
server/src/main/java/com/metamx/druid/http/ComputeNode.java
server/src/main/java/com/metamx/druid/http/MasterMain.java
server/src/main/java/com/metamx/druid/loading/SegmentLoaderConfig.java
server/src/main/java/com/metamx/druid/loading/SingleSegmentLoader.java
server/src/main/java/com/metamx/druid/master/DruidMaster.java
2013-08-01 16:42:47 -07:00
cheddar
019bb5d453
1) Another whole bunch of changes to annotate things and create Modules and bind stuff. But OMFG, the compute node actually appears to be working!
...
2) The compute node works with Guice
3) The compute node fires up with Guice and appears to work
4) Did I mention that the compute node, now called historical node, fires up with Guice and appears to work?
2013-08-01 15:28:08 -07:00