Gian Merlino
8388cbf69d
NumberedShardSpec
...
Each shard has a number, and there are a fixed number of shards that will
form a complete set.
2013-08-20 16:45:12 -07:00
fjy
9c145f5ce3
basic unit tets for realtime functinality
2013-08-19 15:00:10 -07:00
fjy
5f292143e0
disable merging segments with linear shard spec
2013-08-06 16:17:49 -07:00
cheddar
d66af7625c
1) Eliminate the need for SingleSegmentLoader
...
2) Setup the configuration glue for ServerInventoryViews and DataSegmentAnnouncer
3) Make processes run and work again!
2013-08-02 17:05:01 -07:00
cheddar
9e78bb38f5
Merge branch 'master' into guice
...
Conflicts:
client/src/main/java/com/metamx/druid/QueryableNode.java
client/src/main/java/com/metamx/druid/client/ServerInventoryView.java
client/src/main/java/com/metamx/druid/coordination/SingleDataSegmentAnnouncer.java
client/src/main/java/com/metamx/druid/initialization/CuratorDiscoveryConfig.java
client/src/main/java/com/metamx/druid/query/MetricsEmittingExecutorService.java
indexing-hadoop/src/test/java/com/metamx/druid/indexer/HadoopDruidIndexerConfigTest.java
indexing-service/src/main/java/com/metamx/druid/indexing/common/TaskToolbox.java
indexing-service/src/main/java/com/metamx/druid/indexing/coordinator/http/IndexerCoordinatorNode.java
indexing-service/src/main/java/com/metamx/druid/indexing/worker/executor/ExecutorNode.java
indexing-service/src/main/java/com/metamx/druid/indexing/worker/http/WorkerNode.java
pom.xml
server/src/main/java/com/metamx/druid/coordination/ServerManager.java
server/src/main/java/com/metamx/druid/coordination/ZkCoordinator.java
server/src/main/java/com/metamx/druid/db/DatabaseRuleManager.java
server/src/main/java/com/metamx/druid/db/DatabaseSegmentManager.java
server/src/main/java/com/metamx/druid/http/ComputeNode.java
server/src/main/java/com/metamx/druid/http/MasterMain.java
server/src/main/java/com/metamx/druid/loading/SegmentLoaderConfig.java
server/src/main/java/com/metamx/druid/loading/SingleSegmentLoader.java
server/src/main/java/com/metamx/druid/master/DruidMaster.java
2013-08-01 16:42:47 -07:00
cheddar
019bb5d453
1) Another whole bunch of changes to annotate things and create Modules and bind stuff. But OMFG, the compute node actually appears to be working!
...
2) The compute node works with Guice
3) The compute node fires up with Guice and appears to work
4) Did I mention that the compute node, now called historical node, fires up with Guice and appears to work?
2013-08-01 15:28:08 -07:00
cheddar
f4fc8b2f6e
1) A whole boondoggle of changes to Guicify the instantiation of things for the Historical nodes
...
2) Add GuiceInjectableValues that supports @JacksonInject resolution via Guice
3) Refactor RequestLogger stuff and setup polymorphic deserialization method of creating objects
2013-07-31 18:36:47 -07:00
cheddar
9de2e5b096
1) Adjust JsonConfigurator to be able to attach the proper property path if it is renamed via a @JsonProperty annotation
...
2) JsonConfigurator now requires that fields be annotated with @JsonProperty. It will fail fast if they aren't.
2013-07-31 14:55:34 -07:00
cheddar
97fb971f84
1) Start the journey of making the historical nodes work with Guice. Doesn't work yet, but at least it builds.
2013-07-30 11:58:05 -07:00
cheddar
6b9963b472
1) Move the @Json and @Smile annotations to com.metamx.druid.guice.annotations
...
2) Changed ServiceAnnouncer to take a DruidNode object
3) Remove ServiceInstanceFactory interface and implementations
4) Add registrations to DiscoveryModule so that you can register nodes that should be announced on startup
5) Make the set of default Monitors configurable
2013-07-26 14:03:51 -07:00
cheddar
02ffd805c8
1) Move DbConnector into its own module
...
2) Move JacksonConfig stuff into its own module
3) Fix LogEmitterModule to inject properly with a Supplier<>
4) Set Guice to require explicit bindings, to protect from weirdness like was initially experienced with LoggingEmitterConfig
5) Master fires up and appears to all work with Guice! Whoot!
2013-07-23 14:55:36 -07:00
cheddar
85a35201b7
1) The Master compiles and runs with Guice bindings!!!!
...
2) The service discovery stuff really needs to be reworked. It's unhappy now.
2013-07-19 16:29:54 -07:00
cheddar
b83bc14784
Merge pull request #173 from metamx/dhruv
...
Add new demo firehose that is lower friction than twitter
2013-07-09 17:39:51 -07:00
cheddar
b42c5743c9
Merge pull request #177 from nebrera/master
...
Postgresql adaptation
2013-07-05 16:42:57 -07:00
fjy
fde874ea56
fix according to code review
2013-07-02 16:11:12 -07:00
Pablo Nebrera
e9ce6b596c
PostgresSQL integration with druid
2013-06-28 12:49:24 +02:00
Dhruv Parthasarathy
c15f18c343
removed NoopRunnable
2013-06-27 19:03:25 -07:00
fjy
15a4dae2b1
bunch of issue fixes
2013-06-26 10:45:54 -07:00
Dhruv Parthasarathy
4e4a0a7953
removed DS_Store files
2013-06-25 14:58:12 -07:00
cheddar
149c2e3560
1) A bunch more changes to make things actually run. Not quite done, but close!
2013-06-20 17:19:51 -07:00
Dhruv Parthasarathy
748695bf97
trying to recover my files on intellij
2013-06-20 14:59:52 -07:00
cheddar
11ea15fc1a
1) Introduce Jetty 8
...
2) Fix up modules based on exceptions at startup for MasterMain
2013-06-17 10:53:50 -07:00
cheddar
2f56c24259
1) Inject IndexingServiceClient
...
2) Switch all the DBI references to IDBI
2013-06-07 17:37:33 -07:00
cheddar
f68df7ab69
1) Make tests work and continue trying to make the DruidMaster start up with just Guice
2013-06-07 12:01:46 -07:00
cheddar
9df458a065
1) Initial commit of conversion to using Guice modules for bootstrapping. Things don't actually completely work yet.
2013-06-06 15:43:15 -07:00
fjy
bd9e6fecc1
fix day 1 issue with VIT
2013-05-28 14:26:49 -07:00
Gian Merlino
343af872b5
DbConnectorConfig: Serialization is hard
2013-05-14 14:39:29 -07:00
fjy
43d3c53806
fix order by double sum agg
2013-05-08 10:14:40 -07:00
cheddar
3c04f1635c
1) Fix bug with same name on multiple JSON properties
2013-05-02 18:00:50 -05:00
cheddar
60b279b0d3
1) Add support for storing segments in HDFS
2013-04-30 12:47:43 -05:00
cheddar
43d630c098
1) Replace InventoryManagers with Curator-based Inventory Managers
...
2) Replace ZkSegmentAnnouncer with CuratorSegmentAnnouncer
3) Adjust LoadQueuePeons to operate using Curator
4) Remove ZkPhoneBook
Things left to do:
1) Unit tests
2) Remove references to zkclient library
3) Remove references to PhoneBook interface
2013-04-26 19:19:23 -05:00
Gian Merlino
dbfa045df0
DbConnector: SQL and validation query tweaks
2013-04-19 14:51:22 -07:00
Gian Merlino
1a6594524f
Merger: Tweaks to DB tables. Create tables automatically.
2013-04-19 14:07:27 -07:00
Gian Merlino
1dfe133554
DbConnector: Optional validation query (default off for now)
2013-04-19 14:07:27 -07:00
xvrl
66a52ed282
javascript aggregator now uses column selector
2013-04-16 09:33:50 -07:00
xvrl
b66f69def6
specify javascript aggregator functions individually to support getCombiningFactory()
2013-04-16 09:33:50 -07:00
xvrl
c83631928c
object column selectors
2013-04-16 09:33:50 -07:00
xvrl
0c68bd1b1d
rename MetricSelectorFactory to ColumnSelectorFactory
2013-04-16 09:33:49 -07:00
Eric Tschetter
55648c47a7
1) Adjust the GroupByQuery to also be able to merge results on the local node. Fixes #116
...
2) Make the GroupByQuery operate in a multi-threaded fashion by default (this is configurable via druid.query.groupBy.singleThreaded). Fixes #96
3) Fix up some post aggregation computation stuff. I believe #72 is fixed
4) Fix case sensitivity issue with post aggregations on GroupBy queries
2013-04-09 19:13:08 -07:00
René Scheibe
6c27cd2e8e
cleanup - removed unused imports
2013-04-07 23:31:22 +02:00
René Scheibe
a6dc29cf85
cleanup - removed extra empty lines
...
- there should not be any adjacent empty lines
2013-04-07 14:32:09 +02:00
xvrl
8eec41f934
squigglies ftw
2013-03-20 11:42:17 -07:00
xvrl
c68bd66945
add close method to aggregators
2013-03-19 16:03:48 -07:00
Eric Tschetter
39449e6a3e
Merge branch 'master' of github.com:metamx/druid
2013-03-14 16:45:54 -05:00
Gian Merlino
df8e4d4061
Merge branch 'master' into realtime-index-task
2013-03-13 22:43:01 -07:00
Eric Tschetter
1e0f2c2d92
1) Make log a bit more descriptive
2013-03-13 19:26:22 -05:00
Eric Tschetter
fa66e1d2cc
1) SQL is hard
2013-03-13 16:29:34 -05:00
Gian Merlino
3fa46988f5
Realtime:
...
- MetadataUpdater now built from SegmentAnnouncer, SegmentPublisher instances.
- Sinks can take a version instead of always using interval.start. The realtime
plumber selects a version using a VersioningPolicy.
- Plumbers gained a startJob method.
- Realtime plumbers gained an implementation for finishJob.
2013-03-11 11:14:51 -07:00
Nelson Ray
a470f3fa6a
change name of druid.indexer.configTable to druid.database.configTable to be consistent
2013-03-08 10:35:13 -08:00
Eric Tschetter
f70f71243d
1) Stop polling in ConfigManager when stop is called
...
2) Remove WorkSetupManager in favor of just using ConfigManager
2013-03-07 17:45:57 -06:00
