Commit Graph

3415 Commits

Author SHA1 Message Date
Gian Merlino 16835a1f84 Master: Add segment limit to merge selection algo
If we attempt to merge too many segments at once, we risk creating an
oversized indexing task.
2012-11-19 14:46:45 -08:00
Paul Baclace b7d43a6622 doc/data_flow* diagrams added 2012-11-15 21:32:56 -08:00
Eric Tschetter aa073e4e73 1) Add verification of memory settings to initialization. (Fixes #21) 2012-11-14 15:37:11 -06:00
Fangjin Yang cf1c741f8a [maven-release-plugin] prepare for next development iteration 2012-11-13 15:10:12 -08:00
Fangjin Yang 06bd77fca7 [maven-release-plugin] prepare release druid-0.1.4 2012-11-13 15:10:00 -08:00
cheddar 06ed0e7448 Merge pull request #28 from metamx/fjy
Some modifications on how to register things in Druid
2012-11-13 15:02:14 -08:00
Fangjin Yang cd1a812fff construct registering nodes with lists 2012-11-13 15:00:55 -08:00
Fangjin Yang 0ef40171a8 nodes no longer inherit from interfaces but instead extend classes 2012-11-13 13:18:31 -08:00
Fangjin Yang 24564d73e1 register subtypes for reducer 2012-11-12 16:41:34 -08:00
Fangjin Yang 7eccd76e9a add missing headers 2012-11-12 16:34:48 -08:00
Fangjin Yang 0d697ed104 fix rename of this node 2012-11-12 16:17:51 -08:00
Fangjin Yang 57468d39ef reverting some of the last changes 2012-11-12 16:14:48 -08:00
Fangjin Yang c20dccd0f4 modifying the way registering serdes works to hopefully be a bit easier to use 2012-11-12 13:58:43 -08:00
cheddar c30f04e0d4 Merge pull request #27 from marshallpierce/master
Remove duplicate copies of servlet-api from dependency tree
2012-11-12 08:49:31 -08:00
Marshall Pierce 447dfc0cc6 Switch to using javax.servlet:servlet-api:2.5 instead of two different versions of jetty's servlet-api distribution 2012-11-09 17:31:03 -08:00
Fangjin Yang dd17992172 [maven-release-plugin] prepare for next development iteration 2012-11-09 15:50:24 -08:00
Fangjin Yang 47e71080db [maven-release-plugin] prepare release druid-0.1.3 2012-11-09 15:50:16 -08:00
Fangjin Yang e668660a9c fix strategy check in indexing coordinator 2012-11-09 15:48:26 -08:00
Fangjin Yang 5859599365 [maven-release-plugin] prepare for next development iteration 2012-11-09 13:41:04 -08:00
Fangjin Yang 56f2c15e21 [maven-release-plugin] prepare release druid-0.1.2 2012-11-09 13:40:57 -08:00
Fangjin Yang 2ef1136ab2 fix a bug where intervals were being returned as String instead of Interval objects by the compute nodes 2012-11-09 13:39:02 -08:00
Fangjin Yang 0b7a3f259a [maven-release-plugin] prepare for next development iteration 2012-11-09 10:10:32 -08:00
Fangjin Yang baba4e7b75 [maven-release-plugin] prepare release druid-0.1.1 2012-11-09 10:10:26 -08:00
Fangjin Yang 03e5d74087 [maven-release-plugin] prepare for next development iteration 2012-11-09 09:33:06 -08:00
Fangjin Yang 8aff8decad [maven-release-plugin] prepare release druid-0.1.0 2012-11-09 09:32:57 -08:00
Eric Tschetter 0a0e2a6cc1 1) Try to fix the dependency issues for running the HadoopDruidIndexer locally. 2012-11-08 17:06:02 -08:00
cheddar 81a33bcbb3 Merge pull request #26 from metamx/misc
Updates to druid indexer to be able to index complex metrics
2012-11-08 16:39:07 -08:00
Fangjin Yang 6da047b5fa fix backwards compatibility issues 2012-11-08 15:09:00 -08:00
Fangjin Yang 17fb93d049 fixes to init and more unit tests for timeseries 2012-11-08 14:43:02 -08:00
Fangjin Yang 5cf21e3c8a Merge branch 'master' into misc 2012-11-08 13:49:02 -08:00
cheddar 90b7fd9935 Merge pull request #25 from metamx/moarunittests
A basic timeseries query for druid and also more unit tests
2012-11-08 13:46:30 -08:00
Fangjin Yang 09e81be14c rename file 2012-11-08 13:42:58 -08:00
Fangjin Yang e8d1909883 rename file 2012-11-08 13:42:14 -08:00
Fangjin Yang ef6e65b8ca Merge branch 'moarunittests' into misc
Conflicts:
	client/src/main/java/com/metamx/druid/http/BrokerMain.java
2012-11-08 10:51:41 -08:00
Fangjin Yang 4c98b176e4 Merge branch 'master' into misc
Conflicts:
	merger/src/main/java/com/metamx/druid/merger/coordinator/RemoteTaskRunner.java
2012-11-08 10:51:13 -08:00
Fangjin Yang 3ddfdfc702 add missing header 2012-11-08 10:45:21 -08:00
Fangjin Yang bff5a7d786 fix some merge issues 2012-11-08 10:43:39 -08:00
Fangjin Yang 8323feedb4 Merge branch 'master' into moarunittests
Conflicts:
	client/src/main/java/com/metamx/druid/http/BrokerMain.java
2012-11-08 10:37:05 -08:00
Fangjin Yang 88bb02963a fix compile breakage introduced by scaling strategies 2012-11-08 10:32:18 -08:00
cheddar f8a5d08dc3 Merge pull request #20 from metamx/autoscaling
Improvements to distributed indexing service and auto scaling
2012-11-08 10:11:33 -08:00
Fangjin Yang 7083821fbf no param for scaling provision and minor fix for initialization 2012-11-08 10:08:40 -08:00
Fangjin Yang cdd9cdb2bd use PropUtils for indexer coordinator node 2012-11-08 09:31:22 -08:00
Fangjin Yang f39af83be4 make switching between scaling strategies config based 2012-11-08 09:30:32 -08:00
Fangjin Yang 4d6cfdc774 Merge branch 'master' into autoscaling 2012-11-07 17:27:42 -08:00
Fangjin Yang 52214d7355 additional improvements according to code review; unit tests; bug fixes for retry policies 2012-11-07 17:27:23 -08:00
cheddar 9c3b70068e Merge pull request #22 from metamx/histograms
HistogramVisual: add support for quantiles
2012-11-06 20:20:34 -08:00
Eric Tschetter b1475219a9 Merge branch 'master' of git://github.com/tralfamadude/druid-1
Added DruidSetup.java and install/druid_setup.sh to run it for Druid ensemble setup (put properties to zk, create zk zpaths, prep db, and dump properties/paths in zk); property druid.zk.paths.base can establish a namespace for a druid ensemble allowing more than one ensemble to use the same zookeepers; this namespace is the base zpath prefix for paths with properties in the form druid.zk.paths.*Path which are normally set automatically now; if druid.zk.paths.*Path are explicitly set, then all of them must be set with absolute paths to ensure careful attention; ZkSetup is now deprecated, use DruidSetup instead; examples/twitter RealtimeStandaloneMain will exit properly now after a kill -15 (control-c or kill pid) instead of hanging on an unstopped daemon.
2012-11-06 20:15:57 -08:00
Nelson Ray 217caa3a04 HistogramVisual: put min. and max. in quantile array 2012-11-06 16:55:35 -08:00
Paul Baclace cb02c6841b removed recursive zpath listing from DruidSetup dump command. 2012-11-06 15:30:46 -08:00
Fangjin Yang 34cb352cf8 working indexer with registererers 2012-11-06 14:26:53 -08:00