Apache/druid
1
0
Fork 0
mirror of https://github.com/apache/druid.git synced 2025-02-06 10:08:26 +00:00
Code Issues Packages Projects Releases Wiki Activity
7,179 Commits 115 Branches 507 Tags
Commit Graph

2696 Commits

Author SHA1 Message Date
Fangjin Yang
00e6ac1e10 [maven-release-plugin] prepare for next development iteration 2013-01-30 17:09:23 -08:00
Fangjin Yang
ef19de8270 [maven-release-plugin] prepare release druid-0.2.2 2013-01-30 17:09:18 -08:00
Fangjin Yang
fa733565e8 [maven-release-plugin] prepare for next development iteration 2013-01-30 16:28:28 -08:00
Fangjin Yang
0b116a8fe4 [maven-release-plugin] prepare release druid-0.2.1 2013-01-30 16:28:22 -08:00
Fangjin Yang
2a0de2090b [maven-release-plugin] prepare for next development iteration 2013-01-30 13:47:15 -08:00
Fangjin Yang
049ca2bad4 [maven-release-plugin] prepare release druid-0.2.0 2013-01-30 13:47:08 -08:00
Nelson Ray
dc49cccf56 javadoc format 2013-01-29 18:32:52 -08:00
Nelson Ray
73f774e768 make masterbalancertest more stringent 2013-01-29 18:17:38 -08:00
Nelson Ray
a1ce4b294e simplify balancer test 2013-01-29 18:16:49 -08:00
Nelson Ray
b205f7b3c4 use existing currentlyMovingSegments instead of creating a reundant segmentsBeingMoved 2013-01-29 18:16:34 -08:00
Nelson Ray
034d652569 make balancer tests take into account loadqueue status 2013-01-29 17:13:01 -08:00
cheddar
9a22e46eca Merge pull request #71 from metamx/queryrunner-onerow-test 
Bug fixes for incremental index storage adapter and one row indexes
 2013-01-29 13:41:15 -08:00
cheddar
a7abd2ca86 Merge pull request #70 from metamx/timezone-tests 
More time zone tests
 2013-01-29 13:40:04 -08:00
Fangjin Yang
8fc10a61a0 bug fix for incremental index and 1 row 2013-01-29 13:23:57 -08:00
Fangjin Yang
41ca33c734 Merge branch 'master' of github.com:metamx/druid into task-stuff 2013-01-29 12:57:56 -08:00
Gian Merlino
61569f62be TimeseriesQueryRunner tests with small incremental indexes 2013-01-29 12:54:52 -08:00
Eric Tschetter
da914b835e 1) Add caching for SegmentMetadataQuery 2013-01-29 13:04:57 -06:00
xvrl
27e09987c6 timezone test 2013-01-29 10:38:22 -08:00
Eric Tschetter
08d3253f3d Merge branch 'master' of github.com:metamx/druid 2013-01-29 11:29:42 -06:00
Eric Tschetter
f2cce28297 1) Make SegmentMetadataQuery work 2013-01-29 11:29:26 -06:00
Nelson Ray
6438401a32 split pick segment logic into its own method 2013-01-28 15:06:09 -08:00
Eric Tschetter
7439a2e820 1) Make tests pass 2013-01-28 16:42:51 -06:00
xvrl
c0822325e7 proper groupby tests 2013-01-28 16:41:03 -06:00
cheddar
5f18f368e3 Merge pull request #61 from metamx/fix-cache-timezone 
Cache did not preserve timezone information
 2013-01-28 14:39:00 -08:00
Fangjin Yang
74057600f9 fix worker node still using db connection 2013-01-27 09:57:37 -08:00
Gian Merlino
f3b04d3f5f S3SegmentKiller: Add TODO note 2013-01-25 11:33:50 -08:00
Gian Merlino
e6a618ca76 Merge branch 'killsegments' into task-stuff 
Conflicts:
	merger/src/main/java/com/metamx/druid/merger/common/TaskStatus.java
	merger/src/main/java/com/metamx/druid/merger/common/task/DeleteTask.java
	merger/src/main/java/com/metamx/druid/merger/common/task/IndexGeneratorTask.java
	merger/src/main/java/com/metamx/druid/merger/common/task/IndexTask.java
	merger/src/main/java/com/metamx/druid/merger/common/task/MergeTask.java
	merger/src/main/java/com/metamx/druid/merger/coordinator/LocalTaskRunner.java
	merger/src/main/java/com/metamx/druid/merger/coordinator/TaskQueue.java
	merger/src/main/java/com/metamx/druid/merger/coordinator/exec/TaskConsumer.java
	merger/src/main/java/com/metamx/druid/merger/worker/TaskMonitor.java
	merger/src/test/java/com/metamx/druid/merger/coordinator/RemoteTaskRunnerTest.java
	merger/src/test/java/com/metamx/druid/merger/coordinator/TaskQueueTest.java
 2013-01-25 11:30:10 -08:00
xvrl
5e1cac6d9f timezone test 2013-01-24 17:57:10 -08:00
Deep Ganguli
017d4779d6 Implemented Hadoop Index Task which takes as input a HadoopDruidIndexConfig and 
generates index segments.

The HadoopIndexTask run method wraps a HadoopDruidIndexerJob run method. The
key modifications to the HadoopDruidIndexerJob are as follows:

- The UpDaterJobSpec field of the config that is used to set up the indexer job
  is set to null. This ensures that the job does not push a list of published
segments to the database, in order to allow the indexing service to handle this
later.
- Set the version field of the config file based on the TaskContext. Also
  changed config.setVersion method to take a string (as opposed to a Date) as
input, and propogated this change where necessary.
- Set the SegmentOutputDir field of the config file based on the TaskToolbox,
  to allow the indexing service to handle where to write the segments too.
- Added a method to IndexGeneratorJob called getPublishedSegments, that simply
  returns a list of published segments without publishing this list to the
database.
 2013-01-23 19:27:14 -08:00
Eric Tschetter
67feee3cd6 1) Indexes don't always have an index.drd file anymore 2013-01-23 18:36:52 -06:00
xvrl
55ae4c87dd timezone support in groupby query 2013-01-23 08:51:02 -08:00
xvrl
35058786d9 match query interval to granularity for this test 2013-01-23 08:50:43 -08:00
xvrl
86a6d112e3 proper groupby tests 2013-01-22 16:54:14 -08:00
Fangjin Yang
272d737517 cleaning up some interactions with RTR and workers 2013-01-22 16:21:38 -08:00
xvrl
f05c050c53 add test for timezone 2013-01-21 15:49:39 -08:00
Nelson Ray
94b72e8878 replace param BalancerCostAnalyzer getter with a factory 2013-01-21 15:32:29 -08:00
Fangjin Yang
bab9ee8827 Merge branch 'master' into killsegments 
Conflicts:
	merger/src/main/java/com/metamx/druid/merger/coordinator/http/IndexerCoordinatorNode.java
 2013-01-21 14:47:49 -08:00
Nelson Ray
2d7113b263 huge simplification of balancing code 2013-01-21 14:28:25 -08:00
Eric Tschetter
5b1e03530c 1) Fix some bugs found by external test suite 2013-01-16 21:06:57 -06:00
Fangjin Yang
21613bc73b initial commit to hard delete segments 2013-01-16 17:31:01 -08:00
Eric Tschetter
c8cb96b006 1) Remove vast majority of usages of IndexIO.mapDir() and deprecated it. IndexIO.loadIndex() is the new IndexIO.mapDir() 
2) Fix bug with IndexMerger and null columns
3) Add QueryableIndexIndexableAdapter so that QueryableIndexes can be merged
4) Adjust twitter example to have multiple values for each hash tag
5) Adjusted GroupByQueryEngine to just drop dimensions that don't exist instead of throwing an NPE
 2013-01-16 17:10:33 -06:00
Eric Tschetter
538d00e75e Merge branch 'master' of github.com:metamx/druid 2013-01-16 10:02:01 -06:00
Eric Tschetter
8b31d8db9f 1) Adjust IndexMerger to create convert the indexes it creates from the old format to the new. This is done quite sub-optimally, but it will work for now... 2013-01-16 10:01:46 -06:00
Fangjin Yang
7e074e8158 fix pom breakage 2013-01-15 12:04:12 -08:00
Nelson Ray
e847faf02f change name of MAX_SEGMENTS_TO_MOVE since it's not a final 2013-01-15 11:29:46 -08:00
Nelson Ray
ef9e077d9a remove getConfig method from DruidMaster 2013-01-14 16:01:29 -08:00
Eric Tschetter
998f0bf3c8 1) Better error message when aggregators want more memory than is available. 2013-01-14 18:00:51 -06:00
Nelson Ray
5f40dc6d9c put BalancerCostAnalyzer into params 2013-01-10 10:27:43 -08:00
Nelson Ray
617907d85b move empty server holder list check outside of loop 2013-01-08 16:12:16 -08:00
Nelson Ray
4549c3a8c3 add some finals, reorganize 2013-01-08 09:07:43 -08:00