Commit Graph

6062 Commits

Author SHA1 Message Date
Fangjin Yang f50c214514 Merge branch 'master' into task-stuff 2013-01-31 09:59:52 -08:00
Gian Merlino f946fc3ee6 TaskConsumer: Commit to segment db in one transaction 2013-01-31 08:22:10 -08:00
Gian Merlino 1e35e6ad46 TaskQueue: Tweak to implementation of findTaskGroupForTask 2013-01-31 08:22:10 -08:00
Gian Merlino 34e76f868f TaskQueue: Clarify "Naptime!" log message 2013-01-31 08:22:10 -08:00
Gian Merlino 86ec3a372e TaskGroup: Add javadocs 2013-01-31 08:22:10 -08:00
Gian Merlino 65576cbade TaskStorageQueryAdapter: Rename some methods and tweak javadocs for clarity 2013-01-31 08:22:10 -08:00
Gian Merlino 779c54d8f2 TaskToolbox: Replace IndexerCoordinatorConfig with TaskConfig 2013-01-31 08:22:09 -08:00
Gian Merlino fe38ed2547 Introduce TaskExistsException, thrown by TaskStorage.insert when appropriate 2013-01-31 08:22:09 -08:00
Gian Merlino 0e469c6f4c TaskStatus: Fix javadocs 2013-01-31 08:09:22 -08:00
Fangjin Yang 00e6ac1e10 [maven-release-plugin] prepare for next development iteration 2013-01-30 17:09:23 -08:00
Fangjin Yang ef19de8270 [maven-release-plugin] prepare release druid-0.2.2 2013-01-30 17:09:18 -08:00
Fangjin Yang 26ed96f05d bug fix for autoscaling termination 2013-01-30 17:06:02 -08:00
Fangjin Yang fa733565e8 [maven-release-plugin] prepare for next development iteration 2013-01-30 16:28:28 -08:00
Fangjin Yang 0b116a8fe4 [maven-release-plugin] prepare release druid-0.2.1 2013-01-30 16:28:22 -08:00
Fangjin Yang 934207be0d updating sdk version to fix indexer in aws 2013-01-30 16:26:24 -08:00
Fangjin Yang 2a0de2090b [maven-release-plugin] prepare for next development iteration 2013-01-30 13:47:15 -08:00
Fangjin Yang 049ca2bad4 [maven-release-plugin] prepare release druid-0.2.0 2013-01-30 13:47:08 -08:00
Nelson Ray dc49cccf56 javadoc format 2013-01-29 18:32:52 -08:00
Nelson Ray 73f774e768 make masterbalancertest more stringent 2013-01-29 18:17:38 -08:00
Nelson Ray a1ce4b294e simplify balancer test 2013-01-29 18:16:49 -08:00
Nelson Ray b205f7b3c4 use existing currentlyMovingSegments instead of creating a reundant segmentsBeingMoved 2013-01-29 18:16:34 -08:00
Nelson Ray 034d652569 make balancer tests take into account loadqueue status 2013-01-29 17:13:01 -08:00
cheddar 9a22e46eca Merge pull request #71 from metamx/queryrunner-onerow-test
Bug fixes for incremental index storage adapter and one row indexes
2013-01-29 13:41:15 -08:00
cheddar a7abd2ca86 Merge pull request #70 from metamx/timezone-tests
More time zone tests
2013-01-29 13:40:04 -08:00
Fangjin Yang 8fc10a61a0 bug fix for incremental index and 1 row 2013-01-29 13:23:57 -08:00
Fangjin Yang 41ca33c734 Merge branch 'master' of github.com:metamx/druid into task-stuff 2013-01-29 12:57:56 -08:00
Gian Merlino 61569f62be TimeseriesQueryRunner tests with small incremental indexes 2013-01-29 12:54:52 -08:00
Eric Tschetter da914b835e 1) Add caching for SegmentMetadataQuery 2013-01-29 13:04:57 -06:00
xvrl 27e09987c6 timezone test 2013-01-29 10:38:22 -08:00
Eric Tschetter 8af3ae09d6 1) Fix bug with loading old indexes that might have mixed case column names 2013-01-29 11:38:35 -06:00
Eric Tschetter 08d3253f3d Merge branch 'master' of github.com:metamx/druid 2013-01-29 11:29:42 -06:00
Eric Tschetter f2cce28297 1) Make SegmentMetadataQuery work 2013-01-29 11:29:26 -06:00
Nelson Ray 6438401a32 split pick segment logic into its own method 2013-01-28 15:06:09 -08:00
cheddar 1bcf443b49 Merge pull request #62 from metamx/groupby-tests
Actual groupby tests (tests fail because of group by bug)
2013-01-28 14:45:00 -08:00
Eric Tschetter 673cffc3f2 Merge branch 'groupby-tests' of github.com:metamx/druid into groupby-tests
Conflicts:
	common/src/main/java/com/metamx/druid/input/MapBasedRow.java
2013-01-28 16:44:18 -06:00
Eric Tschetter 7439a2e820 1) Make tests pass 2013-01-28 16:42:51 -06:00
xvrl c0822325e7 proper groupby tests 2013-01-28 16:41:03 -06:00
cheddar 5f18f368e3 Merge pull request #61 from metamx/fix-cache-timezone
Cache did not preserve timezone information
2013-01-28 14:39:00 -08:00
cheddar 59dd9a8e18 Merge pull request #66 from metamx/queryservlet-alert-remote-addr
QueryServlet: Add "host" (remote address) to alerts
2013-01-28 14:38:29 -08:00
Fangjin Yang 74057600f9 fix worker node still using db connection 2013-01-27 09:57:37 -08:00
Eric Tschetter 4a1f5315a6 1) Make tests pass 2013-01-25 18:15:51 -06:00
Gian Merlino 1cff766e2a RemoteTaskRunner: Only cleanup paths during bootstrapping if task is complete 2013-01-25 16:01:17 -08:00
Fangjin Yang efdff7b9f1 fix unit test bug 2013-01-25 14:33:05 -08:00
Gian Merlino 0f4746450b RemoteTaskRunner: null check on workerData 2013-01-25 13:40:20 -08:00
Gian Merlino bb68091cef Index service: TaskConsumer tests 2013-01-25 13:15:55 -08:00
Gian Merlino 82d77a8b72 Index service: Fix kill task 2013-01-25 13:15:49 -08:00
Gian Merlino 553738e1d8 Merge branch 'master' into task-stuff 2013-01-25 11:34:18 -08:00
Gian Merlino f3b04d3f5f S3SegmentKiller: Add TODO note 2013-01-25 11:33:50 -08:00
Gian Merlino e6a618ca76 Merge branch 'killsegments' into task-stuff
Conflicts:
	merger/src/main/java/com/metamx/druid/merger/common/TaskStatus.java
	merger/src/main/java/com/metamx/druid/merger/common/task/DeleteTask.java
	merger/src/main/java/com/metamx/druid/merger/common/task/IndexGeneratorTask.java
	merger/src/main/java/com/metamx/druid/merger/common/task/IndexTask.java
	merger/src/main/java/com/metamx/druid/merger/common/task/MergeTask.java
	merger/src/main/java/com/metamx/druid/merger/coordinator/LocalTaskRunner.java
	merger/src/main/java/com/metamx/druid/merger/coordinator/TaskQueue.java
	merger/src/main/java/com/metamx/druid/merger/coordinator/exec/TaskConsumer.java
	merger/src/main/java/com/metamx/druid/merger/worker/TaskMonitor.java
	merger/src/test/java/com/metamx/druid/merger/coordinator/RemoteTaskRunnerTest.java
	merger/src/test/java/com/metamx/druid/merger/coordinator/TaskQueueTest.java
2013-01-25 11:30:10 -08:00
Gian Merlino a14200d779 Index service support for early returns and choice of commit semantics.
Task:
- Add TaskCallback to run method (for early returns)

TaskStatus:
- Remove CONTINUED status
- Add segmentsNuked (placeholder for future deletion support)
- Add more builder methods
- Add validations to constructor

TaskStorage:
- Add TaskStorageQueryAdapter, a concrete class that wraps TaskStorages and
  provides various read-only convenience methods
- Add getTask method for benefit of TaskStorageQueryAdapter

TaskQueue:
- Rename "done" to "notify"
- notify is responsible for deciding if we should commit
- Add optional commitRunnable to "notify", which gets called when it's time to commit
- Allow nextTasks and commits to run early (statusCode RUNNING)
- Move getStatus, collapseStatus functionality to TaskStorageQueryAdapter
2013-01-25 11:05:34 -08:00