06ef83db69
Merge pull request #85 from metamx/speedup-timeboundary
...
Avoid hitting all segments for TimeBoundary queries
2013-02-15 11:43:42 -08:00
e042c29173
Fixed typos in comments, changed prefix on s3Paths to s3n from s3://, cleaned
...
up umbrellaIntervals code in JodaUtils, modified the DbUpdater to push segment
meta-data to the database in batches.
2013-02-15 11:39:49 -08:00
728e208f49
merge master
2013-02-15 11:39:22 -08:00
05d347c304
Merge remote-tracking branch 'origin/master' into speedup-timeboundary
...
Conflicts:
client/pom.xml
common/pom.xml
druid-services/pom.xml
examples/pom.xml
examples/rand/pom.xml
examples/twitter/pom.xml
index-common/pom.xml
indexer/pom.xml
merger/pom.xml
pom.xml
realtime/pom.xml
server/pom.xml
2013-02-15 11:25:47 -08:00
780410446c
even more simple
2013-02-15 11:19:13 -08:00
5ee7c0c264
1) Remove stray import of java.util.List
2013-02-15 12:15:53 -06:00
e1533b871e
Merge pull request #88 from metamx/8to9-empty-column
...
Additional fix for columns with cardinality 0
2013-02-15 10:15:05 -08:00
548c901c0b
Additional fix for columns with cardinality 0
2013-02-14 23:45:02 -08:00
3fed8ee0ce
[maven-release-plugin] prepare for next development iteration
2013-02-14 21:23:46 -08:00
ba7df5b709
[maven-release-plugin] prepare release druid-0.2.9
2013-02-14 21:23:41 -08:00
22d1f2a0c0
IndexMergerTest: Empty column test
2013-02-14 21:11:31 -08:00
53e801ecb3
Merge branch 'master' of github.com:metamx/druid
2013-02-14 22:59:43 -06:00
48538d0454
1) Fix bug in index converter when column has cardinality 0
2013-02-14 22:59:17 -06:00
152bf201ec
[maven-release-plugin] prepare for next development iteration
2013-02-14 16:27:20 -08:00
e56bc27f93
[maven-release-plugin] prepare release druid-0.2.8
2013-02-14 16:27:12 -08:00
4f11eb5209
1) Fix alert sent from line DruidMasterBalancer:71 to not include all of the segments that a server is holding
2013-02-14 18:24:51 -06:00
bf0d9c601d
Merge branch 'task-stuff' into indexing_refactor
...
Conflicts:
merger/src/main/java/com/metamx/druid/merger/common/TaskStatus.java
merger/src/main/java/com/metamx/druid/merger/common/TaskToolbox.java
merger/src/main/java/com/metamx/druid/merger/common/task/DeleteTask.java
merger/src/main/java/com/metamx/druid/merger/common/task/IndexDeterminePartitionsTask.java
merger/src/main/java/com/metamx/druid/merger/common/task/KillTask.java
merger/src/main/java/com/metamx/druid/merger/common/task/Task.java
merger/src/main/java/com/metamx/druid/merger/common/task/V8toV9UpgradeTask.java
merger/src/main/java/com/metamx/druid/merger/coordinator/MergerDBCoordinator.java
merger/src/main/java/com/metamx/druid/merger/coordinator/RemoteTaskRunner.java
merger/src/main/java/com/metamx/druid/merger/coordinator/TaskMasterLifecycle.java
merger/src/main/java/com/metamx/druid/merger/coordinator/TaskQueue.java
merger/src/main/java/com/metamx/druid/merger/coordinator/TaskRunner.java
merger/src/main/java/com/metamx/druid/merger/coordinator/TaskRunnerWorkQueue.java
merger/src/main/java/com/metamx/druid/merger/coordinator/http/IndexerCoordinatorNode.java
merger/src/main/java/com/metamx/druid/merger/coordinator/http/IndexerCoordinatorServletModule.java
merger/src/test/java/com/metamx/druid/merger/coordinator/RemoteTaskRunnerTest.java
2013-02-14 15:42:07 -08:00
dd44f5cbf0
Merge branch 'master' into task-stuff
2013-02-14 15:11:40 -08:00
ee4236dac2
1) Update to mmx build of jackson 2.1 branch to get bug-fix for jackson-databind #167
2013-02-14 17:10:27 -06:00
ef768feeb1
new resource
2013-02-14 14:20:20 -08:00
ad1de9ba9d
Merge branch 'master' into task-stuff
2013-02-14 14:16:46 -08:00
77fbe974d8
fix version conflicts of old jackson
2013-02-14 13:52:19 -08:00
de4fc98128
TaskMasterLifecycle: Stop leaderLifecycle if it dies while starting
2013-02-14 13:36:43 -08:00
18daa19fc9
Merge branch 'master' into task-stuff
...
Conflicts:
merger/src/main/java/com/metamx/druid/merger/common/TaskHolder.java
merger/src/main/java/com/metamx/druid/merger/common/TaskStatus.java
merger/src/main/java/com/metamx/druid/merger/common/task/AbstractTask.java
merger/src/main/java/com/metamx/druid/merger/common/task/DeleteTask.java
merger/src/main/java/com/metamx/druid/merger/common/task/IndexDeterminePartitionsTask.java
merger/src/main/java/com/metamx/druid/merger/common/task/IndexGeneratorTask.java
merger/src/main/java/com/metamx/druid/merger/common/task/Task.java
merger/src/main/java/com/metamx/druid/merger/coordinator/MergerDBCoordinator.java
merger/src/main/java/com/metamx/druid/merger/coordinator/TaskContext.java
merger/src/main/java/com/metamx/druid/merger/worker/TaskMonitor.java
merger/src/test/java/com/metamx/druid/merger/coordinator/RemoteTaskRunnerTest.java
merger/src/test/java/com/metamx/druid/merger/coordinator/TaskQueueTest.java
server/src/main/java/com/metamx/druid/master/DruidMaster.java
2013-02-14 13:10:29 -08:00
ff325b1f65
Merger: Changes to support rolling locks and a task-action API
...
Generally, TaskStatus is no longer used as the sole way for tasks to
communicate status and metadata update requests back to the
coordinator. It is still used to communicate success or failure, but a
TaskActionClient is used for all other communication. In remote mode
this uses an http api.
TaskContext no longer exists, as its purpose is now served by
the TaskActionClient.
The TaskQueue and TaskConsumer are no longer in charge of committing
stuff for a task. Instead, it happens when an action is sent in. Tasks
are expected to ensure that this is OK by making their behavior
idempotent (since they may be retried after partially completing).
One new kind of request afforded to tasks is the ability to release
and acquire arbitrary locks. This will be useful for long-running tasks.
Short-lived tasks can still be given a lock automatically upon startup
by providing a "fixed interval".
New tables when using db storage:
- tasklocks, to support persistence of arbitrary locks.
- tasklogs, to log actions taken by tasks
2013-02-14 12:46:40 -08:00
6998d604a2
fixes #80
2013-02-14 12:41:34 -08:00
a616f86128
add DateTime import back
2013-02-14 09:09:22 -08:00
754b065c54
merge master
2013-02-14 09:08:25 -08:00
98de0382d5
Merge branch 'master' into speedup-timeboundary
2013-02-13 21:27:27 -08:00
1b85eaad3e
simplify query toolchest interface
2013-02-13 21:25:16 -08:00
e3822f6ca7
DeterminePartitionsJob: Fix docs
2013-02-13 18:51:33 -08:00
ee193f0ca7
DeterminePartitionsJob: Select partition dimension to minimize segment size variance when cardinality is low
2013-02-13 18:51:32 -08:00
c5b78e75cf
1) Move up to Jackson 2.1
...
2) Some bugs were fixed, but they ended up getting mixed in with the Jackson upgrade :(
2013-02-13 18:51:32 -08:00
82f02a4fe4
Merge branch 'master' into indexing_refactor
...
Conflicts:
merger/src/main/java/com/metamx/druid/merger/common/TaskStatus.java
merger/src/main/java/com/metamx/druid/merger/common/task/DeleteTask.java
merger/src/main/java/com/metamx/druid/merger/common/task/IndexDeterminePartitionsTask.java
merger/src/main/java/com/metamx/druid/merger/common/task/Task.java
merger/src/main/java/com/metamx/druid/merger/common/task/V8toV9UpgradeTask.java
merger/src/main/java/com/metamx/druid/merger/coordinator/MergerDBCoordinator.java
merger/src/main/java/com/metamx/druid/merger/coordinator/RemoteTaskRunner.java
merger/src/test/java/com/metamx/druid/merger/coordinator/RemoteTaskRunnerTest.java
2013-02-13 16:34:14 -08:00
1963bfe83f
cleanup
2013-02-13 16:04:43 -08:00
c7b4973700
bug fixes for RTR
2013-02-13 14:19:11 -08:00
ce1d90788d
DeterminePartitionsJob: Fix docs
2013-02-13 10:16:03 -08:00
0eb65f69d4
Merge pull request #86 from metamx/dimpartition-by-variance
...
Select partition dimension by variance when cardinality is low
2013-02-13 09:54:34 -08:00
a665bfa2ef
DeterminePartitionsJob: Select partition dimension to minimize segment size variance when cardinality is low
2013-02-13 09:51:04 -08:00
429e23d3b2
change break to continue in BalancerCostAnalyzer to skip calculating cost when it's not necessary
2013-02-13 08:57:39 -08:00
a0b159fed7
1) Move up to Jackson 2.1
...
2) Some bugs were fixed, but they ended up getting mixed in with the Jackson upgrade :(
2013-02-12 20:58:17 -06:00
fcbac96193
revert change to findNewSegmentHome: now return single ServerHolder
2013-02-12 10:47:30 -08:00
07b0b4611b
bump up to 0.3.0
2013-02-12 09:52:21 -08:00
68cd2e10a7
remove unnecessary segment grouping
2013-02-12 09:45:26 -08:00
7ab2e0552a
cleanup imports
2013-02-11 18:42:43 -08:00
633cccce69
bump up to 0.3.0
2013-02-11 18:41:25 -08:00
d4009c8c1c
refactor filterSegments to use `TimelineObjectHolder`s
2013-02-11 18:41:25 -08:00
b27a459f71
more refactoring and UT passing at this point
2013-02-11 18:13:01 -08:00
6b87ef2921
assume segment intervals have already been filtered based on query interval
2013-02-11 16:56:52 -08:00
e9f546c4ca
add default implementations to QueryToolChest methods
2013-02-11 16:51:40 -08:00
cheddar
Deep Ganguli
Nelson Ray
xvrl
Eric Tschetter
Gian Merlino
Fangjin Yang