fjy
649f285feb
Add an endpoint to return the overlord leader
2015-01-30 12:37:48 -08:00
fjy
bc1405bee0
fix worker status path announcement with indexer zk config
2015-01-30 12:26:08 -08:00
Xavier Léauté
2c2771b90e
Make dynamic worker selection actually work
2015-01-27 14:17:42 -08:00
nishantmonu51
0f3eac4705
fix dimension exclusion
2015-01-23 00:31:23 +05:30
fjy
1f94de22c6
[maven-release-plugin] prepare for next development iteration
2015-01-20 14:23:55 -08:00
fjy
17476edc31
[maven-release-plugin] prepare release druid-0.7.0-rc1
2015-01-20 14:23:51 -08:00
fjy
2d516fa591
Add a new equal distribution strategy for assigning tasks
2015-01-20 13:12:22 -08:00
Xavier Léauté
cd9635ff5e
Merge pull request #1034 from druid-io/minor-rename
...
minor rename of things in hadoop ingestion config to match 0.6.x
2015-01-15 15:46:13 -08:00
fjy
ccddbf8747
minor rename of things in hadoop ingestion config to match 0.6.x
2015-01-15 14:04:55 -08:00
Fangjin Yang
5bfcc43377
Merge pull request #1008 from metamx/stringConversionJavaUtilUpdate
...
Update all String conversions to and from byte[] to use the java-util StringUtils functions
2015-01-15 13:50:27 -08:00
Charles Allen
67757b6aea
Change IndexerZkConfig to use @JacksonInject instead of just straight @Inject
...
* Updated IndexerZkConfig to use no setters, and take all arguments from constructor instead
* Also added more unit tests
2015-01-08 11:11:17 -08:00
Charles Allen
f6fbb733b8
Added a few places where tests were using Object instead of Module
2015-01-05 13:47:25 -08:00
Charles Allen
b1b5c9099e
Update all String conversions to and from byte[] to use the java-util StringUtils functions
...
* Speedup of GroupBy with javaScript filters by ~10%
* Requires https://github.com/metamx/java-util/pull/15
2015-01-05 11:22:32 -08:00
Charles Allen
65286a24e0
Change zk configs to use Jackson injection instead of Skife
...
* Also added generic config testing class JsonConfigTesterBase
2014-12-29 10:36:12 -08:00
Fangjin Yang
af1185b58c
Merge pull request #969 from metamx/fixRemoteLogViewing
...
Remove try-with-resources for log stream in WokerResource
2014-12-15 16:26:02 -07:00
Charles Allen
54068e8b1d
Remove try-with-resources for log stream in WokerResource
2014-12-15 15:24:59 -08:00
fjy
ac407fb6ba
clean up defaults
2014-12-15 15:05:02 -08:00
fjy
e872952390
fix working path default bug
2014-12-15 14:51:58 -08:00
Fangjin Yang
b3fe91bb50
Merge pull request #830 from metamx/union-merge-on-historical
...
Union merge on historical
2014-12-15 13:36:47 -07:00
Charles Allen
bed3e7e1d2
Merge pull request #966 from metamx/fix-tasklog-streaming
...
fix task log streaming
2014-12-14 09:31:41 -08:00
Xavier Léauté
bd91a40491
fix task log streaming
2014-12-13 15:22:55 -08:00
Xavier Léauté
092dfe0309
fix IndexTaskTest tmp dir
...
- Create local firehose files in a clean temp directory to avoid
firehose reading other random temp files that start with 'druid'
2014-12-12 17:05:45 -08:00
fjy
123db3da4d
fix another broken ut
2014-12-09 15:47:28 -08:00
nishantmonu51
1a1b0e6f23
merge from master and review comments
2014-12-09 13:16:45 +05:30
Charles Allen
a0f9f9877e
Changed all "application/json" to MediaType.APPLICATION_JSON except for in druid.js
2014-12-08 14:21:49 -08:00
nishantmonu51
6e03a6245f
Merge branch 'master' into onheap-incremental-index
2014-12-05 10:40:28 +05:30
Xavier Léauté
7cd45a6e1f
IncrementalIndex throws exception if limit exceeded
...
- For now uses a hardcoded ratio of aggregator to timeanddim buffer sizes
- canAppendRow is a workaround for realtime index since the
Firehose currently does not have a way of rolling back the last event in
case of error
- canAppendRow needs a fudge factor; there is a race between checking
if we can add a row and actually adding a row, because of the way MapDB
reports its size.
2014-12-04 14:38:16 -08:00
Charles Allen
18234a2f00
Fix confusing error message in HadoopIndexTask
2014-12-04 10:57:57 -08:00
Gian Merlino
20a7239ffd
Replace google-http-client imports with real guava imports.
2014-12-04 10:57:57 -08:00
Xavier Léauté
0c521e0a77
update joda-time and fix min/max instant
2014-12-04 10:57:56 -08:00
Fangjin Yang
27d4b2bdea
Merge pull request #934 from metamx/fix-hadoop-metadata-injection
...
metadata update handler injection not needed for indexing service
2014-12-04 10:45:20 -07:00
Xavier Léauté
2e6c254937
metadata injection not needed for indexing service
2014-12-03 15:09:31 -08:00
Charles Allen
325a5c4abc
Update ForkingTaskRunner to remove @Deprecated Files method usage
2014-12-03 13:18:33 -08:00
xvrl
2681da4420
Merge pull request #929 from metamx/google-cleanup
...
Replace google-http-client imports with real guava imports.
2014-12-03 11:50:19 -08:00
Charles Allen
b6f71d3fd6
Fix confusing error message in HadoopIndexTask
2014-12-03 11:11:53 -08:00
Gian Merlino
d388a8fe89
Replace google-http-client imports with real guava imports.
2014-12-03 10:52:57 -08:00
nishantmonu51
da8bd7836b
Introduce buffer size
2014-12-03 16:28:22 +05:30
Xavier Léauté
a79389a9e5
update joda-time and fix min/max instant
2014-12-02 17:27:22 -08:00
Xavier Léauté
d23fd1e1ab
make host+port more explicit
...
- document the behavior for node host/port initialization
- throw exception if settings make no sense
- fixes announcement for nodes without host/port defaults
- makes code clearer as to when host vs. host+port are used
2014-11-26 22:03:25 -08:00
Fangjin Yang
3ff569ef2d
Merge pull request #879 from metamx/rtr-with-pref
...
Rewrite autoscaling and enable easier configuration of worker selection and autoscaling behaviour
2014-11-24 17:54:28 -07:00
fjy
3808411340
address some cr
2014-11-24 16:54:47 -08:00
fjy
13cae41f6c
Merge branch 'master' into refactor-examples
2014-11-24 11:00:26 -08:00
fjy
9b701bbc76
a few more code review fixes
2014-11-24 10:54:29 -08:00
fjy
1aaea9a0d7
address code review
2014-11-24 10:52:30 -08:00
fjy
8ee4d12562
Refactor structure for examples and extensions
2014-11-21 14:45:24 -08:00
fjy
580e1172c1
move IndexTask to use hashed partition; fixes #815
2014-11-21 11:15:25 -08:00
fjy
fdeab0c6af
make Druid case sensitive
2014-11-19 14:27:31 -08:00
Fangjin Yang
109fdf0b34
Merge pull request #852 from metamx/druid-0.7.x-TaskLogStreamer
...
(DO NOT MERGE YET) Update logging to https://github.com/druid-io/druid-api/pull/27
2014-11-19 15:03:12 -07:00
Fangjin Yang
590d31799e
Merge pull request #876 from metamx/remove-backwards-compatible
...
Remove backwards compatible
2014-11-19 14:33:14 -07:00
fjy
64719b15e0
rewrite autoscaling with tests
2014-11-18 15:41:06 -08:00
xvrl
a96eaeb036
Merge pull request #882 from metamx/now_with_OPEN_SOURCE
...
Added src jar build to maven poms and re-formatted to conform to style guidelines.
2014-11-18 13:00:04 -08:00
Charles Allen
dc66e1708e
Added src jar build to maven poms and re-formatted to conform to style guidelines.
2014-11-18 09:05:30 -08:00
fjy
c91310914b
fix a few naming things
2014-11-17 16:05:18 -08:00
fjy
32600e10bb
address code review
2014-11-17 15:55:22 -08:00
fjy
1af6b337f2
optionally choose what worker to send tasks to
2014-11-17 14:50:56 -08:00
Xavier Léauté
d914afe1cd
make defaultVersion configurable for non-jar testing
2014-11-17 13:54:32 -08:00
nishantmonu51
0c2d06475d
merge from master
2014-11-17 19:19:18 +05:30
nishantmonu51
cbffe3c648
merge from master and resolve conflicts
2014-11-17 18:07:08 +05:30
nishantmonu51
ad1dd161e7
formatting
2014-11-17 17:44:26 +05:30
Fangjin Yang
d4ca805cb9
Merge pull request #806 from metamx/rtac-error-messages
...
RemoteTaskActionClient: Better error messages for non-2xx responses.
2014-11-13 11:57:50 -07:00
Charles Allen
a89b539b4f
Merge pull request #823 from metamx/roaring
...
Configurable bitmap indexes: roaring and concise
2014-11-11 17:26:38 -08:00
fjy
1cc162727b
address code review
2014-11-11 14:05:37 -08:00
Xavier Léauté
aeb194ad12
fix injection for real
2014-11-07 11:43:53 -08:00
Fangjin Yang
2336e6c167
Merge pull request #758 from metamx/jisoo-metadata
...
make metadata storage pluggable
2014-11-07 11:30:11 -07:00
nishantmonu51
fd8eb7742b
handle union query on realtime node
2014-11-07 23:27:50 +05:30
Xavier Léauté
5bda4ee1dd
global task entry type
2014-11-06 17:08:20 -08:00
Charles Allen
d52530e0de
Update logging to https://github.com/druid-io/druid-api/pull/27
2014-11-06 11:43:25 -08:00
Xavier Léauté
9bc20ef8bf
prefer druid.curator.compress to druid.indexer.runner.compressZnodes
2014-11-06 11:28:51 -08:00
Xavier Léauté
350bb09605
refactor sql storage to abstract task storage
2014-11-05 17:19:37 -08:00
Xavier Léauté
1872b8f979
make it easier to test
2014-10-31 14:49:07 -07:00
Xavier Léauté
97a2f5af4a
rename db->metadata
2014-10-31 10:54:33 -07:00
Xavier Léauté
9c06db021f
rename db->metadata postgres->postgresql
2014-10-31 10:30:27 -07:00
Xavier Léauté
fb4d41cedb
make the injection gods happy
2014-10-30 21:16:36 -07:00
Xavier Léauté
377151beda
better abstraction for metadatastorage
2014-10-30 18:23:35 -07:00
Xavier Léauté
3cc1b2e690
remove mysql dependencies + fix jdbc class loading
2014-10-29 17:30:43 -07:00
jisookim0513
aa754b86e8
build success!
2014-10-24 11:28:42 -07:00
fjy
bef74104d9
merge with 0.7.x and resolve any conflicts
2014-10-23 17:24:06 -07:00
Gian Merlino
ca0a4bd8a5
RemoteTaskActionClient: Better error messages for non-2xx responses.
2014-10-22 18:02:22 -07:00
fjy
3b29e77866
[maven-release-plugin] prepare for next development iteration
2014-10-22 16:25:32 -07:00
fjy
dcab2997f2
[maven-release-plugin] prepare release druid-0.6.160
2014-10-22 16:25:27 -07:00
jisookim0513
02e79d6b15
attempted to solve merge-conflict; IncrementalIndex has unresolved classes after updates - needs to be fixed
2014-10-22 00:18:17 -07:00
jisookim0513
37979282fe
enabled ansi-quote in mysql; insert statement should now work
2014-10-21 00:09:19 -07:00
jisookim0513
b8cbe2457a
fixed variable name
2014-10-17 00:13:30 -07:00
jisookim0513
7d5c5f2083
fixed createTable; fixed miscellaneous stuff; added DerbyMetadataRuleManagerProvider
2014-10-17 00:10:36 -07:00
nishantmonu51
f4a97aebbc
fix rollup for hashed partitions
...
truncate timestamp while calculating the partitionNumber
2014-10-15 22:32:56 +05:30
nishantmonu51
bce388fb27
merge changes from 0.7.x branch
2014-10-14 18:46:02 +05:30
nishantmonu51
b5d66381f3
more cleanup
2014-10-14 18:32:40 +05:30
fjy
a4c8f04409
[maven-release-plugin] prepare for next development iteration
2014-10-13 12:50:45 -07:00
fjy
7fd1747ffa
[maven-release-plugin] prepare release druid-0.6.159
2014-10-13 12:50:41 -07:00
nishantmonu51
454acd3f5a
remove backwards compatible code
...
1) remove backwards compatible and deprecated code
2) make hashed partitions spec default
2014-10-13 19:30:44 +05:30
Gian Merlino
e1fedbe741
RemoteTaskRunner should respect worker version changes ( fixes #787 ).
2014-10-12 11:27:44 -07:00
jisookim0513
521398267c
fixed inconsistent variable names
2014-10-10 17:00:50 -07:00
fjy
d0fbd5f729
[maven-release-plugin] prepare for next development iteration
2014-10-09 14:24:53 -07:00
fjy
dada60a301
[maven-release-plugin] prepare release druid-0.6.158
2014-10-09 14:24:48 -07:00
fjy
8a4b32c482
[maven-release-plugin] prepare for next development iteration
2014-10-07 14:30:26 -07:00
fjy
96e29c2fdd
[maven-release-plugin] prepare release druid-0.6.157
2014-10-07 14:30:20 -07:00
fjy
c7b4d5b7b4
Merge branch 'master' into druid-0.7.x
...
Conflicts:
processing/src/test/java/io/druid/segment/filter/SpatialFilterTest.java
2014-10-02 18:12:10 -07:00
fjy
c3bea245a7
fix up some bugs
2014-09-30 17:20:52 -07:00
fjy
a0782d4c54
fix compile
2014-09-30 16:56:44 -07:00
jisookim0513
0e50852985
fixed MetadataTaskStorage and handler
2014-09-30 14:09:23 -07:00