fjy
e872952390
fix working path default bug
2014-12-15 14:51:58 -08:00
fjy
28b72a69ad
redocumenting ingestion
2014-12-08 16:15:46 -08:00
nishantmonu51
40f223215a
fix buffer pool usage
2014-12-05 16:09:26 +05:30
nishantmonu51
6e03a6245f
Merge branch 'master' into onheap-incremental-index
2014-12-05 10:40:28 +05:30
Xavier Léauté
7cd45a6e1f
IncrementalIndex throws exception if limit exceeded
...
- For now uses a hardcoded ratio of aggregator to timeanddim buffer sizes
- canAppendRow is a workaround for realtime index since the
Firehose currently does not have a way of rolling back the last event in
case of error
- canAppendRow needs a fudge factor; there is a race between checking
if we can add a row and actually adding a row, because of the way MapDB
reports its size.
2014-12-04 14:38:16 -08:00
Gian Merlino
20a7239ffd
Replace google-http-client imports with real guava imports.
2014-12-04 10:57:57 -08:00
Charles Allen
c2add5730b
Fix Hadoop CLI jobs
...
* Change "schema" --> "spec" for cli hadoop to keep up with internal hadoop
* Added check for HadoopDruidIndexerConfig deserialization from Map to see if it is trying to get a HadoopDruidIndexerConfig or a HadoopIngestionSpec
2014-12-04 10:57:56 -08:00
xvrl
c867d59ee0
fix error message
2014-12-03 15:30:32 -08:00
Xavier Léauté
2e6c254937
metadata injection not needed for indexing service
2014-12-03 15:09:31 -08:00
Gian Merlino
d388a8fe89
Replace google-http-client imports with real guava imports.
2014-12-03 10:52:57 -08:00
nishantmonu51
4dc0fdba8a
consider mapped size in limit calculation & review comments
2014-12-03 23:47:30 +05:30
nishantmonu51
da8bd7836b
Introduce buffer size
2014-12-03 16:28:22 +05:30
Charles Allen
7cd689be75
Fix Hadoop CLI jobs
...
* Change "schema" --> "spec" for cli hadoop to keep up with internal hadoop
* Added check for HadoopDruidIndexerConfig deserialization from Map to see if it is trying to get a HadoopDruidIndexerConfig or a HadoopIngestionSpec
2014-12-02 11:23:04 -08:00
nishantmonu51
eac776f1a7
tests passing with on heap incremental index
2014-12-02 22:29:28 +05:30
Xavier Léauté
59542c41f8
fix port not set in DruidNode
2014-12-01 14:37:28 -08:00
Charles Allen
8b3652a67a
Modify HadoopDruidIndexerConfig to give a port of 0 instead of -1 when binding DruidNode @Self annotation
2014-12-01 14:08:41 -08:00
fjy
fdeab0c6af
make Druid case sensitive
2014-11-19 14:27:31 -08:00
Fangjin Yang
590d31799e
Merge pull request #876 from metamx/remove-backwards-compatible
...
Remove backwards compatible
2014-11-19 14:33:14 -07:00
Charles Allen
dc66e1708e
Added src jar build to maven poms and re-formatted to conform to style guidelines.
2014-11-18 09:05:30 -08:00
nishantmonu51
f0452c5968
merge from master
2014-11-18 19:34:51 +05:30
nishantmonu51
edf0fc0851
Make hashed partitions spec default
...
- make hashed partitionsSpec as default partitions spec for 0.7
2014-11-17 19:48:12 +05:30
nishantmonu51
0c2d06475d
merge from master
2014-11-17 19:19:18 +05:30
Xavier Léauté
0498df25df
override metadata storage injection in CliHadoopIndexer
2014-11-07 13:44:56 -08:00
Xavier Léauté
50a191425c
fix injection on MetadataStorageUpdaterJob
2014-11-07 11:11:14 -08:00
Xavier Léauté
20a9aef96a
fix test
2014-11-06 17:27:05 -08:00
Xavier Léauté
9c06db021f
rename db->metadata postgres->postgresql
2014-10-31 10:30:27 -07:00
jisookim0513
aa754b86e8
build success!
2014-10-24 11:28:42 -07:00
fjy
bef74104d9
merge with 0.7.x and resolve any conflicts
2014-10-23 17:24:06 -07:00
fjy
3b29e77866
[maven-release-plugin] prepare for next development iteration
2014-10-22 16:25:32 -07:00
fjy
dcab2997f2
[maven-release-plugin] prepare release druid-0.6.160
2014-10-22 16:25:27 -07:00
fjy
d76d57d95d
update docs
2014-10-22 16:16:28 -07:00
jisookim0513
37979282fe
enabled ansi-quote in mysql; insert statement should now work
2014-10-21 00:09:19 -07:00
jisookim0513
7d5c5f2083
fixed createTable; fixed miscellaneous stuff; added DerbyMetadataRuleManagerProvider
2014-10-17 00:10:36 -07:00
nishantmonu51
41e88baeca
Add test for bucket selection
2014-10-15 23:09:28 +05:30
nishantmonu51
f4a97aebbc
fix rollup for hashed partitions
...
truncate timestamp while calculating the partitionNumber
2014-10-15 22:32:56 +05:30
nishantmonu51
b5d66381f3
more cleanup
2014-10-14 18:32:40 +05:30
fjy
a4c8f04409
[maven-release-plugin] prepare for next development iteration
2014-10-13 12:50:45 -07:00
fjy
7fd1747ffa
[maven-release-plugin] prepare release druid-0.6.159
2014-10-13 12:50:41 -07:00
nishantmonu51
454acd3f5a
remove backwards compatible code
...
1) remove backwards compatible and deprecated code
2) make hashed partitions spec default
2014-10-13 19:30:44 +05:30
fjy
d0fbd5f729
[maven-release-plugin] prepare for next development iteration
2014-10-09 14:24:53 -07:00
fjy
dada60a301
[maven-release-plugin] prepare release druid-0.6.158
2014-10-09 14:24:48 -07:00
fjy
8a4b32c482
[maven-release-plugin] prepare for next development iteration
2014-10-07 14:30:26 -07:00
fjy
96e29c2fdd
[maven-release-plugin] prepare release druid-0.6.157
2014-10-07 14:30:20 -07:00
fjy
c7b4d5b7b4
Merge branch 'master' into druid-0.7.x
...
Conflicts:
processing/src/test/java/io/druid/segment/filter/SpatialFilterTest.java
2014-10-02 18:12:10 -07:00
nishantmonu51
ad75a21040
separate offheapIncrementalIndex implementation
2014-10-01 13:58:51 +05:30
jisookim0513
9d7b5d9b0f
fixed javadoc; fixed pom files; deleted unnecessary class
2014-09-30 13:47:35 -07:00
nishantmonu51
358ff915bb
fix merge conflicts
2014-09-30 22:19:18 +05:30
nishantmonu51
2789536bed
merge changes from druid-0.7.x
2014-09-30 22:05:49 +05:30
nishantmonu51
61c7fd2e6e
make ingestOffheap tuneable
2014-09-30 15:30:02 +05:30
nishantmonu51
adb4a65e0a
Merge branch 'offheap-incremental-index' into mapdb-branch
2014-09-29 12:38:31 +05:30
jisookim0513
74565c9371
cleaned up the code
2014-09-27 13:10:01 -07:00
jisookim0513
aa887edb73
added two seperate modules for mysql and postgres
2014-09-27 13:08:53 -07:00
flow
2dd62979bb
Fixed the issue of batch ingestion with indexing service to hdfs end up with the path of metadata in mysql missing "hdfs://host" prefix. The detail describe can be found here: https://groups.google.com/forum/#!topic/druid-development/ofvSxiPpCxI
2014-09-27 22:26:52 +08:00
jisookim0513
6a641621b2
finished merging into druid-0.7.x; derby not working (to be fixed)
2014-09-26 14:24:53 -07:00
jisookim0513
43cc6283d3
trying to revert files that have overwritten changes
2014-09-26 12:38:04 -07:00
fjy
eaf0a48b92
Merge branch 'master' into druid-0.7.x
...
Conflicts:
cassandra-storage/pom.xml
common/pom.xml
examples/pom.xml
hdfs-storage/pom.xml
histogram/pom.xml
indexing-hadoop/pom.xml
indexing-service/pom.xml
kafka-eight/pom.xml
kafka-seven/pom.xml
pom.xml
processing/pom.xml
processing/src/main/java/io/druid/guice/PropertiesModule.java
rabbitmq/pom.xml
s3-extensions/pom.xml
server/pom.xml
services/pom.xml
2014-09-26 11:39:24 -07:00
jisookim0513
a5d02b9030
second attempt to fix merge-conflicts
2014-09-24 15:59:00 -07:00
jisookim0513
3bf39cc9f8
attempted to fix merge-conflicts
2014-09-24 15:55:42 -07:00
Xavier Léauté
7cfe86b7bc
[maven-release-plugin] prepare for next development iteration
2014-09-23 16:31:25 -07:00
Xavier Léauté
80166314d9
[maven-release-plugin] prepare release druid-0.6.156
2014-09-23 16:31:21 -07:00
fjy
4235e14fc6
[maven-release-plugin] prepare for next development iteration
2014-09-23 16:12:43 -07:00
fjy
576e9b8a84
[maven-release-plugin] prepare release druid-0.6.155
2014-09-23 16:12:39 -07:00
nishantmonu51
f51ab84386
merge changes from druid-0.7.x
2014-09-22 23:48:45 +05:30
nishantmonu51
443e5788fb
make OffheapIncrementalIndex tuneable
2014-09-22 19:26:10 +05:30
jisookim0513
273205f217
initial attempt for abstraction; druid cluster works with Derby as a default
2014-09-19 17:39:59 -07:00
nishantmonu51
8eb6466487
revert buffer size and add back rowFlushBoundary
2014-09-19 23:06:04 +05:30
fjy
a17794a516
[maven-release-plugin] prepare for next development iteration
2014-09-16 15:22:55 -07:00
fjy
f9c91ace3f
[maven-release-plugin] prepare release druid-0.6.154
2014-09-16 15:22:49 -07:00
Xavier Léauté
d501b052ea
remove unused columnConfig
2014-09-15 13:02:47 -07:00
Xavier Léauté
e57e2d97ba
make constants final
2014-09-15 12:53:40 -07:00
fjy
469ccbbe5e
Merge branch 'master' into druid-0.7.x
...
Conflicts:
cassandra-storage/pom.xml
common/pom.xml
examples/pom.xml
hdfs-storage/pom.xml
histogram/pom.xml
indexing-hadoop/pom.xml
indexing-service/pom.xml
kafka-eight/pom.xml
kafka-seven/pom.xml
pom.xml
processing/pom.xml
processing/src/main/java/io/druid/query/FinalizeResultsQueryRunner.java
processing/src/main/java/io/druid/query/UnionQueryRunner.java
processing/src/main/java/io/druid/query/groupby/GroupByQueryRunnerFactory.java
processing/src/main/java/io/druid/query/topn/TopNQueryEngine.java
processing/src/main/java/io/druid/query/topn/TopNQueryRunnerFactory.java
rabbitmq/pom.xml
s3-extensions/pom.xml
server/pom.xml
server/src/test/java/io/druid/server/initialization/JettyTest.java
services/pom.xml
2014-09-11 16:20:50 -07:00
Xavier Léauté
32e256a842
[maven-release-plugin] prepare for next development iteration
2014-09-10 17:24:15 -07:00
Xavier Léauté
f7dc13d240
[maven-release-plugin] prepare release druid-0.6.153
2014-09-10 17:24:11 -07:00
fjy
fec7b43fcb
make making v9 segments something completely configurable
2014-09-10 15:28:30 -07:00
fjy
351afb8be7
allow legacy index generator
2014-09-09 17:04:35 -07:00
Xavier Léauté
22553b0b28
[maven-release-plugin] prepare for next development iteration
2014-09-05 11:07:22 -07:00
Xavier Léauté
570a7a07bf
[maven-release-plugin] prepare release druid-0.6.152
2014-09-05 11:07:14 -07:00
fjy
e24be03a38
[maven-release-plugin] prepare for next development iteration
2014-09-04 14:10:13 -07:00
fjy
a933ea1866
[maven-release-plugin] prepare release druid-0.6.151
2014-09-04 14:10:09 -07:00
fjy
f473e62f1f
Merge pull request #714 from metamx/cleanup-javadocs
...
Cleanup javadocs
2014-09-04 12:28:10 -06:00
Gian Merlino
96d7b18163
[maven-release-plugin] prepare for next development iteration
2014-08-29 15:29:58 -07:00
Gian Merlino
860cf36ab1
[maven-release-plugin] prepare release druid-0.6.150
2014-08-29 15:29:54 -07:00
Xavier Léauté
58ab759fc6
remove unused imports
2014-08-29 14:03:47 -07:00
Xavier Léauté
ac05836833
make Java 8 javadoc happy
2014-08-29 13:58:50 -07:00
Xavier Léauté
daca178631
[maven-release-plugin] prepare for next development iteration
2014-08-29 10:43:19 -07:00
Xavier Léauté
0793a5aee6
[maven-release-plugin] prepare release druid-0.6.149
2014-08-29 10:43:15 -07:00
Xavier Léauté
1d6842c7f0
[maven-release-plugin] prepare for next development iteration
2014-08-27 12:22:53 -07:00
Xavier Léauté
575951f99a
[maven-release-plugin] prepare release druid-0.6.148
2014-08-27 12:22:49 -07:00
fjy
00f7077f50
[maven-release-plugin] prepare for next development iteration
2014-08-22 08:28:56 -07:00
fjy
df488563e4
[maven-release-plugin] prepare release druid-0.6.147
2014-08-22 08:28:51 -07:00
fjy
12f4147df5
switch index gen job to use logging indicator
2014-08-21 13:28:15 -07:00
fjy
df48b48e35
[maven-release-plugin] prepare for next development iteration
2014-08-21 12:50:33 -07:00
fjy
4f0b994037
[maven-release-plugin] prepare release druid-0.6.146
2014-08-21 12:50:30 -07:00
fjy
d64879ccca
more cleanup
2014-08-20 13:22:42 -07:00
fjy
bb73b2556e
fix compilation
2014-08-20 13:17:00 -07:00
fjy
92f26d9a1f
cleanup rowflushboundary
2014-08-20 13:09:37 -07:00
nishantmonu51
79ff993b31
increase default buffer size to 512m
2014-08-20 22:15:06 +05:30
nishantmonu51
33354cf7fe
replace maxRowsInMemory with BufferSize
2014-08-20 20:59:44 +05:30
fjy
88a904e0b3
address cr about progress ind
2014-08-19 12:59:01 -07:00
fjy
51988be776
[maven-release-plugin] prepare for next development iteration
2014-08-14 14:59:00 -07:00
fjy
2830028092
[maven-release-plugin] prepare release druid-0.6.145
2014-08-14 14:58:57 -07:00
fjy
4e3f4fbc22
[maven-release-plugin] prepare for next development iteration
2014-08-12 13:24:55 -07:00
fjy
f3aafc246c
[maven-release-plugin] prepare release druid-0.6.144
2014-08-12 13:24:50 -07:00
nishantmonu51
c6712739dc
merge changes from druid-0.7.x
2014-08-12 15:47:42 +05:30
nishantmonu51
9598a524a8
review comment - move index closure to finally
2014-08-12 14:58:55 +05:30
fjy
0cff63c7c6
[maven-release-plugin] prepare for next development iteration
2014-08-09 19:36:11 -07:00
fjy
724562b181
[maven-release-plugin] prepare release druid-0.6.143
2014-08-09 19:36:05 -07:00
fjy
d58ae945a4
[maven-release-plugin] prepare for next development iteration
2014-08-08 16:22:38 -07:00
fjy
d240479133
[maven-release-plugin] prepare release druid-0.6.142
2014-08-08 16:22:34 -07:00
fjy
199f2b1683
[maven-release-plugin] prepare for next development iteration
2014-08-08 15:53:53 -07:00
fjy
29a077d893
[maven-release-plugin] prepare release druid-0.6.141
2014-08-08 15:53:49 -07:00
fjy
958792db5c
[maven-release-plugin] prepare for next development iteration
2014-08-08 15:16:38 -07:00
fjy
4482e1b7d8
[maven-release-plugin] prepare release druid-0.6.140
2014-08-08 15:16:34 -07:00
fjy
ddcea18631
fix dependencies
2014-08-08 14:02:14 -07:00
fjy
74646f18f4
[maven-release-plugin] prepare for next development iteration
2014-08-08 11:40:52 -07:00
fjy
78c7140b52
[maven-release-plugin] prepare release druid-0.6.139
2014-08-08 11:40:46 -07:00
fjy
9f4dd7b33e
[maven-release-plugin] prepare for next development iteration
2014-08-06 13:34:04 -07:00
fjy
aa5cb91618
[maven-release-plugin] prepare release druid-0.6.138
2014-08-06 13:33:59 -07:00
fjy
65b8278add
[maven-release-plugin] prepare for next development iteration
2014-08-01 10:14:34 -07:00
fjy
0ecbef6c5d
[maven-release-plugin] prepare release druid-0.6.137
2014-08-01 10:14:30 -07:00
fjy
bf8c24f88d
[maven-release-plugin] prepare for next development iteration
2014-07-31 14:08:38 -07:00
fjy
66020fc2b6
[maven-release-plugin] prepare release druid-0.6.136
2014-07-31 14:08:34 -07:00
nishantmonu51
637bd35785
merge changes from druid-0.7.x
2014-07-31 16:07:22 +05:30
fjy
a8c8e4cb51
[maven-release-plugin] prepare for next development iteration
2014-07-29 22:03:14 -07:00
fjy
25eda62a0c
[maven-release-plugin] prepare release druid-0.6.135
2014-07-29 22:03:09 -07:00
fjy
0c898c58d1
[maven-release-plugin] prepare for next development iteration
2014-07-29 18:01:06 -07:00
fjy
c8244d05d1
[maven-release-plugin] prepare release druid-0.6.134
2014-07-29 18:01:02 -07:00
fjy
f7319620c4
[maven-release-plugin] prepare for next development iteration
2014-07-29 17:40:56 -07:00
fjy
540a146eaa
[maven-release-plugin] prepare release druid-0.6.133
2014-07-29 17:40:52 -07:00
fjy
b5ecf000ad
[maven-release-plugin] prepare for next development iteration
2014-07-29 16:20:14 -07:00
fjy
877bd98667
[maven-release-plugin] prepare release druid-0.6.132
2014-07-29 16:20:10 -07:00
fjy
e1d87ed5ea
[maven-release-plugin] prepare for next development iteration
2014-07-29 14:13:41 -07:00
fjy
c46965c52c
[maven-release-plugin] prepare release druid-0.6.131
2014-07-29 14:13:37 -07:00
fjy
1de0f89718
[maven-release-plugin] prepare for next development iteration
2014-07-18 11:55:50 -07:00
fjy
39bff5c1c2
[maven-release-plugin] prepare release druid-0.6.130
2014-07-18 11:55:46 -07:00
fjy
9e303527f2
[maven-release-plugin] prepare for next development iteration
2014-07-18 11:17:56 -07:00
fjy
ea04022772
[maven-release-plugin] prepare release druid-0.6.129
2014-07-18 11:17:52 -07:00
nishantmonu51
4ce12470a1
Add way to skip determine partitions for index task
...
Add a way to skip determinePartitions for IndexTask by manually
specifying numShards.
2014-07-18 18:52:15 +05:30
nishantmonu51
f5f05e3a9b
Sync changes from branch new-ingestion PR #599
...
Sync and Resolve Conflicts
2014-07-11 16:15:10 +05:30
nishantmonu51
fa43049240
review comments & pom changes
2014-07-10 11:48:46 +05:30
nishantmonu51
36fc85736c
Add ShardSpec Lookup
...
Optimize choosing shardSpec for Hash Partitions
2014-07-08 18:01:31 +05:30
Xavier Léauté
70ae6e1fcd
Approximate Histogram Module
2014-07-01 15:10:23 -07:00
fjy
4c40e71e54
address cr
2014-06-19 14:48:46 -07:00
fjy
a870fe5cbe
inject column config
2014-06-19 14:47:57 -07:00
Xavier Léauté
09346b0a3c
make column cache configurable
2014-06-19 14:43:03 -07:00
fjy
0bc1915067
Merge pull request #578 from metamx/new-guava
...
Update guava, java-util, and druid-api
2014-06-18 14:23:32 -06:00
Gian Merlino
7c7d170e78
[maven-release-plugin] prepare for next development iteration
2014-06-18 10:53:40 -07:00
Gian Merlino
a52a1d3929
[maven-release-plugin] prepare release druid-0.6.128
2014-06-18 10:53:36 -07:00
Gian Merlino
9532beb05c
[maven-release-plugin] prepare for next development iteration
2014-06-17 17:29:31 -07:00
Gian Merlino
e3dcbde07d
[maven-release-plugin] prepare release druid-0.6.127
2014-06-17 17:29:27 -07:00
Gian Merlino
a658afe902
[maven-release-plugin] prepare for next development iteration
2014-06-17 13:01:01 -07:00
Gian Merlino
4e875b8084
[maven-release-plugin] prepare release druid-0.6.126
2014-06-17 13:00:54 -07:00
Gian Merlino
964f12b7d6
[maven-release-plugin] prepare for next development iteration
2014-06-16 16:56:44 -07:00
Gian Merlino
4e184e3793
[maven-release-plugin] prepare release druid-0.6.125
2014-06-16 16:56:37 -07:00
Gian Merlino
ef7e786b96
[maven-release-plugin] prepare for next development iteration
2014-06-16 16:38:08 -07:00
Gian Merlino
96be9faec7
[maven-release-plugin] prepare release druid-0.6.124
2014-06-16 16:37:59 -07:00
nishantmonu51
2d03888a2c
Merge branch 'master' into offheap-incremental-index
...
Conflicts:
processing/src/main/java/io/druid/query/groupby/GroupByQueryHelper.java
processing/src/main/java/io/druid/query/groupby/GroupByQueryQueryToolChe
st.java
processing/src/main/java/io/druid/segment/incremental/IncrementalIndex.j
ava
2014-06-16 20:43:17 +05:30
Xavier Léauté
a5c533dcab
[maven-release-plugin] prepare for next development iteration
2014-06-13 15:17:00 -07:00
Xavier Léauté
903f1a695f
[maven-release-plugin] prepare release druid-0.6.123
2014-06-13 15:16:36 -07:00
fjy
0fd57dbc75
[maven-release-plugin] prepare for next development iteration
2014-06-13 15:05:18 -07:00
fjy
bcc6e77919
[maven-release-plugin] prepare release druid-0.6.122
2014-06-13 15:05:14 -07:00
Xavier Léauté
b7b28ad2f9
[maven-release-plugin] rollback the release of druid-0.6.122
2014-06-13 15:03:03 -07:00
Xavier Léauté
695a2946a9
[maven-release-plugin] prepare for next development iteration
2014-06-13 15:01:13 -07:00
Xavier Léauté
83b2434cad
[maven-release-plugin] prepare release druid-0.6.122
2014-06-13 15:01:09 -07:00
Xavier Léauté
bd18fef474
[maven-release-plugin] rollback the release of druid-0.6.122
2014-06-13 14:57:31 -07:00
Xavier Léauté
1159e2e415
[maven-release-plugin] prepare release druid-0.6.122
2014-06-13 14:56:12 -07:00
Xavier Léauté
6505f82053
[maven-release-plugin] rollback the release of druid-0.6.122
2014-06-13 14:54:23 -07:00
Xavier Léauté
f6d319dac2
[maven-release-plugin] prepare for next development iteration
2014-06-13 14:46:08 -07:00
Xavier Léauté
394d0cfbca
[maven-release-plugin] prepare release druid-0.6.122
2014-06-13 14:45:43 -07:00
fjy
a63cda3281
Merge branch 'master' into new-guava
...
Conflicts:
server/src/main/java/io/druid/server/QueryResource.java
2014-06-13 10:08:10 -07:00
nishantmonu51
025814cfff
Merge branch 'master' into offheap-incremental-index
...
Conflicts:
processing/src/main/java/io/druid/query/GroupByParallelQueryRunner.java
processing/src/main/java/io/druid/query/groupby/GroupByQueryRunnerFactor
y.java
processing/src/main/java/io/druid/segment/incremental/IncrementalIndexSt
orageAdapter.java
2014-06-12 20:02:27 +05:30
nishantmonu51
a7e19ad892
configure buffer sizes
2014-06-12 19:32:37 +05:30
fjy
46ef5c4560
[maven-release-plugin] prepare for next development iteration
2014-06-05 10:03:31 -07:00
fjy
0265ae9ac0
[maven-release-plugin] prepare release druid-0.6.121
2014-06-05 10:03:26 -07:00
nishantmonu51
6265613bb9
Merge branch 'master' into offheap-incremental-index
2014-06-05 17:42:57 +05:30
nishantmonu51
01e8a713b6
unit tests passing with offheap-indexing
2014-06-05 17:42:53 +05:30
fjy
e8aef86458
[maven-release-plugin] prepare for next development iteration
2014-06-04 20:22:31 -07:00
fjy
033f81ca64
[maven-release-plugin] prepare release druid-0.6.120
2014-06-04 20:22:14 -07:00
Gian Merlino
3325f6d6ed
[maven-release-plugin] prepare for next development iteration
2014-06-04 17:56:20 -07:00
Gian Merlino
6309ab1973
[maven-release-plugin] prepare release druid-0.6.119
2014-06-04 17:56:15 -07:00
Gian Merlino
1ca7bf03b8
IndexGeneratorJob needs to respect isCombineText, too.
2014-06-04 17:54:31 -07:00
fjy
4524863db1
[maven-release-plugin] prepare for next development iteration
2014-06-04 16:49:49 -07:00
fjy
37c6ece150
[maven-release-plugin] prepare release druid-0.6.118
2014-06-04 16:49:44 -07:00
fjy
adc00f2bcf
make combine text configurable
2014-06-04 16:24:56 -07:00
fjy
2d95780d12
[maven-release-plugin] prepare for next development iteration
2014-06-04 09:45:11 -07:00
fjy
30ce0ab99c
[maven-release-plugin] prepare release druid-0.6.117
2014-06-04 09:45:06 -07:00
fjy
bb4105ed1a
fix broken standalone hadoop ingestion
2014-06-04 09:23:46 -07:00
fjy
77ec4df797
update guava, java-util, and druid-api
2014-06-03 13:43:38 -07:00
fjy
1407b49da1
[maven-release-plugin] prepare for next development iteration
2014-06-02 10:53:47 -07:00
fjy
f91ecf20f3
[maven-release-plugin] prepare release druid-0.6.116
2014-06-02 10:53:43 -07:00
fjy
4c13327297
more logging for determine hashed
2014-05-30 16:19:20 -07:00
fjy
ee60183df7
[maven-release-plugin] prepare for next development iteration
2014-05-29 17:26:55 -07:00
fjy
d13a354ffb
[maven-release-plugin] prepare release druid-0.6.115
2014-05-29 17:26:49 -07:00
fjy
7be93a770a
make all firehoses work with tasks, add a lot more documentation about configuration
2014-05-28 16:33:59 -07:00
Deepak
7d92cf2b3b
Update IndexGeneratorJob.java
...
CombineTextInputFormat instead of TextInputFormat combines multiple splits for a single mapper and reduces the strain on hadoop platform. It greatly improves job completion time as there are fewer number of mappers to bookkeep.
2014-05-22 15:08:12 +05:30
Deepak
de0a7b27e7
Update DetermineHashedPartitionsJob.java
...
CombineTextInputFormat instead of TextInputFormat combines multiple splits for a single mapper and reduces the strain on hadoop platform. It greatly improves job completion time as there are fewer number of mappers to bookkeep.
2014-05-22 15:06:56 +05:30
fjy
5ce80068d2
[maven-release-plugin] prepare for next development iteration
2014-05-20 13:22:52 -07:00
fjy
904c9049a7
[maven-release-plugin] prepare release druid-0.6.114
2014-05-20 13:22:48 -07:00
fjy
783f8fcc99
[maven-release-plugin] prepare for next development iteration
2014-05-20 12:47:33 -07:00
fjy
def12c03bd
[maven-release-plugin] prepare release druid-0.6.113
2014-05-20 12:47:29 -07:00
fjy
e5454b47f1
[maven-release-plugin] prepare for next development iteration
2014-05-20 10:49:00 -07:00
fjy
bcffb92181
[maven-release-plugin] prepare release druid-0.6.112
2014-05-20 10:48:53 -07:00
fjy
dd59b58208
[maven-release-plugin] prepare for next development iteration
2014-05-19 21:17:09 -07:00
fjy
511aca9ea8
[maven-release-plugin] prepare release druid-0.6.111
2014-05-19 21:17:04 -07:00
Xavier Léauté
9ec7c71e0f
fix compilation error with updated druid-api
2014-05-19 14:06:23 -07:00
Xavier Léauté
20c4fbc98d
[maven-release-plugin] prepare for next development iteration
2014-05-16 16:34:19 -07:00
Xavier Léauté
4abcf3e16a
[maven-release-plugin] prepare release druid-0.6.110
2014-05-16 16:34:12 -07:00
fjy
da285d8665
[maven-release-plugin] prepare for next development iteration
2014-05-15 16:44:36 -07:00
fjy
b7009c9102
[maven-release-plugin] prepare release druid-0.6.109
2014-05-15 16:44:32 -07:00
fjy
48ae84ed56
[maven-release-plugin] prepare for next development iteration
2014-05-07 12:40:14 -07:00
fjy
27f7c45e91
[maven-release-plugin] prepare release druid-0.6.108
2014-05-07 12:40:10 -07:00
fjy
42994cebcd
[maven-release-plugin] prepare for next development iteration
2014-05-07 11:25:50 -07:00
fjy
2bf5c3831d
[maven-release-plugin] prepare release druid-0.6.107
2014-05-07 11:25:45 -07:00
fjy
1100d2f2a1
rename configs to make a bit more sense
2014-05-06 14:52:50 -07:00
fjy
b6fb4245aa
Merge branch 'master' into new-schema
...
Conflicts:
indexing-hadoop/src/main/java/io/druid/indexer/HadoopDriverConfig.java
indexing-hadoop/src/main/java/io/druid/indexer/HadoopDruidIndexerConfig.java
indexing-hadoop/src/main/java/io/druid/indexer/HadoopDruidIndexerConfigBuilder.java
pom.xml
server/src/main/java/io/druid/segment/realtime/RealtimeManager.java
server/src/main/java/io/druid/segment/realtime/firehose/EventReceiverFirehoseFactory.java
2014-05-06 14:32:51 -07:00
Gian Merlino
6f3f5c6e99
[maven-release-plugin] prepare for next development iteration
2014-05-06 11:28:39 -07:00
Gian Merlino
a5a875e1ed
[maven-release-plugin] prepare release druid-0.6.106
2014-05-06 11:28:34 -07:00
Gian Merlino
bdf9e74a3b
Allow config-based overriding of hadoop job properties.
2014-05-06 09:11:31 -07:00
fjy
e0bce3168c
[maven-release-plugin] prepare for next development iteration
2014-05-01 15:09:01 -07:00
fjy
dd0004b759
[maven-release-plugin] prepare release druid-0.6.105
2014-05-01 15:08:57 -07:00
fjy
f9523274ac
remove extra println
2014-05-01 15:06:51 -07:00
nishantmonu51
5137031304
use same logic for compression
...
Use same logic for compression across creating files, reading from
files, and checking file existence
2014-05-01 15:20:47 +05:30
nishantmonu51
728f1e8ee3
fix exists check with compression
2014-05-01 15:01:10 +05:30
nishantmonu51
01e84f10b7
add the checks again.
...
removing these checks breaks when there is no data for any interval
2014-05-01 14:35:09 +05:30
fjy
015000ee8f
[maven-release-plugin] prepare for next development iteration
2014-04-30 13:16:24 -07:00
fjy
eae7d55dce
[maven-release-plugin] prepare release druid-0.6.104
2014-04-30 13:16:20 -07:00
fjy
7700001e27
[maven-release-plugin] prepare for next development iteration
2014-04-30 10:45:20 -07:00
fjy
1e639792bf
[maven-release-plugin] prepare release druid-0.6.103
2014-04-30 10:45:14 -07:00
fjy
9ad0da0794
[maven-release-plugin] prepare for next development iteration
2014-04-30 10:26:38 -07:00
fjy
5b7b29b61b
[maven-release-plugin] prepare release druid-0.6.102
2014-04-30 10:26:34 -07:00
fjy
76e0a48527
Merge branch 'master' into new-schema
...
Conflicts:
indexing-hadoop/src/main/java/io/druid/indexer/DbUpdaterJob.java
indexing-hadoop/src/test/java/io/druid/indexer/HadoopDruidIndexerConfigTest.java
indexing-service/src/main/java/io/druid/indexing/common/task/HadoopIndexTask.java
server/src/main/java/io/druid/segment/realtime/plumber/RealtimePlumber.java
server/src/main/java/io/druid/segment/realtime/plumber/RealtimePlumberSchool.java
2014-04-25 14:03:28 -07:00
Xavier Léauté
f88cb13ccb
[maven-release-plugin] prepare for next development iteration
2014-04-24 17:27:58 -07:00
Xavier Léauté
b8c14ba061
[maven-release-plugin] prepare release druid-0.6.101
2014-04-24 17:27:46 -07:00
fjy
5e98275251
[maven-release-plugin] prepare for next development iteration
2014-04-24 11:47:52 -07:00
fjy
35dc96e946
[maven-release-plugin] prepare release druid-0.6.100
2014-04-24 11:47:47 -07:00
fjy
bec171fea9
[maven-release-plugin] prepare for next development iteration
2014-04-22 17:10:33 -07:00
fjy
67972ca5c5
[maven-release-plugin] prepare release druid-0.6.99
2014-04-22 17:10:27 -07:00
fjy
2d1f33e59f
Merge pull request #500 from metamx/batch-ingestion-fixes
...
Batch ingestion fixes
2014-04-22 17:59:24 -06:00
nishantmonu51
357bbf5127
add all the shard specs
2014-04-23 05:23:11 +05:30
nishantmonu51
625a5418d2
minor fix
2014-04-23 05:05:51 +05:30
nishantmonu51
1ca61237c1
review comments- use final variables
2014-04-23 03:33:28 +05:30
nishantmonu51
0d8c1ffe54
review comments and add partitioner
2014-04-23 03:30:30 +05:30
nishantmonu51
ea4a80e8d2
Add serde test for shardCount
2014-04-23 00:24:08 +05:30
nishantmonu51
e920cec5d0
remove unused import
2014-04-23 00:13:30 +05:30
nishantmonu51
0748eabe9b
batch ingestion fixes
...
1) Fix path when mapped output is compressed
2) Add number of reducers to the determine hashed partitions job
manually
3) Add a way to disable determine partitions and specify shardCount in
HashedPartitionsSpec
2014-04-23 00:05:08 +05:30
fjy
2df2cbf2a2
Merge pull request #466 from Crystark/patch-1
...
Support for postgresql
2014-04-22 12:18:05 -06:00
fjy
bed8860fd4
[maven-release-plugin] prepare for next development iteration
2014-04-21 22:34:43 -07:00
fjy
594bb65ba6
[maven-release-plugin] prepare release druid-0.6.98
2014-04-21 22:34:38 -07:00
fjy
357cd66f66
[maven-release-plugin] prepare for next development iteration
2014-04-21 22:26:28 -07:00
fjy
93ed56f680
[maven-release-plugin] prepare release druid-0.6.97
2014-04-21 22:26:23 -07:00