nishantmonu51
79ff993b31
increase default buffer size to 512m
2014-08-20 22:15:06 +05:30
nishantmonu51
33354cf7fe
replace maxRowsInMemory with BufferSize
2014-08-20 20:59:44 +05:30
fjy
88a904e0b3
address cr about progress ind
2014-08-19 12:59:01 -07:00
fjy
51988be776
[maven-release-plugin] prepare for next development iteration
2014-08-14 14:59:00 -07:00
fjy
2830028092
[maven-release-plugin] prepare release druid-0.6.145
2014-08-14 14:58:57 -07:00
fjy
4e3f4fbc22
[maven-release-plugin] prepare for next development iteration
2014-08-12 13:24:55 -07:00
fjy
f3aafc246c
[maven-release-plugin] prepare release druid-0.6.144
2014-08-12 13:24:50 -07:00
nishantmonu51
c6712739dc
merge changes from druid-0.7.x
2014-08-12 15:47:42 +05:30
nishantmonu51
9598a524a8
review comment - move index closure to finally
2014-08-12 14:58:55 +05:30
fjy
0cff63c7c6
[maven-release-plugin] prepare for next development iteration
2014-08-09 19:36:11 -07:00
fjy
724562b181
[maven-release-plugin] prepare release druid-0.6.143
2014-08-09 19:36:05 -07:00
fjy
d58ae945a4
[maven-release-plugin] prepare for next development iteration
2014-08-08 16:22:38 -07:00
fjy
d240479133
[maven-release-plugin] prepare release druid-0.6.142
2014-08-08 16:22:34 -07:00
fjy
199f2b1683
[maven-release-plugin] prepare for next development iteration
2014-08-08 15:53:53 -07:00
fjy
29a077d893
[maven-release-plugin] prepare release druid-0.6.141
2014-08-08 15:53:49 -07:00
fjy
958792db5c
[maven-release-plugin] prepare for next development iteration
2014-08-08 15:16:38 -07:00
fjy
4482e1b7d8
[maven-release-plugin] prepare release druid-0.6.140
2014-08-08 15:16:34 -07:00
fjy
ddcea18631
fix dependencies
2014-08-08 14:02:14 -07:00
fjy
74646f18f4
[maven-release-plugin] prepare for next development iteration
2014-08-08 11:40:52 -07:00
fjy
78c7140b52
[maven-release-plugin] prepare release druid-0.6.139
2014-08-08 11:40:46 -07:00
fjy
9f4dd7b33e
[maven-release-plugin] prepare for next development iteration
2014-08-06 13:34:04 -07:00
fjy
aa5cb91618
[maven-release-plugin] prepare release druid-0.6.138
2014-08-06 13:33:59 -07:00
fjy
65b8278add
[maven-release-plugin] prepare for next development iteration
2014-08-01 10:14:34 -07:00
fjy
0ecbef6c5d
[maven-release-plugin] prepare release druid-0.6.137
2014-08-01 10:14:30 -07:00
fjy
bf8c24f88d
[maven-release-plugin] prepare for next development iteration
2014-07-31 14:08:38 -07:00
fjy
66020fc2b6
[maven-release-plugin] prepare release druid-0.6.136
2014-07-31 14:08:34 -07:00
nishantmonu51
637bd35785
merge changes from druid-0.7.x
2014-07-31 16:07:22 +05:30
fjy
a8c8e4cb51
[maven-release-plugin] prepare for next development iteration
2014-07-29 22:03:14 -07:00
fjy
25eda62a0c
[maven-release-plugin] prepare release druid-0.6.135
2014-07-29 22:03:09 -07:00
fjy
0c898c58d1
[maven-release-plugin] prepare for next development iteration
2014-07-29 18:01:06 -07:00
fjy
c8244d05d1
[maven-release-plugin] prepare release druid-0.6.134
2014-07-29 18:01:02 -07:00
fjy
f7319620c4
[maven-release-plugin] prepare for next development iteration
2014-07-29 17:40:56 -07:00
fjy
540a146eaa
[maven-release-plugin] prepare release druid-0.6.133
2014-07-29 17:40:52 -07:00
fjy
b5ecf000ad
[maven-release-plugin] prepare for next development iteration
2014-07-29 16:20:14 -07:00
fjy
877bd98667
[maven-release-plugin] prepare release druid-0.6.132
2014-07-29 16:20:10 -07:00
fjy
e1d87ed5ea
[maven-release-plugin] prepare for next development iteration
2014-07-29 14:13:41 -07:00
fjy
c46965c52c
[maven-release-plugin] prepare release druid-0.6.131
2014-07-29 14:13:37 -07:00
fjy
1de0f89718
[maven-release-plugin] prepare for next development iteration
2014-07-18 11:55:50 -07:00
fjy
39bff5c1c2
[maven-release-plugin] prepare release druid-0.6.130
2014-07-18 11:55:46 -07:00
fjy
9e303527f2
[maven-release-plugin] prepare for next development iteration
2014-07-18 11:17:56 -07:00
fjy
ea04022772
[maven-release-plugin] prepare release druid-0.6.129
2014-07-18 11:17:52 -07:00
nishantmonu51
4ce12470a1
Add way to skip determine partitions for index task
...
Add a way to skip determinePartitions for IndexTask by manually
specifying numShards.
2014-07-18 18:52:15 +05:30
nishantmonu51
f5f05e3a9b
Sync changes from branch new-ingestion PR #599
...
Sync and Resolve Conflicts
2014-07-11 16:15:10 +05:30
nishantmonu51
fa43049240
review comments & pom changes
2014-07-10 11:48:46 +05:30
nishantmonu51
36fc85736c
Add ShardSpec Lookup
...
Optimize choosing shardSpec for Hash Partitions
2014-07-08 18:01:31 +05:30
Xavier Léauté
70ae6e1fcd
Approximate Histogram Module
2014-07-01 15:10:23 -07:00
fjy
4c40e71e54
address cr
2014-06-19 14:48:46 -07:00
fjy
a870fe5cbe
inject column config
2014-06-19 14:47:57 -07:00
Xavier Léauté
09346b0a3c
make column cache configurable
2014-06-19 14:43:03 -07:00
fjy
0bc1915067
Merge pull request #578 from metamx/new-guava
...
Update guava, java-util, and druid-api
2014-06-18 14:23:32 -06:00
Gian Merlino
7c7d170e78
[maven-release-plugin] prepare for next development iteration
2014-06-18 10:53:40 -07:00
Gian Merlino
a52a1d3929
[maven-release-plugin] prepare release druid-0.6.128
2014-06-18 10:53:36 -07:00
Gian Merlino
9532beb05c
[maven-release-plugin] prepare for next development iteration
2014-06-17 17:29:31 -07:00
Gian Merlino
e3dcbde07d
[maven-release-plugin] prepare release druid-0.6.127
2014-06-17 17:29:27 -07:00
Gian Merlino
a658afe902
[maven-release-plugin] prepare for next development iteration
2014-06-17 13:01:01 -07:00
Gian Merlino
4e875b8084
[maven-release-plugin] prepare release druid-0.6.126
2014-06-17 13:00:54 -07:00
Gian Merlino
964f12b7d6
[maven-release-plugin] prepare for next development iteration
2014-06-16 16:56:44 -07:00
Gian Merlino
4e184e3793
[maven-release-plugin] prepare release druid-0.6.125
2014-06-16 16:56:37 -07:00
Gian Merlino
ef7e786b96
[maven-release-plugin] prepare for next development iteration
2014-06-16 16:38:08 -07:00
Gian Merlino
96be9faec7
[maven-release-plugin] prepare release druid-0.6.124
2014-06-16 16:37:59 -07:00
nishantmonu51
2d03888a2c
Merge branch 'master' into offheap-incremental-index
...
Conflicts:
processing/src/main/java/io/druid/query/groupby/GroupByQueryHelper.java
processing/src/main/java/io/druid/query/groupby/GroupByQueryQueryToolChe
st.java
processing/src/main/java/io/druid/segment/incremental/IncrementalIndex.j
ava
2014-06-16 20:43:17 +05:30
Xavier Léauté
a5c533dcab
[maven-release-plugin] prepare for next development iteration
2014-06-13 15:17:00 -07:00
Xavier Léauté
903f1a695f
[maven-release-plugin] prepare release druid-0.6.123
2014-06-13 15:16:36 -07:00
fjy
0fd57dbc75
[maven-release-plugin] prepare for next development iteration
2014-06-13 15:05:18 -07:00
fjy
bcc6e77919
[maven-release-plugin] prepare release druid-0.6.122
2014-06-13 15:05:14 -07:00
Xavier Léauté
b7b28ad2f9
[maven-release-plugin] rollback the release of druid-0.6.122
2014-06-13 15:03:03 -07:00
Xavier Léauté
695a2946a9
[maven-release-plugin] prepare for next development iteration
2014-06-13 15:01:13 -07:00
Xavier Léauté
83b2434cad
[maven-release-plugin] prepare release druid-0.6.122
2014-06-13 15:01:09 -07:00
Xavier Léauté
bd18fef474
[maven-release-plugin] rollback the release of druid-0.6.122
2014-06-13 14:57:31 -07:00
Xavier Léauté
1159e2e415
[maven-release-plugin] prepare release druid-0.6.122
2014-06-13 14:56:12 -07:00
Xavier Léauté
6505f82053
[maven-release-plugin] rollback the release of druid-0.6.122
2014-06-13 14:54:23 -07:00
Xavier Léauté
f6d319dac2
[maven-release-plugin] prepare for next development iteration
2014-06-13 14:46:08 -07:00
Xavier Léauté
394d0cfbca
[maven-release-plugin] prepare release druid-0.6.122
2014-06-13 14:45:43 -07:00
fjy
a63cda3281
Merge branch 'master' into new-guava
...
Conflicts:
server/src/main/java/io/druid/server/QueryResource.java
2014-06-13 10:08:10 -07:00
nishantmonu51
025814cfff
Merge branch 'master' into offheap-incremental-index
...
Conflicts:
processing/src/main/java/io/druid/query/GroupByParallelQueryRunner.java
processing/src/main/java/io/druid/query/groupby/GroupByQueryRunnerFactor
y.java
processing/src/main/java/io/druid/segment/incremental/IncrementalIndexSt
orageAdapter.java
2014-06-12 20:02:27 +05:30
nishantmonu51
a7e19ad892
configure buffer sizes
2014-06-12 19:32:37 +05:30
fjy
46ef5c4560
[maven-release-plugin] prepare for next development iteration
2014-06-05 10:03:31 -07:00
fjy
0265ae9ac0
[maven-release-plugin] prepare release druid-0.6.121
2014-06-05 10:03:26 -07:00
nishantmonu51
6265613bb9
Merge branch 'master' into offheap-incremental-index
2014-06-05 17:42:57 +05:30
nishantmonu51
01e8a713b6
unit tests passing with offheap-indexing
2014-06-05 17:42:53 +05:30
fjy
e8aef86458
[maven-release-plugin] prepare for next development iteration
2014-06-04 20:22:31 -07:00
fjy
033f81ca64
[maven-release-plugin] prepare release druid-0.6.120
2014-06-04 20:22:14 -07:00
Gian Merlino
3325f6d6ed
[maven-release-plugin] prepare for next development iteration
2014-06-04 17:56:20 -07:00
Gian Merlino
6309ab1973
[maven-release-plugin] prepare release druid-0.6.119
2014-06-04 17:56:15 -07:00
Gian Merlino
1ca7bf03b8
IndexGeneratorJob needs to respect isCombineText, too.
2014-06-04 17:54:31 -07:00
fjy
4524863db1
[maven-release-plugin] prepare for next development iteration
2014-06-04 16:49:49 -07:00
fjy
37c6ece150
[maven-release-plugin] prepare release druid-0.6.118
2014-06-04 16:49:44 -07:00
fjy
adc00f2bcf
make combine text configurable
2014-06-04 16:24:56 -07:00
fjy
2d95780d12
[maven-release-plugin] prepare for next development iteration
2014-06-04 09:45:11 -07:00
fjy
30ce0ab99c
[maven-release-plugin] prepare release druid-0.6.117
2014-06-04 09:45:06 -07:00
fjy
bb4105ed1a
fix broken standalone hadoop ingestion
2014-06-04 09:23:46 -07:00
fjy
77ec4df797
update guava, java-util, and druid-api
2014-06-03 13:43:38 -07:00
fjy
1407b49da1
[maven-release-plugin] prepare for next development iteration
2014-06-02 10:53:47 -07:00
fjy
f91ecf20f3
[maven-release-plugin] prepare release druid-0.6.116
2014-06-02 10:53:43 -07:00
fjy
4c13327297
more logging for determine hashed
2014-05-30 16:19:20 -07:00
fjy
ee60183df7
[maven-release-plugin] prepare for next development iteration
2014-05-29 17:26:55 -07:00
fjy
d13a354ffb
[maven-release-plugin] prepare release druid-0.6.115
2014-05-29 17:26:49 -07:00
fjy
7be93a770a
make all firehoses work with tasks, add a lot more documentation about configuration
2014-05-28 16:33:59 -07:00
Deepak
7d92cf2b3b
Update IndexGeneratorJob.java
...
CombineTextInputFormat instead of TextInputFormat combines multiple splits for a single mapper and reduces the strain on hadoop platform. It greatly improves job completion time as there are fewer number of mappers to bookkeep.
2014-05-22 15:08:12 +05:30
Deepak
de0a7b27e7
Update DetermineHashedPartitionsJob.java
...
CombineTextInputFormat instead of TextInputFormat combines multiple splits for a single mapper and reduces the strain on hadoop platform. It greatly improves job completion time as there are fewer number of mappers to bookkeep.
2014-05-22 15:06:56 +05:30
fjy
5ce80068d2
[maven-release-plugin] prepare for next development iteration
2014-05-20 13:22:52 -07:00
fjy
904c9049a7
[maven-release-plugin] prepare release druid-0.6.114
2014-05-20 13:22:48 -07:00
fjy
783f8fcc99
[maven-release-plugin] prepare for next development iteration
2014-05-20 12:47:33 -07:00
fjy
def12c03bd
[maven-release-plugin] prepare release druid-0.6.113
2014-05-20 12:47:29 -07:00
fjy
e5454b47f1
[maven-release-plugin] prepare for next development iteration
2014-05-20 10:49:00 -07:00
fjy
bcffb92181
[maven-release-plugin] prepare release druid-0.6.112
2014-05-20 10:48:53 -07:00
fjy
dd59b58208
[maven-release-plugin] prepare for next development iteration
2014-05-19 21:17:09 -07:00
fjy
511aca9ea8
[maven-release-plugin] prepare release druid-0.6.111
2014-05-19 21:17:04 -07:00
Xavier Léauté
9ec7c71e0f
fix compilation error with updated druid-api
2014-05-19 14:06:23 -07:00
Xavier Léauté
20c4fbc98d
[maven-release-plugin] prepare for next development iteration
2014-05-16 16:34:19 -07:00
Xavier Léauté
4abcf3e16a
[maven-release-plugin] prepare release druid-0.6.110
2014-05-16 16:34:12 -07:00
fjy
da285d8665
[maven-release-plugin] prepare for next development iteration
2014-05-15 16:44:36 -07:00
fjy
b7009c9102
[maven-release-plugin] prepare release druid-0.6.109
2014-05-15 16:44:32 -07:00
fjy
48ae84ed56
[maven-release-plugin] prepare for next development iteration
2014-05-07 12:40:14 -07:00
fjy
27f7c45e91
[maven-release-plugin] prepare release druid-0.6.108
2014-05-07 12:40:10 -07:00
fjy
42994cebcd
[maven-release-plugin] prepare for next development iteration
2014-05-07 11:25:50 -07:00
fjy
2bf5c3831d
[maven-release-plugin] prepare release druid-0.6.107
2014-05-07 11:25:45 -07:00
fjy
1100d2f2a1
rename configs to make a bit more sense
2014-05-06 14:52:50 -07:00
fjy
b6fb4245aa
Merge branch 'master' into new-schema
...
Conflicts:
indexing-hadoop/src/main/java/io/druid/indexer/HadoopDriverConfig.java
indexing-hadoop/src/main/java/io/druid/indexer/HadoopDruidIndexerConfig.java
indexing-hadoop/src/main/java/io/druid/indexer/HadoopDruidIndexerConfigBuilder.java
pom.xml
server/src/main/java/io/druid/segment/realtime/RealtimeManager.java
server/src/main/java/io/druid/segment/realtime/firehose/EventReceiverFirehoseFactory.java
2014-05-06 14:32:51 -07:00
Gian Merlino
6f3f5c6e99
[maven-release-plugin] prepare for next development iteration
2014-05-06 11:28:39 -07:00
Gian Merlino
a5a875e1ed
[maven-release-plugin] prepare release druid-0.6.106
2014-05-06 11:28:34 -07:00
Gian Merlino
bdf9e74a3b
Allow config-based overriding of hadoop job properties.
2014-05-06 09:11:31 -07:00
fjy
e0bce3168c
[maven-release-plugin] prepare for next development iteration
2014-05-01 15:09:01 -07:00
fjy
dd0004b759
[maven-release-plugin] prepare release druid-0.6.105
2014-05-01 15:08:57 -07:00
fjy
f9523274ac
remove extra println
2014-05-01 15:06:51 -07:00
nishantmonu51
5137031304
use same logic for compression
...
Use same logic for compression across creating files, reading from
files, and checking file existence
2014-05-01 15:20:47 +05:30
nishantmonu51
728f1e8ee3
fix exists check with compression
2014-05-01 15:01:10 +05:30
nishantmonu51
01e84f10b7
add the checks again.
...
removing these checks breaks when there is no data for any interval
2014-05-01 14:35:09 +05:30
fjy
015000ee8f
[maven-release-plugin] prepare for next development iteration
2014-04-30 13:16:24 -07:00
fjy
eae7d55dce
[maven-release-plugin] prepare release druid-0.6.104
2014-04-30 13:16:20 -07:00
fjy
7700001e27
[maven-release-plugin] prepare for next development iteration
2014-04-30 10:45:20 -07:00
fjy
1e639792bf
[maven-release-plugin] prepare release druid-0.6.103
2014-04-30 10:45:14 -07:00
fjy
9ad0da0794
[maven-release-plugin] prepare for next development iteration
2014-04-30 10:26:38 -07:00
fjy
5b7b29b61b
[maven-release-plugin] prepare release druid-0.6.102
2014-04-30 10:26:34 -07:00
fjy
76e0a48527
Merge branch 'master' into new-schema
...
Conflicts:
indexing-hadoop/src/main/java/io/druid/indexer/DbUpdaterJob.java
indexing-hadoop/src/test/java/io/druid/indexer/HadoopDruidIndexerConfigTest.java
indexing-service/src/main/java/io/druid/indexing/common/task/HadoopIndexTask.java
server/src/main/java/io/druid/segment/realtime/plumber/RealtimePlumber.java
server/src/main/java/io/druid/segment/realtime/plumber/RealtimePlumberSchool.java
2014-04-25 14:03:28 -07:00
Xavier Léauté
f88cb13ccb
[maven-release-plugin] prepare for next development iteration
2014-04-24 17:27:58 -07:00
Xavier Léauté
b8c14ba061
[maven-release-plugin] prepare release druid-0.6.101
2014-04-24 17:27:46 -07:00
fjy
5e98275251
[maven-release-plugin] prepare for next development iteration
2014-04-24 11:47:52 -07:00
fjy
35dc96e946
[maven-release-plugin] prepare release druid-0.6.100
2014-04-24 11:47:47 -07:00
fjy
bec171fea9
[maven-release-plugin] prepare for next development iteration
2014-04-22 17:10:33 -07:00
fjy
67972ca5c5
[maven-release-plugin] prepare release druid-0.6.99
2014-04-22 17:10:27 -07:00
fjy
2d1f33e59f
Merge pull request #500 from metamx/batch-ingestion-fixes
...
Batch ingestion fixes
2014-04-22 17:59:24 -06:00
nishantmonu51
357bbf5127
add all the shard specs
2014-04-23 05:23:11 +05:30
nishantmonu51
625a5418d2
minor fix
2014-04-23 05:05:51 +05:30
nishantmonu51
1ca61237c1
review comments- use final variables
2014-04-23 03:33:28 +05:30
nishantmonu51
0d8c1ffe54
review comments and add partitioner
2014-04-23 03:30:30 +05:30
nishantmonu51
ea4a80e8d2
Add serde test for shardCount
2014-04-23 00:24:08 +05:30
nishantmonu51
e920cec5d0
remove unused import
2014-04-23 00:13:30 +05:30
nishantmonu51
0748eabe9b
batch ingestion fixes
...
1) Fix path when mapped output is compressed
2) Add number of reducers to the determine hashed partitions job
manually
3) Add a way to disable determine partitions and specify shardCount in
HashedPartitionsSpec
2014-04-23 00:05:08 +05:30
fjy
2df2cbf2a2
Merge pull request #466 from Crystark/patch-1
...
Support for postgresql
2014-04-22 12:18:05 -06:00