fjy
b1b9e0a267
i suck
2014-09-30 11:45:19 -07:00
fjy
575d51b0ce
fix compilation error
2014-09-30 11:44:50 -07:00
fjy
4c23a5e9f6
address cr again
2014-09-30 11:40:29 -07:00
fjy
55db06ccb1
address cr
2014-09-30 10:29:02 -07:00
nishantmonu51
358ff915bb
fix merge conflicts
2014-09-30 22:19:18 +05:30
nishantmonu51
2789536bed
merge changes from druid-0.7.x
2014-09-30 22:05:49 +05:30
nishantmonu51
61c7fd2e6e
make ingestOffheap tuneable
2014-09-30 15:30:02 +05:30
fjy
3f524baa67
Merge pull request #769 from metamx/task-logs-fixes
...
TaskLogs fixes and cleanups.
2014-09-29 17:37:00 -06:00
Gian Merlino
1e6ce8ac9a
TaskLogs fixes and cleanups.
...
- Fix negative offsets in FileTaskLogs and HdfsTaskLogs.
- Consolidate file offset code into LogUtils (currently used in two places).
- Clean up style for HdfsTaskLogs and related classes.
- Remove unused code in ForkingTaskRunner.
2014-09-29 16:20:34 -07:00
fjy
4a09678739
make the selection strategy in rtr extendable
2014-09-29 14:24:02 -07:00
jisookim0513
74565c9371
cleaned up the code
2014-09-27 13:10:01 -07:00
jisookim0513
6a641621b2
finished merging into druid-0.7.x; derby not working (to be fixed)
2014-09-26 14:24:53 -07:00
jisookim0513
43cc6283d3
trying to revert files that have overwritten changes
2014-09-26 12:38:04 -07:00
fjy
eaf0a48b92
Merge branch 'master' into druid-0.7.x
...
Conflicts:
cassandra-storage/pom.xml
common/pom.xml
examples/pom.xml
hdfs-storage/pom.xml
histogram/pom.xml
indexing-hadoop/pom.xml
indexing-service/pom.xml
kafka-eight/pom.xml
kafka-seven/pom.xml
pom.xml
processing/pom.xml
processing/src/main/java/io/druid/guice/PropertiesModule.java
rabbitmq/pom.xml
s3-extensions/pom.xml
server/pom.xml
services/pom.xml
2014-09-26 11:39:24 -07:00
jisookim0513
a5d02b9030
second attempt to fix merge-conflicts
2014-09-24 15:59:00 -07:00
jisookim0513
3bf39cc9f8
attempted to fix merge-conflicts
2014-09-24 15:55:42 -07:00
Xavier Léauté
7cfe86b7bc
[maven-release-plugin] prepare for next development iteration
2014-09-23 16:31:25 -07:00
Xavier Léauté
80166314d9
[maven-release-plugin] prepare release druid-0.6.156
2014-09-23 16:31:21 -07:00
fjy
4235e14fc6
[maven-release-plugin] prepare for next development iteration
2014-09-23 16:12:43 -07:00
fjy
576e9b8a84
[maven-release-plugin] prepare release druid-0.6.155
2014-09-23 16:12:39 -07:00
nishantmonu51
f51ab84386
merge changes from druid-0.7.x
2014-09-22 23:48:45 +05:30
jisookim0513
273205f217
initial attempt for abstraction; druid cluster works with Derby as a default
2014-09-19 17:39:59 -07:00
nishantmonu51
8eb6466487
revert buffer size and add back rowFlushBoundary
2014-09-19 23:06:04 +05:30
nishantmonu51
e6d93a3070
fix NPE
...
fix NPE when the dimension of metric is not present one of the segments
to be reIndexed.
2014-09-17 15:57:58 +05:30
fjy
a17794a516
[maven-release-plugin] prepare for next development iteration
2014-09-16 15:22:55 -07:00
fjy
f9c91ace3f
[maven-release-plugin] prepare release druid-0.6.154
2014-09-16 15:22:49 -07:00
nishantmonu51
f006de8639
fix #732
...
fix metric list discovery
2014-09-16 22:12:36 +05:30
Xavier Léauté
c8b8e3f6e9
negating compare is bad
2014-09-15 13:00:06 -07:00
Xavier Léauté
137ad50bf1
classes that should be static
2014-09-15 13:00:06 -07:00
Xavier Léauté
e57e2d97ba
make constants final
2014-09-15 12:53:40 -07:00
Xavier Léauté
cfa92e8217
fix incorrect nullable annotations
2014-09-15 12:13:52 -07:00
fjy
469ccbbe5e
Merge branch 'master' into druid-0.7.x
...
Conflicts:
cassandra-storage/pom.xml
common/pom.xml
examples/pom.xml
hdfs-storage/pom.xml
histogram/pom.xml
indexing-hadoop/pom.xml
indexing-service/pom.xml
kafka-eight/pom.xml
kafka-seven/pom.xml
pom.xml
processing/pom.xml
processing/src/main/java/io/druid/query/FinalizeResultsQueryRunner.java
processing/src/main/java/io/druid/query/UnionQueryRunner.java
processing/src/main/java/io/druid/query/groupby/GroupByQueryRunnerFactory.java
processing/src/main/java/io/druid/query/topn/TopNQueryEngine.java
processing/src/main/java/io/druid/query/topn/TopNQueryRunnerFactory.java
rabbitmq/pom.xml
s3-extensions/pom.xml
server/pom.xml
server/src/test/java/io/druid/server/initialization/JettyTest.java
services/pom.xml
2014-09-11 16:20:50 -07:00
Xavier Léauté
32e256a842
[maven-release-plugin] prepare for next development iteration
2014-09-10 17:24:15 -07:00
Xavier Léauté
f7dc13d240
[maven-release-plugin] prepare release druid-0.6.153
2014-09-10 17:24:11 -07:00
fjy
fec7b43fcb
make making v9 segments something completely configurable
2014-09-10 15:28:30 -07:00
fjy
351afb8be7
allow legacy index generator
2014-09-09 17:04:35 -07:00
Xavier Léauté
22553b0b28
[maven-release-plugin] prepare for next development iteration
2014-09-05 11:07:22 -07:00
Xavier Léauté
570a7a07bf
[maven-release-plugin] prepare release druid-0.6.152
2014-09-05 11:07:14 -07:00
fjy
e24be03a38
[maven-release-plugin] prepare for next development iteration
2014-09-04 14:10:13 -07:00
fjy
a933ea1866
[maven-release-plugin] prepare release druid-0.6.151
2014-09-04 14:10:09 -07:00
fjy
f473e62f1f
Merge pull request #714 from metamx/cleanup-javadocs
...
Cleanup javadocs
2014-09-04 12:28:10 -06:00
Xavier Léauté
508e982190
Merge remote-tracking branch 'origin/master' into druid-0.7.x
...
Conflicts:
cassandra-storage/pom.xml
common/pom.xml
examples/config/historical/runtime.properties
examples/config/overlord/runtime.properties
examples/config/realtime/runtime.properties
examples/pom.xml
hdfs-storage/pom.xml
histogram/pom.xml
indexing-hadoop/pom.xml
indexing-service/pom.xml
kafka-eight/pom.xml
kafka-seven/pom.xml
pom.xml
processing/pom.xml
rabbitmq/pom.xml
s3-extensions/pom.xml
server/pom.xml
server/src/main/java/io/druid/server/ClientQuerySegmentWalker.java
services/pom.xml
2014-08-30 22:42:36 -07:00
Gian Merlino
96d7b18163
[maven-release-plugin] prepare for next development iteration
2014-08-29 15:29:58 -07:00
Gian Merlino
860cf36ab1
[maven-release-plugin] prepare release druid-0.6.150
2014-08-29 15:29:54 -07:00
Xavier Léauté
58ab759fc6
remove unused imports
2014-08-29 14:03:47 -07:00
Xavier Léauté
ac05836833
make Java 8 javadoc happy
2014-08-29 13:58:50 -07:00
Xavier Léauté
daca178631
[maven-release-plugin] prepare for next development iteration
2014-08-29 10:43:19 -07:00
Xavier Léauté
0793a5aee6
[maven-release-plugin] prepare release druid-0.6.149
2014-08-29 10:43:15 -07:00
Gian Merlino
8bcb73a0eb
Java programs are best run with a java command.
2014-08-28 18:10:01 -07:00
Gian Merlino
5564a67bfc
File.pathSeparator is better than ":".
2014-08-28 18:09:33 -07:00
Gian Merlino
68aeafaacd
Allow indexing tasks to specify extra classpaths.
...
This could be used by Hadoop tasks to reference configs for different clusters, assuming
that the possible configs have been pre-distributed to middle managers.
2014-08-28 18:00:26 -07:00
Xavier Léauté
1d6842c7f0
[maven-release-plugin] prepare for next development iteration
2014-08-27 12:22:53 -07:00
Xavier Léauté
575951f99a
[maven-release-plugin] prepare release druid-0.6.148
2014-08-27 12:22:49 -07:00
fjy
00f7077f50
[maven-release-plugin] prepare for next development iteration
2014-08-22 08:28:56 -07:00
fjy
df488563e4
[maven-release-plugin] prepare release druid-0.6.147
2014-08-22 08:28:51 -07:00
fjy
df48b48e35
[maven-release-plugin] prepare for next development iteration
2014-08-21 12:50:33 -07:00
fjy
4f0b994037
[maven-release-plugin] prepare release druid-0.6.146
2014-08-21 12:50:30 -07:00
fjy
d64879ccca
more cleanup
2014-08-20 13:22:42 -07:00
fjy
1614f40f1a
fix index task
2014-08-20 13:11:00 -07:00
fjy
92f26d9a1f
cleanup rowflushboundary
2014-08-20 13:09:37 -07:00
nishantmonu51
fe105d52ee
use bufferSize for IndexTask
2014-08-20 22:41:34 +05:30
nishantmonu51
33354cf7fe
replace maxRowsInMemory with BufferSize
2014-08-20 20:59:44 +05:30
nishantmonu51
e525562767
review comments - cleanup ColumnSelectorFactory
2014-08-20 15:04:43 +05:30
nishantmonu51
60906c3244
Revert "make valueType configurable"
...
This reverts commit 6f60a3f604
.
2014-08-20 11:55:26 +05:30
fjy
4fd5479559
fix typo
2014-08-19 12:34:10 -07:00
fjy
77e514688a
Merge branch 'druid-0.7.x' into offheap-incremental-index
2014-08-18 11:14:19 -07:00
Xavier Léauté
1fd30ab588
default service/host/port for all nodes
2014-08-15 17:14:05 -07:00
fjy
51988be776
[maven-release-plugin] prepare for next development iteration
2014-08-14 14:59:00 -07:00
fjy
2830028092
[maven-release-plugin] prepare release druid-0.6.145
2014-08-14 14:58:57 -07:00
nishantmonu51
6f60a3f604
make valueType configurable
2014-08-13 14:37:57 +05:30
nishantmonu51
1b0a72751b
Add support for LongColumn
2014-08-13 08:52:36 +05:30
fjy
4e3f4fbc22
[maven-release-plugin] prepare for next development iteration
2014-08-12 13:24:55 -07:00
fjy
f3aafc246c
[maven-release-plugin] prepare release druid-0.6.144
2014-08-12 13:24:50 -07:00
nishantmonu51
c6712739dc
merge changes from druid-0.7.x
2014-08-12 15:47:42 +05:30
fjy
0cff63c7c6
[maven-release-plugin] prepare for next development iteration
2014-08-09 19:36:11 -07:00
fjy
724562b181
[maven-release-plugin] prepare release druid-0.6.143
2014-08-09 19:36:05 -07:00
fjy
d58ae945a4
[maven-release-plugin] prepare for next development iteration
2014-08-08 16:22:38 -07:00
fjy
d240479133
[maven-release-plugin] prepare release druid-0.6.142
2014-08-08 16:22:34 -07:00
fjy
199f2b1683
[maven-release-plugin] prepare for next development iteration
2014-08-08 15:53:53 -07:00
fjy
29a077d893
[maven-release-plugin] prepare release druid-0.6.141
2014-08-08 15:53:49 -07:00
fjy
958792db5c
[maven-release-plugin] prepare for next development iteration
2014-08-08 15:16:38 -07:00
fjy
4482e1b7d8
[maven-release-plugin] prepare release druid-0.6.140
2014-08-08 15:16:34 -07:00
fjy
ddcea18631
fix dependencies
2014-08-08 14:02:14 -07:00
fjy
74646f18f4
[maven-release-plugin] prepare for next development iteration
2014-08-08 11:40:52 -07:00
fjy
78c7140b52
[maven-release-plugin] prepare release druid-0.6.139
2014-08-08 11:40:46 -07:00
fjy
91ebe45b4e
support both rejectionPolicy and rejectionPolicyFactory in serde
2014-08-07 10:06:27 -07:00
fjy
9f4dd7b33e
[maven-release-plugin] prepare for next development iteration
2014-08-06 13:34:04 -07:00
fjy
aa5cb91618
[maven-release-plugin] prepare release druid-0.6.138
2014-08-06 13:33:59 -07:00
fjy
65b8278add
[maven-release-plugin] prepare for next development iteration
2014-08-01 10:14:34 -07:00
fjy
0ecbef6c5d
[maven-release-plugin] prepare release druid-0.6.137
2014-08-01 10:14:30 -07:00
fjy
bf8c24f88d
[maven-release-plugin] prepare for next development iteration
2014-07-31 14:08:38 -07:00
fjy
66020fc2b6
[maven-release-plugin] prepare release druid-0.6.136
2014-07-31 14:08:34 -07:00
nishantmonu51
637bd35785
merge changes from druid-0.7.x
2014-07-31 16:07:22 +05:30
fjy
a8c8e4cb51
[maven-release-plugin] prepare for next development iteration
2014-07-29 22:03:14 -07:00
fjy
25eda62a0c
[maven-release-plugin] prepare release druid-0.6.135
2014-07-29 22:03:09 -07:00
fjy
0c898c58d1
[maven-release-plugin] prepare for next development iteration
2014-07-29 18:01:06 -07:00
fjy
c8244d05d1
[maven-release-plugin] prepare release druid-0.6.134
2014-07-29 18:01:02 -07:00
fjy
f7319620c4
[maven-release-plugin] prepare for next development iteration
2014-07-29 17:40:56 -07:00
fjy
540a146eaa
[maven-release-plugin] prepare release druid-0.6.133
2014-07-29 17:40:52 -07:00
fjy
b5ecf000ad
[maven-release-plugin] prepare for next development iteration
2014-07-29 16:20:14 -07:00
fjy
877bd98667
[maven-release-plugin] prepare release druid-0.6.132
2014-07-29 16:20:10 -07:00
fjy
e1d87ed5ea
[maven-release-plugin] prepare for next development iteration
2014-07-29 14:13:41 -07:00
fjy
c46965c52c
[maven-release-plugin] prepare release druid-0.6.131
2014-07-29 14:13:37 -07:00
fjy
1de0f89718
[maven-release-plugin] prepare for next development iteration
2014-07-18 11:55:50 -07:00
fjy
39bff5c1c2
[maven-release-plugin] prepare release druid-0.6.130
2014-07-18 11:55:46 -07:00
Gian Merlino
09fcfc3b6d
Fix race in RemoteTaskRunner that could lead to zombie tasks.
2014-07-18 11:41:50 -07:00
fjy
9e303527f2
[maven-release-plugin] prepare for next development iteration
2014-07-18 11:17:56 -07:00
fjy
ea04022772
[maven-release-plugin] prepare release druid-0.6.129
2014-07-18 11:17:52 -07:00
nishantmonu51
4ce12470a1
Add way to skip determine partitions for index task
...
Add a way to skip determinePartitions for IndexTask by manually
specifying numShards.
2014-07-18 18:52:15 +05:30
fjy
d8b8826c2e
Merge branch 'cleanup-ingest' of github.com:metamx/druid into cleanup-ingest
...
Conflicts:
server/src/test/java/io/druid/realtime/firehose/CombiningFirehoseFactoryTest.java
2014-07-17 20:26:11 -07:00
fjy
291f4c00ae
Merge branch 'master' of github.com:metamx/druid into cleanup-ingest
2014-07-17 20:24:59 -07:00
nishantmonu51
0e0454a34c
switch reingest task to noop & fix compilation
...
switch back to noop task, its confusing to have a reinvest task that
does nothing.
fix compilation
2014-07-18 06:50:58 +05:30
fjy
ded83557dd
Merge pull request #640 from metamx/disable-worker
...
An alternative way to disable middlemanagers based on worker version
2014-07-17 19:07:27 -06:00
fjy
beac0be45b
fix enabled endpoint
2014-07-17 18:04:36 -07:00
fjy
c6078ca841
address code review
2014-07-17 13:34:05 -07:00
fjy
ba978d8b79
some minor cleanups to ingest firehose
2014-07-17 13:05:59 -07:00
fjy
bc650a1c80
Merge pull request #627 from metamx/druid-firehose
...
Functionality to ingest a Druid segment and change the schema
2014-07-17 13:41:16 -06:00
fjy
5197ea527a
disable middlemanagers based on worker version
2014-07-17 12:35:45 -07:00
nishantmonu51
e59c9ebdbc
minor fixes
...
fix IndexOutOfBoundsException
fix ingestFirehose
2014-07-17 17:24:57 +05:30
nishantmonu51
972c5dac31
improve memory usage and rename firehose
2014-07-14 21:17:53 +05:30
nishantmonu51
f5f05e3a9b
Sync changes from branch new-ingestion PR #599
...
Sync and Resolve Conflicts
2014-07-11 16:15:10 +05:30
nishantmonu51
7168adcca7
Use Ingest task instead of Noop Task
2014-07-08 21:20:17 +05:30
fjy
ce478be899
Remove redundant forking task runner config
2014-07-07 18:08:37 -06:00
nishantmonu51
97b58eb193
review comments
...
1) Rename firehose to IngestSegment
2) fix segment overlapping, intervals
3) fix overshadow
2014-07-04 12:31:33 +05:30
nishantmonu51
518ab473f3
improve port finding strategy for task runner
...
1) Recycle free ports
2) Choose only ports that are free & not used by any other application
2014-07-03 09:58:12 +05:30
nishantmonu51
1de390801f
Druid Fireshose
...
Add druidFirehose, can be used to reIndex filtered data from a
datasource
2014-07-02 20:34:18 +05:30
fjy
4c40e71e54
address cr
2014-06-19 14:48:46 -07:00
fjy
a870fe5cbe
inject column config
2014-06-19 14:47:57 -07:00
Xavier Léauté
09346b0a3c
make column cache configurable
2014-06-19 14:43:03 -07:00
fjy
0bc1915067
Merge pull request #578 from metamx/new-guava
...
Update guava, java-util, and druid-api
2014-06-18 14:23:32 -06:00
Gian Merlino
7c7d170e78
[maven-release-plugin] prepare for next development iteration
2014-06-18 10:53:40 -07:00
Gian Merlino
a52a1d3929
[maven-release-plugin] prepare release druid-0.6.128
2014-06-18 10:53:36 -07:00
fjy
b0517dc55d
Merge pull request #610 from metamx/ec2-user-data
...
More flexible EC2 user data classes.
2014-06-18 11:36:13 -06:00
Gian Merlino
5c4b9a7d5b
Indexing: Allow null userData.
2014-06-18 10:08:50 -07:00
Gian Merlino
9532beb05c
[maven-release-plugin] prepare for next development iteration
2014-06-17 17:29:31 -07:00
Gian Merlino
e3dcbde07d
[maven-release-plugin] prepare release druid-0.6.127
2014-06-17 17:29:27 -07:00
Gian Merlino
65c1553a76
Fix busted TaskConfig.
2014-06-17 17:27:41 -07:00
Gian Merlino
9f16f0a955
More flexible EC2 user data classes.
2014-06-17 17:10:17 -07:00
Gian Merlino
a658afe902
[maven-release-plugin] prepare for next development iteration
2014-06-17 13:01:01 -07:00
Gian Merlino
4e875b8084
[maven-release-plugin] prepare release druid-0.6.126
2014-06-17 13:00:54 -07:00
fjy
5227b43050
fix more test breakage
2014-06-17 10:35:01 -07:00
fjy
8a13e34c50
fix broken ut
2014-06-17 10:31:50 -07:00
Gian Merlino
54833fa43d
Indexing: Make default hadoop coordinates configurable.
2014-06-17 08:53:39 -07:00
Gian Merlino
964f12b7d6
[maven-release-plugin] prepare for next development iteration
2014-06-16 16:56:44 -07:00
Gian Merlino
4e184e3793
[maven-release-plugin] prepare release druid-0.6.125
2014-06-16 16:56:37 -07:00
Gian Merlino
ef7e786b96
[maven-release-plugin] prepare for next development iteration
2014-06-16 16:38:08 -07:00
Gian Merlino
96be9faec7
[maven-release-plugin] prepare release druid-0.6.124
2014-06-16 16:37:59 -07:00
nishantmonu51
2d03888a2c
Merge branch 'master' into offheap-incremental-index
...
Conflicts:
processing/src/main/java/io/druid/query/groupby/GroupByQueryHelper.java
processing/src/main/java/io/druid/query/groupby/GroupByQueryQueryToolChe
st.java
processing/src/main/java/io/druid/segment/incremental/IncrementalIndex.j
ava
2014-06-16 20:43:17 +05:30
nishantmonu51
0629be622c
remove unnecessary changes & fix index closing subquery
2014-06-16 18:50:49 +05:30
Xavier Léauté
a5c533dcab
[maven-release-plugin] prepare for next development iteration
2014-06-13 15:17:00 -07:00