Commit Graph

2052 Commits

Author SHA1 Message Date
Gian Merlino 781673a8f8 ForkingTaskRunner: Fix pass-down of nodeType 2013-10-23 14:13:05 -07:00
fjy 5d8f1d11ec fix broken UT as a result of new druid api changes 2013-10-22 10:44:28 -07:00
fjy bf3acbf28c Merge pull request #272 from daggerrz/feature/raw-row-data
Use druid-api 0.1.2-SNAPSHOT which provides Row.getRaw()
2013-10-22 10:05:31 -07:00
fjy 3e609f996d i need to learn to type, this fixes incorrect version in pom 2013-10-21 18:33:41 -07:00
fjy 74ab5b9792 updated extendedset version 2013-10-21 18:28:35 -07:00
fjy c32c5b1257 Merge pull request #273 from metamx/igalDruid
Refactored to focus and bring out the really good sections.
2013-10-21 18:27:34 -07:00
daggerrz 522feb65d5 Use druid-api 0.1.2-SNAPSHOT which provides Row.getRaw() 2013-10-20 22:39:13 -04:00
Igal Levy 3ee3d82bf2 Refactored to focus and bring out the really good sections. 2013-10-18 16:38:19 -07:00
fjy a684885839 [maven-release-plugin] prepare for next development iteration 2013-10-18 15:48:16 -07:00
fjy 88dcfe9a94 [maven-release-plugin] prepare release druid-0.6.0 2013-10-18 15:48:12 -07:00
fjy 5bca36247f fix more docs 2013-10-18 15:37:43 -07:00
fjy b3984f4e2e Merge pull request #271 from metamx/indexing-service-realtime
Indexing service fixes, targeted at RealtimeIndexTask
2013-10-18 13:28:04 -07:00
Gian Merlino b68b3526e8 IndexingServiceFirehoseModule: Add header 2013-10-18 13:27:40 -07:00
fjy 94d4920edd Merge branch 'master' into indexing-service-realtime 2013-10-18 12:26:43 -07:00
Gian Merlino 2e9c46867f Fixes for indexing service.
- Create IndexingServiceFirehoseModule so firehoses can be loaded by all mains
- Fix implicit lock acquisition in AbstractTask
2013-10-18 11:14:33 -07:00
fjy afa5735228 fix typo in intro tutorial 2013-10-18 10:43:20 -07:00
fjy 18b02e5dba add link to data flow from druid cluster tutorial 2013-10-18 10:39:04 -07:00
fjy 8d22c05807 Merge branch 'master' of github.com:metamx/druid 2013-10-18 10:30:13 -07:00
fjy c96abe3a59 add data flow docs 2013-10-18 10:29:58 -07:00
fjy 84960f6c58 Merge pull request #270 from metamx/igalDruid
removed bogus word
2013-10-18 10:25:34 -07:00
Igal Levy 413c4d075a fixed typo 2013-10-18 10:21:30 -07:00
Xavier Léauté ce48278d83 more legible graphics 2013-10-18 10:04:32 -07:00
Xavier Léauté 5bec1cd881 data flow graph 2013-10-18 08:11:16 -07:00
fjy cdde400718 fix task docs and indexing service img 2013-10-16 18:08:36 -07:00
fjy 7e24776097 fix typo in docs 2013-10-16 17:58:57 -07:00
fjy 4862852b43 more docs about how to use different versions of hadoop in druid 2013-10-16 17:54:49 -07:00
fjy 6192602893 fix extensions config not getting picked up in hadoop index task 2013-10-16 16:52:23 -07:00
fjy 1bd1bc98d1 update s3 calls to not use deprecated fns 2013-10-16 13:21:54 -07:00
fjy 2dc716bf7e fix bug and make it actually possible to load extensions 2013-10-16 11:59:01 -07:00
fjy 98dcd4468b Merge pull request #269 from metamx/fix-task
Refactor Hadoop-based indexing to repair broken Hadoop Index Task
2013-10-16 11:38:21 -07:00
fjy 71a9b43c83 fix docs for deep storage 2013-10-16 11:37:56 -07:00
fjy a1c09df17f make the hadoop index task work again 2013-10-16 09:45:17 -07:00
fjy 9796a40b92 port docs over to 0.6 and a bunch of misc fixes 2013-10-11 18:38:53 -07:00
Xavier Léauté b85fbbfdf5 add indexing service diagram 2013-10-11 15:21:28 -07:00
fjy 38e9ff5984 Merge pull request #266 from metamx/more-docs
a ton of fixes to docs
2013-10-10 15:05:34 -07:00
fjy 560981acbf a ton of fixes to docs 2013-10-10 15:05:01 -07:00
fjy cf4711d99d Merge pull request #263 from metamx/is-docs
New Tutorial for batch ingestion with indexing service
2013-10-09 15:45:03 -07:00
fjy a9a723bd11 clean up poms, add a new loading your own data tutorial, add new validation, clean up logs 2013-10-09 15:42:39 -07:00
fjy 4e509d1d09 Merge branch 'master' into is-docs 2013-10-09 14:05:10 -07:00
cheddar adf6625081 Merge pull request #1 from metamx/master
Update to latest master
2013-10-09 13:51:08 -07:00
fjy 3364b9ae5e Merge pull request #262 from metamx/fix-hadoop
Fix HadoopDruidIndexer to work with the new way of things
2013-10-09 13:27:49 -07:00
cheddar c47fe202c7 Fix HadoopDruidIndexer to work with the new way of things
There are multiple and sundry changes in here.

First, "HadoopDruidIndexer" has been split into two pieces, (1) CliHadoop which pulls the hadoop version and builds up the right classpath with the proper hadoop version to run the indexer and (2) CliInternalHadoopIndexer which actually runs the indexer.

In order to work around a bunch of jets3t version conflicts with Hadoop and Druid, I needed to extract the S3 deep storage stuff into its own module.  I then also moved the HDFS stuff into its own module so that I could eliminate the dependency on Hadoop for druid-server.

In doing these changes, I wanted to make the extensions buildable with only the druid-api jar, so a few other things had to move out of Druid and into druid-api.  They are all API-level things, however, so they really belong in druid-api instead.

Lastly, I removed the druid-realtime module and put it all in druid-server.
2013-10-09 15:15:44 -05:00
fjy a96eb634d4 Merge pull request #260 from rjurney/master
Changed indexGranularity on webstream example from minute to second
2013-10-09 12:25:10 -07:00
Russell Jurney 806bc0f58c Changed webstream example to second indexGranularity. 2013-10-09 12:23:00 -07:00
fjy 4ec4b8e024 rewrite indexing service docs 2013-10-08 16:34:58 -07:00
Russell Jurney 4e30a14438 Reverted minute/second change. 2013-10-08 13:27:39 -07:00
Russell Jurney caa3c663f5 Changed wikipedia example to second indexGranularity. 2013-10-08 13:05:38 -07:00
fjy ed6ba44917 Merge pull request #258 from metamx/fix-docs
Fix docs for 0.6 (part 1 of many)
2013-10-07 14:49:04 -07:00
fjy af1dbe6eab fix docs for 0.6 part 1 of many 2013-10-07 14:47:04 -07:00
fjy de71c14114 Merge pull request #257 from metamx/az
Add availability zone info to autoscaling
2013-10-07 12:17:42 -07:00