Commit Graph

1652 Commits

Author SHA1 Message Date
fjy 5cc747431b Merge branch 'master' into worker-resource 2013-07-12 13:00:26 -07:00
fjy b9578a1ada 1) remove retry logic from RTR
2) simplify configs
3) introduce task resource
4) make worker versions match coordinator version by default
2013-07-12 12:51:12 -07:00
Jan Rudert a8039107d8 no bytebuffer in the middle 2013-07-12 16:02:15 +02:00
Jan Rudert 89b0c84f3b initial implementation of an protocol buffers firehose 2013-07-12 13:34:57 +02:00
cheddar 09b1130810 Merge pull request #186 from rjurney/master
Made upload.sh executable
2013-07-11 13:06:58 -07:00
cheddar 33ac931b80 Merge pull request #185 from rjurney/test-harness
Fixed hanging ssh bug FINALLY
2013-07-11 13:06:02 -07:00
fjy a190527731 Merge branch 'master' into worker-resource 2013-07-11 12:40:48 -07:00
Jan Rudert 0961d8f149 Merge branch 'master' of github.com:metamx/druid 2013-07-11 16:02:11 +02:00
Russell Jurney a33aa57ca9 Made webstream example work. 2013-07-10 17:04:51 -07:00
Russell Jurney 921bee33d9 Merge branch 'master' of github.com:metamx/druid 2013-07-10 14:19:35 -07:00
cheddar c519be5b9f 1) Fix stray imports from libraries that aren't depended on and fix annotations/methods accordingly. 2013-07-10 14:19:04 -07:00
Russell Jurney 9d9d49f9b5 Make upload script executable 2013-07-10 14:17:40 -07:00
cheddar 3778425250 1) Fix new WebStreamFirehose stuff to have tests in the tests directory
2) Change the webStream package to the web package, because capital letters in packages suck
2013-07-10 14:12:13 -07:00
fjy aad11a69b4 Merge branch 'master' into worker-resource 2013-07-10 09:48:53 -07:00
Jan Rudert ad087a7a22 correct segment path for hadoop indexer 2013-07-10 09:21:45 +02:00
Russell Jurney a39148a0af Fixed hanging ssh bug FINALLY 2013-07-09 18:41:06 -07:00
cheddar b83bc14784 Merge pull request #173 from metamx/dhruv
Add new demo firehose that is lower friction than twitter
2013-07-09 17:39:51 -07:00
Dhruv Parthasarathy bd6dcd3973 interruption! 2013-07-09 17:39:19 -07:00
cheddar 093953c041 Merge pull request #170 from metamx/batch-zk
Enable batched ZK announcements
2013-07-09 17:23:47 -07:00
Dhruv Parthasarathy ba484fca5c catch error 2013-07-09 17:17:21 -07:00
fjy dd203f969b announcer thread fixes 2013-07-09 17:16:45 -07:00
Dhruv Parthasarathy 9f7284c801 fixed thread stuff 2013-07-09 16:59:49 -07:00
Dhruv Parthasarathy b3157c2752 made thread final 2013-07-09 16:42:35 -07:00
Dhruv Parthasarathy 3250c698bb fixed thread stuff and made tests cleaner 2013-07-09 16:34:55 -07:00
Dhruv Parthasarathy 6d000fc4c2 interfaces added and tests simplified 2013-07-09 15:31:03 -07:00
cheddar e50bcf4309 Merge pull request #184 from rjurney/test-harness
Upload script for test-harness tarball
2013-07-09 15:18:46 -07:00
Russell Jurney fa0d37f14e Upload script for services tarball, relies on s3cmd 2013-07-09 15:10:44 -07:00
Russell Jurney b2cb9bead4 Merge branch 'master' of github.com:metamx/druid into test-harness 2013-07-09 14:48:17 -07:00
Russell Jurney 6568728ead Merge branch 'master' of github.com:rjurney/druid into test-harness 2013-07-09 14:48:06 -07:00
cheddar 2403056a0e Merge pull request #183 from rjurney/test-harness
Scripts for firing up stuff and getting a stand-alone AWS node working
2013-07-09 14:47:43 -07:00
Russell Jurney 2df7463311 Removed dupe numThreads value from configs, fiddling with run_ec2.sh/env.sh 2013-07-09 14:44:03 -07:00
Dhruv Parthasarathy 41cb115d60 few more changes to RenamingKeysUpdateStreamFactory and test 2013-07-09 10:46:43 -07:00
Dhruv Parthasarathy 72fbc516bc added a RenameKeysUpdateStream wrapper 2013-07-08 18:53:08 -07:00
Russell Jurney 570fb1cf19 Working stuff, doing pull request. CTRL-C problem remains. 2013-07-08 17:30:37 -07:00
Dhruv Parthasarathy 142271aad2 better encapsulation 2013-07-08 16:46:47 -07:00
Dhruv Parthasarathy 01b4728c40 removed shared queue structure. Queue now encapsulated within updateStream 2013-07-08 14:27:35 -07:00
Russell Jurney 2403f1eceb Seperated env/run files. 2013-07-08 13:42:50 -07:00
Dhruv Parthasarathy e7da31e42d seems to be working 2013-07-08 13:41:19 -07:00
Dhruv Parthasarathy 439e8ca4ad now take a map for renaming 2013-07-08 13:35:22 -07:00
Dhruv Parthasarathy c8c686c738 added druid license comments 2013-07-08 12:19:38 -07:00
Dhruv Parthasarathy adc00e6576 fixed with Erics suggestions 2013-07-08 12:13:25 -07:00
fjy cc35841e23 Merge branch 'batch-zk' into worker-resource 2013-07-08 11:04:05 -07:00
fjy adda1488dc another thread safety fix 2013-07-08 10:59:07 -07:00
fjy 454f23d7c0 Merge branch 'master' of github.com:metamx/druid into batch-zk 2013-07-08 10:40:30 -07:00
fjy 83b96ee507 fix concurrency problem 2013-07-08 10:40:13 -07:00
Jan Rudert d5b4417280 Merge branch 'master' of github.com:metamx/druid 2013-07-08 11:50:15 +02:00
Jan Rudert 18ec081855 moved getHdfsStorageDir() to DataSegmentPusherUtil, extended test 2013-07-08 08:39:08 +02:00
Russell Jurney 056bd9cfe6 Created log directory, and echo ssh instructions. 2013-07-05 18:03:37 -07:00
Russell Jurney 1e46c6f4a2 Removed debug on ssh 2013-07-05 16:51:01 -07:00
cheddar b42c5743c9 Merge pull request #177 from nebrera/master
Postgresql adaptation
2013-07-05 16:42:57 -07:00