Commit Graph

5133 Commits

Author SHA1 Message Date
Fangjin Yang b4041c13e5 Merge pull request #1029 from metamx/fixChainedExecutionQueryRunnerTest
Address spurious test failures
2015-01-16 13:08:32 -08:00
Xavier Léauté 3b3aad78cb Merge pull request #1027 from metamx/concurrentOnHeapIncrementalIndexFix
Fix concurrency issues in OnheapIncrementalIndex
2015-01-16 12:54:42 -08:00
Fangjin Yang c68869f765 Merge pull request #1042 from metamx/expand-sharding-info
New section to provide detail on how and why to set up sharding
2015-01-16 12:54:04 -08:00
Charles Allen 197af967ef Fix concurrency issues in OnheapIncrementalIndex
* Was encountering weird errors when fast writes were coming in while queries were happening.
* Added unit tests which tend to cause concurrency query problems
2015-01-16 12:01:46 -08:00
nishantmonu51 503631f6ff review comments. 2015-01-16 20:21:40 +05:30
Igal Levy e86273a9ae New section to provide detail on how and why to set up sharding
* Different types of sharding strategies
* How and what to configure
* Redundancy and scale-out
2015-01-15 21:19:53 -08:00
Xavier Léauté 6bc6e71b0d Add messages to catch spurious test failures 2015-01-15 16:49:43 -08:00
Charles Allen ebafa2a786 Fix spurious test failures in ChainedExecutionQueryRunnerTest 2015-01-15 16:49:16 -08:00
fjy f7ea308b25 fix minor error output problem 2015-01-15 15:57:45 -08:00
Xavier Léauté cd9635ff5e Merge pull request #1034 from druid-io/minor-rename
minor rename of things in hadoop ingestion config to match 0.6.x
2015-01-15 15:46:13 -08:00
Xavier Léauté c0de179aa0 ensure MySQL database defaults to UTF-8 on startup 2015-01-15 15:30:16 -08:00
fjy ccddbf8747 minor rename of things in hadoop ingestion config to match 0.6.x 2015-01-15 14:04:55 -08:00
Fangjin Yang 5bfcc43377 Merge pull request #1008 from metamx/stringConversionJavaUtilUpdate
Update all String conversions to and from byte[] to use the java-util StringUtils functions
2015-01-15 13:50:27 -08:00
Fangjin Yang ee28e990ce Merge pull request #1030 from mrijke/docfix-taskexample
Fix some of the Task json examples to have the correct description
2015-01-15 11:18:30 -08:00
nishantmonu51 c7452b75f6 Merge branch 'master' into ingestmetadata-query 2015-01-15 18:00:31 +05:30
Maarten Rijke 58b334c8e6 Fix some of the Task json examples to have the correct description 2015-01-15 09:41:23 +01:00
Xavier Léauté 6f1537d153 Merge pull request #1025 from druid-io/rt-retry
Add retry capabilities for realtime logic
2015-01-13 14:28:36 -08:00
fjy 021a7de759 Add retry capabilities for realtime logic 2015-01-13 14:30:49 -08:00
Xavier Léauté 705e5ab0b1 Merge pull request #1021 from druid-io/log-mpp
Add more metrics and logs for when ingestion may be throttled
2015-01-09 14:37:30 -08:00
Fangjin Yang f811c8d1ad Merge pull request #1018 from metamx/faster-builds
new faster container builds in Travis-CI
2015-01-09 14:36:14 -08:00
fjy 84cc32ba32 Add more logging for when ingestion may be throttled 2015-01-08 14:51:46 -08:00
fjy a02ef1dbf1 update batch ingest docs 2015-01-08 14:38:10 -08:00
xvrl a8f8c268d2 Merge pull request #1019 from metamx/fixZkInjection
Fix indexing service using incorrect announcement path in ZK + cleanup config.
2015-01-08 11:36:21 -08:00
Charles Allen 67757b6aea Change IndexerZkConfig to use @JacksonInject instead of just straight @Inject
* Updated IndexerZkConfig to use no setters, and take all arguments from constructor instead
* Also added more unit tests
2015-01-08 11:11:17 -08:00
Xavier Léauté d5f4182de4 global test timeouts + fix test race condition 2015-01-07 23:36:57 -08:00
Xavier Léauté 9acc8c72ee new faster container builds in Travis-CI 2015-01-07 15:07:14 -08:00
xvrl 8ea237d6a1 Merge pull request #1017 from druid-io/integrationtest
Integration tests
2015-01-07 14:28:18 -08:00
nishantmonu51 f69e0591b0 working integration tests 2015-01-07 14:23:38 -08:00
xvrl 5e7f68058d Merge pull request #1013 from metamx/backgroundTimeout
Change background caching to trigger cache population on Futures end.
2015-01-07 13:38:00 -08:00
Charles Allen c1295202ff Allow background caching run after the futures are finished 2015-01-07 13:23:34 -08:00
Fangjin Yang f6893cc2f3 Merge pull request #1015 from gianm/mpp-docs
Improve maxPendingPersists docs.
2015-01-07 09:59:52 -08:00
Gian Merlino dde21a16e1 Improve maxPendingPersists docs. 2015-01-07 09:55:33 -08:00
Fangjin Yang 5e4aa760fe Merge pull request #1009 from metamx/missingPluginVersions
Add some missing versions for maven plugins
2015-01-05 14:44:20 -08:00
Fangjin Yang dec424b4af Merge pull request #1010 from metamx/fixTestsModuleMissing
Added a few places where tests were using Object instead of Module
2015-01-05 14:04:10 -08:00
Charles Allen f6fbb733b8 Added a few places where tests were using Object instead of Module 2015-01-05 13:47:25 -08:00
Charles Allen c20142f2a9 Add some missing versions for maven plugins 2015-01-05 13:27:29 -08:00
Fangjin Yang 852e863425 Merge pull request #981 from druid-io/strictModuleTyping
Use Module instead of generic Object in Guice related items
2015-01-05 12:43:20 -08:00
Fangjin Yang ab0ddc0d7c Merge pull request #998 from drcrallen/zkConfigJackson
Change zk configs to use Jackson injection instead of Skife
2015-01-05 12:42:40 -08:00
Charles Allen b1b5c9099e Update all String conversions to and from byte[] to use the java-util StringUtils functions
* Speedup of GroupBy with javaScript filters by ~10%
* Requires https://github.com/metamx/java-util/pull/15
2015-01-05 11:22:32 -08:00
Fangjin Yang c0469c99d6 Merge pull request #1007 from metamx/fix-hadoop-index-bitmap-property
workaround to pass down bitmap type to hadoop map-reduce tasks
2015-01-02 17:53:12 -08:00
Xavier Léauté f1375b0bfb workaround to pass down bitmap type to map-reduce tasks 2015-01-02 17:29:00 -08:00
xvrl f17c59e21b Merge pull request #1004 from drcrallen/cachingMemoryHelpers
Add memory hinting and concurrency helpers in CachingClusteredClient
2015-01-02 16:40:00 -08:00
Charles Allen 81fdc791e0 Add memory hinting and concurrency helpers in CachingClusteredClient 2015-01-02 15:54:26 -08:00
Fangjin Yang 2aa9e1bf3f Merge pull request #1006 from metamx/fix-lzf-exceeding-chunksize
Tests for larger compression chunks + throw errors on decompression
2015-01-02 14:45:41 -08:00
Xavier Léauté 3fc6cf918d add test for large chunks 2015-01-02 14:31:22 -08:00
Xavier Léauté f2f9cbeca8 throw error rather than returning garbage results 2015-01-02 14:29:21 -08:00
Fangjin Yang aca381ba6a Merge pull request #1002 from metamx/fix-lzf-exceeding-chunksize
fix LZF compression with buffers exceeding LZF chunk size
2015-01-02 14:27:23 -08:00
Xavier Léauté 071943a367 fix LZF compression with buffers exceeding LZF chunk size 2015-01-02 11:39:50 -08:00
Fangjin Yang d25c677bdd Merge pull request #993 from metamx/fix-bitmap-factory-serde
fix bitmap factory serde
2014-12-30 17:25:49 -08:00
Fangjin Yang 2e63bcd020 Merge pull request #994 from metamx/fix-test-timeout
fix test timeout
2014-12-30 17:17:44 -08:00