Commit Graph

5133 Commits

Author SHA1 Message Date
nishantmonu51 1a1b0e6f23 merge from master and review comments 2014-12-09 13:16:45 +05:30
xvrl 89afd83116 Merge pull request #947 from metamx/configUpdates
Move some config description from Configuration.md to the Broker and Historical config pages
2014-12-08 16:21:17 -08:00
fjy 38a369c0ff fix links and some errors 2014-12-08 16:20:35 -08:00
fjy 28b72a69ad redocumenting ingestion 2014-12-08 16:15:46 -08:00
Charles Allen 0fbbcd5885 Move some config description from Configuration.md to the Broker and Historical config pages 2014-12-08 15:53:58 -08:00
Xavier Léauté 7871470491 fix jackson-annotations version dependencies 2014-12-08 15:31:58 -08:00
Fangjin Yang 623443a145 Merge pull request #946 from metamx/MoreMediaTypes
Changed all "application/json" to MediaType.APPLICATION_JSON  except for in druid.js
2014-12-08 15:24:21 -07:00
Charles Allen a0f9f9877e Changed all "application/json" to MediaType.APPLICATION_JSON except for in druid.js 2014-12-08 14:21:49 -08:00
xvrl 1392e2731f Merge pull request #936 from metamx/cachingRunnerImprovements
General Caching Query Runners cleanup (40% query time reduction for HLL)
2014-12-08 14:07:52 -08:00
Charles Allen 7b65f0635d General Caching Query Runners cleanup
* Add type strictness to CachingClusteredClient.
* Add background caching to CachingClusteredClient. Gives between 0% and 5% query speed increase.
* Add @BackgroundCaching annotation for injected ExecutorService items
* Add `numBackgroundThreads' configuration options to CacheConfig (default 0 aka same thread legacy behavior)
* Add unit tests for CacheConfig
* Add an abstract caching query runner class, currently it doesn't do anything exceppt simply make the two caching queries distinct.
* Add caching to CachingQueryRunner. Gives up to a WHOPPING 40% reduction in query time on HLL queries
* Updated docs with more info on cache settings.
2014-12-08 13:29:32 -08:00
Maarten Rijke 90670a9c7e Fix NullPointerException in PartialDimExtractionFn by explicity checking for dimValue == null, attempt 2 2014-12-08 22:26:35 +01:00
Fangjin Yang c48839a0a0 Merge pull request #945 from metamx/MediaTypeFixes
Added checks for backwards compat on MediaTypes
2014-12-08 14:11:58 -07:00
Charles Allen 43041ed4ba Added checks for backwards compat on MediaTypes 2014-12-08 13:11:00 -08:00
Fangjin Yang eb233fe50e Merge pull request #921 from metamx/onheap-incremental-index
separate implementations of  incremental index
2014-12-08 13:59:08 -07:00
Fangjin Yang cc9d0ec73e Merge pull request #944 from metamx/MediaTypeFixes
Changed references to MediaType to use standard strings
2014-12-08 13:53:44 -07:00
Charles Allen 03f7fae3e8 Changed references to MediaType to pull from javax.ws.rs.core.MediaType or com.fasterxml.jackson.jaxrs.smile.MediaType 2014-12-08 12:39:36 -08:00
Xavier Léauté c88de97370 Merge branch 'master' into onheap-incremental-index
Conflicts:
	server/src/main/java/io/druid/segment/realtime/RealtimeManager.java
2014-12-08 11:48:21 -08:00
Maarten Rijke bd9bbf396c Fix NullPointerException in PartialDimExtractionFn by explicity checking for dimValue == null 2014-12-08 20:11:58 +01:00
Fangjin Yang 86a837a653 Merge pull request #939 from 7eggs/doc-fixes
Fix link to Druid Cluster Tutorial in Booting a Druid Cluster page
2014-12-08 12:10:15 -07:00
Fangjin Yang 3a7f571aeb Merge pull request #942 from metamx/fix-tiered-selector-naming
fix tiered selector service name usage
2014-12-08 12:09:45 -07:00
Charles Allen 703470eea5 Merge pull request #941 from metamx/fix-event-receiver-firehose
remove unused but required parameter
2014-12-08 09:54:05 -08:00
nishantmonu51 ef86dec660 remove unused but required parameter 2014-12-08 19:25:46 +05:30
nishantmonu51 4883f5526b fix tiered selector service name usage 2014-12-08 19:22:27 +05:30
Alexander Makarenko 6dfa0d20b8 Fix link to Druid Cluster Tutorial in Booting a Druid Cluster page 2014-12-07 21:59:06 +03:00
Fangjin Yang c255c16c1a Merge pull request #894 from zhaown/fix-query-realtime-with-multi-partition
bugfix for #887
2014-12-07 09:49:31 -07:00
Fangjin Yang 1a4e798373 Merge pull request #938 from 7eggs/doc-fixes
Broker config small fix
2014-12-07 09:48:53 -07:00
Fangjin Yang 42f783ef2b Merge pull request #937 from 7eggs/doc-add-nodejs-lib
Add Node.js client to Community Libraries
2014-12-07 09:48:36 -07:00
Alexander Makarenko df5b525097 Broker config small fix 2014-12-07 18:59:22 +03:00
Alexander Makarenko bbd337235e Add Node.js client to Community Libraries 2014-12-07 03:51:35 +03:00
Xavier Léauté 629f6bc759 moved methods to java-util 2014-12-05 15:53:23 -08:00
Xavier Léauté ad23e49777 use fixed-size mapdb cache to avoid heap growing uncontrollably 2014-12-05 15:34:50 -08:00
nishantmonu51 40f223215a fix buffer pool usage 2014-12-05 16:09:26 +05:30
Weinan Zhao 3119770ce9 Reformatting using intellij_formatting.jar 2014-12-05 14:21:24 +08:00
nishantmonu51 6e03a6245f Merge branch 'master' into onheap-incremental-index 2014-12-05 10:40:28 +05:30
Xavier Léauté d4a1752c5d add code to release ByteBuffers 2014-12-04 16:18:55 -08:00
Xavier Léauté 7cd45a6e1f IncrementalIndex throws exception if limit exceeded
- For now uses a hardcoded ratio of aggregator to timeanddim buffer sizes
- canAppendRow is a workaround for realtime index since the
Firehose currently does not have a way of rolling back the last event in
case of error
- canAppendRow needs a fudge factor; there is a race between checking
if we can add a row and actually adding a row, because of the way MapDB
reports its size.
2014-12-04 14:38:16 -08:00
Charles Allen 18234a2f00 Fix confusing error message in HadoopIndexTask 2014-12-04 10:57:57 -08:00
Gian Merlino 20a7239ffd Replace google-http-client imports with real guava imports. 2014-12-04 10:57:57 -08:00
Gian Merlino b48fc51ed1 SSL-capable ServiceEmitter. 2014-12-04 10:57:56 -08:00
Xavier Léauté 1905302c16 use property for jackson version 2014-12-04 10:57:56 -08:00
Xavier Léauté c7dbe6116c write byte data as is in smile 2014-12-04 10:57:56 -08:00
Xavier Léauté c21a82a697 upgrade LZ4 to operate directly on ByteBuffers 2014-12-04 10:57:56 -08:00
Xavier Léauté 1566999a6a update jackson to 2.4.4 2014-12-04 10:57:56 -08:00
Xavier Léauté 0c521e0a77 update joda-time and fix min/max instant 2014-12-04 10:57:56 -08:00
Charles Allen c2add5730b Fix Hadoop CLI jobs
* Change "schema" --> "spec" for cli hadoop to keep up with internal hadoop
* Added check for HadoopDruidIndexerConfig deserialization from Map to see if it is trying to get a HadoopDruidIndexerConfig or a HadoopIngestionSpec
2014-12-04 10:57:56 -08:00
fjy 187126dd4b fix broken unit tests 2014-12-04 10:49:36 -08:00
Fangjin Yang 332e4a4d1c Merge pull request #902 from metamx/cache-config
Commonalize the cache config and change default to disable cache
2014-12-04 11:30:24 -07:00
Fangjin Yang 27d4b2bdea Merge pull request #934 from metamx/fix-hadoop-metadata-injection
metadata update handler injection not needed for indexing service
2014-12-04 10:45:20 -07:00
nishantmonu51 269a51964e fix size calculation 2014-12-04 17:22:24 +05:30
Fangjin Yang 6533de3563 Merge pull request #933 from metamx/removeDeprecatedFiles
Update ForkingTaskRunner to remove @Deprecated Files method usage
2014-12-03 17:27:30 -07:00