Commit Graph

709 Commits

Author SHA1 Message Date
David Rodrigues 5b76a52c99 Reformat Deep Storage options to use table. 2015-04-16 16:30:42 -07:00
David Pinheiro f912e45464 Add doc. on how to validate a deep storage implementation. 2015-04-16 16:10:43 -07:00
David Pinheiro baeef08c4c Add Microsoft Azure as a Deep Storage option. 2015-04-16 15:39:36 -07:00
Xavier Léauté 49d1f4e568 add documentation for dimension compression 2015-04-14 10:44:19 -07:00
Xavier Léauté 66a4daa363 [docs] fix broken links 2015-04-09 17:36:20 -07:00
Slim d854ceebbd typo or backward compatibility problem
2147483648 will break the node since druid 0.7 it is parsing it as an `int`
2015-04-08 19:12:01 -05:00
Xavier Léauté 9962a33cdf Merge pull request #1270 from metamx/fix-broken-link-druid-cluster-tutorial
fixes #112 broken link
2015-04-08 13:36:40 -07:00
Igal Levy 905fa84d45 fixes #112 broken link 2015-04-08 13:23:10 -07:00
Slim a9b5529ff8 fix typo (missing ```) 2015-04-07 14:54:04 -05:00
Fangjin Yang 834fd71e34 Merge pull request #1254 from bobrik/on-the-right
Menu is on the right now
2015-03-31 15:58:57 -07:00
Prajwal Tuladhar def4cddfea fix doc link 2015-03-31 18:19:24 -04:00
Ian Babrou a6887da923 menu is on the right now 2015-03-30 21:59:15 -07:00
Slim 425c5f750c Fix typo in the query body
last `,` will break the query.
2015-03-30 09:34:38 -05:00
Xavier Léauté 2c58e355fd Merge pull request #1239 from metamx/log4j2forRealz
Exclude log4j from curator dependencies in favor of log4j-1.2-api
2015-03-26 13:21:13 -07:00
Charles Allen 9cd6c08e96 Exclude log4j from curator dependencies in favor of log4j-1.2-api 2015-03-26 13:05:12 -07:00
Xavier Léauté 47cc11829d Merge pull request #1240 from himanshug/async_query_forwarding_servlet_router_fix
adding router numMaxThread configuration for ProxyServlet HttpClient executor
2015-03-26 10:15:44 -07:00
nishantmonu51 99bf430844 fix examples and doc 2015-03-26 19:01:10 +05:30
Himanshu Gupta b131a4fd3b adding router numMaxThread configuration for ProxyServlet HttpClient executor 2015-03-23 21:58:01 -05:00
fjy 6a47c1530c update versions to prepare for rc release 2015-03-19 11:39:38 -07:00
fjy db06bda5e0 fix ingestion docs 2015-03-18 17:23:22 -07:00
fjy 3e664a4c32 fix plumber docs 2015-03-18 15:56:27 -07:00
fjy 8de3eab832 fix doc formatting 2015-03-18 15:53:00 -07:00
fjy bfe10bd156 This fixes arbitrary gran spec breaking 2015-03-17 12:19:43 -07:00
fjy 36b4c6a371 fix set up with first tutorial 2015-03-13 13:54:45 -07:00
Xavier Léauté 7fb4b1d2bb Merge pull request #1144 from metamx/javaLoggingManager
Add log4j2 hooks to other loggings
2015-03-12 14:38:51 -07:00
Charles Allen edfcea18d8 Add log4j2 hooks to standard java logging 2015-03-12 14:29:41 -07:00
nishantmonu51 3ec4a30ab5 initial commit
review comments

more refactoring and cleaning of redundant code

add UT + docs + more refactoring

fixes + review comments

more cleanup

end points to fetch history

review comments

remove unnecessary changes

review comments rename header name

review comments + add test for MetadataRulesManager

review comments docs
2015-03-12 22:50:29 +05:30
Xavier Léauté 11b3230602 update to kafka 0.8.2.1, because it's better™ 2015-03-12 09:59:24 -07:00
Xavier Léauté d3f5bddc5c Add ability to apply extraction functions to the time dimension
- Moves DimExtractionFn under a more generic ExtractionFn interface to
  support extracting dimension values other than strings
- pushes down extractionFn to the storage adapter from query engine
- 'dimExtractionFn' parameter has been deprecated in favor of 'extractionFn'
- adds a TimeFormatExtractionFn, allowing to project the '__time' dimension
- JavascriptDimExtractionFn renamed to JavascriptExtractionFn, adding
  support for any dimension value types that map directly to Javascript
- update documentation for time column extraction and related changes
2015-03-11 16:45:42 -07:00
Xavier Léauté 9f242ed1ba Merge pull request #1182 from druid-io/better-docs
Rework the druid docs and fix many mistakes
2015-03-10 14:23:38 -07:00
fjy 064d65a009 rework the druid docs and fix many mistakes 2015-03-10 14:19:19 -07:00
Fangjin Yang 0b467624ec Merge pull request #694 from druid-io/arithmetic-op-strategies
normal division & configurable ordering for ArithmeticPostAggregator
2015-03-10 13:48:27 -07:00
Fangjin Yang 2d79c6e5b9 Merge pull request #1187 from metamx/update-design-diagram
updates Realtime node's dataflow connection, s/historical/deep storage; ...
2015-03-10 13:46:21 -07:00
Fangjin Yang fa2c431589 Merge pull request #1186 from metamx/dataFormatDocsUpdate
Update Data_formats.md to match arguments used in 0.7.x
2015-03-10 13:45:37 -07:00
Igal Levy 705a7b3f23 updates Realtime node's dataflow connection, s/historical/deep storage; a bit more information on how Realtime nodes drop segments based on said segments' uptake by Historicals 2015-03-10 13:44:36 -07:00
Charles Allen 2ac610771e Update Data_formats.md to match arguments used in 0.7.x 2015-03-10 13:41:11 -07:00
Fangjin Yang c7ec8ba15b Merge pull request #1184 from metamx/docs-event-receiver-firehose
fix docs and add docs for event receiver firehose
2015-03-10 10:23:19 -07:00
nishantmonu51 425ad98261 fix docs and add docs for event receiver firehose 2015-03-10 21:29:57 +05:30
Fangjin Yang 2abdce1dc0 Merge pull request #1180 from metamx/logging-groupBy-NPE
add null check early to catch root cause for groupBy NPE while running bySegment query
2015-03-09 09:16:33 -07:00
nishantmonu51 704f463dbf fix property name in doc 2015-03-09 21:19:29 +05:30
Himanshu Gupta cb5ed4942c simple typo fix on Concepts-and_Terminology.md to correct navigation to spec file info 2015-03-07 11:29:24 -06:00
Xavier Léauté 0d47c0c36d normal division and configurable ordering for ArithmeticPostAggregator
Fixes #510
2015-03-04 12:44:24 -08:00
Fangjin Yang 9578304d6f Merge pull request #1130 from housejester/jde-building
Various improvements to the tutorial and building experience.
2015-03-02 14:48:32 -08:00
Fangjin Yang e8605c63a9 Merge pull request #1150 from himanshug/broker-parallel-chunk-process
interval chunk query runner now processes individual chunk in a threadpool
2015-03-02 13:50:23 -08:00
Himanshu Gupta 29039fd541 interval chunk query runner now processes individual chunk in a thread pool and prints metrics query/time per chunk 2015-03-02 15:45:09 -06:00
Fangjin Yang a76a24742b Merge pull request #1149 from himanshug/broker-get-datasource-update
updating ClientInfoResource.getDatasource() with a full flag
2015-03-02 13:28:27 -08:00
Himanshu Gupta a39f4f8bf4 updating ClientInfoResource.getDatasource() with a full flag to return all the served intervals for given data source along with the dimension and metric information 2015-03-02 14:18:52 -06:00
Xavier Léauté 437d61ed8f Merge pull request #1164 from mrijke/docfix-cache-configs
Docfix: Update Cache config pages
2015-03-02 11:47:50 -08:00
Maarten Rijke 2531bb9664 Docfix: Update Cache config pages
* Update Broker-Config.md Cache options table
 * Update Historical-Config.md Cache options table (broker->historical)
2015-03-02 19:55:00 +01:00
Xavier Léauté 1d98717d24 Merge pull request #1162 from mrijke/fix-metric-monitor-names
Update metrics monitors names in Configuration.md
2015-03-02 10:33:19 -08:00
Maarten Rijke 092acaea9d Update metrics monitors names in Configuration.md
Updated the metric package names to reflect the new names in 0.7
2015-03-02 12:16:47 +01:00
Maarten Rijke d52f3bb817 Update default value for druid.emitter in Configuration.md 2015-03-02 12:06:30 +01:00
James Estes 9cb5d9bd00 Various improvements to the tutorial and building experience.
- Improve geo ip download stability
- Retry default geo ip download if corrupt
- Clarify docs on building & where to get artifact
2015-02-25 18:49:16 -07:00
Prajwal Tuladhar d1fb42c554 fix broken docs link 2015-02-24 23:41:13 -05:00
fjy 46bd614d63 fix broken links 2015-02-24 20:14:17 -08:00
Xavier Léauté 667c3d4f8c fix typo 2015-02-19 11:41:37 -08:00
James Estes 562de6c621 Update docs and examples for log4j2 usage.
- Put configs early in classpath in examples so log4j2.xml will get picked up properly
- Add an example log4j2.xml file.
- Update Logging doc.
2015-02-19 11:40:56 -07:00
Xavier Léauté 475ba9d068 remove build.sh in favor of mvn package 2015-02-19 10:32:41 -08:00
Xavier Léauté 8e33e58422 rename Druid binary assembly 2015-02-18 17:42:55 -08:00
fjy 6d05f4fe5e Add more compare docs 2015-02-18 15:57:36 -08:00
Fangjin Yang 146a6a3b2b Merge pull request #1135 from metamx/topNDocumentation
Add more TopN documentation regarding Aliasing
2015-02-18 15:39:27 -08:00
Xavier Léauté 19e11ae601 Use default ports in examples 2015-02-18 11:46:27 -08:00
Charles Allen 2e27b888ed Add more TopN documentation regarding Aliasing
* Addresses concerns in https://github.com/druid-io/druid/issues/1134
2015-02-18 11:27:53 -08:00
Xavier Léauté cff218ee20 update example + tutorial for kafka 0.8 2015-02-17 23:58:51 -08:00
fjy 3fab045b2d Go through and fix mistakes in tutorials and docs 2015-02-17 15:21:16 -08:00
cheddar 2a45501393 Merge pull request #1110 from metamx/move-to-sonatype
Move Druid release artifacts to Sonatype
2015-02-17 11:54:16 -08:00
Xavier Léauté 78df7f6165 Move Druid release artifacts to Sonatype
- Switch to using Druid parent POM
- Add required fields for Sonatype
- Common plugin versions and settings have been moved to the parent pom
- Cleanup artifacts and POMs for consistent formatting
- Remove org.hyperic.sigar dependency and update docs to reflect necessary jars to add at runtime when sigar is needed
2015-02-13 14:26:31 -08:00
James Estes 8d1aa2beb3 Add common config dir to classpath in examples
Also adds query examples in the Cluster tutorial
2015-02-13 12:59:08 -07:00
fjy 13de51494e update versions in tutorials and docs 2015-02-12 16:11:31 -08:00
Fangjin Yang e915675b97 Merge pull request #1112 from druid-io/fix-examples
Update realtime node configs for examples; fixes #1111
2015-02-12 15:44:15 -08:00
fjy 34ed474d40 Add docs for http endpoints 2015-02-11 16:12:51 -08:00
fjy 63338e6e35 Update realtime node configs for examples; fixes #1111 2015-02-11 14:34:02 -08:00
Xavier Léauté 72333731c3 Merge pull request #1101 from druid-io/update
Update poms and add docs for backwards compat JSON parser
2015-02-09 16:14:57 -08:00
fjy e5debb2dec update poms and add docs for backwards compat 2015-02-09 16:13:00 -08:00
Charles Allen 79a3e8f59f Fix overriding base of IndexerZkConfig to be absolute instead of relative
* Updated docs to clarify ZK config behavior
* Added unit tests for this case
2015-02-04 13:04:06 -08:00
fjy 67ecb07ccd update version in docs 2015-02-03 14:26:42 -08:00
fjy b9337e883a I'm all about them doc fixes 2015-01-21 22:04:48 -08:00
fjy f437e16543 moar doc fixes 2015-01-21 21:59:16 -08:00
fjy e33e45e69e one more doc fix 2015-01-21 21:52:23 -08:00
fjy 74a4fddcfe fix task docs 2015-01-21 21:48:48 -08:00
fjy 7540f2f562 Add more docs for production clusters 2015-01-21 14:21:27 -08:00
Xavier Léauté 5a2030c49b Merge pull request #1059 from druid-io/remove-test
Remove test rejection policy - it has no place anywhere
2015-01-20 13:39:46 -08:00
Xavier Léauté a74ced97d9 Merge pull request #1058 from druid-io/equal-dist
Add a new equal distribution strategy for assigning tasks
2015-01-20 13:27:32 -08:00
fjy 1ff5829d6d remove test rejection policy 2015-01-20 13:22:30 -08:00
fjy 2d516fa591 Add a new equal distribution strategy for assigning tasks 2015-01-20 13:12:22 -08:00
Charles Allen 3d27747f7e Upgrade to log4j2
Default behavior is as before.
Added documentation for how to enable synchronous logging for select chatty classes:
* io.druid.client.ServerInventoryView
* io.druid.client.BatchServerInventoryView
* io.druid.curator.inventory.CuratorInventoryManager
* com.metamx.http.client.pool.ChannelResourceFactory
2015-01-20 12:35:18 -08:00
Fangjin Yang 91a79dbf95 Merge pull request #1031 from metamx/ingestmetadata-query
DataSourceMetadata query
2015-01-19 21:55:35 -08:00
Fangjin Yang 068518216b Merge pull request #1048 from metamx/update-tutorial
update tutorial to create db utf8 by default
2015-01-19 11:02:17 -08:00
Xavier Léauté 2443dda46b update tutorial to create db utf8 by default 2015-01-16 20:52:40 -08:00
nishantmonu51 503631f6ff review comments. 2015-01-16 20:21:40 +05:30
Igal Levy e86273a9ae New section to provide detail on how and why to set up sharding
* Different types of sharding strategies
* How and what to configure
* Redundancy and scale-out
2015-01-15 21:19:53 -08:00
nishantmonu51 c7452b75f6 Merge branch 'master' into ingestmetadata-query 2015-01-15 18:00:31 +05:30
Maarten Rijke 58b334c8e6 Fix some of the Task json examples to have the correct description 2015-01-15 09:41:23 +01:00
fjy a02ef1dbf1 update batch ingest docs 2015-01-08 14:38:10 -08:00
Gian Merlino dde21a16e1 Improve maxPendingPersists docs. 2015-01-07 09:55:33 -08:00
Xavier Léauté 47fa1b3d10 update docs to point to druid-io/druid 2014-12-23 11:26:52 -08:00
fjy ac407fb6ba clean up defaults 2014-12-15 15:05:02 -08:00
Fangjin Yang 335fbebb94 Merge pull request #960 from metamx/new-config
Rewrite config docs for 0.7.x
2014-12-15 13:35:25 -07:00
Charles Allen 225a039a01 Merge pull request #965 from metamx/doc-fix
Fix documented default value for druid.coordinator.merge.on.
2014-12-13 11:13:14 -08:00
Gian Merlino 020f8653f0 Fix documented default value for druid.coordinator.merge.on. 2014-12-13 08:03:09 -08:00
fjy 818f85e745 rewrite config docs 2014-12-11 15:52:26 -08:00
nishantmonu51 a0d3579a92 add docs + fix tests 2014-12-11 17:58:01 +05:30
Fangjin Yang d6d3ec6846 Merge pull request #948 from metamx/ingestion-docs
Redocumenting ingestion
2014-12-09 15:30:03 -07:00
fjy f0e5bb1ba9 remove excess tutorials 2014-12-09 14:29:19 -08:00
fjy 5727193873 more fixes to docs 2014-12-09 14:28:15 -08:00
fjy 4e3d8faed8 fix bad example 2014-12-09 14:21:47 -08:00
fjy 9596c11f42 address cr 2014-12-09 14:19:18 -08:00
fjy 38a369c0ff fix links and some errors 2014-12-08 16:20:35 -08:00
fjy 28b72a69ad redocumenting ingestion 2014-12-08 16:15:46 -08:00
Charles Allen 0fbbcd5885 Move some config description from Configuration.md to the Broker and Historical config pages 2014-12-08 15:53:58 -08:00
xvrl 1392e2731f Merge pull request #936 from metamx/cachingRunnerImprovements
General Caching Query Runners cleanup (40% query time reduction for HLL)
2014-12-08 14:07:52 -08:00
Charles Allen 7b65f0635d General Caching Query Runners cleanup
* Add type strictness to CachingClusteredClient.
* Add background caching to CachingClusteredClient. Gives between 0% and 5% query speed increase.
* Add @BackgroundCaching annotation for injected ExecutorService items
* Add `numBackgroundThreads' configuration options to CacheConfig (default 0 aka same thread legacy behavior)
* Add unit tests for CacheConfig
* Add an abstract caching query runner class, currently it doesn't do anything exceppt simply make the two caching queries distinct.
* Add caching to CachingQueryRunner. Gives up to a WHOPPING 40% reduction in query time on HLL queries
* Updated docs with more info on cache settings.
2014-12-08 13:29:32 -08:00
Fangjin Yang 86a837a653 Merge pull request #939 from 7eggs/doc-fixes
Fix link to Druid Cluster Tutorial in Booting a Druid Cluster page
2014-12-08 12:10:15 -07:00
Alexander Makarenko 6dfa0d20b8 Fix link to Druid Cluster Tutorial in Booting a Druid Cluster page 2014-12-07 21:59:06 +03:00
Fangjin Yang 1a4e798373 Merge pull request #938 from 7eggs/doc-fixes
Broker config small fix
2014-12-07 09:48:53 -07:00
Alexander Makarenko df5b525097 Broker config small fix 2014-12-07 18:59:22 +03:00
Alexander Makarenko bbd337235e Add Node.js client to Community Libraries 2014-12-07 03:51:35 +03:00
fjy 8ee4d12562 Refactor structure for examples and extensions 2014-11-21 14:45:24 -08:00
nishantmonu51 e3260aa177 Filtered Aggregator fixes + enhancements
- fix NPE on IncrementIndex
- refactor code to support AND, OR filter
- tests for AND & OR filter
- handling for missing column / null values
2014-11-20 15:17:18 -08:00
nishantmonu51 2f08ab85fc Revert "update doc"
This reverts commit d66d0de54f.
2014-11-20 10:17:07 +05:30
nishantmonu51 d66d0de54f update doc 2014-11-20 09:29:26 +05:30
Fangjin Yang db8a168b91 Merge pull request #881 from mrijke/update-ruleconf-docs
Update Rule-Configuration docs: match example with description
2014-11-18 16:41:49 -07:00
Fangjin Yang 87ea6fd377 Merge pull request #878 from metamx/default-extension-version
use Druid version as the default version for extensions
2014-11-18 13:56:54 -07:00
Xavier Léauté bf04ad0eb3 add documentation 2014-11-18 10:50:18 -08:00
Maarten Rijke 06e4535cb8 Update Rule-Configuration: match example with description
The example JSON snippets of the 'loadForever' and the 'dropForever' don't match their description, the 'type' description mentions 'loadByInterval' and 'dropByPeriod' respectively.
2014-11-18 17:00:42 +01:00
nishantmonu51 b2e8073c61 document combining firehose 2014-11-18 11:01:08 +05:30
fjy afd419ea29 fix bugs with docs 2014-11-14 13:25:21 -08:00
Fangjin Yang d85c172285 Merge pull request #808 from metamx/igalDruid
Clarify value types for granularities; link to more ISO info; more info on OrderByColumnSpec
2014-11-14 14:20:37 -07:00
Eric Bouchut e89f2f973d Fix typo in DimensionSpecs 2014-11-13 15:35:09 +01:00
Xavier Léauté ba442b9882 fix default FilteredServerView + batch annoucement 2014-11-12 23:17:16 -08:00
fjy 26b358e127 Merge branch 'master' of github.com:metamx/druid into druid-0.7.x 2014-11-11 17:30:30 -08:00
Igal Levy de7fb5a690 fixed typo, added note on matching schema requirement for unioned data sources 2014-11-11 11:56:22 -08:00
Igal Levy 34a6f7f7ca Merge branch 'master' into fix-datasource-doc 2014-11-11 11:55:47 -08:00
fjy 6188315293 Merge branch 'master' into druid-0.7.x
Conflicts:
	processing/src/test/java/io/druid/query/search/SearchQueryRunnerTest.java
2014-11-10 14:52:10 -08:00
Igal Levy 03515a4de6 fixes typo 2014-11-07 10:40:46 -08:00
xvrl 18b9c5cd2f db -> metadata 2014-11-06 21:46:35 -08:00
Igal Levy 20562492de clarified that dimension and metric can be String too, not just object 2014-11-06 15:16:36 -08:00
Igal Levy ec0accf0b1 clarified that dimensions and metrics are given in String arrays 2014-11-06 15:13:30 -08:00
Igal Levy 8f0b675e23 Added info to better explain how to use pagingSpec 2014-11-06 14:50:01 -08:00
Igal Levy 5a98fcf5b9 typo: s/metric_value/metric_name/ and added quotes 2014-11-06 11:18:30 -08:00
Igal Levy 73226f20cc typo: s/metric_value/metric_name/ 2014-11-06 11:01:31 -08:00
Igal Levy 81227b63a7 Merge branch 'master' into fix-query-docs 2014-11-04 11:09:13 -08:00
xvrl 2c62b9e6e3 Merge pull request #821 from metamx/minor-fix
Some minor fixes in docs and change jetty defaults
2014-11-04 10:18:57 -08:00
fjy 42cf20c9f1 some minor fixes in docs and change jetty defaults 2014-11-04 10:08:50 -08:00
Xavier Léauté f56d026d7d fix realtime module + cleaner metadata abstraction
- better metadata abstractions
- more db->metadata renaming
2014-11-03 16:40:23 -08:00
Igal Levy c58fc503d9 Clarified sort as optional, object 2014-11-03 11:59:04 -08:00
Igal Levy b416c3ff5c added quotes to clarify string value; added example of numeric filter 2014-11-03 11:57:52 -08:00
Xavier Léauté 48e6bef250 update documentation with new property names 2014-11-03 09:25:39 -08:00
Igal Levy e07b02f54b fixed typo and added info that union can take any number of dataSources 2014-10-31 11:07:55 -07:00
Igal Levy 0906b21079 Merge branch 'master' into fix-datasource-doc 2014-10-30 16:26:16 -07:00