Apache
/
druid
mirror of https://github.com/apache/druid.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
5,542 Commits 112 Branches 504 Tags 710 MiB
Commit Graph

687 Commits

Author SHA1 Message Date
fjy bfe10bd156 This fixes arbitrary gran spec breaking 2015-03-17 12:19:43 -07:00
fjy 36b4c6a371 fix set up with first tutorial 2015-03-13 13:54:45 -07:00
Xavier Léauté 7fb4b1d2bb Merge pull request #1144 from metamx/javaLoggingManager 
Add log4j2 hooks to other loggings
 2015-03-12 14:38:51 -07:00
Charles Allen edfcea18d8 Add log4j2 hooks to standard java logging 2015-03-12 14:29:41 -07:00
nishantmonu51 3ec4a30ab5 initial commit 
review comments

more refactoring and cleaning of redundant code

add UT + docs + more refactoring

fixes + review comments

more cleanup

end points to fetch history

review comments

remove unnecessary changes

review comments rename header name

review comments + add test for MetadataRulesManager

review comments docs
 2015-03-12 22:50:29 +05:30
Xavier Léauté 11b3230602 update to kafka 0.8.2.1, because it's better™ 2015-03-12 09:59:24 -07:00
Xavier Léauté d3f5bddc5c Add ability to apply extraction functions to the time dimension 
- Moves DimExtractionFn under a more generic ExtractionFn interface to
  support extracting dimension values other than strings
- pushes down extractionFn to the storage adapter from query engine
- 'dimExtractionFn' parameter has been deprecated in favor of 'extractionFn'
- adds a TimeFormatExtractionFn, allowing to project the '__time' dimension
- JavascriptDimExtractionFn renamed to JavascriptExtractionFn, adding
  support for any dimension value types that map directly to Javascript
- update documentation for time column extraction and related changes
 2015-03-11 16:45:42 -07:00
Xavier Léauté 9f242ed1ba Merge pull request #1182 from druid-io/better-docs 
Rework the druid docs and fix many mistakes
 2015-03-10 14:23:38 -07:00
fjy 064d65a009 rework the druid docs and fix many mistakes 2015-03-10 14:19:19 -07:00
Fangjin Yang 0b467624ec Merge pull request #694 from druid-io/arithmetic-op-strategies 
normal division & configurable ordering for ArithmeticPostAggregator
 2015-03-10 13:48:27 -07:00
Fangjin Yang 2d79c6e5b9 Merge pull request #1187 from metamx/update-design-diagram 
updates Realtime node's dataflow connection, s/historical/deep storage; ...
 2015-03-10 13:46:21 -07:00
Fangjin Yang fa2c431589 Merge pull request #1186 from metamx/dataFormatDocsUpdate 
Update Data_formats.md to match arguments used in 0.7.x
 2015-03-10 13:45:37 -07:00
Igal Levy 705a7b3f23 updates Realtime node's dataflow connection, s/historical/deep storage; a bit more information on how Realtime nodes drop segments based on said segments' uptake by Historicals 2015-03-10 13:44:36 -07:00
Charles Allen 2ac610771e Update Data_formats.md to match arguments used in 0.7.x 2015-03-10 13:41:11 -07:00
Fangjin Yang c7ec8ba15b Merge pull request #1184 from metamx/docs-event-receiver-firehose 
fix docs and add docs for event receiver firehose
 2015-03-10 10:23:19 -07:00
nishantmonu51 425ad98261 fix docs and add docs for event receiver firehose 2015-03-10 21:29:57 +05:30
Fangjin Yang 2abdce1dc0 Merge pull request #1180 from metamx/logging-groupBy-NPE 
add null check early to catch root cause for groupBy NPE while running bySegment query
 2015-03-09 09:16:33 -07:00
nishantmonu51 704f463dbf fix property name in doc 2015-03-09 21:19:29 +05:30
Himanshu Gupta cb5ed4942c simple typo fix on Concepts-and_Terminology.md to correct navigation to spec file info 2015-03-07 11:29:24 -06:00
Xavier Léauté 0d47c0c36d normal division and configurable ordering for ArithmeticPostAggregator 
Fixes #510
 2015-03-04 12:44:24 -08:00
Fangjin Yang 9578304d6f Merge pull request #1130 from housejester/jde-building 
Various improvements to the tutorial and building experience.
 2015-03-02 14:48:32 -08:00
Fangjin Yang e8605c63a9 Merge pull request #1150 from himanshug/broker-parallel-chunk-process 
interval chunk query runner now processes individual chunk in a threadpool
 2015-03-02 13:50:23 -08:00
Himanshu Gupta 29039fd541 interval chunk query runner now processes individual chunk in a thread pool and prints metrics query/time per chunk 2015-03-02 15:45:09 -06:00
Fangjin Yang a76a24742b Merge pull request #1149 from himanshug/broker-get-datasource-update 
updating ClientInfoResource.getDatasource() with a full flag
 2015-03-02 13:28:27 -08:00
Himanshu Gupta a39f4f8bf4 updating ClientInfoResource.getDatasource() with a full flag to return all the served intervals for given data source along with the dimension and metric information 2015-03-02 14:18:52 -06:00
Xavier Léauté 437d61ed8f Merge pull request #1164 from mrijke/docfix-cache-configs 
Docfix: Update Cache config pages
 2015-03-02 11:47:50 -08:00
Maarten Rijke 2531bb9664 Docfix: Update Cache config pages 
* Update Broker-Config.md Cache options table
 * Update Historical-Config.md Cache options table (broker->historical)
 2015-03-02 19:55:00 +01:00
Xavier Léauté 1d98717d24 Merge pull request #1162 from mrijke/fix-metric-monitor-names 
Update metrics monitors names in Configuration.md
 2015-03-02 10:33:19 -08:00
Maarten Rijke 092acaea9d Update metrics monitors names in Configuration.md 
Updated the metric package names to reflect the new names in 0.7
 2015-03-02 12:16:47 +01:00
Maarten Rijke d52f3bb817 Update default value for druid.emitter in Configuration.md 2015-03-02 12:06:30 +01:00
James Estes 9cb5d9bd00 Various improvements to the tutorial and building experience. 
- Improve geo ip download stability
- Retry default geo ip download if corrupt
- Clarify docs on building & where to get artifact
 2015-02-25 18:49:16 -07:00
Prajwal Tuladhar d1fb42c554 fix broken docs link 2015-02-24 23:41:13 -05:00
fjy 46bd614d63 fix broken links 2015-02-24 20:14:17 -08:00
Xavier Léauté 667c3d4f8c fix typo 2015-02-19 11:41:37 -08:00
James Estes 562de6c621 Update docs and examples for log4j2 usage. 
- Put configs early in classpath in examples so log4j2.xml will get picked up properly
- Add an example log4j2.xml file.
- Update Logging doc.
 2015-02-19 11:40:56 -07:00
Xavier Léauté 475ba9d068 remove build.sh in favor of mvn package 2015-02-19 10:32:41 -08:00
Xavier Léauté 8e33e58422 rename Druid binary assembly 2015-02-18 17:42:55 -08:00
fjy 6d05f4fe5e Add more compare docs 2015-02-18 15:57:36 -08:00
Fangjin Yang 146a6a3b2b Merge pull request #1135 from metamx/topNDocumentation 
Add more TopN documentation regarding Aliasing
 2015-02-18 15:39:27 -08:00
Xavier Léauté 19e11ae601 Use default ports in examples 2015-02-18 11:46:27 -08:00
Charles Allen 2e27b888ed Add more TopN documentation regarding Aliasing 
* Addresses concerns in https://github.com/druid-io/druid/issues/1134
 2015-02-18 11:27:53 -08:00
Xavier Léauté cff218ee20 update example + tutorial for kafka 0.8 2015-02-17 23:58:51 -08:00
fjy 3fab045b2d Go through and fix mistakes in tutorials and docs 2015-02-17 15:21:16 -08:00
cheddar 2a45501393 Merge pull request #1110 from metamx/move-to-sonatype 
Move Druid release artifacts to Sonatype
 2015-02-17 11:54:16 -08:00
Xavier Léauté 78df7f6165 Move Druid release artifacts to Sonatype 
- Switch to using Druid parent POM
- Add required fields for Sonatype
- Common plugin versions and settings have been moved to the parent pom
- Cleanup artifacts and POMs for consistent formatting
- Remove org.hyperic.sigar dependency and update docs to reflect necessary jars to add at runtime when sigar is needed
 2015-02-13 14:26:31 -08:00
James Estes 8d1aa2beb3 Add common config dir to classpath in examples 
Also adds query examples in the Cluster tutorial
 2015-02-13 12:59:08 -07:00
fjy 13de51494e update versions in tutorials and docs 2015-02-12 16:11:31 -08:00
Fangjin Yang e915675b97 Merge pull request #1112 from druid-io/fix-examples 
Update realtime node configs for examples; fixes #1111
 2015-02-12 15:44:15 -08:00
fjy 34ed474d40 Add docs for http endpoints 2015-02-11 16:12:51 -08:00
fjy 63338e6e35 Update realtime node configs for examples; fixes #1111 2015-02-11 14:34:02 -08:00
Xavier Léauté 72333731c3 Merge pull request #1101 from druid-io/update 
Update poms and add docs for backwards compat JSON parser
 2015-02-09 16:14:57 -08:00
fjy e5debb2dec update poms and add docs for backwards compat 2015-02-09 16:13:00 -08:00
Charles Allen 79a3e8f59f Fix overriding base of IndexerZkConfig to be absolute instead of relative 
* Updated docs to clarify ZK config behavior
* Added unit tests for this case
 2015-02-04 13:04:06 -08:00
fjy 67ecb07ccd update version in docs 2015-02-03 14:26:42 -08:00
fjy b9337e883a I'm all about them doc fixes 2015-01-21 22:04:48 -08:00
fjy f437e16543 moar doc fixes 2015-01-21 21:59:16 -08:00
fjy e33e45e69e one more doc fix 2015-01-21 21:52:23 -08:00
fjy 74a4fddcfe fix task docs 2015-01-21 21:48:48 -08:00
fjy 7540f2f562 Add more docs for production clusters 2015-01-21 14:21:27 -08:00
Xavier Léauté 5a2030c49b Merge pull request #1059 from druid-io/remove-test 
Remove test rejection policy - it has no place anywhere
 2015-01-20 13:39:46 -08:00
Xavier Léauté a74ced97d9 Merge pull request #1058 from druid-io/equal-dist 
Add a new equal distribution strategy for assigning tasks
 2015-01-20 13:27:32 -08:00
fjy 1ff5829d6d remove test rejection policy 2015-01-20 13:22:30 -08:00
fjy 2d516fa591 Add a new equal distribution strategy for assigning tasks 2015-01-20 13:12:22 -08:00
Charles Allen 3d27747f7e Upgrade to log4j2 
Default behavior is as before.
Added documentation for how to enable synchronous logging for select chatty classes:
* io.druid.client.ServerInventoryView
* io.druid.client.BatchServerInventoryView
* io.druid.curator.inventory.CuratorInventoryManager
* com.metamx.http.client.pool.ChannelResourceFactory
 2015-01-20 12:35:18 -08:00
Fangjin Yang 91a79dbf95 Merge pull request #1031 from metamx/ingestmetadata-query 
DataSourceMetadata query
 2015-01-19 21:55:35 -08:00
Fangjin Yang 068518216b Merge pull request #1048 from metamx/update-tutorial 
update tutorial to create db utf8 by default
 2015-01-19 11:02:17 -08:00
Xavier Léauté 2443dda46b update tutorial to create db utf8 by default 2015-01-16 20:52:40 -08:00
nishantmonu51 503631f6ff review comments. 2015-01-16 20:21:40 +05:30
Igal Levy e86273a9ae New section to provide detail on how and why to set up sharding 
* Different types of sharding strategies
* How and what to configure
* Redundancy and scale-out
 2015-01-15 21:19:53 -08:00
nishantmonu51 c7452b75f6 Merge branch 'master' into ingestmetadata-query 2015-01-15 18:00:31 +05:30
Maarten Rijke 58b334c8e6 Fix some of the Task json examples to have the correct description 2015-01-15 09:41:23 +01:00
fjy a02ef1dbf1 update batch ingest docs 2015-01-08 14:38:10 -08:00
Gian Merlino dde21a16e1 Improve maxPendingPersists docs. 2015-01-07 09:55:33 -08:00
Xavier Léauté 47fa1b3d10 update docs to point to druid-io/druid 2014-12-23 11:26:52 -08:00
fjy ac407fb6ba clean up defaults 2014-12-15 15:05:02 -08:00
Fangjin Yang 335fbebb94 Merge pull request #960 from metamx/new-config 
Rewrite config docs for 0.7.x
 2014-12-15 13:35:25 -07:00
Charles Allen 225a039a01 Merge pull request #965 from metamx/doc-fix 
Fix documented default value for druid.coordinator.merge.on.
 2014-12-13 11:13:14 -08:00
Gian Merlino 020f8653f0 Fix documented default value for druid.coordinator.merge.on. 2014-12-13 08:03:09 -08:00
fjy 818f85e745 rewrite config docs 2014-12-11 15:52:26 -08:00
nishantmonu51 a0d3579a92 add docs + fix tests 2014-12-11 17:58:01 +05:30
Fangjin Yang d6d3ec6846 Merge pull request #948 from metamx/ingestion-docs 
Redocumenting ingestion
 2014-12-09 15:30:03 -07:00
fjy f0e5bb1ba9 remove excess tutorials 2014-12-09 14:29:19 -08:00
fjy 5727193873 more fixes to docs 2014-12-09 14:28:15 -08:00
fjy 4e3d8faed8 fix bad example 2014-12-09 14:21:47 -08:00
fjy 9596c11f42 address cr 2014-12-09 14:19:18 -08:00
fjy 38a369c0ff fix links and some errors 2014-12-08 16:20:35 -08:00
fjy 28b72a69ad redocumenting ingestion 2014-12-08 16:15:46 -08:00
Charles Allen 0fbbcd5885 Move some config description from Configuration.md to the Broker and Historical config pages 2014-12-08 15:53:58 -08:00
xvrl 1392e2731f Merge pull request #936 from metamx/cachingRunnerImprovements 
General Caching Query Runners cleanup (40% query time reduction for HLL)
 2014-12-08 14:07:52 -08:00
Charles Allen 7b65f0635d General Caching Query Runners cleanup 
* Add type strictness to CachingClusteredClient.
* Add background caching to CachingClusteredClient. Gives between 0% and 5% query speed increase.
* Add @BackgroundCaching annotation for injected ExecutorService items
* Add `numBackgroundThreads' configuration options to CacheConfig (default 0 aka same thread legacy behavior)
* Add unit tests for CacheConfig
* Add an abstract caching query runner class, currently it doesn't do anything exceppt simply make the two caching queries distinct.
* Add caching to CachingQueryRunner. Gives up to a WHOPPING 40% reduction in query time on HLL queries
* Updated docs with more info on cache settings.
 2014-12-08 13:29:32 -08:00
Fangjin Yang 86a837a653 Merge pull request #939 from 7eggs/doc-fixes 
Fix link to Druid Cluster Tutorial in Booting a Druid Cluster page
 2014-12-08 12:10:15 -07:00
Alexander Makarenko 6dfa0d20b8 Fix link to Druid Cluster Tutorial in Booting a Druid Cluster page 2014-12-07 21:59:06 +03:00
Fangjin Yang 1a4e798373 Merge pull request #938 from 7eggs/doc-fixes 
Broker config small fix
 2014-12-07 09:48:53 -07:00
Alexander Makarenko df5b525097 Broker config small fix 2014-12-07 18:59:22 +03:00
Alexander Makarenko bbd337235e Add Node.js client to Community Libraries 2014-12-07 03:51:35 +03:00
fjy 8ee4d12562 Refactor structure for examples and extensions 2014-11-21 14:45:24 -08:00
nishantmonu51 e3260aa177 Filtered Aggregator fixes + enhancements 
- fix NPE on IncrementIndex
- refactor code to support AND, OR filter
- tests for AND & OR filter
- handling for missing column / null values
 2014-11-20 15:17:18 -08:00
nishantmonu51 2f08ab85fc Revert "update doc" 
This reverts commit d66d0de54f.
 2014-11-20 10:17:07 +05:30
nishantmonu51 d66d0de54f update doc 2014-11-20 09:29:26 +05:30
Fangjin Yang db8a168b91 Merge pull request #881 from mrijke/update-ruleconf-docs 
Update Rule-Configuration docs: match example with description
 2014-11-18 16:41:49 -07:00
Fangjin Yang 87ea6fd377 Merge pull request #878 from metamx/default-extension-version 
use Druid version as the default version for extensions
 2014-11-18 13:56:54 -07:00
Xavier Léauté bf04ad0eb3 add documentation 2014-11-18 10:50:18 -08:00
Maarten Rijke 06e4535cb8 Update Rule-Configuration: match example with description 
The example JSON snippets of the 'loadForever' and the 'dropForever' don't match their description, the 'type' description mentions 'loadByInterval' and 'dropByPeriod' respectively.
 2014-11-18 17:00:42 +01:00
nishantmonu51 b2e8073c61 document combining firehose 2014-11-18 11:01:08 +05:30
fjy afd419ea29 fix bugs with docs 2014-11-14 13:25:21 -08:00
Fangjin Yang d85c172285 Merge pull request #808 from metamx/igalDruid 
Clarify value types for granularities; link to more ISO info; more info on OrderByColumnSpec
 2014-11-14 14:20:37 -07:00
Eric Bouchut e89f2f973d Fix typo in DimensionSpecs 2014-11-13 15:35:09 +01:00
Xavier Léauté ba442b9882 fix default FilteredServerView + batch annoucement 2014-11-12 23:17:16 -08:00
fjy 26b358e127 Merge branch 'master' of github.com:metamx/druid into druid-0.7.x 2014-11-11 17:30:30 -08:00
Igal Levy de7fb5a690 fixed typo, added note on matching schema requirement for unioned data sources 2014-11-11 11:56:22 -08:00
Igal Levy 34a6f7f7ca Merge branch 'master' into fix-datasource-doc 2014-11-11 11:55:47 -08:00
fjy 6188315293 Merge branch 'master' into druid-0.7.x 
Conflicts:
	processing/src/test/java/io/druid/query/search/SearchQueryRunnerTest.java
 2014-11-10 14:52:10 -08:00
Igal Levy 03515a4de6 fixes typo 2014-11-07 10:40:46 -08:00
xvrl 18b9c5cd2f db -> metadata 2014-11-06 21:46:35 -08:00
Igal Levy 20562492de clarified that dimension and metric can be String too, not just object 2014-11-06 15:16:36 -08:00
Igal Levy ec0accf0b1 clarified that dimensions and metrics are given in String arrays 2014-11-06 15:13:30 -08:00
Igal Levy 8f0b675e23 Added info to better explain how to use pagingSpec 2014-11-06 14:50:01 -08:00
Igal Levy 5a98fcf5b9 typo: s/metric_value/metric_name/ and added quotes 2014-11-06 11:18:30 -08:00
Igal Levy 73226f20cc typo: s/metric_value/metric_name/ 2014-11-06 11:01:31 -08:00
Igal Levy 81227b63a7 Merge branch 'master' into fix-query-docs 2014-11-04 11:09:13 -08:00
xvrl 2c62b9e6e3 Merge pull request #821 from metamx/minor-fix 
Some minor fixes in docs and change jetty defaults
 2014-11-04 10:18:57 -08:00
fjy 42cf20c9f1 some minor fixes in docs and change jetty defaults 2014-11-04 10:08:50 -08:00
Xavier Léauté f56d026d7d fix realtime module + cleaner metadata abstraction 
- better metadata abstractions
- more db->metadata renaming
 2014-11-03 16:40:23 -08:00
Igal Levy c58fc503d9 Clarified sort as optional, object 2014-11-03 11:59:04 -08:00
Igal Levy b416c3ff5c added quotes to clarify string value; added example of numeric filter 2014-11-03 11:57:52 -08:00
Xavier Léauté 48e6bef250 update documentation with new property names 2014-11-03 09:25:39 -08:00
Igal Levy e07b02f54b fixed typo and added info that union can take any number of dataSources 2014-10-31 11:07:55 -07:00
Igal Levy 0906b21079 Merge branch 'master' into fix-datasource-doc 2014-10-30 16:26:16 -07:00
Igal Levy 479c196aa4 Added section on union data sources 2014-10-29 12:32:24 -07:00
Igal Levy 23315e298d expanded and clarified OrderByColumnSpec section 2014-10-28 10:38:21 -07:00
Xavier Léauté 575919ec6c provide a little more involved example 2014-10-27 19:18:09 -07:00
Igal Levy f62221bfae added link to DimensionSpec for alternative way to provide dimensions 2014-10-23 14:30:02 -07:00
Igal Levy f76d68e2c9 added missing anchor to fix broken internal link 2014-10-23 12:49:44 -07:00
Igal Levy 374ba8ab5e minor edits based on Vad's feedback 2014-10-23 11:38:01 -07:00
fjy d76d57d95d update docs 2014-10-22 16:16:28 -07:00
nishantmonu51 0785baf54c review comments 2014-10-22 21:28:31 +05:30
nishantmonu51 6cb6ec39cf add support for not filter and add test 2014-10-22 10:25:24 +05:30
Xavier Léauté 34f2c74331 add docs 2014-10-21 17:24:44 -07:00
fjy ee392b6064 more updates to docs 2014-10-21 16:26:17 -07:00
fjy 2d96bc5f1f more FAQ docs 2014-10-21 16:08:56 -07:00
Fangjin Yang 5df92aff2c Merge pull request #797 from metamx/igalDruid 
Igal druid
 2014-10-21 16:47:47 -06:00
Xavier Léauté 9d5e65913d fix serde 2014-10-21 15:05:08 -07:00
Xavier Léauté b32ce31eff add documentation 2014-10-20 14:12:30 -07:00
Igal Levy 1dd9aeba4f removed link with no target 2014-10-19 21:22:10 -07:00
Igal Levy b7c4983a91 added syntax highlighting 2014-10-19 18:38:20 -07:00
Igal Levy 63a4f2dc05 fixed broken internal link 2014-10-19 18:29:34 -07:00
Fangjin Yang 82fc6e5358 Merge pull request #793 from metamx/partitions-docs 
New PartitionsSpec docs.
 2014-10-19 15:33:16 -06:00
Gian Merlino 20d29666af New PartitionsSpec docs. 2014-10-16 13:17:13 -07:00
fjy 35716e8dee add a best practices doc 2014-10-13 14:33:45 -07:00
fjy d4f5a71ded prepare for next release 2014-10-13 12:48:12 -07:00