Commit Graph

1069 Commits

Author SHA1 Message Date
fjy 36b4c6a371 fix set up with first tutorial 2015-03-13 13:54:45 -07:00
Xavier Léauté 7fb4b1d2bb Merge pull request #1144 from metamx/javaLoggingManager
Add log4j2 hooks to other loggings
2015-03-12 14:38:51 -07:00
Charles Allen edfcea18d8 Add log4j2 hooks to standard java logging 2015-03-12 14:29:41 -07:00
nishantmonu51 3ec4a30ab5 initial commit
review comments

more refactoring and cleaning of redundant code

add UT + docs + more refactoring

fixes + review comments

more cleanup

end points to fetch history

review comments

remove unnecessary changes

review comments rename header name

review comments + add test for MetadataRulesManager

review comments docs
2015-03-12 22:50:29 +05:30
Xavier Léauté 11b3230602 update to kafka 0.8.2.1, because it's better™ 2015-03-12 09:59:24 -07:00
Xavier Léauté d3f5bddc5c Add ability to apply extraction functions to the time dimension
- Moves DimExtractionFn under a more generic ExtractionFn interface to
  support extracting dimension values other than strings
- pushes down extractionFn to the storage adapter from query engine
- 'dimExtractionFn' parameter has been deprecated in favor of 'extractionFn'
- adds a TimeFormatExtractionFn, allowing to project the '__time' dimension
- JavascriptDimExtractionFn renamed to JavascriptExtractionFn, adding
  support for any dimension value types that map directly to Javascript
- update documentation for time column extraction and related changes
2015-03-11 16:45:42 -07:00
Xavier Léauté 9f242ed1ba Merge pull request #1182 from druid-io/better-docs
Rework the druid docs and fix many mistakes
2015-03-10 14:23:38 -07:00
fjy 064d65a009 rework the druid docs and fix many mistakes 2015-03-10 14:19:19 -07:00
Fangjin Yang 0b467624ec Merge pull request #694 from druid-io/arithmetic-op-strategies
normal division & configurable ordering for ArithmeticPostAggregator
2015-03-10 13:48:27 -07:00
Fangjin Yang 2d79c6e5b9 Merge pull request #1187 from metamx/update-design-diagram
updates Realtime node's dataflow connection, s/historical/deep storage; ...
2015-03-10 13:46:21 -07:00
Fangjin Yang fa2c431589 Merge pull request #1186 from metamx/dataFormatDocsUpdate
Update Data_formats.md to match arguments used in 0.7.x
2015-03-10 13:45:37 -07:00
Igal Levy 705a7b3f23 updates Realtime node's dataflow connection, s/historical/deep storage; a bit more information on how Realtime nodes drop segments based on said segments' uptake by Historicals 2015-03-10 13:44:36 -07:00
Charles Allen 2ac610771e Update Data_formats.md to match arguments used in 0.7.x 2015-03-10 13:41:11 -07:00
Fangjin Yang c7ec8ba15b Merge pull request #1184 from metamx/docs-event-receiver-firehose
fix docs and add docs for event receiver firehose
2015-03-10 10:23:19 -07:00
nishantmonu51 425ad98261 fix docs and add docs for event receiver firehose 2015-03-10 21:29:57 +05:30
Fangjin Yang cee7e12cb7 Merge pull request #1183 from metamx/update-design-diagram
updates diagram: s/MySql/metadata storage
2015-03-09 16:54:03 -07:00
Igal Levy f98e168ed5 updates diagram: s/MySql/metadata storage' 2015-03-09 16:41:21 -07:00
Fangjin Yang 2abdce1dc0 Merge pull request #1180 from metamx/logging-groupBy-NPE
add null check early to catch root cause for groupBy NPE while running bySegment query
2015-03-09 09:16:33 -07:00
nishantmonu51 704f463dbf fix property name in doc 2015-03-09 21:19:29 +05:30
Himanshu Gupta cb5ed4942c simple typo fix on Concepts-and_Terminology.md to correct navigation to spec file info 2015-03-07 11:29:24 -06:00
Xavier Léauté 0d47c0c36d normal division and configurable ordering for ArithmeticPostAggregator
Fixes #510
2015-03-04 12:44:24 -08:00
Fangjin Yang 9578304d6f Merge pull request #1130 from housejester/jde-building
Various improvements to the tutorial and building experience.
2015-03-02 14:48:32 -08:00
Fangjin Yang e8605c63a9 Merge pull request #1150 from himanshug/broker-parallel-chunk-process
interval chunk query runner now processes individual chunk in a threadpool
2015-03-02 13:50:23 -08:00
Himanshu Gupta 29039fd541 interval chunk query runner now processes individual chunk in a thread pool and prints metrics query/time per chunk 2015-03-02 15:45:09 -06:00
Fangjin Yang a76a24742b Merge pull request #1149 from himanshug/broker-get-datasource-update
updating ClientInfoResource.getDatasource() with a full flag
2015-03-02 13:28:27 -08:00
Himanshu Gupta a39f4f8bf4 updating ClientInfoResource.getDatasource() with a full flag to return all the served intervals for given data source along with the dimension and metric information 2015-03-02 14:18:52 -06:00
Xavier Léauté 437d61ed8f Merge pull request #1164 from mrijke/docfix-cache-configs
Docfix: Update Cache config pages
2015-03-02 11:47:50 -08:00
Maarten Rijke 2531bb9664 Docfix: Update Cache config pages
* Update Broker-Config.md Cache options table
 * Update Historical-Config.md Cache options table (broker->historical)
2015-03-02 19:55:00 +01:00
Xavier Léauté 1d98717d24 Merge pull request #1162 from mrijke/fix-metric-monitor-names
Update metrics monitors names in Configuration.md
2015-03-02 10:33:19 -08:00
Maarten Rijke 092acaea9d Update metrics monitors names in Configuration.md
Updated the metric package names to reflect the new names in 0.7
2015-03-02 12:16:47 +01:00
Maarten Rijke d52f3bb817 Update default value for druid.emitter in Configuration.md 2015-03-02 12:06:30 +01:00
James Estes 9cb5d9bd00 Various improvements to the tutorial and building experience.
- Improve geo ip download stability
- Retry default geo ip download if corrupt
- Clarify docs on building & where to get artifact
2015-02-25 18:49:16 -07:00
Prajwal Tuladhar d1fb42c554 fix broken docs link 2015-02-24 23:41:13 -05:00
fjy 46bd614d63 fix broken links 2015-02-24 20:14:17 -08:00
Xavier Léauté 667c3d4f8c fix typo 2015-02-19 11:41:37 -08:00
James Estes 562de6c621 Update docs and examples for log4j2 usage.
- Put configs early in classpath in examples so log4j2.xml will get picked up properly
- Add an example log4j2.xml file.
- Update Logging doc.
2015-02-19 11:40:56 -07:00
Xavier Léauté 475ba9d068 remove build.sh in favor of mvn package 2015-02-19 10:32:41 -08:00
Xavier Léauté 8e33e58422 rename Druid binary assembly 2015-02-18 17:42:55 -08:00
fjy 6d05f4fe5e Add more compare docs 2015-02-18 15:57:36 -08:00
Fangjin Yang 146a6a3b2b Merge pull request #1135 from metamx/topNDocumentation
Add more TopN documentation regarding Aliasing
2015-02-18 15:39:27 -08:00
Xavier Léauté 19e11ae601 Use default ports in examples 2015-02-18 11:46:27 -08:00
Charles Allen 2e27b888ed Add more TopN documentation regarding Aliasing
* Addresses concerns in https://github.com/druid-io/druid/issues/1134
2015-02-18 11:27:53 -08:00
Xavier Léauté cff218ee20 update example + tutorial for kafka 0.8 2015-02-17 23:58:51 -08:00
Xavier Léauté 018653700b update docs jekyll config 2015-02-17 23:58:50 -08:00
fjy 3fab045b2d Go through and fix mistakes in tutorials and docs 2015-02-17 15:21:16 -08:00
cheddar 2a45501393 Merge pull request #1110 from metamx/move-to-sonatype
Move Druid release artifacts to Sonatype
2015-02-17 11:54:16 -08:00
Xavier Léauté 78df7f6165 Move Druid release artifacts to Sonatype
- Switch to using Druid parent POM
- Add required fields for Sonatype
- Common plugin versions and settings have been moved to the parent pom
- Cleanup artifacts and POMs for consistent formatting
- Remove org.hyperic.sigar dependency and update docs to reflect necessary jars to add at runtime when sigar is needed
2015-02-13 14:26:31 -08:00
James Estes 8d1aa2beb3 Add common config dir to classpath in examples
Also adds query examples in the Cluster tutorial
2015-02-13 12:59:08 -07:00
fjy 13de51494e update versions in tutorials and docs 2015-02-12 16:11:31 -08:00
Fangjin Yang e915675b97 Merge pull request #1112 from druid-io/fix-examples
Update realtime node configs for examples; fixes #1111
2015-02-12 15:44:15 -08:00
fjy 34ed474d40 Add docs for http endpoints 2015-02-11 16:12:51 -08:00
fjy 63338e6e35 Update realtime node configs for examples; fixes #1111 2015-02-11 14:34:02 -08:00
Xavier Léauté 72333731c3 Merge pull request #1101 from druid-io/update
Update poms and add docs for backwards compat JSON parser
2015-02-09 16:14:57 -08:00
fjy e5debb2dec update poms and add docs for backwards compat 2015-02-09 16:13:00 -08:00
Fangjin Yang cb4f894ef7 Merge pull request #1087 from metamx/fixIndexerBaseRelativity
Fix overriding base of IndexerZkConfig to be absolute instead of relative
2015-02-04 14:10:21 -08:00
Fangjin Yang 60b2d920bc Merge pull request #1088 from metamx/upload-docs-s3
Upload documentation to static.druid.io
2015-02-04 13:23:27 -08:00
Charles Allen 79a3e8f59f Fix overriding base of IndexerZkConfig to be absolute instead of relative
* Updated docs to clarify ZK config behavior
* Added unit tests for this case
2015-02-04 13:04:06 -08:00
Xavier Léauté ae78b1450e upload documentation to static.druid.io 2015-02-04 12:56:52 -08:00
fjy 67ecb07ccd update version in docs 2015-02-03 14:26:42 -08:00
fjy d05032b98a towards a community led druid 2015-01-31 20:57:36 -08:00
fjy b9337e883a I'm all about them doc fixes 2015-01-21 22:04:48 -08:00
fjy f437e16543 moar doc fixes 2015-01-21 21:59:16 -08:00
fjy e33e45e69e one more doc fix 2015-01-21 21:52:23 -08:00
fjy 74a4fddcfe fix task docs 2015-01-21 21:48:48 -08:00
fjy 7540f2f562 Add more docs for production clusters 2015-01-21 14:21:27 -08:00
Xavier Léauté 5a2030c49b Merge pull request #1059 from druid-io/remove-test
Remove test rejection policy - it has no place anywhere
2015-01-20 13:39:46 -08:00
Xavier Léauté a74ced97d9 Merge pull request #1058 from druid-io/equal-dist
Add a new equal distribution strategy for assigning tasks
2015-01-20 13:27:32 -08:00
fjy 1ff5829d6d remove test rejection policy 2015-01-20 13:22:30 -08:00
fjy 2d516fa591 Add a new equal distribution strategy for assigning tasks 2015-01-20 13:12:22 -08:00
Charles Allen 3d27747f7e Upgrade to log4j2
Default behavior is as before.
Added documentation for how to enable synchronous logging for select chatty classes:
* io.druid.client.ServerInventoryView
* io.druid.client.BatchServerInventoryView
* io.druid.curator.inventory.CuratorInventoryManager
* com.metamx.http.client.pool.ChannelResourceFactory
2015-01-20 12:35:18 -08:00
Fangjin Yang 91a79dbf95 Merge pull request #1031 from metamx/ingestmetadata-query
DataSourceMetadata query
2015-01-19 21:55:35 -08:00
Fangjin Yang 068518216b Merge pull request #1048 from metamx/update-tutorial
update tutorial to create db utf8 by default
2015-01-19 11:02:17 -08:00
Xavier Léauté 2443dda46b update tutorial to create db utf8 by default 2015-01-16 20:52:40 -08:00
nishantmonu51 503631f6ff review comments. 2015-01-16 20:21:40 +05:30
Igal Levy e86273a9ae New section to provide detail on how and why to set up sharding
* Different types of sharding strategies
* How and what to configure
* Redundancy and scale-out
2015-01-15 21:19:53 -08:00
nishantmonu51 c7452b75f6 Merge branch 'master' into ingestmetadata-query 2015-01-15 18:00:31 +05:30
Maarten Rijke 58b334c8e6 Fix some of the Task json examples to have the correct description 2015-01-15 09:41:23 +01:00
fjy a02ef1dbf1 update batch ingest docs 2015-01-08 14:38:10 -08:00
Gian Merlino dde21a16e1 Improve maxPendingPersists docs. 2015-01-07 09:55:33 -08:00
Xavier Léauté 47fa1b3d10 update docs to point to druid-io/druid 2014-12-23 11:26:52 -08:00
fjy ac407fb6ba clean up defaults 2014-12-15 15:05:02 -08:00
Fangjin Yang 335fbebb94 Merge pull request #960 from metamx/new-config
Rewrite config docs for 0.7.x
2014-12-15 13:35:25 -07:00
Charles Allen 225a039a01 Merge pull request #965 from metamx/doc-fix
Fix documented default value for druid.coordinator.merge.on.
2014-12-13 11:13:14 -08:00
Gian Merlino 020f8653f0 Fix documented default value for druid.coordinator.merge.on. 2014-12-13 08:03:09 -08:00
fjy 818f85e745 rewrite config docs 2014-12-11 15:52:26 -08:00
nishantmonu51 a0d3579a92 add docs + fix tests 2014-12-11 17:58:01 +05:30
Fangjin Yang d6d3ec6846 Merge pull request #948 from metamx/ingestion-docs
Redocumenting ingestion
2014-12-09 15:30:03 -07:00
fjy f0e5bb1ba9 remove excess tutorials 2014-12-09 14:29:19 -08:00
fjy 5727193873 more fixes to docs 2014-12-09 14:28:15 -08:00
fjy 4e3d8faed8 fix bad example 2014-12-09 14:21:47 -08:00
fjy 9596c11f42 address cr 2014-12-09 14:19:18 -08:00
fjy 38a369c0ff fix links and some errors 2014-12-08 16:20:35 -08:00
fjy 28b72a69ad redocumenting ingestion 2014-12-08 16:15:46 -08:00
Charles Allen 0fbbcd5885 Move some config description from Configuration.md to the Broker and Historical config pages 2014-12-08 15:53:58 -08:00
xvrl 1392e2731f Merge pull request #936 from metamx/cachingRunnerImprovements
General Caching Query Runners cleanup (40% query time reduction for HLL)
2014-12-08 14:07:52 -08:00
Charles Allen 7b65f0635d General Caching Query Runners cleanup
* Add type strictness to CachingClusteredClient.
* Add background caching to CachingClusteredClient. Gives between 0% and 5% query speed increase.
* Add @BackgroundCaching annotation for injected ExecutorService items
* Add `numBackgroundThreads' configuration options to CacheConfig (default 0 aka same thread legacy behavior)
* Add unit tests for CacheConfig
* Add an abstract caching query runner class, currently it doesn't do anything exceppt simply make the two caching queries distinct.
* Add caching to CachingQueryRunner. Gives up to a WHOPPING 40% reduction in query time on HLL queries
* Updated docs with more info on cache settings.
2014-12-08 13:29:32 -08:00
Fangjin Yang 86a837a653 Merge pull request #939 from 7eggs/doc-fixes
Fix link to Druid Cluster Tutorial in Booting a Druid Cluster page
2014-12-08 12:10:15 -07:00
Alexander Makarenko 6dfa0d20b8 Fix link to Druid Cluster Tutorial in Booting a Druid Cluster page 2014-12-07 21:59:06 +03:00
Fangjin Yang 1a4e798373 Merge pull request #938 from 7eggs/doc-fixes
Broker config small fix
2014-12-07 09:48:53 -07:00
Alexander Makarenko df5b525097 Broker config small fix 2014-12-07 18:59:22 +03:00
Alexander Makarenko bbd337235e Add Node.js client to Community Libraries 2014-12-07 03:51:35 +03:00
fjy 8ee4d12562 Refactor structure for examples and extensions 2014-11-21 14:45:24 -08:00
nishantmonu51 e3260aa177 Filtered Aggregator fixes + enhancements
- fix NPE on IncrementIndex
- refactor code to support AND, OR filter
- tests for AND & OR filter
- handling for missing column / null values
2014-11-20 15:17:18 -08:00
nishantmonu51 2f08ab85fc Revert "update doc"
This reverts commit d66d0de54f.
2014-11-20 10:17:07 +05:30
nishantmonu51 d66d0de54f update doc 2014-11-20 09:29:26 +05:30
Fangjin Yang db8a168b91 Merge pull request #881 from mrijke/update-ruleconf-docs
Update Rule-Configuration docs: match example with description
2014-11-18 16:41:49 -07:00
Fangjin Yang 87ea6fd377 Merge pull request #878 from metamx/default-extension-version
use Druid version as the default version for extensions
2014-11-18 13:56:54 -07:00
Xavier Léauté bf04ad0eb3 add documentation 2014-11-18 10:50:18 -08:00
Maarten Rijke 06e4535cb8 Update Rule-Configuration: match example with description
The example JSON snippets of the 'loadForever' and the 'dropForever' don't match their description, the 'type' description mentions 'loadByInterval' and 'dropByPeriod' respectively.
2014-11-18 17:00:42 +01:00
nishantmonu51 b2e8073c61 document combining firehose 2014-11-18 11:01:08 +05:30
fjy afd419ea29 fix bugs with docs 2014-11-14 13:25:21 -08:00
Fangjin Yang d85c172285 Merge pull request #808 from metamx/igalDruid
Clarify value types for granularities; link to more ISO info; more info on OrderByColumnSpec
2014-11-14 14:20:37 -07:00
Eric Bouchut e89f2f973d Fix typo in DimensionSpecs 2014-11-13 15:35:09 +01:00
Xavier Léauté ba442b9882 fix default FilteredServerView + batch annoucement 2014-11-12 23:17:16 -08:00
fjy 26b358e127 Merge branch 'master' of github.com:metamx/druid into druid-0.7.x 2014-11-11 17:30:30 -08:00
Igal Levy de7fb5a690 fixed typo, added note on matching schema requirement for unioned data sources 2014-11-11 11:56:22 -08:00
Igal Levy 34a6f7f7ca Merge branch 'master' into fix-datasource-doc 2014-11-11 11:55:47 -08:00
fjy 6188315293 Merge branch 'master' into druid-0.7.x
Conflicts:
	processing/src/test/java/io/druid/query/search/SearchQueryRunnerTest.java
2014-11-10 14:52:10 -08:00
Igal Levy 03515a4de6 fixes typo 2014-11-07 10:40:46 -08:00
xvrl 18b9c5cd2f db -> metadata 2014-11-06 21:46:35 -08:00
Igal Levy 20562492de clarified that dimension and metric can be String too, not just object 2014-11-06 15:16:36 -08:00
Igal Levy ec0accf0b1 clarified that dimensions and metrics are given in String arrays 2014-11-06 15:13:30 -08:00
Igal Levy 8f0b675e23 Added info to better explain how to use pagingSpec 2014-11-06 14:50:01 -08:00
Igal Levy 5a98fcf5b9 typo: s/metric_value/metric_name/ and added quotes 2014-11-06 11:18:30 -08:00
Igal Levy 73226f20cc typo: s/metric_value/metric_name/ 2014-11-06 11:01:31 -08:00
Igal Levy 81227b63a7 Merge branch 'master' into fix-query-docs 2014-11-04 11:09:13 -08:00
xvrl 2c62b9e6e3 Merge pull request #821 from metamx/minor-fix
Some minor fixes in docs and change jetty defaults
2014-11-04 10:18:57 -08:00
fjy 42cf20c9f1 some minor fixes in docs and change jetty defaults 2014-11-04 10:08:50 -08:00
Xavier Léauté f56d026d7d fix realtime module + cleaner metadata abstraction
- better metadata abstractions
- more db->metadata renaming
2014-11-03 16:40:23 -08:00
Igal Levy c58fc503d9 Clarified sort as optional, object 2014-11-03 11:59:04 -08:00
Igal Levy b416c3ff5c added quotes to clarify string value; added example of numeric filter 2014-11-03 11:57:52 -08:00
Xavier Léauté 48e6bef250 update documentation with new property names 2014-11-03 09:25:39 -08:00
Igal Levy e07b02f54b fixed typo and added info that union can take any number of dataSources 2014-10-31 11:07:55 -07:00
Igal Levy 0906b21079 Merge branch 'master' into fix-datasource-doc 2014-10-30 16:26:16 -07:00
Igal Levy 479c196aa4 Added section on union data sources 2014-10-29 12:32:24 -07:00
Igal Levy 23315e298d expanded and clarified OrderByColumnSpec section 2014-10-28 10:38:21 -07:00
Xavier Léauté 575919ec6c provide a little more involved example 2014-10-27 19:18:09 -07:00
Igal Levy f62221bfae added link to DimensionSpec for alternative way to provide dimensions 2014-10-23 14:30:02 -07:00
Igal Levy f76d68e2c9 added missing anchor to fix broken internal link 2014-10-23 12:49:44 -07:00
Igal Levy 374ba8ab5e minor edits based on Vad's feedback 2014-10-23 11:38:01 -07:00
fjy d76d57d95d update docs 2014-10-22 16:16:28 -07:00
nishantmonu51 0785baf54c review comments 2014-10-22 21:28:31 +05:30
nishantmonu51 6cb6ec39cf add support for not filter and add test 2014-10-22 10:25:24 +05:30
Xavier Léauté 34f2c74331 add docs 2014-10-21 17:24:44 -07:00
fjy ee392b6064 more updates to docs 2014-10-21 16:26:17 -07:00
fjy 2d96bc5f1f more FAQ docs 2014-10-21 16:08:56 -07:00
Fangjin Yang 5df92aff2c Merge pull request #797 from metamx/igalDruid
Igal druid
2014-10-21 16:47:47 -06:00
Xavier Léauté 9d5e65913d fix serde 2014-10-21 15:05:08 -07:00
Xavier Léauté b32ce31eff add documentation 2014-10-20 14:12:30 -07:00
Igal Levy 1dd9aeba4f removed link with no target 2014-10-19 21:22:10 -07:00
Igal Levy b7c4983a91 added syntax highlighting 2014-10-19 18:38:20 -07:00
Igal Levy 63a4f2dc05 fixed broken internal link 2014-10-19 18:29:34 -07:00
Fangjin Yang 82fc6e5358 Merge pull request #793 from metamx/partitions-docs
New PartitionsSpec docs.
2014-10-19 15:33:16 -06:00
Gian Merlino 20d29666af New PartitionsSpec docs. 2014-10-16 13:17:13 -07:00
fjy 35716e8dee add a best practices doc 2014-10-13 14:33:45 -07:00
fjy d4f5a71ded prepare for next release 2014-10-13 12:48:12 -07:00
Xavier Léauté 8304365948 move thanks page to main site 2014-10-10 10:19:33 -07:00
fjy 0532208c25 prepare for next release 2014-10-09 14:21:38 -07:00
Xavier Léauté fa27908ae4 and another one, fixes #782 2014-10-09 10:28:33 -07:00
Xavier Léauté e2e912cdc3 fix broken link, resolved #782 2014-10-09 10:26:47 -07:00
fjy 21ac3f2aab slight clarification about hadoop setup 2014-10-08 10:56:00 -07:00
fjy 8a34a55c0b add example hadoop config 2014-10-08 10:51:00 -07:00
fjy 1ce67dcfc4 prepare for next release 2014-10-07 14:27:47 -07:00
fjy 19dc32d314 add headers for druid vs pages 2014-10-07 13:50:32 -07:00
fjy f1d37d569c doc fixes 2014-10-07 13:01:41 -07:00
fjy ee0e856029 correct mistakes 2014-10-06 14:23:23 -07:00
fjy 546fca2d67 docs for router node 2014-10-06 14:18:25 -07:00
fjy d9453f29f1 fix docs 2014-09-30 15:02:06 -07:00
fjy 5b166134fb add docs 2014-09-30 14:59:02 -07:00
fjy e367f76824 Merge pull request #757 from pdeva/master
FAQ on changing data granularity
2014-09-29 15:40:37 -06:00
pdeva bc66b42acc FAQ on changing data granularity
added cause this question is asked a ton of times on google group and i had a similar question and had to resort to the forums cause there was no doc.
2014-09-25 01:48:45 -07:00
Xavier Léauté 13ac7de882 update doc versions 2014-09-23 16:28:18 -07:00
fjy c042ce5b4b prep next rel 2014-09-23 16:10:12 -07:00
fjy d19723e186 Merge pull request #749 from metamx/background-segment-announcing
Parallelize segment loading + background announcing
2014-09-23 17:07:51 -06:00
fjy bdea4f45ea fixes #733 2014-09-23 15:41:56 -07:00
Xavier Léauté d7b39fa7ea add documentation 2014-09-23 09:30:40 -07:00
xvrl 5e0b6b9896 Merge pull request #746 from pdeva/master
segment metadata result explained better
2014-09-22 10:27:35 -07:00
Xavier Léauté 815ebeee25 add docs for background segments loading 2014-09-18 12:09:20 -07:00
pdeva d53ccf7ead segment metadata result explained better 2014-09-16 15:56:15 -07:00
fjy fbeb57d261 prepare for next release 2014-09-16 15:18:27 -07:00
fjy c1a0961f98 Merge pull request #731 from pdeva/master
Corrected documentation for IngestSegmentFirehose
2014-09-16 10:54:29 -06:00
pdeva d674e611de described how to enable experimental features 2014-09-15 14:41:57 -07:00
pdeva 4a23cd94ef Corrected documentation for IngestSegmentFirehose
Ingest Segment firehose had incorrect documentation.
2014-09-14 11:22:36 -07:00
Xavier Léauté 17b6ed2cbe fix docs deploy 2014-09-05 11:44:34 -07:00
Xavier Léauté 958f2f9abd fix docs versions 2014-09-05 11:40:51 -07:00
Xavier Léauté 280681e84b add option to generate only api or only docs 2014-09-05 10:55:44 -07:00
fjy 963a44a8d4 Merge branch 'master' of github.com:metamx/druid 2014-09-05 10:15:47 -07:00
fjy eecda34940 fix tutorial with msg that no longer exists 2014-09-05 10:15:37 -07:00
Xavier Léauté f0d67fe873 deploy api docs 2014-09-04 16:13:43 -07:00
Xavier Léauté 3c131f4d13 update version in docs 2014-09-04 13:47:25 -07:00
fjy 6e75cb755d Merge pull request #719 from pdeva/master
clarify division operation in post aggregation
2014-09-04 11:26:42 -06:00
Xavier Léauté 23a2b84703 fix broken link, resolves #718 2014-08-31 21:51:12 +00:00
pdeva 1bad66c16d clarify division operation in post aggregation 2014-08-31 09:56:15 -07:00
Xavier Léauté 6f45f88f26 fix post-aggregations broken link 2014-08-29 16:39:09 -07:00
pdeva 7c47c60c4b explain what 'full cluster view' means 2014-08-26 03:02:05 -07:00
fjy 7ca3b2d27c update docs 2014-08-22 08:26:25 -07:00
fjy 85ff054726 prepare for next release 2014-08-21 12:47:55 -07:00
fjy 29d14b772f prepare for next release 2014-08-14 14:56:27 -07:00
Amy Troschinetz 71b8db631c Updates Cassandra example documentation.
Updates the required properties to enable Cassandra as deep storage.
Also adds more information about how to create the required keystore,
and which properties files need to be modified to support Cassandra.
Also adds syntax highlighting to the provided example code.

Additionally, moves Cassandra Deep Storage documentation out into the
actual documentation hierarchy with appropriate linkage. A stub
README.md is left in the example directory to provide a useful landing
page for existing weblinks to the original documentation.
2014-08-14 16:36:36 -05:00
fjy 79f6486b88 prepare for next release 2014-08-12 13:22:23 -07:00
fjy d4014c6a4e Merge pull request #675 from metamx/slimmer-column-cache
reduce object count overhead of column cache
2014-08-12 14:16:33 -06:00
Xavier Léauté 1c244c8be8 add column cache docs 2014-08-12 10:40:09 -07:00
fjy bd98e0dd29 prep next release 2014-08-09 19:33:31 -07:00
fjy 8998700760 prepare for next release 2014-08-08 16:19:45 -07:00
fjy 8e87cae990 prepare for next rel 2014-08-08 15:51:22 -07:00
fjy 35937132a7 prep next release 2014-08-08 14:35:22 -07:00
fjy bb44056810 prepare for next release 2014-08-08 11:38:17 -07:00
fjy 57a979ef19 prepare for next release 2014-08-06 13:31:27 -07:00
Gian Merlino 6e33cd4e0a Coordinator drop/remove related stuff.
- DruidCoordinatorCleanup should wait for availableSegments to populate
  before dropping any segments.
- Clarify that millisToWaitBeforeDeleting applies to "removing" rather than
  "dropping" segments.
- LoadRule shouldn't need to wait for the deletionWaitTime before dropping
  excess replicas.
2014-08-06 12:52:09 -07:00
Xavier Léauté 8f615212a9 new deploy script that automatically submits a pull request 2014-08-01 15:42:22 -07:00
Xavier Léauté 91fc5fc82d reformatting 2014-08-01 15:28:13 -07:00
Xavier Léauté a0a12f5989 remove css from docs 2014-08-01 15:28:13 -07:00
Xavier Léauté cd5ccc39fb updated deploy script 2014-08-01 15:28:13 -07:00
Xavier Léauté e158aa30a7 add timeboundary docs 2014-08-01 10:44:45 -07:00
fjy 362be7a2c0 prepare for next release 2014-08-01 10:12:03 -07:00
fjy 046e8864b1 more docs 2014-08-01 10:10:23 -07:00
Xavier Léauté 2667cd5188 cleanup docs template for preview 2014-08-01 10:01:19 -07:00
Xavier Léauté b44546ad8c query cancellation/timeout docs + missing items 2014-08-01 09:48:06 -07:00
fjy 90ebeaa8d3 fix broken approx histo doc 2014-08-01 09:42:52 -07:00
nishantmonu51 80a4f7c5b5 doc for IngestSegmentFirehose 2014-08-01 16:43:39 +05:30
fjy d202eae3b5 toc fix 2014-07-31 17:27:16 -07:00
fjy 611dcb9d1c new docs on logging
Conflicts:
	docs/content/toc.textile
2014-07-31 17:26:15 -07:00
fjy 17c600c691 some doc fixes 2014-07-31 17:25:30 -07:00
fjy e5ce9b4a2a prepare for next release 2014-07-31 14:05:56 -07:00
fjy 32bd7003ec minor doc fix 2014-07-31 12:58:19 -07:00
fjy 147f5754da add missing doc 2014-07-31 10:23:48 -07:00
fjy 625377fdd2 prep next rel 2014-07-29 22:00:11 -07:00
fjy 7803ca07e7 fix broken chat handler 2014-07-29 17:58:21 -07:00
fjy 89149b5fcb prepare for next release 2014-07-29 17:38:19 -07:00
fjy 0be5d27f2a another docs fix 2014-07-29 11:40:35 -07:00
fjy d9c9190e2f fix breakage in batch ingestion schema 2014-07-29 11:36:29 -07:00
Jasmine Hegman 1844bf4f08 Adding a section to detail supporting Kafka 8 2014-07-28 14:46:39 -07:00
Jasmine Hegman 61af84a4a1 Cleaning up code sample indentations 2014-07-28 14:44:59 -07:00
fjy 45e443bedb a few slight tweaks and bumping up curator version 2014-07-25 16:07:40 -07:00
fjy 7e0fa6fe06 Merge branch 'master' of github.com:metamx/druid 2014-07-25 10:50:47 -07:00
fjy bb5c5b3ce7 fix config with broker select and add docs 2014-07-25 10:50:41 -07:00
fjy 41770574f9 Merge pull request #646 from metamx/inverted-topn-metric-spec-docs
add docs
2014-07-25 10:30:38 -06:00
fjy d3b920769d a few more cleanups to docs 2014-07-25 09:26:44 -07:00
Xavier Léauté 9c36014645 remove css from docs 2014-07-24 14:41:45 -07:00
Gian Merlino baeb93772d Rename OrderBy to LimitSpec in docs. 2014-07-24 14:20:43 -07:00
nishantmonu51 27cda43d89 add docs
doc for inverted topN metric spec
2014-07-24 13:16:44 +05:30
fjy 387350abd8 fix toc entry 2014-07-23 13:41:14 -07:00
fjy ded83557dd Merge pull request #640 from metamx/disable-worker
An alternative way to disable middlemanagers based on worker version
2014-07-17 19:07:27 -06:00
fjy 83cb7931ac add more stuff to docs 2014-07-17 14:59:56 -07:00
fjy d765ff5e75 docs for updating 2014-07-17 14:53:26 -07:00
fjy bb5598df54 fix doc 2014-07-17 14:07:12 -07:00
fjy c6078ca841 address code review 2014-07-17 13:34:05 -07:00
fjy bdfeccd092 doc and timeout fix 2014-07-15 15:57:58 -07:00
fjy ce478be899 Remove redundant forking task runner config 2014-07-07 18:08:37 -06:00
fjy c646648319 fix examples start port 2014-07-02 10:07:04 -07:00
fjy dba7e972d8 refactor docs for histograms 2014-07-01 16:39:24 -07:00
Xavier Léauté 70ae6e1fcd Approximate Histogram Module 2014-07-01 15:10:23 -07:00
fjy 484b91db5a Merge pull request #617 from metamx/igalDruid
Igal druid
2014-06-30 19:58:38 -06:00
Gian Merlino 991ff34f38 More explicit example of jobProperties. 2014-06-25 20:24:51 -07:00
fjy ff00b545bc Merge pull request #623 from metamx/document-hadoop-jobProperties
Document how to set hadoop properties
2014-06-25 21:15:21 -06:00
Gian Merlino a7ef019b22 Document batch ingestion jobProperties. 2014-06-25 20:14:11 -07:00
Igal Levy 805e80c24d Merge branch 'master' into igalDruid 2014-06-20 17:16:41 -07:00
Igal Levy 262d43ae2e removed build section that didn't work (direct from whirr repo); added info on resource files needed to run test; tweaked whirr config section to match current requirements; changed cluster-start section to reflect fact that we're starting multiple instances; other minor edits 2014-06-20 17:03:21 -07:00
fjy 5afcb9cbd3 add docs 2014-06-19 16:55:02 -07:00
fjy 276e48e564 another doc fix 2014-06-19 13:33:16 -07:00
fjy fdb39d57a3 fix another doc problem 2014-06-19 13:10:08 -07:00
fjy 9aa018925d fix doc header 2014-06-19 12:59:58 -07:00
fjy f1759b450c fix Zk setup problem 2014-06-19 12:55:02 -07:00
Gian Merlino 3164228ecf Fix example middle manager configs. 2014-06-19 12:43:42 -07:00
Gian Merlino eab9381ba1 Docs for string-based EC2 userData. 2014-06-18 10:09:07 -07:00
Gian Merlino e9ef1e956c Docs for defaultHadoopCoordinates. 2014-06-18 09:50:37 -07:00
fjy 1110b34328 Merge pull request #586 from metamx/jisoo
modify whirr documentation
2014-06-06 16:14:48 -06:00
jisookim0513 11f07b5fbf revert changes to wikipedia_realtime_task.json, CliBroker.java, CliHistorical.java 2014-06-05 17:51:58 -07:00
jisookim0513 a0d51a8cb2 modify whirr documentation 2014-06-05 15:51:23 -07:00
fjy c8689507c8 prepare for next release 2014-06-05 10:01:25 -07:00
fjy e3941a2890 prepare for next rel 2014-06-04 20:19:50 -07:00
fjy 612624fb89 prepare for next release 2014-06-04 16:47:54 -07:00
fjy 8f657686c5 fix typos 2014-06-04 10:14:39 -07:00
fjy 22c62cc176 update performance FAQ 2014-06-04 10:09:17 -07:00
fjy 22bbe037a7 prepare for next release 2014-06-04 09:34:29 -07:00
fjy dd76fc49e2 fix doc mistake 2014-06-02 15:38:25 -07:00
fjy abe26a7f2e change default merge size to 500mb instead of 1g 2014-06-02 12:48:57 -07:00
fjy abac529116 prepare for next release 2014-06-02 10:49:54 -07:00
fjy 34d3eb3b5f fix minor link problem in docs 2014-06-02 10:21:00 -07:00
fjy 49f03b808d fix default value for max segments to merge 2014-06-02 10:20:13 -07:00
fjy 9adf80da7c prepare for next release 2014-05-29 17:24:02 -07:00
fjy 53638a74ec add more segment metadata docs 2014-05-29 12:53:13 -07:00
fjy fcc9bf4f26 document limitspec in groupby, fixes #394 2014-05-29 10:19:11 -07:00
fjy 7be93a770a make all firehoses work with tasks, add a lot more documentation about configuration 2014-05-28 16:33:59 -07:00
fjy 002fefb4cf Merge pull request #554 from jcollum/kafka-404-fix
changed the url for kafka wget (old one was 404)
2014-05-19 14:37:20 -06:00
Justin Collum d3d2534105 changed the url for kafka wget (old one was 404) 2014-05-19 10:55:22 -07:00
fjy b6fb4245aa Merge branch 'master' into new-schema
Conflicts:
	indexing-hadoop/src/main/java/io/druid/indexer/HadoopDriverConfig.java
	indexing-hadoop/src/main/java/io/druid/indexer/HadoopDruidIndexerConfig.java
	indexing-hadoop/src/main/java/io/druid/indexer/HadoopDruidIndexerConfigBuilder.java
	pom.xml
	server/src/main/java/io/druid/segment/realtime/RealtimeManager.java
	server/src/main/java/io/druid/segment/realtime/firehose/EventReceiverFirehoseFactory.java
2014-05-06 14:32:51 -07:00
fjy b1bd6eb0f2 Merge pull request #512 from metamx/cardinality
Cardinality aggregator
2014-05-05 17:10:24 -06:00
fjy 8af927e2a7 Merge pull request #516 from metamx/alphanumeric-topn
Alpha-numeric sorting for topN
2014-05-05 17:09:24 -06:00
fjy b8184821b5 update docs for next rel 2014-05-01 15:07:14 -07:00
fjy 268c9aa807 update docs version 2014-04-30 13:11:46 -07:00
fjy 3fd651c235 fix the rule again, update docs, and prepare for next release 2014-04-30 10:43:30 -07:00
fjy 0790303b4a update docs and prepare for next release 2014-04-30 10:23:35 -07:00
fjy ffd37bc7bd Merge pull request #521 from metamx/igalDruid
Igal druid
2014-04-29 18:06:30 -06:00
Igal Levy 7cd2f9a9bb fixed couple of typos 2014-04-29 10:00:28 -07:00
Igal Levy 77fb424034 fixed borked description of whirr.hardware-id 2014-04-29 09:56:00 -07:00
Xavier Léauté fc874f8bbb add docs 2014-04-28 09:51:58 -07:00
fjy 76e0a48527 Merge branch 'master' into new-schema
Conflicts:
	indexing-hadoop/src/main/java/io/druid/indexer/DbUpdaterJob.java
	indexing-hadoop/src/test/java/io/druid/indexer/HadoopDruidIndexerConfigTest.java
	indexing-service/src/main/java/io/druid/indexing/common/task/HadoopIndexTask.java
	server/src/main/java/io/druid/segment/realtime/plumber/RealtimePlumber.java
	server/src/main/java/io/druid/segment/realtime/plumber/RealtimePlumberSchool.java
2014-04-25 14:03:28 -07:00
Xavier Léauté 42c4e955fa cosmetic changes 2014-04-25 13:26:11 -07:00
Xavier Léauté 14907645aa add cardinality aggregator docs 2014-04-25 13:23:43 -07:00
Xavier Léauté 55d316b1ff update docs version 2014-04-24 17:18:27 -07:00
fjy c4cefb667e prepare for next release 2014-04-24 11:45:25 -07:00
nishantmonu51 0595b001e5 add doc for numShards 2014-04-23 22:11:28 +05:30
fjy b653ea0530 prepare for next release 2014-04-22 17:07:11 -07:00
fjy c689043938 fix twitter tutorial doc 2014-04-22 15:31:14 -07:00
fjy 771f89f495 update docs 2014-04-22 15:27:19 -07:00
fjy c0ddfc0872 update versions 2014-04-21 22:32:53 -07:00
fjy 04009b4195 prepare for next release 2014-04-21 12:14:50 -07:00
Son fd0d745018 Fix typo in link back to The Druid Cluster page. 2014-04-19 14:23:40 +08:00
fjy 517d3d2682 prepare for next release 2014-04-18 17:42:47 -07:00
fjy c00fb1d08e Merge pull request #445 from metamx/hadoop-version-update
Hadoop version update
2014-04-17 19:16:44 -06:00
fjy ad60a4a5fd prepare for next release 2014-04-17 15:28:46 -07:00
fjy 88874ed56c Merge pull request #485 from metamx/igalDruid
Igal druid
2014-04-16 18:05:36 -06:00
fjy 795d506939 internet disconnected and last build failed 2014-04-16 11:32:32 -07:00
fjy 7f4e7d2b8f prepare for next release 2014-04-16 11:24:45 -07:00
Igal Levy f3125490ff Merge branch 'master' into igalDruid 2014-04-16 11:24:18 -07:00
Igal Levy 52e53db54e minor edit to Metrics Module section 2014-04-16 11:23:47 -07:00
Igal Levy 0629b1a044 Major edits including the following:
* Emitter module is logging
* readTimeout for http client module 15min
* Fixed broken link to ZooKeeper.html
* Clarified druid.processing.numThreads is #cores - 1 or 1 if #cores == 1
* aws storage section moved under deep storage
* Added more info on various monitors and how to specify them (Metrics Module section)
* Clarified info on:
    * storage tiers and added the property druid.server.priority (Storage Node Module section)
    * segment cache : where historical nodes store data in disk cache
    * druid.query.chunkPeriod
* Removed druid.db.connector.pollDuration
* Fixed definition of druid.selectors.indexing.serviceName and moved to discovery section
2014-04-16 10:57:52 -07:00
Igal Levy ee47937889 overhaul of config reference, first pass 2014-04-15 15:38:58 -07:00
Xavier Léauté ce250222bf update docs 2014-04-14 16:33:08 -07:00
fjy 7db756f819 prepare for next release 2014-04-08 16:25:59 -07:00
fjy a4df23f092 prepare for next release 2014-04-08 11:42:59 -07:00
fjy 4ef2bbbfc1 prepare for next release 2014-04-07 14:37:02 -07:00
fjy 2e9579a146 prepare for next release 2014-04-07 12:43:30 -07:00
Jon Chase 0036954261 docs: correcting path to index file 2014-04-07 09:14:21 -04:00
Igal Levy 4576c5077e switched operations and ingestion sections 2014-04-04 10:05:33 -07:00
Igal Levy 0b0b8a1d37 Merge branch 'master' into igalDruid 2014-04-04 10:04:22 -07:00
fjy d9062d91fa fix endpoint bugs and more docs 2014-04-03 17:01:33 -07:00
fjy b0bf08554a fix broken build 2014-04-02 22:22:42 -07:00
fjy e53d107472 revert broken cache 2014-04-02 22:12:22 -07:00
fjy ea9f31bbe0 learn to math and prepare for next release 2014-04-02 21:31:17 -07:00
fjy f185d215e1 fix jetty default thread pool size for jetty 9 and prepare for next release 2014-04-02 21:01:07 -07:00
fjy fc94b847c3 prepare for next release 2014-04-02 17:31:19 -07:00
Igal Levy ba6c289ccb minor typos fixed 2014-03-31 13:05:54 -07:00
Igal Levy adfcc3d16f Merge branch 'master' into igalDruid 2014-03-27 16:19:58 -07:00
Igal Levy 0f4e5cb125 added firehose and plumber sections, which were being referenced but were missing 2014-03-27 16:18:56 -07:00
Igal Levy 2245764b8f added link to info on rejection policy 2014-03-27 15:16:47 -07:00
Igal Levy effd30f991 added link to info on how tasks are posted 2014-03-27 15:12:50 -07:00
Igal Levy de771a6642 edits for readability 2014-03-27 15:09:42 -07:00
Igal Levy fa0f0a810c removed references to config elements that do not appear on the page 2014-03-27 15:00:28 -07:00
Igal Levy 525cbf5aab completed config info with rjection policy, segmentGranularity; some minor edits 2014-03-27 14:58:40 -07:00
nishantmonu51 298b9c9346 update default version in docs 2014-03-27 20:16:49 +05:30
fjy 183a133ee4 Merge pull request #442 from metamx/demo-paper
Writing a demonstration paper for a conference
2014-03-25 22:29:36 -06:00
fjy 15af9ac3c5 fix things 2014-03-25 21:26:48 -07:00
Igal Levy 24dbc58cec edited for flow and readability 2014-03-25 17:19:55 -07:00
Igal Levy 5ff77dad34 Merge branch 'master' into igalDruid 2014-03-25 16:56:24 -07:00
Igal Levy 7881f068c6 added task types that were missing from some of the JSON task configs 2014-03-25 16:53:06 -07:00
Igal Levy 8859aa675a fixed link text to realtime ingestion 2014-03-25 16:43:58 -07:00
Igal Levy d780b28a09 added link for more info on indexGranularity 2014-03-25 16:25:00 -07:00
Igal Levy 5eacd97239 fixed typo in task spec 2014-03-24 16:51:11 -07:00
Michael E. Driscoll 98cd83071a Update index.md
Fixed a few typos and grammatical issues.
2014-03-23 14:58:11 -07:00
fjy 55169175de prepare for next release 2014-03-21 11:05:54 -07:00
Igal Levy a64be537a5 updated task ID definition 2014-03-19 21:08:40 -07:00
Guillaume Simard 1b20188ec7 Merge 2014-03-18 17:12:49 -04:00
Igal Levy c4d06faa05 Merge branch 'master' into igalDruid 2014-03-18 11:00:10 -07:00
Igal Levy 04040ef75f Fixed:
- Bad link for granularitySpec changed to real definition.
- All heads set to logical levels (consistent with all others).
- Fixed bad link in definition for spatialDimensions.
2014-03-18 10:28:33 -07:00
fjy 804a4051fa prepare for next rel 2014-03-18 08:10:59 -07:00
fjy 1d1ec1d855 clean up some defaults and prepare for next release 2014-03-17 21:41:34 -07:00
fjy 2adcf07f5f Merge branch 'master' into new-schema
Conflicts:
	indexing-hadoop/src/main/java/io/druid/indexer/DetermineHashedPartitionsJob.java
	indexing-service/src/main/java/io/druid/indexing/common/task/RealtimeIndexTask.java
	indexing-service/src/test/java/io/druid/indexing/common/task/TaskSerdeTest.java
	processing/src/test/java/io/druid/segment/TestIndex.java
	server/src/main/java/io/druid/segment/realtime/RealtimeManager.java
	server/src/main/java/io/druid/segment/realtime/plumber/RealtimePlumberSchool.java
2014-03-17 10:59:31 -07:00
fjy f1da044cfa fix another breaking endpoint in druid coordinator 2014-03-14 15:15:08 -07:00
fjy f525361c3d fix broken tests and prepare for next release 2014-03-14 15:05:07 -07:00
fjy f0fdfbb2f7 fix broken constant post agg 2014-03-14 14:54:52 -07:00
fjy b3fb2fea9c prepare for next release 2014-03-14 10:57:43 -07:00
fjy 6844063a52 fix broken examples 2014-03-14 10:56:27 -07:00
fjy b4f1591260 clean up examples, finish paper 2014-03-13 18:52:08 -07:00
Igal Levy 71818288e2 syntax and grammar fixes; tightened up language and flow 2014-03-13 17:55:45 -07:00
Igal Levy a8820bd3a0 Merge branch 'master' into igalDruid 2014-03-13 17:44:43 -07:00
fjy ae2dc6506c fix broken granularity 2014-03-10 15:03:43 -07:00
fjy 243af486cf prepare for next release 2014-03-10 13:24:53 -07:00
fjy 228cfa95bd Merge pull request #371 from N3TWORK/subquery
Subquery functionality for Group By queries
2014-03-07 13:41:56 -07:00
Yuval Oren 4b63645802 Merge branch 'master' into subquery
Conflicts:
	processing/src/main/java/io/druid/query/BaseQuery.java
	processing/src/main/java/io/druid/query/groupby/GroupByQueryQueryToolChest.java
	processing/src/test/java/io/druid/query/QueryRunnerTestHelper.java
	processing/src/test/java/io/druid/query/topn/TopNQueryRunnerTest.java
2014-03-06 13:33:59 -08:00
fjy e1fac64298 prepare for next release 2014-03-06 12:53:05 -08:00
fjy 08138688e4 port hyperunique to open source 2014-03-05 14:19:38 -08:00
Igal Levy b6d9619db0 fixed markdown rendering issue (literal '<' are interpreted) 2014-03-04 16:14:19 -08:00
fjy 0e8e527662 Merge branch 'master' into new-schema 2014-03-04 14:42:16 -08:00
Igal Levy 916bd30db3 fixed link to Cassandra article 2014-03-04 11:44:06 -08:00
Igal Levy a73b4afc4b added note+link about Cassandra option 2014-03-04 11:41:05 -08:00
Igal Levy f9f9b30709 fixed minor typo 2014-03-04 11:40:35 -08:00
fjy 0feddc3831 Merge pull request #411 from metamx/small-fixes-docs-searchquery-limit
Small fixes
2014-03-04 10:30:27 -07:00
fjy 46b9ac78e7 Merge branch 'master' into new-schema
Conflicts:
	indexing-hadoop/src/test/java/io/druid/indexer/HadoopDruidIndexerConfigTest.java
	pom.xml
	publications/whitepaper/druid.pdf
	publications/whitepaper/druid.tex
2014-03-03 14:48:15 -08:00
nishantmonu51 5603da189d fix #405 update cluster setup doc
rename old names to new ones
2014-02-28 13:02:05 +05:30
Igal Levy 95c491db0f fixed broken link 2014-02-26 17:37:52 -08:00
Igal Levy 0721220772 Merge branch 'master' into igalDruid 2014-02-26 17:36:48 -08:00
nishantmonu51 8af63005a6 refactor randomPartitionsSpec to hashedPartitionsSpec
refactor to a more appropriate name
2014-02-25 03:07:31 +05:30
Igal Levy 21299a6f81 refactored hadoop intro since the replacement page for instructions also wasn't right and there are quite a few available that are right 2014-02-21 10:43:52 -08:00
Igal Levy d3a1041e49 fixed broken url to other tutorial 2014-02-20 09:52:25 -08:00
Igal Levy 723f1427eb fixed broken url to hadoop setup instructions 2014-02-20 09:50:44 -08:00
Igal Levy 7aadef8e76 minor edits for clarity 2014-02-19 21:20:07 -08:00
fjy 20cac8c506 not compiling yet but close 2014-02-19 15:54:27 -08:00
Igal Levy 75ae4d434d added advice about restarting zk and mysql if not already running 2014-02-19 15:28:48 -08:00
fjy fb93448e9d prepare for next release because my last one failzored out of bad internetz 2014-02-14 15:22:27 -08:00
fjy 1a8f9f2e12 prepare for next release 2014-02-14 15:07:44 -08:00
fjy 3979eb270c Revert "Revert "Merge branch 'determine-partitions-improvements'""
This reverts commit 189b3e2b9b.
2014-02-14 12:58:56 -08:00
fjy 189b3e2b9b Revert "Merge branch 'determine-partitions-improvements'"
This reverts commit 7ad228ceb5, reversing
changes made to 9c55e2b779.
2014-02-14 12:47:34 -08:00
Igal Levy 5ee776db64 fixed broken link 2014-02-13 16:39:44 -08:00
Igal Levy 0714800904 Merge branch 'master' into igalDruid 2014-02-13 16:38:09 -08:00
fjy a986166b9c prepare for next release 2014-02-12 20:01:05 -08:00
Igal Levy 9313c7f511 minor tweaking to clarify instructions for csv and tsv 2014-02-12 18:59:35 -08:00
nishantmonu51 7ad228ceb5 Merge branch 'determine-partitions-improvements'
Conflicts:
	pom.xml
2014-02-12 10:51:26 +05:30
Gian Merlino 38e9a79560 Fix typo 2014-02-08 15:07:01 -08:00
fjy 2497bd2e85 prepare for next release 2014-02-07 13:04:34 -08:00
fjy c8b350270f prepare for next release 2014-02-07 11:54:56 -08:00
fjy 0fd95bc2b4 refactor out the configuration docs 2014-02-07 11:35:44 -08:00
nishantmonu51 48d0c37f98 documentation for random partition spec 2014-02-05 15:30:44 +05:30
Yuval Oren 689191c5ad Merge branch 'master' into subquery 2014-02-03 14:52:50 -08:00
Mike Vincent 5a152f8b1f Link Data Formats document and format spec references 2014-02-02 19:47:55 -06:00
Igal Levy 3a980b8a68 Merge branch 'master' into igalDruid
Resolve conflict in first tutorial.
Conflicts:
	docs/content/Tutorial:-The-Druid-Cluster.md
2014-01-28 09:35:39 -08:00
Guillaume Simard 624b13e8f5 Fixed JSON 2014-01-28 11:04:19 -05:00
GuiSim 374904ce20 Removed trailing comma 2014-01-28 10:34:13 -05:00
GuiSim 9831401c7d missing word 2014-01-28 10:17:49 -05:00
GuiSim 8d024a5e9a typo fix 2014-01-28 09:56:38 -05:00
Igal Levy 01e8d9e0a0 fixed typo 2014-01-27 17:29:49 -08:00
Igal Levy 1bca1c47b7 creating a doc to cover ingestion of csv and tsv formats 2014-01-27 17:29:05 -08:00
Yuval Oren 1c0b818cb2 Merge branch 'master' into subquery 2014-01-27 14:57:14 -08:00
GuiSim 929e6be8e9 text cleanup 2014-01-27 17:28:59 -05:00
fjy 74dd855a45 fix spelling 2014-01-28 05:50:23 +08:00
Yuval Oren c99e468ccd Merge branch 'master' into subquery 2014-01-24 16:48:35 -08:00
Igal Levy 06b73b366a minor rewriting for flow; fixed some wrong links 2014-01-24 16:48:19 -08:00
Yuval Oren 8f39981fab Documentation for query data sources 2014-01-24 16:12:10 -08:00
fjy 0c789412bb add a workaround for jackson bug where jacksoninject fails when a null value is passed through json creator annotated constructor 2014-01-25 07:07:27 +08:00
Igal Levy 3301d5d510 added a little padding to table cells to improve look and readablity 2014-01-24 13:14:56 -08:00
Igal Levy 5aacfe72e1 minor corrections and edits for flow 2014-01-24 12:26:38 -08:00
Igal Levy 0c16f24ba1 added note about slow start first time around due to fetching of dependencies 2014-01-21 11:03:07 -08:00
Igal Levy 010abf2552 fixed typo 2014-01-21 10:05:03 -08:00
Igal Levy 53f69c5791 updated to not refer to old wiki 2014-01-20 17:12:36 -08:00
fjy e2ea2ec7fd Merge branch 'master' into az
Conflicts:
	server/src/main/java/io/druid/server/coordinator/DruidCoordinator.java
	server/src/main/java/io/druid/server/http/CoordinatorResource.java
	server/src/test/java/io/druid/client/DirectDruidClientTest.java
2014-01-20 15:10:13 -08:00
fjy 215584891e Merge branch 'master' into moar-endpoints 2014-01-20 13:06:45 -08:00
fjy 3cba0c8ff2 more endpoints for getting info out of druid 2014-01-17 17:52:27 -08:00
fjy f898c29e20 fix batch indexing and prepare for next release 2014-01-17 15:52:04 -08:00
Igal Levy 53b6392dce added titles; fixed a few typos 2014-01-16 15:37:07 -08:00
Igal Levy 6e880f8b24 tweaked naming 2014-01-16 15:16:04 -08:00
fjy 0ceda034cd fix dependency issue and prepare for next release 2014-01-14 17:34:02 -08:00
fjy 187bb84b45 prepare for next release 2014-01-14 16:07:05 -08:00
fjy 9184906c39 prepare for next release 2014-01-14 09:54:42 -08:00
fjy e8d61ffe99 prepare for next release 2014-01-13 18:02:24 -08:00
fjy 3b17c4c03c a whole bunch of docs and fixes 2014-01-13 18:01:56 -08:00
fjy f4e3f02c3b more exceptions 2014-01-10 18:06:42 -08:00
Igal Levy 8196bf5dde added link to manually download druid 0.5.x 2014-01-10 17:20:53 -08:00
Igal Levy 58c8fcc519 added note about support for druid 0.5.x only 2014-01-10 16:29:33 -08:00
Igal Levy 917b4ea5ce Merge branch 'master' into igalDruid 2014-01-10 16:19:20 -08:00
fjy fe50104053 fix the index task and more docs 2014-01-10 14:47:18 -08:00
Igal Levy 8c2bffc1a6 final draft 2014-01-10 14:45:38 -08:00
fjy f123a14373 Merge branch 'master' into az
Conflicts:
	docs/content/Realtime.md
	server/src/main/java/io/druid/client/selector/ServerSelector.java
2014-01-09 19:09:38 -08:00
Igal Levy 2ddf3c4ef6 first stab at overhauling this doc to bring it up to date 2014-01-09 15:44:54 -08:00
Xavier Léauté 84273d4fc2 add docs 2014-01-09 15:18:40 -08:00
fjy 81cdf1b6d0 Merge pull request #340 from metamx/igalDruid
Igal druid
2014-01-08 18:39:00 -08:00
fjy 96caf2d518 Merge branch 'master' into az 2014-01-08 16:23:05 -08:00
fjy 90f3056fce clean up doc 2014-01-08 16:10:48 -08:00
fjy 50a6839693 inital commit of topNs 2014-01-08 15:51:03 -08:00
fjy e11952f3b6 bridge is kinda working for mastery stuff right now, tests pass 2014-01-06 17:01:50 -08:00
fjy 488a118f3f Merge branch 'master' into az 2014-01-02 10:53:37 -08:00
Igal Levy 5efca6eea8 Merge branch 'master' into igalDruid 2013-12-20 13:45:16 -08:00
Igal Levy 39012c6dbe Separated realitme ingestion from realtime node info; under Data Ingestion the Realtime link now points to the new realtime-ingestion page 2013-12-20 13:43:55 -08:00
Igal Levy 9b53912209 Added titles 2013-12-20 13:42:22 -08:00
Igal Levy 3d66f0fb8b added Realtime-ingestion under Data Ingestion (this is the content split from Realtime, which is now just about the node); moved Firehose and Plumber under Realtime-ingestion 2013-12-20 13:08:25 -08:00
Igal Levy d283693d78 updated links and references since these two files contain the lists of firehoses and plumbers they refer to, and pointed to Realtime-ingestion for the example of the kafka firehose 2013-12-20 13:04:40 -08:00
Gian Merlino bbe1b82347 Update versions 2013-12-20 12:26:27 -08:00
Gian Merlino 4bc8ff4d6a Update versions 2013-12-20 11:19:36 -08:00
Igal Levy 721195ac12 added anchor for linking to section 2013-12-19 17:26:51 -08:00
Igal Levy 18d8b0840e fixed formatting on numbered list and code blocks 2013-12-19 16:07:57 -08:00
Igal Levy 0aa04dd787 added title 2013-12-19 16:04:56 -08:00
Igal Levy 479b953a79 added definitions for master and compute nodes; tweaked spacing between term and definition 2013-12-18 17:35:30 -08:00
fjy 9b8134c73e Merge branch 'master' into az 2013-12-18 15:44:43 -08:00
Gian Merlino fc4dd51194 Update versions 2013-12-18 15:33:25 -08:00
Xavier Léauté 892a42bafe fix docs config casing 2013-12-18 14:37:27 -08:00
fjy d112b2d211 prepare for next release 2013-12-17 17:47:04 -08:00
fjy 07875dd30b prepare for next release 2013-12-17 16:28:11 -08:00
Xavier Léauté 178c26f9f7 fix naming and docs 2013-12-16 16:50:31 -08:00
fjy f2241c8885 prepare for next release 2013-12-16 16:16:00 -08:00
gianm bc4a7349d1 Merge pull request #303 from metamx/s3-storage-archiving
S3 Storage: moving and archiving of unused segments
2013-12-16 16:02:18 -08:00
fjy 2c7a6d26b3 fix typo in tutorial 2013-12-16 15:55:28 -08:00
fjy 27bba22e6f make rules assignable across tiers 2013-12-16 15:54:42 -08:00
fjy e309f48357 Merge branch 'master' into az
Conflicts:
	server/src/main/java/io/druid/server/coordinator/DruidCoordinator.java
2013-12-16 14:57:54 -08:00
Xavier Léauté bb1b037f87 fix docs 2013-12-16 13:59:16 -08:00
Xavier Léauté e38f2877fb default to archiving segments + docs 2013-12-16 13:59:15 -08:00
fjy 2dd4860106 fix typo 2013-12-13 17:08:29 -08:00
fjy 87b83bceb1 fix task storage config serde and prepare for next release 2013-12-13 16:55:22 -08:00
fjy 01f9c1df31 fix broken task storage config and prepare for next release 2013-12-13 16:45:32 -08:00
fjy 9a5fd6b0e9 prepare for next release 2013-12-13 16:18:34 -08:00
fjy 52cdb20f10 add better messaging and error handling 2013-12-13 15:01:07 -08:00
fjy ca7335f45f things dont work 2013-12-13 13:35:22 -08:00
fjy 407f8caf94 remove server monitor from list of default monitors 2013-12-13 09:04:32 -08:00
fjy 25ebba2c38 fix default start delay of indexing service and prepare for next release 2013-12-12 18:51:25 -08:00
fjy 19eafe0e96 prepare for next release 2013-12-12 17:26:50 -08:00
fjy a58f90a689 prepare for next release 2013-12-12 14:51:14 -08:00
fjy 6eb1102f95 Merge pull request #320 from metamx/igalDruid
Igal druid
2013-12-12 14:45:28 -08:00
Gian Merlino 81ccb37019 Indexing-Service.md: New overlord-related configs. 2013-12-12 11:46:56 -08:00
Gian Merlino 58d8f0046a Configuration.md: Update TaskLogs docs 2013-12-12 11:46:30 -08:00
Igal Levy 476ce8677d Merge branch 'master' into igalDruid 2013-12-11 09:17:30 -08:00
Igal Levy 60577a6e24 adjusted size of first section head to match others 2013-12-11 09:16:49 -08:00
fjy 6cc0860657 fix s3 module problems and prepare for next release 2013-12-09 20:05:55 -08:00
fjy ab1f02b2bc fix version brokenness and prepare for next release 2013-12-09 18:38:22 -08:00
fjy 976affb3af prepare for next release 2013-12-09 18:28:31 -08:00
Igal Levy fcc8801b13 added title 2013-12-09 16:11:06 -08:00
Igal Levy 19be4f8bb0 Refactored modules section for better flow/readability and added link to extending druid 2013-12-09 16:08:14 -08:00
Igal Levy 0e3378e5cd refactored sidebar sections to group related topics together under a section that encompasses what they are about, and communicates to a user that this is the go-to section for provisioning/deploying etc. a druid cluster 2013-12-09 15:17:56 -08:00
Igal Levy ddbab46ace added title; fixed link to configuration 2013-12-09 14:03:29 -08:00
Igal Levy 84234b142d added title; minor typo fixes 2013-12-09 13:21:57 -08:00
fjy 77fec83b59 clean up znode def 2013-12-09 11:25:58 -08:00
fjy b7e8a83fcb Merge pull request #318 from metamx/minor-fixes
Minor fixes and documentation changes
2013-12-09 10:30:13 -08:00