Apache
/
druid
mirror of https://github.com/apache/druid.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
6,866 Commits 112 Branches 504 Tags 710 MiB
Commit Graph

1026 Commits

Author SHA1 Message Date
Slim Bouguerra c511273efd adding in filter 2015-11-06 16:23:24 -06:00
Xavier Léauté e9533db987 Merge pull request #1850 from metamx/friendlyBardCache 
Allow setting upper limit on the number of cache segments a broker will try to fetch.
 2015-11-06 10:25:49 -08:00
Himanshu 3c3ea128cc Merge pull request #1895 from druid-io/cleanup-codebase 
Cleanup the Druid codebase
 2015-11-04 17:16:33 -06:00
fjy 8f231fd3e3 cleanup druid codebase 2015-11-04 13:59:53 -08:00
Fangjin Yang 1cbc514eb5 Merge pull request #1719 from se7entyse7en/feature-rackspace-cloud-files-deep-storage 
Add Rackspace Cloud Files Deep Storage Extension
 2015-11-04 11:13:25 -08:00
Fangjin Yang 861338c5e9 Merge pull request #1904 from rohitkochar/doc 
modifying the documentation as per Issue#1903
 2015-11-04 09:48:45 -08:00
Himanshu Gupta 67c218bed6 since topN is descending by default, inversion makes is ascending 2015-11-04 11:36:49 -06:00
Lou Marvin Caraig c924f9fe56 Added cloudfiles-extensions in order to support Rackspace's cloudfiles as deep storage 2015-11-04 17:44:48 +01:00
rohit.kochar 69a3b38f81 made changes as per review comments 2015-11-04 11:10:28 +05:30
Bingkun Guo 3ee28c35ce fix curator compress doc 2015-11-03 16:48:59 -06:00
Gian Merlino 8defe29270 Merge pull request #1901 from guobingkun/fix_typo_and_rename 
Fix metadata typo and rename default extension directory
 2015-11-03 14:02:11 -08:00
Xavier Léauté 3b3d88bd03 Merge pull request #1857 from noddi/feature/intervals-route 
Queryable intervals
 2015-11-03 13:19:04 -08:00
Bingkun Guo 962f65cc76 fix metadata typo and rename default extension directory 2015-11-03 14:50:42 -06:00
Fangjin Yang cec09a9967 Merge pull request #1804 from himanshug/objectify_index_creators 
static to non-static conversion for methods in Index[Merger/Maker/IO]
 2015-11-03 11:25:32 -08:00
rohit.kochar 2a617c777e modifying the documentation as per Issue#1903 2015-11-03 21:48:19 +05:30
Fangjin Yang f681c84014 Merge pull request #1892 from navis/DRUID-1878 
Make 'search' filter have a case sensitive option (for #1878)
 2015-11-03 07:11:00 -08:00
Himanshu Gupta c74a4490e1 add metamarket histogram post to approx-histo doc 2015-11-03 01:19:22 -06:00
Himanshu Gupta 8b67417ac8 make methods in Index[Merger,Maker,IO] non-static so that they can have 
appropriate ObjectMapper injected instead of creating one statically
 2015-11-02 23:24:26 -06:00
Gian Merlino 0d85774a27 Merge pull request #1899 from itsmee/docs-historical-improvements 
Docs improved: more details about caching and memory for segments on historicals
 2015-11-02 12:48:56 -08:00
Nishant efc49da073 fix doc - correct default value for maxRowsInMemory 2015-11-01 22:09:24 -08:00
navis.ryu 69c86716d6 addressed comments 2015-11-02 14:23:13 +09:00
Oleg Zaezdny 95a5ae0373 Docs improved by adding more details about local cache and memory for segments on historicals. 2015-11-01 21:56:28 +02:00
Bingkun Guo c3b6fcce9d Add EventReceiverFirehoseMonitor 
add an EventReceiverFirehoseMonitor so that we can monitor how many
events have been queued in the EventReceiverFirehose and get a sense
about whether the firehose is under too much pressure.
 2015-10-30 11:40:02 -05:00
Bingkun Guo 657a5ac346 fix pull-deps remoteRepository option 2015-10-30 11:32:56 -05:00
Bartosz Ługowski 6de51e022d Coordinator - add intervals route. 2015-10-30 11:51:42 +01:00
Charles Allen dfce14ed17 Allow setting upper limit on the number of cache segments a broker will try to fetch. 2015-10-29 11:50:00 -07:00
Angel M de Miguel a2510c9b0b Update ruby-druid URL 2015-10-28 10:31:30 +01:00
Angel M de Miguel 04c5d0f8e2 Update Ruby libraries in docs 2015-10-28 09:08:26 +01:00
Xavier Léauté 59872bd0cd Merge pull request #1809 from metamx/fifoPriorityExecutorService 
Make PrioritizedExecutorService optionally FIFO
 2015-10-27 15:19:32 -07:00
Gian Merlino 7df7370935 Merge pull request #1862 from metamx/indexingServiceMMGone 
Add timeout to shutdown request to middle manager for indexing service
 2015-10-27 14:38:01 -07:00
Charles Allen ecdafa87c5 Make PrioritizedExecutorService optionally FIFO 2015-10-27 14:16:22 -07:00
Charles Allen 44a2b204df Add timeout to shutdown request to middle manager for indexing service 2015-10-27 13:56:03 -07:00
Bingkun Guo 44aad069da add description for /druid/coordinator/v1/loadqueue?full 2015-10-26 14:19:13 -05:00
Fangjin Yang 7e1cde25b6 Merge pull request #1820 from himanshug/doc_files 
Removing the md files created for redirection
 2015-10-26 09:37:11 -07:00
Fangjin Yang 5f23703216 Merge pull request #1638 from guobingkun/remove_maven_client_code 
Remove Maven client at runtime + Provide a way to load Druid extensions through local file system
 2015-10-26 09:30:05 -07:00
Slim 16f84161da Fix documentation about lookup 2015-10-23 16:40:54 -07:00
Xavier Léauté 72c408cf2d Merge pull request #1770 from metamx/merge-time 
Add segment merge time as a metric
 2015-10-22 22:03:41 -07:00
Nishant 7cecc55045 Add segment merge time as a metric 
Add merge and persist cpu time

Fix typo

review comment

move cpu time measuring to VMUtils

review comments.
 2015-10-22 12:28:03 +05:30
Gian Merlino d068ec3b9d "druid.manager.segment" should be "druid.manager.segments" 2015-10-21 15:50:44 -07:00
Bingkun Guo 4914925d65 New extension loading mechanism 
1) Remove maven client from downloading extensions at runtime.
2) Provide a way to load Druid extensions and hadoop dependencies through file system.
3) Refactor pull-deps so that it can download extensions into extension directories.
4) Add documents on how to use this new extension loading mechanism.
5) Change the way how Druid tarball is generated. Now all the extensions + hadoop-client 2.3.0
are packaged within the Druid tarball.
 2015-10-21 14:22:36 -05:00
Himanshu 8dd30e6e18 Merge pull request #1832 from guobingkun/improve_granularity_doc 
add examples for duration and period granularities
 2015-10-21 13:13:24 -05:00
Bingkun Guo 2de5e9cefb add examples for duration and period granularities 2015-10-21 11:23:00 -05:00
Fangjin Yang 170cce69d4 Merge pull request #1834 from guobingkun/fix_doc 
fix ingestion faq link
 2015-10-18 17:31:22 -07:00
Fangjin Yang ccd17f818a Merge pull request #1837 from druid-io/update-paper 
add more details to radstack paper
 2015-10-18 17:31:08 -07:00
fjy 89785b2f52 add more details to paper 2015-10-18 17:30:24 -07:00
Bingkun Guo 620e334d0f fix ingestion faq link 2015-10-16 10:14:14 -05:00
sahner 83d31844db fix doubled word 2015-10-15 15:59:07 -05:00
Himanshu Gupta 24f33938d8 Removing the md files created for redirection 2015-10-12 15:21:55 -05:00
Gian Merlino 933cbdf780 Adjust realtime constraints in the docs. 2015-10-09 10:52:52 -07:00
Charles Allen 020a706ac4 Merge pull request #1800 from metamx/hybrid-cache 
Hybrid L1/L2 cache
 2015-10-06 15:18:07 -07:00
Xavier Léauté b11c0859e8 hybrid l1/l2 cache to combine local and remote cache 2015-10-06 14:32:08 -07:00
Xavier Léauté e5b3226b62 Merge pull request #1793 from himanshug/fix_chunking_link 
fixing the link to chunkPeriod doc
 2015-10-02 10:10:11 -04:00
Himanshu Gupta 9006e255ef fixing the link to chunkPeriod doc 2015-10-01 13:03:46 -05:00
Xavier Léauté faf4c865d5 update R / Python clients 2015-10-01 13:42:09 -04:00
Nishant 573aa96bd6 fix #1727 - Union bySegment queries fix 
Fixes #1727.
revert to doing merging for results for union queries on broker.

revert unrelated changes

Add test for union query runner

Add test

remove unused imports

fix imports

fix renamed file

fix test

update docs.
 2015-09-29 23:32:36 +05:30
Himanshu Gupta 6e550d5346 update doc about aggregation field in merge task and a null check 2015-09-24 22:25:07 -05:00
Xavier Léauté 2cb0fb4669 Merge pull request #1753 from jon-wei/segmentmetadataquery_flags 
Allow SegmentMetadataQuery to skip cardinality and size calculations
 2015-09-22 14:52:28 -07:00
jon-wei e6a6284ebd Allow SegmentMetadataQuery to skip cardinality and size calculations 2015-09-22 13:51:55 -07:00
Xavier Léauté df4c8a3aa5 balance memcached cache across multiple connections 2015-09-18 09:52:16 -07:00
fjy c9ccf9a565 add docs for search filter 2015-09-16 16:08:59 -07:00
Gian Merlino 9705c5139b Merge pull request #1732 from jon-wei/segmentmeta 
Add support for a configurable default segment history period for segmentMetadata queries and GET /datasources/<datasourceName> lookups
 2015-09-16 12:36:25 -07:00
Gian Merlino b29cbf97a6 Docs: Suggest hadoopyString parser for Hadoop. 2015-09-16 10:19:42 -07:00
Xavier Léauté b464da438c Merge pull request #1688 from metamx/moreMemcachedMetrics 
More memcached metrics
 2015-09-15 15:33:51 -07:00
fjy beab6fd487 add pivot as a UI 2015-09-15 14:58:32 -07:00
jon-wei 193fb4fdfc Add support for a configurable default segment history period for segmentMetadata queries and GET /datasources/<datasourceName> lookups 2015-09-14 19:41:42 -07:00
Himanshu 5ff92664f8 Merge pull request #1696 from metamx/cpuTimeReporting 
Add CPU time to metrics for segment scanning.
 2015-09-14 10:53:55 -05:00
Bingkun Guo e222e6b86b fix typo in segments.md 2015-09-11 16:32:50 -05:00
Himanshu Gupta 075b6d4385 update ingestion faq to mention dataSource inputSpec as an option of reindexing via hadoop 2015-09-10 14:41:13 -05:00
Himanshu Gupta 39d23ffc45 in configuration/index.md s/instantialize/initialize 2015-09-09 21:18:26 -05:00
Himanshu Gupta ebdb612933 composing emitter module to use multiple emitters together 2015-09-09 16:45:50 -05:00
Charles Allen 5813856819 More memcached metrics 2015-09-08 13:34:58 -07:00
Charles Allen fcf5cae81d Add CPU time to metrics for segment scanning. 2015-09-08 13:34:19 -07:00
Fangjin Yang 4546652b3b Merge pull request #1698 from gianm/docs-skipEmptyBuckets 
Timeseries skipEmptyBucket docs.
 2015-09-02 15:30:43 -07:00
Gian Merlino cbef4a15b0 Timeseries skipEmptyBucket docs. 2015-09-02 14:59:21 -07:00
Charles Allen ce3506b8e1 Merge pull request #1542 from metamx/audit-rule-history 
add endpoint to fetch rule history for all datasources
 2015-09-01 13:57:28 -07:00
cheddar 4f61b42f40 Merge pull request #1578 from b-slim/fix_extraction_filter_2 
Fix UT and documentation to the extraction filter
 2015-09-01 10:46:20 -07:00
Xavier Léauté d89b0fa76a Merge pull request #1662 from qix/pathFormat-doc 
Add documentation for pathFormat in batch ingestion
 2015-08-31 11:14:54 -07:00
Josh Yudaken 29c29b42d3 Add default value and link to joda docs 2015-08-31 11:09:54 -07:00
nishant 0835e12f2a add endpoint to fetch rule history for all datasources. 
review comments

Review comment

fix compilation
 2015-08-31 14:05:52 +05:30
Himanshu Gupta 2e0dd1d792 adding UTs and addressing review comments to 
firehoseV2 addition to Realtime[Manager|Plumber],
essential segment metadata persist support,
kafka-simple-consumer-firehose extension patch
 2015-08-27 20:50:46 -05:00
lvjq 2237a8cf0f kafka 8 simple consumer firehose 2015-08-27 20:50:46 -05:00
Bingkun ae1f104c10 Fix batch ingestion doc 2015-08-26 15:16:21 -05:00
fjy bdfe67fe17 fix formatting 2015-08-26 09:21:32 -07:00
Gian Merlino 10946610f4 Merge pull request #1656 from druid-io/all-the-docs 
more docs for common questions
 2015-08-25 17:49:47 -07:00
fjy 4055f9ca48 more docs for common questions 2015-08-25 17:49:04 -07:00
sahner 3def847e28 add documentation about TimedShutoff firehose 2015-08-24 20:41:42 -05:00
Josh Yudaken 5e42aee49e Add documentation for pathFormat in batch ingestion 2015-08-24 14:39:57 -07:00
Xavier Léauté 5a48376788 add postgresql setup docs 2015-08-21 13:35:58 -07:00
Himanshu Gupta 0daeb830b0 update approx-histogram document to explain how to ignore rows with no value at ingestion time 2015-08-19 15:20:37 -05:00
Xavier Léauté 0cbda0c01d update version numbers in docs 2015-08-17 16:41:21 -07:00
Charles Allen b9792b57bc Merge pull request #1374 from himanshug/batch_delta_ingestion3 
Feature for hadoop batch re-ingesion and delta ingestion
 2015-08-17 15:52:49 -07:00
Fangjin Yang f9e3f922e6 Merge pull request #1633 from pjain1/edit_metrics 
swap description and dimension column for some JVM metrics
 2015-08-17 13:07:57 -07:00
Parag Jain 41fa9bf994 swap description and dimension for some JVM metrics 2015-08-17 15:03:06 -05:00
Himanshu Gupta cfd81bfac7 updating the docs on how to do hadoop batch re-ingesion and delta ingestion 2015-08-16 14:07:35 -05:00
Fangjin Yang 958dd1a451 Merge pull request #1629 from metamx/fix-1584 
Update post-aggregations.md
 2015-08-14 11:07:47 -07:00
MarConSchneid 3f15d81f76 Update post-aggregations.md 
fix for  the issue: https://github.com/druid-io/druid/issues/1584
 2015-08-14 11:03:58 -07:00
Xavier Léauté 24dc23967f Merge pull request #1607 from druid-io/even-more-docs 
Fixes and more docs across many areas
 2015-08-13 11:53:53 -07:00
fjy 43978eba99 Fixes and more docs across many areas 2015-08-13 10:35:53 -07:00
Xavier Léauté f583cad2e2 disclaimer + more docs for approximate histograms 2015-08-10 13:13:49 -07:00
Slim Bouguerra 64d638a386 optimize makeMatcher 2015-08-06 17:04:36 -05:00
Charles Allen e6226968a6 Merge pull request #1589 from druid-io/fix-firehose-doc 
Add a lot more docs for firehoses
 2015-08-06 12:45:24 -07:00
Charles Allen 0326a7ac69 Merge pull request #1597 from metamx/fix-doc 
some docs were missing before, hopfully this is more clear
 2015-08-06 11:17:23 -07:00
Xavier Léauté 0357dc2cd8 some docs were missing before, hopfully this is more clear 2015-08-04 11:11:00 -07:00
fjy 012fff6616 fix firehose docs 2015-08-04 09:52:23 -07:00
Fangjin Yang ba76806f3a Merge pull request #1591 from b-slim/patch-1 
typo in the documentation after changing the code
 2015-08-04 09:23:25 -07:00
Himanshu 3078d905fa Merge pull request #1586 from onlychoice/fix_javaOpts 
Fix configuration for javaOpts, remove quotation marks
 2015-08-03 21:27:45 -05:00
pdeva 27997f9682 added required config option 2015-08-03 19:08:05 -07:00
Slim 1fdfc67ffa typo in the documentation after changing the code 2015-08-03 10:45:03 -05:00
Slim Bouguerra 83de5a4716 addressing reviewers comments 2015-08-03 09:03:28 -05:00
Slim Bouguerra 65654ddbf9 adding documentation about extraction filter 2015-08-03 09:02:17 -05:00
Zhihui Jiao d3e838ff34 Fix configuration for javaOpts, remove quotation marks 2015-08-01 11:26:37 +08:00
kete.yangkt 2b2bba8d59 fix realtime index task json description in doc 2015-07-31 13:59:58 +08:00
Himanshu Gupta 7ee509bcd0 fix mysql references in tutorial docs 2015-07-30 22:05:05 -05:00
Fangjin Yang f4567c995c Merge pull request #1572 from himanshug/cache_doc_update 
update doc with useCache and populateCache flags
 2015-07-28 11:50:13 -10:00
Fangjin Yang 22567946cf Merge pull request #1259 from metamx/queryTimeLookup 
Query Time Lookup
 2015-07-28 11:43:05 -10:00
Himanshu Gupta c17bc3fd74 update doc with useCache and populateCache flags 2015-07-28 15:46:22 -05:00
fjy 9946eebc02 Add setup to metadata stoer page 2015-07-28 08:36:48 -10:00
Charles Allen ba59f8afc4 Merge pull request #1550 from himanshug/optionally_log_all_requests 
print *all* HTTP requests to log if configured
 2015-07-28 11:19:36 -07:00
Charles Allen 86ede702b1 Add namespaced lookups as extensions 
* Adds kafka, URI, and JDBC namespace defintions
* Add ability to explicitly rename using a "namespace" which is a particular data collection that is loaded on all realtime, historic nodes, and brokers. If any of these nodes has the namespace extension, ALL nodes have the namespace extension.
* Add namespace caching and populating (can be on heap or off heap)
* Add NamespaceExtractionCacheManager for handling caches
* Added ExtractionNamespace for handling metadata on the extraction namespaces
* Added ExtractionNamespaceUpdate for handling metadata related to updates
* Add extension which caches renames from a kafka stream (requires kafka8)
* Added README.md for the namespace kafka extension
* Added docs
* Added namespace/size, namespace/count, namespace/deltaTasksStarted metrics

Add static config for namespaces via `druid.query.extraction.namespace`
* This is a rebase of https://github.com/b-slim/druid/tree/static_config_only
 2015-07-28 11:14:14 -07:00
Himanshu Gupta 90b475975e Log all the requests to debug level in logger io.druid.jetty.RequestLog 2015-07-28 12:56:04 -05:00
pdeva ef0439229d Specify dynamic dimension schema 
Document how druid can dynamically infer dimension columns
 2015-07-27 20:20:53 -07:00
sahner 4801de62a2 make "announce" the chathandler default in realtime node, 
remove doc references to chathandler type "announce" since it is the default now,
 2015-07-27 12:14:28 -05:00
pdeva 76bf8ccd8c correct key name 2015-07-25 21:58:37 -07:00
Charles Allen b9359b7531 Add convert.md to document conversion task 2015-07-24 17:37:49 -07:00
fjy 92293ef094 Added section on best practices for schema designa and a few other edits 2015-07-24 14:06:20 -07:00
Himanshu Gupta 119ec13d23 updating hadoop tuningConfig doc with useCombiner flag 2015-07-22 13:55:00 -05:00
Maxime Beauchemin db4928e73b Documentation entry for Panormix (a druid UI) 2015-07-21 18:23:46 -07:00
Fangjin Yang 020827349e Merge pull request #1539 from mvfast/cdh_workaround 
Cdh workaround
 2015-07-20 09:16:42 -07:00
Qi Wang 7211791585 add workaround for cdh 2015-07-19 14:11:47 -07:00
Himanshu Gupta dd95ef77c0 recommend druid-hdfs-storage and hadoop dependencies to be in the classpath instead of added as an extension 2015-07-18 16:18:12 -05:00
Charles Allen e051e93d19 Merge pull request #1518 from RealROI/more-azure-features 
Azure Blob Store support for Firehose and Indexing Service Logs
 2015-07-17 16:10:22 -07:00
Zak Kristjanson 0bda7af52c Add more support for Azure Blob Store 
Azure Blob Store support for Task Logs and a firehose for data ingestion
 2015-07-17 15:38:21 -07:00
Fangjin Yang e21195f987 Merge pull request #1469 from guobingkun/table_config 
Inconsistent property names for "druid.metadata.storage.tables.xxx"
 2015-07-17 07:43:19 -07:00
Himanshu 19af3bc9bc Merge pull request #1535 from metamx/alphanum-docs-tests 
Update alphanumeric sort docs + more tests / examples
 2015-07-16 22:09:41 -05:00
Xavier Léauté 2c464ad936 correct reference in docs + more tests / examples 2015-07-16 19:50:05 -07:00
Fangjin Yang 6e4108c29b Merge pull request #1530 from sherry-q/ingestion-doc-fix 
Fix Doc data-formats.md
 2015-07-15 18:01:17 -07:00
fjy 0074138bb9 fix versions in tutorials 2015-07-15 16:18:16 -07:00
Shiyu Qiu bec8e8e23a fix doc data-formats.md 2015-07-15 17:13:33 -05:00
Tim 3b692fb6f7 fix #1525 - typo: "HadoopBatchIndexer" 2015-07-14 20:48:24 -07:00
Gian Merlino 183f51fe58 Clearer language around external dependencies in tutorials. 2015-07-14 10:50:45 -07:00
Fangjin Yang 798c3320d0 Merge pull request #1475 from himanshug/derby_in_examples 
for example/tutorial, use derby instead of mysql
 2015-07-14 10:18:21 -07:00
Fangjin Yang 14a07077a2 Merge pull request #1519 from solimant/master 
add section: "What to Do When You Have a Firewall"
 2015-07-13 23:20:59 -07:00
solimant 91c15a90a9 add section: "What to Do When You Have a Firewall" 2015-07-13 22:12:16 -07:00
samjhecht fc438e5a72 add alert on errors polling for rules 
reset retrystarttime after alerting
 2015-07-13 09:03:51 -07:00
fjy 08d00cc80f rework the realtime examples a bit; add more faq 2015-07-07 14:07:14 -07:00
Himanshu Gupta db00533bc8 make concepts link in toc more robust 2015-07-07 14:53:22 -05:00
Xavier Léauté 3e960dcc01 Merge pull request #1496 from druid-io/more-docs 
Add more docs based on proposed wishlist
 2015-07-07 10:03:02 -07:00
Fangjin Yang d846f3ced6 Merge pull request #1498 from rasahner/doc_localFirehose 
say explicitly that local firehose searches dirs recursively for files
 2015-07-05 15:34:36 -07:00
sahner acd20e8c00 say explicitly that local firehose searches directories recursively for files 2015-07-05 14:46:44 -05:00
fjy 42ac41d55e add more docs based on proposed wishlist 2015-07-02 17:46:08 -07:00
Kris Molendyke 5b5e3caba9 Make postAggregations example a list type. 2015-07-02 14:37:23 -04:00
Charles Allen f2919b98b1 Merge pull request #1471 from metamx/direct-client-metrics 
add query/node/time metrics to DirectDruidClient
 2015-06-30 22:06:44 -07:00
Himanshu Gupta 473bc101d7 for example/tutorial, use derby instead of mysql 2015-06-30 20:47:32 -05:00
Himanshu Gupta 12f5d1743e fix toc links per the shortened names from commit d2346b6834 2015-06-30 14:16:40 -05:00
fjy 8c551ed889 very minor fix to the TOC 2015-06-29 10:49:45 -07:00
Himanshu Gupta 4114b4902e fixing the links to doc images 2015-06-29 12:17:42 -05:00
Bingkun Guo 4a0ae7d8d5 Fix inconsistent druid property names for "druid.metadata.storage.tables.xxx" between document and code 2015-06-29 10:12:30 -05:00
Xavier Léauté 2da12de598 add back query/node/(time|ttfb) docs 2015-06-26 17:58:47 -07:00
Charles Allen fbcac10e00 Remove metrics emitting from caching clustered client 2015-06-26 10:49:13 -07:00
Fangjin Yang 9859555346 Merge pull request #1446 from conradlee/docs-segment-details 
Improve segment file documentation
 2015-06-24 12:14:59 -07:00
Conrad Lee f214b412ca Improve segment file documentation 2015-06-24 11:45:23 -07:00
Fangjin Yang 9104d08a6a Merge pull request #1461 from rasahner/doc_queryFixes 
minor fixes to TimeseriesQuery and Aggregations
 2015-06-24 08:12:09 -07:00
sahner a938e65315 minor fixes to TimeseriesQuery and Aggregations 2015-06-24 08:24:07 -05:00
Fangjin Yang 726ed432a1 Merge pull request #1451 from rasahner/doc_minorFixes 
minor documentation fixes in Tasks.md, index.md, indexing-service.md
 2015-06-23 10:15:47 -07:00
Fangjin Yang 2544f3655e Merge pull request #1457 from ravishrathod/rabbitmq-doc 
updating doc for rabbitmq firehose
 2015-06-23 08:24:49 -07:00
Xavier Léauté 36b4453789 Merge pull request #1455 from druid-io/fix-protobuf 
Fix protobuf impl and docs
 2015-06-22 23:15:40 -07:00
Xavier Léauté d9dfff0689 fix broken redirects 2015-06-22 23:04:31 -07:00
ravishrathod 9213fd3801 updating doc for rabbitmq firehose 2015-06-22 02:40:11 -04:00
fjy 9c74993559 fix protobuf impl and docs 2015-06-20 21:59:38 -07:00
sahner 4ba34fe43d minor documentation fixes in Tasks.md, index.md, indexing-service.md 2015-06-19 17:09:53 -05:00
nishant fb4052d577 JavaScript Worker Select Strategy 
this PR adds a JavaScriptWorkerSelectStrategy which allows defining
arbitrary logic for selecting workers to run task using a JavaScript
function.

This gives users full control to implement complex worker selection
strategies based on task attributes.

more tests and a complex javascript config

fix for java8 modify for nashorn compatibility
 2015-06-20 02:01:34 +05:30
Xavier Léauté 6763e3780a Merge pull request #1417 from metamx/rtr-fixes 
fix behaviour of middlemanagers around ZK disconnects , fixes #709
 2015-06-10 14:42:49 -07:00
Bingkun Guo bdf4d541e3 Fix issue #1016 that if user specifies extension coordinates, the local extensions will be loaded twice, 
which could cause Guice duplicate binding errors.
Add unit test to replicate duplicate extension issue. Update documents. Add an package accessible getter for loadersMap for testing only.
Notice that extensions explicitly specified in druid.extensions.coordinates have a higher priority than ones included in the classpath.
Extension modules that don't have a canonical class name will be ignored.
 2015-06-10 15:48:03 -05:00
nishant e9afec4a2b fix task status issues on zk outages 
docs

review comments

fix test

review comments

Review comments

fix compilation

fix typo
 2015-06-11 00:49:52 +05:30
fjy afdd9304cf rename servermonitor to historicalmetricsmonitor in docs 2015-06-05 17:32:04 -07:00
fjy 6744eb2889 Add more links for talks 2015-06-05 14:35:56 -07:00
Xavier Léauté 35e2fde18e Merge pull request #1386 from himanshug/aggregation_testing1 
General class for testing any Aggregation Implementation
 2015-06-03 23:43:36 -07:00
Charles Allen f48db09e35 Add optimizations for ExtractionFn by enabling MANY_TO_ONE vs ONE_TO_ONE codepaths 
* Also adds LookupExtractionFn and MapLookupExtractor which takes in an explicit mapping of renames
* Add injective to javascript extraction fn
 2015-06-02 12:22:56 -07:00
Himanshu Gupta 215c1ab01e UTs for hyperUnique aggregation 2015-06-01 12:52:40 -05:00
fjy 74d8840414 Change tranquility links 2015-05-31 10:59:38 -07:00
Himanshu Gupta be4ecc4b91 in batch ingestion metadataUpdateSpec->type is derby, mysql etc and not metadata 2015-05-29 22:16:18 -05:00
Xavier Léauté 96103e1227 remove whirr from documentation 2015-05-29 20:55:42 -05:00
Xavier Léauté d2346b6834 shorten links and file names 
* remove redundant parts in file names
* delete unsupported "Druid-Personal-Demo-Cluster"
 2015-05-29 20:55:42 -05:00
Himanshu Gupta 8edc2aaca3 renaming all *.md filenames to only have lowercase and dashes 
so that they are editable on case-insensitive os as well
 2015-05-29 20:55:42 -05:00
fjy 185c99deec Add schema check for overlap between dimension and metric names 2015-05-28 22:18:08 -07:00
janakg 5812b3dd5c druid production architecture diagram 2015-05-27 17:06:24 -07:00
gbuisson 9e90dc0055 added clj-druid to query libraries (clojure) 2015-05-22 17:49:31 +02:00
Xavier Léauté e6d22565ad Merge pull request #1368 from himanshug/fix_seg_metadata_complex_column 
in segment metadata query return actual complex data type name
 2015-05-15 19:52:16 -07:00
Himanshu Gupta 2fd3e9e8e5 return size = 0 in ColumnAnalysis if its unknown 
that is if complex agg did not implement inputSizeFn() so
that segment metadata query shows atleast some information.
also instead of COMPLEX, return type of data stored.
 2015-05-15 20:11:56 -05:00
Fangjin Yang 1d33f46ece Merge pull request #1373 from metamx/segmentMetadataQueryDocClarification 
Modify SegmentMetadataQuery.md to refer to flat data instead of `TSV`
 2015-05-15 17:27:26 -06:00
Charles Allen 03df582fe4 Modify SegmentMetadataQuery.md to refer to flat data instead of `TSV` 2015-05-15 13:49:51 -07:00
Xavier Léauté 87924c7c66 Merge pull request #1369 from druid-io/add-toc 
Add missing toc entry for data ingestion
 2015-05-15 10:18:00 -07:00
fjy 614e79a0da Add missing toc entry 2015-05-15 11:16:51 -06:00
Himanshu Gupta 4b907a93c5 updating the aggregators doc 2015-05-13 09:25:57 -05:00
Himanshu Gupta f2adb22350 documenting druid alerts schema 2015-05-09 21:03:10 -05:00
fjy 70f089594f Add back some links in TOC 2015-05-07 16:38:09 -07:00
fjy b19435d172 fix typos with batch ingestion in docs 2015-05-07 14:46:17 -07:00
Gian Merlino 1519a1c930 Tasks are not actually sigkilled. 2015-05-07 08:44:28 -07:00
Xavier Léauté 2ec87838d2 Merge pull request #1333 from himanshug/convert_props_ut 
UTs for ConvertProperties
 2015-05-03 15:11:53 -07:00
Himanshu Gupta eca69fd084 remove validation query config from docs as its not valid anymore 2015-05-03 08:41:35 -05:00
Himanshu Gupta fd3b23072b fixing defaults for druid.[host,port,service] in docs etc 2015-05-02 15:44:03 -05:00
Himanshu Gupta ce7ad41aaa removing port number from druid.host in production-cluster-configuration as its gives the intuition that port name is mandatory to be specified which is not true anymore 2015-05-02 15:34:36 -05:00
Himanshu Gupta 3982301484 add audit table name configuration doc 2015-04-30 06:45:57 -05:00
Xavier Léauté 8b16d70e19 Merge pull request #1320 from davrodpin/fix-deep-storage-doc 
Remove duplicated Azure doc. section.
 2015-04-29 16:09:37 -07:00
David Rodrigues 1dda3268d1 Remove duplicated Azure doc. section. 2015-04-29 11:42:57 -07:00
Himanshu Gupta 42ed88e1cb adding druid.broker.retryPolicy.numTries config to documentation 2015-04-28 13:22:32 -05:00
Himanshu Gupta 0beaec5578 adding druid.server.maxSize config doc 2015-04-28 09:34:05 -05:00
Xavier Léauté 721505c017 Merge pull request #1208 from druid-io/rework-metrics 
Schemaless metrics + additional metrics for things we care about
 2015-04-27 15:04:54 -07:00
fjy 963e5765bf Schemaless metrics + additional metrics for things we care about 2015-04-27 13:39:40 -07:00
Alexander Makarenko 070da15a66 Update Realtime-ingestion.md 
Add note about sharding and firehose configurations
 2015-04-26 16:55:49 +03:00
Vadim Ogievetsky 58879ca0bf added facetjs to the library list in the docs 2015-04-22 18:38:01 -07:00
Fangjin Yang f15a41270a Merge pull request #1302 from metamx/fix-groupby-doc 
Updates groupBy doc:
 2015-04-21 20:22:23 -07:00
Igal Levy 1216512e49 Updates groupBy doc: 
* changes sample dimension names to be more meaningful
* fixes timestamps in example output
* adds formatting to names appearing in paragraphs for easier reading
 2015-04-21 17:30:37 -07:00
fjy be69946751 fix typo 2015-04-21 11:14:26 -07:00
fjy 4575c5378c Rework the druid docs 2015-04-21 10:11:11 -07:00
sahner 6ef2941975 minor fixes: 
1. leader endpoint returns a string, not a json object
2. "enabled and enabled" -> "enabled and disabled"
 2015-04-20 17:02:44 -05:00
Fangjin Yang 8b68b8f3c2 Merge pull request #1282 from davrodpin/validate-deep-storage-impl 
Add doc. on how to validate a deep storage implementation.
 2015-04-16 20:40:54 -07:00
David Rodrigues 5b76a52c99 Reformat Deep Storage options to use table. 2015-04-16 16:30:42 -07:00
David Pinheiro f912e45464 Add doc. on how to validate a deep storage implementation. 2015-04-16 16:10:43 -07:00
David Pinheiro baeef08c4c Add Microsoft Azure as a Deep Storage option. 2015-04-16 15:39:36 -07:00
Xavier Léauté 49d1f4e568 add documentation for dimension compression 2015-04-14 10:44:19 -07:00
Xavier Léauté 66a4daa363 [docs] fix broken links 2015-04-09 17:36:20 -07:00
Slim d854ceebbd typo or backward compatibility problem 
2147483648 will break the node since druid 0.7 it is parsing it as an `int`
 2015-04-08 19:12:01 -05:00
Xavier Léauté 9962a33cdf Merge pull request #1270 from metamx/fix-broken-link-druid-cluster-tutorial 
fixes #112 broken link
 2015-04-08 13:36:40 -07:00
Igal Levy 905fa84d45 fixes #112 broken link 2015-04-08 13:23:10 -07:00
Slim a9b5529ff8 fix typo (missing ```) 2015-04-07 14:54:04 -05:00
Fangjin Yang 834fd71e34 Merge pull request #1254 from bobrik/on-the-right 
Menu is on the right now
 2015-03-31 15:58:57 -07:00
Prajwal Tuladhar def4cddfea fix doc link 2015-03-31 18:19:24 -04:00
Ian Babrou a6887da923 menu is on the right now 2015-03-30 21:59:15 -07:00
Slim 425c5f750c Fix typo in the query body 
last `,` will break the query.
 2015-03-30 09:34:38 -05:00
Xavier Léauté 2c58e355fd Merge pull request #1239 from metamx/log4j2forRealz 
Exclude log4j from curator dependencies in favor of log4j-1.2-api
 2015-03-26 13:21:13 -07:00
Charles Allen 9cd6c08e96 Exclude log4j from curator dependencies in favor of log4j-1.2-api 2015-03-26 13:05:12 -07:00
Xavier Léauté 47cc11829d Merge pull request #1240 from himanshug/async_query_forwarding_servlet_router_fix 
adding router numMaxThread configuration for ProxyServlet HttpClient executor
 2015-03-26 10:15:44 -07:00
nishantmonu51 99bf430844 fix examples and doc 2015-03-26 19:01:10 +05:30
Himanshu Gupta b131a4fd3b adding router numMaxThread configuration for ProxyServlet HttpClient executor 2015-03-23 21:58:01 -05:00
fjy 6a47c1530c update versions to prepare for rc release 2015-03-19 11:39:38 -07:00
fjy db06bda5e0 fix ingestion docs 2015-03-18 17:23:22 -07:00
fjy 3e664a4c32 fix plumber docs 2015-03-18 15:56:27 -07:00
fjy 8de3eab832 fix doc formatting 2015-03-18 15:53:00 -07:00
fjy bfe10bd156 This fixes arbitrary gran spec breaking 2015-03-17 12:19:43 -07:00
fjy 36b4c6a371 fix set up with first tutorial 2015-03-13 13:54:45 -07:00
Xavier Léauté 7fb4b1d2bb Merge pull request #1144 from metamx/javaLoggingManager 
Add log4j2 hooks to other loggings
 2015-03-12 14:38:51 -07:00
Charles Allen edfcea18d8 Add log4j2 hooks to standard java logging 2015-03-12 14:29:41 -07:00
nishantmonu51 3ec4a30ab5 initial commit 
review comments

more refactoring and cleaning of redundant code

add UT + docs + more refactoring

fixes + review comments

more cleanup

end points to fetch history

review comments

remove unnecessary changes

review comments rename header name

review comments + add test for MetadataRulesManager

review comments docs
 2015-03-12 22:50:29 +05:30
Xavier Léauté 11b3230602 update to kafka 0.8.2.1, because it's better™ 2015-03-12 09:59:24 -07:00
Xavier Léauté d3f5bddc5c Add ability to apply extraction functions to the time dimension 
- Moves DimExtractionFn under a more generic ExtractionFn interface to
  support extracting dimension values other than strings
- pushes down extractionFn to the storage adapter from query engine
- 'dimExtractionFn' parameter has been deprecated in favor of 'extractionFn'
- adds a TimeFormatExtractionFn, allowing to project the '__time' dimension
- JavascriptDimExtractionFn renamed to JavascriptExtractionFn, adding
  support for any dimension value types that map directly to Javascript
- update documentation for time column extraction and related changes
 2015-03-11 16:45:42 -07:00
Xavier Léauté 9f242ed1ba Merge pull request #1182 from druid-io/better-docs 
Rework the druid docs and fix many mistakes
 2015-03-10 14:23:38 -07:00
fjy 064d65a009 rework the druid docs and fix many mistakes 2015-03-10 14:19:19 -07:00
Fangjin Yang 0b467624ec Merge pull request #694 from druid-io/arithmetic-op-strategies 
normal division & configurable ordering for ArithmeticPostAggregator
 2015-03-10 13:48:27 -07:00
Fangjin Yang 2d79c6e5b9 Merge pull request #1187 from metamx/update-design-diagram 
updates Realtime node's dataflow connection, s/historical/deep storage; ...
 2015-03-10 13:46:21 -07:00