Commit Graph

699 Commits

Author SHA1 Message Date
Charles Allen f48db09e35 Add optimizations for ExtractionFn by enabling MANY_TO_ONE vs ONE_TO_ONE codepaths
* Also adds LookupExtractionFn and MapLookupExtractor which takes in an explicit mapping of renames
* Add injective to javascript extraction fn
2015-06-02 12:22:56 -07:00
Himanshu Gupta 215c1ab01e UTs for hyperUnique aggregation 2015-06-01 12:52:40 -05:00
fjy 74d8840414 Change tranquility links 2015-05-31 10:59:38 -07:00
Himanshu Gupta be4ecc4b91 in batch ingestion metadataUpdateSpec->type is derby, mysql etc and not metadata 2015-05-29 22:16:18 -05:00
Xavier Léauté 96103e1227 remove whirr from documentation 2015-05-29 20:55:42 -05:00
Xavier Léauté d2346b6834 shorten links and file names
* remove redundant parts in file names
* delete unsupported "Druid-Personal-Demo-Cluster"
2015-05-29 20:55:42 -05:00
Himanshu Gupta 8edc2aaca3 renaming all *.md filenames to only have lowercase and dashes
so that they are editable on case-insensitive os as well
2015-05-29 20:55:42 -05:00
fjy 185c99deec Add schema check for overlap between dimension and metric names 2015-05-28 22:18:08 -07:00
janakg 5812b3dd5c druid production architecture diagram 2015-05-27 17:06:24 -07:00
gbuisson 9e90dc0055 added clj-druid to query libraries (clojure) 2015-05-22 17:49:31 +02:00
Xavier Léauté e6d22565ad Merge pull request #1368 from himanshug/fix_seg_metadata_complex_column
in segment metadata query return actual complex data type name
2015-05-15 19:52:16 -07:00
Himanshu Gupta 2fd3e9e8e5 return size = 0 in ColumnAnalysis if its unknown
that is if complex agg did not implement inputSizeFn() so
that segment metadata query shows atleast some information.
also instead of COMPLEX, return type of data stored.
2015-05-15 20:11:56 -05:00
Fangjin Yang 1d33f46ece Merge pull request #1373 from metamx/segmentMetadataQueryDocClarification
Modify SegmentMetadataQuery.md to refer to flat data instead of `TSV`
2015-05-15 17:27:26 -06:00
Charles Allen 03df582fe4 Modify SegmentMetadataQuery.md to refer to flat data instead of `TSV` 2015-05-15 13:49:51 -07:00
Xavier Léauté 87924c7c66 Merge pull request #1369 from druid-io/add-toc
Add missing toc entry for data ingestion
2015-05-15 10:18:00 -07:00
fjy 614e79a0da Add missing toc entry 2015-05-15 11:16:51 -06:00
Himanshu Gupta 4b907a93c5 updating the aggregators doc 2015-05-13 09:25:57 -05:00
Himanshu Gupta f2adb22350 documenting druid alerts schema 2015-05-09 21:03:10 -05:00
fjy 70f089594f Add back some links in TOC 2015-05-07 16:38:09 -07:00
fjy b19435d172 fix typos with batch ingestion in docs 2015-05-07 14:46:17 -07:00
Gian Merlino 1519a1c930 Tasks are not actually sigkilled. 2015-05-07 08:44:28 -07:00
Xavier Léauté 2ec87838d2 Merge pull request #1333 from himanshug/convert_props_ut
UTs for ConvertProperties
2015-05-03 15:11:53 -07:00
Himanshu Gupta eca69fd084 remove validation query config from docs as its not valid anymore 2015-05-03 08:41:35 -05:00
Himanshu Gupta fd3b23072b fixing defaults for druid.[host,port,service] in docs etc 2015-05-02 15:44:03 -05:00
Himanshu Gupta ce7ad41aaa removing port number from druid.host in production-cluster-configuration as its gives the intuition that port name is mandatory to be specified which is not true anymore 2015-05-02 15:34:36 -05:00
Himanshu Gupta 3982301484 add audit table name configuration doc 2015-04-30 06:45:57 -05:00
Xavier Léauté 8b16d70e19 Merge pull request #1320 from davrodpin/fix-deep-storage-doc
Remove duplicated Azure doc. section.
2015-04-29 16:09:37 -07:00
David Rodrigues 1dda3268d1 Remove duplicated Azure doc. section. 2015-04-29 11:42:57 -07:00
Himanshu Gupta 42ed88e1cb adding druid.broker.retryPolicy.numTries config to documentation 2015-04-28 13:22:32 -05:00
Himanshu Gupta 0beaec5578 adding druid.server.maxSize config doc 2015-04-28 09:34:05 -05:00
Xavier Léauté 721505c017 Merge pull request #1208 from druid-io/rework-metrics
Schemaless metrics + additional metrics for things we care about
2015-04-27 15:04:54 -07:00
fjy 963e5765bf Schemaless metrics + additional metrics for things we care about 2015-04-27 13:39:40 -07:00
Alexander Makarenko 070da15a66 Update Realtime-ingestion.md
Add note about sharding and firehose configurations
2015-04-26 16:55:49 +03:00
Vadim Ogievetsky 58879ca0bf added facetjs to the library list in the docs 2015-04-22 18:38:01 -07:00
Fangjin Yang f15a41270a Merge pull request #1302 from metamx/fix-groupby-doc
Updates groupBy doc:
2015-04-21 20:22:23 -07:00
Igal Levy 1216512e49 Updates groupBy doc:
* changes sample dimension names to be more meaningful
* fixes timestamps in example output
* adds formatting to names appearing in paragraphs for easier reading
2015-04-21 17:30:37 -07:00
fjy be69946751 fix typo 2015-04-21 11:14:26 -07:00
fjy 4575c5378c Rework the druid docs 2015-04-21 10:11:11 -07:00
sahner 6ef2941975 minor fixes:
1. leader endpoint returns a string, not a json object
2. "enabled and enabled" -> "enabled and disabled"
2015-04-20 17:02:44 -05:00
Fangjin Yang 8b68b8f3c2 Merge pull request #1282 from davrodpin/validate-deep-storage-impl
Add doc. on how to validate a deep storage implementation.
2015-04-16 20:40:54 -07:00
David Rodrigues 5b76a52c99 Reformat Deep Storage options to use table. 2015-04-16 16:30:42 -07:00
David Pinheiro f912e45464 Add doc. on how to validate a deep storage implementation. 2015-04-16 16:10:43 -07:00
David Pinheiro baeef08c4c Add Microsoft Azure as a Deep Storage option. 2015-04-16 15:39:36 -07:00
Xavier Léauté 49d1f4e568 add documentation for dimension compression 2015-04-14 10:44:19 -07:00
Xavier Léauté 66a4daa363 [docs] fix broken links 2015-04-09 17:36:20 -07:00
Slim d854ceebbd typo or backward compatibility problem
2147483648 will break the node since druid 0.7 it is parsing it as an `int`
2015-04-08 19:12:01 -05:00
Xavier Léauté 9962a33cdf Merge pull request #1270 from metamx/fix-broken-link-druid-cluster-tutorial
fixes #112 broken link
2015-04-08 13:36:40 -07:00
Igal Levy 905fa84d45 fixes #112 broken link 2015-04-08 13:23:10 -07:00
Slim a9b5529ff8 fix typo (missing ```) 2015-04-07 14:54:04 -05:00
Fangjin Yang 834fd71e34 Merge pull request #1254 from bobrik/on-the-right
Menu is on the right now
2015-03-31 15:58:57 -07:00
Prajwal Tuladhar def4cddfea fix doc link 2015-03-31 18:19:24 -04:00
Ian Babrou a6887da923 menu is on the right now 2015-03-30 21:59:15 -07:00
Slim 425c5f750c Fix typo in the query body
last `,` will break the query.
2015-03-30 09:34:38 -05:00
Xavier Léauté 2c58e355fd Merge pull request #1239 from metamx/log4j2forRealz
Exclude log4j from curator dependencies in favor of log4j-1.2-api
2015-03-26 13:21:13 -07:00
Charles Allen 9cd6c08e96 Exclude log4j from curator dependencies in favor of log4j-1.2-api 2015-03-26 13:05:12 -07:00
Xavier Léauté 47cc11829d Merge pull request #1240 from himanshug/async_query_forwarding_servlet_router_fix
adding router numMaxThread configuration for ProxyServlet HttpClient executor
2015-03-26 10:15:44 -07:00
nishantmonu51 99bf430844 fix examples and doc 2015-03-26 19:01:10 +05:30
Himanshu Gupta b131a4fd3b adding router numMaxThread configuration for ProxyServlet HttpClient executor 2015-03-23 21:58:01 -05:00
fjy 6a47c1530c update versions to prepare for rc release 2015-03-19 11:39:38 -07:00
fjy db06bda5e0 fix ingestion docs 2015-03-18 17:23:22 -07:00
fjy 3e664a4c32 fix plumber docs 2015-03-18 15:56:27 -07:00
fjy 8de3eab832 fix doc formatting 2015-03-18 15:53:00 -07:00
fjy bfe10bd156 This fixes arbitrary gran spec breaking 2015-03-17 12:19:43 -07:00
fjy 36b4c6a371 fix set up with first tutorial 2015-03-13 13:54:45 -07:00
Xavier Léauté 7fb4b1d2bb Merge pull request #1144 from metamx/javaLoggingManager
Add log4j2 hooks to other loggings
2015-03-12 14:38:51 -07:00
Charles Allen edfcea18d8 Add log4j2 hooks to standard java logging 2015-03-12 14:29:41 -07:00
nishantmonu51 3ec4a30ab5 initial commit
review comments

more refactoring and cleaning of redundant code

add UT + docs + more refactoring

fixes + review comments

more cleanup

end points to fetch history

review comments

remove unnecessary changes

review comments rename header name

review comments + add test for MetadataRulesManager

review comments docs
2015-03-12 22:50:29 +05:30
Xavier Léauté 11b3230602 update to kafka 0.8.2.1, because it's better™ 2015-03-12 09:59:24 -07:00
Xavier Léauté d3f5bddc5c Add ability to apply extraction functions to the time dimension
- Moves DimExtractionFn under a more generic ExtractionFn interface to
  support extracting dimension values other than strings
- pushes down extractionFn to the storage adapter from query engine
- 'dimExtractionFn' parameter has been deprecated in favor of 'extractionFn'
- adds a TimeFormatExtractionFn, allowing to project the '__time' dimension
- JavascriptDimExtractionFn renamed to JavascriptExtractionFn, adding
  support for any dimension value types that map directly to Javascript
- update documentation for time column extraction and related changes
2015-03-11 16:45:42 -07:00
Xavier Léauté 9f242ed1ba Merge pull request #1182 from druid-io/better-docs
Rework the druid docs and fix many mistakes
2015-03-10 14:23:38 -07:00
fjy 064d65a009 rework the druid docs and fix many mistakes 2015-03-10 14:19:19 -07:00
Fangjin Yang 0b467624ec Merge pull request #694 from druid-io/arithmetic-op-strategies
normal division & configurable ordering for ArithmeticPostAggregator
2015-03-10 13:48:27 -07:00
Fangjin Yang 2d79c6e5b9 Merge pull request #1187 from metamx/update-design-diagram
updates Realtime node's dataflow connection, s/historical/deep storage; ...
2015-03-10 13:46:21 -07:00
Fangjin Yang fa2c431589 Merge pull request #1186 from metamx/dataFormatDocsUpdate
Update Data_formats.md to match arguments used in 0.7.x
2015-03-10 13:45:37 -07:00
Igal Levy 705a7b3f23 updates Realtime node's dataflow connection, s/historical/deep storage; a bit more information on how Realtime nodes drop segments based on said segments' uptake by Historicals 2015-03-10 13:44:36 -07:00
Charles Allen 2ac610771e Update Data_formats.md to match arguments used in 0.7.x 2015-03-10 13:41:11 -07:00
Fangjin Yang c7ec8ba15b Merge pull request #1184 from metamx/docs-event-receiver-firehose
fix docs and add docs for event receiver firehose
2015-03-10 10:23:19 -07:00
nishantmonu51 425ad98261 fix docs and add docs for event receiver firehose 2015-03-10 21:29:57 +05:30
Fangjin Yang 2abdce1dc0 Merge pull request #1180 from metamx/logging-groupBy-NPE
add null check early to catch root cause for groupBy NPE while running bySegment query
2015-03-09 09:16:33 -07:00
nishantmonu51 704f463dbf fix property name in doc 2015-03-09 21:19:29 +05:30
Himanshu Gupta cb5ed4942c simple typo fix on Concepts-and_Terminology.md to correct navigation to spec file info 2015-03-07 11:29:24 -06:00
Xavier Léauté 0d47c0c36d normal division and configurable ordering for ArithmeticPostAggregator
Fixes #510
2015-03-04 12:44:24 -08:00
Fangjin Yang 9578304d6f Merge pull request #1130 from housejester/jde-building
Various improvements to the tutorial and building experience.
2015-03-02 14:48:32 -08:00
Fangjin Yang e8605c63a9 Merge pull request #1150 from himanshug/broker-parallel-chunk-process
interval chunk query runner now processes individual chunk in a threadpool
2015-03-02 13:50:23 -08:00
Himanshu Gupta 29039fd541 interval chunk query runner now processes individual chunk in a thread pool and prints metrics query/time per chunk 2015-03-02 15:45:09 -06:00
Fangjin Yang a76a24742b Merge pull request #1149 from himanshug/broker-get-datasource-update
updating ClientInfoResource.getDatasource() with a full flag
2015-03-02 13:28:27 -08:00
Himanshu Gupta a39f4f8bf4 updating ClientInfoResource.getDatasource() with a full flag to return all the served intervals for given data source along with the dimension and metric information 2015-03-02 14:18:52 -06:00
Xavier Léauté 437d61ed8f Merge pull request #1164 from mrijke/docfix-cache-configs
Docfix: Update Cache config pages
2015-03-02 11:47:50 -08:00
Maarten Rijke 2531bb9664 Docfix: Update Cache config pages
* Update Broker-Config.md Cache options table
 * Update Historical-Config.md Cache options table (broker->historical)
2015-03-02 19:55:00 +01:00
Xavier Léauté 1d98717d24 Merge pull request #1162 from mrijke/fix-metric-monitor-names
Update metrics monitors names in Configuration.md
2015-03-02 10:33:19 -08:00
Maarten Rijke 092acaea9d Update metrics monitors names in Configuration.md
Updated the metric package names to reflect the new names in 0.7
2015-03-02 12:16:47 +01:00
Maarten Rijke d52f3bb817 Update default value for druid.emitter in Configuration.md 2015-03-02 12:06:30 +01:00
James Estes 9cb5d9bd00 Various improvements to the tutorial and building experience.
- Improve geo ip download stability
- Retry default geo ip download if corrupt
- Clarify docs on building & where to get artifact
2015-02-25 18:49:16 -07:00
Prajwal Tuladhar d1fb42c554 fix broken docs link 2015-02-24 23:41:13 -05:00
fjy 46bd614d63 fix broken links 2015-02-24 20:14:17 -08:00
Xavier Léauté 667c3d4f8c fix typo 2015-02-19 11:41:37 -08:00
James Estes 562de6c621 Update docs and examples for log4j2 usage.
- Put configs early in classpath in examples so log4j2.xml will get picked up properly
- Add an example log4j2.xml file.
- Update Logging doc.
2015-02-19 11:40:56 -07:00
Xavier Léauté 475ba9d068 remove build.sh in favor of mvn package 2015-02-19 10:32:41 -08:00
Xavier Léauté 8e33e58422 rename Druid binary assembly 2015-02-18 17:42:55 -08:00
fjy 6d05f4fe5e Add more compare docs 2015-02-18 15:57:36 -08:00