Apache
/
druid
mirror of https://github.com/apache/druid.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
druid/website
History
David Palmer 2855fb6ff8
Change Kafka Lookup Extractor to not register consumer group (#12842) 
* change kafka lookups module to not commit offsets

The current behaviour of the Kafka lookup extractor is to not commit
offsets by assigning a unique ID to the consumer group and setting
auto.offset.reset to earliest. This does the job but also pollutes the
Kafka broker with a bunch of "ghost" consumer groups that will never again be
used.

To fix this, we now set enable.auto.commit to false, which prevents the
ghost consumer groups being created in the first place.

* update docs to include new enable.auto.commit setting behaviour

* update kafka-lookup-extractor documentation

Provide some additional detail on functionality and configuration.
Hopefully this will make it clearer how the extractor works for
developers who aren't so familiar with Kafka.

* add comments better explaining the logic of the code

* add spelling exceptions for kafka lookup docs
 		2022-08-09 16:14:22 +05:30
..
core fix: update footer copyright year (#12594) 2022-06-13 16:29:58 -07:00
i18n Docs refactor of ingestion. Carries #11541 (#11576) 2021-08-13 08:42:03 -07:00
pages/en Docusaurus build framework + ingestion doc refresh. (#8311) 2019-08-20 21:48:59 -07:00
script Graduation update for ASF release process guide and download links (#9126) 2020-01-06 15:00:33 -06:00
scss fix website build (#10172) 2020-07-11 22:01:43 -07:00
static fix website build (#10172) 2020-07-11 22:01:43 -07:00
.gitignore Docusaurus build framework + ingestion doc refresh. (#8311) 2019-08-20 21:48:59 -07:00
.spelling Change Kafka Lookup Extractor to not register consumer group (#12842) 2022-08-09 16:14:22 +05:30
README.md Updates to source and doc build pages (#11464) 2021-07-20 18:07:34 -07:00
package-lock.json Bump eventsource from 1.0.7 to 1.1.1 in /website (#12596) 2022-06-01 22:04:04 -07:00
package.json Druid Quickstart refactor and update (#9766) 2020-04-30 12:07:28 -07:00
pom.xml Bump up the versions (#12480) 2022-04-27 14:28:20 +05:30
redirects.json fix website build (#10172) 2020-07-11 22:01:43 -07:00
sidebars.json Improved Java 17 support and Java runtime docs. (#12839) 2022-08-03 23:16:05 -07:00
siteConfig.js De-incubation cleanup in code, docs, packaging (#9108) 2020-01-03 12:33:19 -05:00

README.md

Druid doc builder

This website was created with Docusaurus.

To view documentation run:

npm install

Then run:

npm start

The current version of the web site appears in your browser. Edit pages with your favorite editor. Refresh the web page after each edit to review your changes.

Dependencies

  • NodeJS. Use the version Docusaurus specifies, not a newer one. (For example, if 12.x is requested, don't install 16.x.) Docusaurus may require a version newer than that available in your Linux package repository, but older than the latest version. See this page to find the version required by Docusaurus.
  • The Yarn dependency from Docusaurus is optional. (This Yarn is not the Hadoop resource manager, it is a package manager for Node.js).
  • Docusaurus. Installed automatically as part of the the above npm commands.

Variables

Documentation pages can refer to a number of special variables using the {{var}} syntax:

  • DRUIDVERSION - the version of Druid in which the page appears. Allows creating links to files of the same version on GitHub.

The variables are not replaced when running the web site locally using the start command above.

Spellcheck

Please run a spellcheck before issuing a pull request to avoid a build failure due to spelling issues. Run:

npm run link-lint
npm run spellcheck

If you introduce new (correctly spelled) project names or technical terms, add them to the dictionary in the .spelling file in this directory. Also, terms enclosed in backticks are not spell checked. Example: `symbolName`