druid/docs/operations
Rishabh Singh 4ebdfe226d
Druid automated quickstart (#13365)
* Druid automated quickstart

* remove conf/druid/single-server/quickstart/_common/historical/jvm.config

* Minor changes in python script

* Add lower bound memory for some services

* Additional runtime properties for services

* Update supervise script to accept command arguments, corresponding changes in druid-quickstart.py

* File end newline

* Limit the ability to start multiple instances of a service, documentation changes

* simplify script arguments

* restore changes in medium profile

* run-druid refactor

* compute and pass middle manager runtime properties to run-druid
supervise script changes to process java opts array
use argparse, leave free memory, logging

* Remove extra quotes from mm task javaopts array

* Update logic to compute minimum memory

* simplify run-druid

* remove debug options from run-druid

* resolve the config_path provided

* comment out service specific runtime properties which are computed in the code

* simplify run-druid

* clean up docs, naming changes

* Throw ValueError exception on illegal state

* update docs

* rename args, compute_only -> compute, run_zk -> zk

* update help documentation

* update help documentation

* move task memory computation into separate method

* Add validation checks

* remove print

* Add validations

* remove start-druid bash script, rename start-druid-main

* Include tasks in lower bound memory calculation

* Fix test

* 256m instead of 256g

* caffeine cache uses 5% of heap

* ensure min task count is 2, task count is monotonic

* update configs and documentation for runtime props in conf/druid/single-server/quickstart

* Update docs

* Specify memory argument for each profile in single-server.md

* Update middleManager runtime.properties

* Move quickstart configs to conf/druid/base, add bash launch script, support python2

* Update supervise script

* rename base config directory to auto

* rename python script, changes to pass repeated args to supervise

* remove exmaples/conf/druid/base dir

* add docs

* restore changes in conf dir

* update start-druid-auto

* remove hashref for commands in supervise script

* start-druid-main java_opts array is comma separated

* update entry point script name in python script

* Update help docs

* documentation changes

* docs changes

* update docs

* add support for running indexer

* update supported services list

* update help

* Update python.md

* remove dir

* update .spelling

* Remove dependency on psutil and pathlib

* update docs

* Update get_physical_memory method

* Update help docs

* update docs

* update method to get physical memory on python

* udpate spelling

* update .spelling

* minor change

* Minor change

* memory comptuation for indexer

* update start-druid

* Update python.md

* Update single-server.md

* Update python.md

* run python3 --version to check if python is installed

* Update supervise script

* start-druid: echo message if python not found

* update anchor text

* minor change

* Update condition in supervise script

* JVM not jvm in docs
2022-12-09 11:04:02 -08:00
..
alerts.md Docusaurus build framework + ingestion doc refresh. (#8311) 2019-08-20 21:48:59 -07:00
api-reference.md api: change API page formatting (#13213) 2022-10-18 13:22:26 -07:00
auth-ldap.md Update LDAP configuration docs (#13245) 2022-11-29 09:26:32 -08:00
basic-cluster-tuning.md Various documentation updates. (#13107) 2022-09-16 21:58:11 -07:00
clean-metadata-store.md fix html tags in docs (#13117) 2022-09-18 19:40:33 -07:00
deep-storage-migration.md cleaning up and fixing links (#10528) 2020-12-17 13:37:43 -08:00
dump-segment.md dump-segment tool support for examining nested columns (#13356) 2022-11-14 16:08:47 -08:00
dynamic-config-provider.md Docs: Splits Kafka topic. Adds detailed example for kafka inputFormat (#11912) 2021-11-12 13:02:23 -08:00
export-metadata.md Update Kafka loading docs to use the streaming data loader (#8544) 2019-09-22 15:00:52 -07:00
getting-started.md Docusaurus build framework + ingestion doc refresh. (#8311) 2019-08-20 21:48:59 -07:00
high-availability.md fixes web console introduction and addresses linking issues (#11609) 2021-08-18 08:37:05 -07:00
http-compression.md De-incubation cleanup in code, docs, packaging (#9108) 2020-01-03 12:33:19 -05:00
insert-segment-to-db.md De-incubation cleanup in code, docs, packaging (#9108) 2020-01-03 12:33:19 -05:00
java.md Add Java 17 information to documentation. (#12990) 2022-08-30 12:32:49 -07:00
kubernetes.md Bump the version of Druid docker image from 0.16.0-incubating to latest (#13058) 2022-09-10 14:06:00 +05:30
metadata-migration.md cleaning up and fixing links (#10528) 2020-12-17 13:37:43 -08:00
metrics.md Limit max batch size for segment allocation, add docs (#13503) 2022-12-07 10:07:14 +05:30
mixed-workloads.md Docs for cluster tiering to improve query concurrency (#12128) 2022-01-15 12:22:08 +08:00
other-hadoop.md cleaning up and fixing links (#10528) 2020-12-17 13:37:43 -08:00
password-provider.md Security overview documentation (#10339) 2020-11-19 15:24:58 -08:00
pull-deps.md Update pull-deps docs with correct repo list. (#13134) 2022-09-21 12:16:57 -07:00
python.md Druid automated quickstart (#13365) 2022-12-09 11:04:02 -08:00
request-logging.md Add sql planning time metric (#12923) 2022-08-22 11:09:44 +05:30
reset-cluster.md Update reset-cluster.md (#10990) 2021-03-29 20:38:35 -07:00
rolling-updates.md add links to release notes, light refactor of landing page (#11051) 2021-05-07 14:26:47 -07:00
rule-configuration.md Add missing MSQ error code fields to docs (#13308) 2022-11-10 21:03:04 +05:30
security-overview.md Update LDAP configuration docs (#13245) 2022-11-29 09:26:32 -08:00
security-user-auth.md Various documentation updates. (#13107) 2022-09-16 21:58:11 -07:00
segment-optimization.md Various documentation updates. (#13107) 2022-09-16 21:58:11 -07:00
single-server.md Druid automated quickstart (#13365) 2022-12-09 11:04:02 -08:00
tls-support.md Auto-reload TLS certs for druid endpoints (#12933) 2022-08-25 20:12:43 +08:00
use_sbt_to_build_fat_jar.md Docusaurus build framework + ingestion doc refresh. (#8311) 2019-08-20 21:48:59 -07:00
web-console.md Various documentation updates. (#13107) 2022-09-16 21:58:11 -07:00