2023-09-04 15:46:35 -03:00
|
|
|
# **Discourse AI** Plugin
|
2023-02-17 11:33:47 -03:00
|
|
|
|
|
|
|
|
**Plugin Summary**
|
|
|
|
|
|
2023-09-04 15:46:35 -03:00
|
|
|
For more information, please see: https://meta.discourse.org/t/discourse-ai/259214?u=falco
|
2025-02-19 15:44:33 +11:00
|
|
|
|
|
|
|
|
### Evals
|
|
|
|
|
|
|
|
|
|
The directory `evals` contains AI evals for the Discourse AI plugin.
|
|
|
|
|
|
|
|
|
|
To run them use:
|
|
|
|
|
|
|
|
|
|
cd evals
|
|
|
|
|
./run --help
|
|
|
|
|
|
|
|
|
|
```
|
|
|
|
|
Usage: evals/run [options]
|
|
|
|
|
-e, --eval NAME Name of the evaluation to run
|
|
|
|
|
--list-models List models
|
|
|
|
|
-m, --model NAME Model to evaluate (will eval all models if not specified)
|
|
|
|
|
-l, --list List evals
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
To run evals you will need to configure API keys in your environment:
|
|
|
|
|
|
|
|
|
|
OPENAI_API_KEY=your_openai_api_key
|
|
|
|
|
ANTHROPIC_API_KEY=your_anthropic_api_key
|
|
|
|
|
GEMINI_API_KEY=your_gemini_api_key
|
