discourse-ai/spec/lib
Sam 948cf893a9
FIX: Add tool support to open ai compatible dialect and vllm (#734)
* FIX: Add tool support to open ai compatible dialect and vllm

Automatic tools are in progress in vllm see: https://github.com/vllm-project/vllm/pull/5649

Even when they are supported, initial support will be uneven, only some models have native tool support
notably mistral which has some special tokens for tool support.

After the above PR lands in vllm we will still need to swap to
XML based tools on models without native tool support.

* fix specs
2024-08-02 09:52:33 -03:00
..
completions FIX: Add tool support to open ai compatible dialect and vllm (#734) 2024-08-02 09:52:33 -03:00
discourse_automation DEV: Remove old code now that features rely on LlmModels. (#729) 2024-07-30 13:44:57 -03:00
modules DEV: Remove old code now that features rely on LlmModels. (#729) 2024-07-30 13:44:57 -03:00
utils FEATURE: Add basic connection check to DNS SRV resources (#563) 2024-04-12 10:39:19 -03:00
guardian_extensions_spec.rb FEATURE: move summary to use llm_model (#699) 2024-07-04 10:48:18 +10:00