discourse-ai/lib/completions/dialects
Sam 948cf893a9
FIX: Add tool support to open ai compatible dialect and vllm (#734)
* FIX: Add tool support to open ai compatible dialect and vllm

Automatic tools are in progress in vllm see: https://github.com/vllm-project/vllm/pull/5649

Even when they are supported, initial support will be uneven, only some models have native tool support
notably mistral which has some special tokens for tool support.

After the above PR lands in vllm we will still need to swap to
XML based tools on models without native tool support.

* fix specs
2024-08-02 09:52:33 -03:00
..
chat_gpt.rb DEV: Remove old code now that features rely on LlmModels. (#729) 2024-07-30 13:44:57 -03:00
claude.rb DEV: Remove old code now that features rely on LlmModels. (#729) 2024-07-30 13:44:57 -03:00
claude_tools.rb FIX: switch off native tools on Anthropic Claude Opus (#659) 2024-06-07 10:52:01 -03:00
cohere_tools.rb FEATURE: Add native Cohere tool support (#655) 2024-06-04 08:59:15 +10:00
command.rb DEV: Remove old code now that features rely on LlmModels. (#729) 2024-07-30 13:44:57 -03:00
dialect.rb DEV: Remove old code now that features rely on LlmModels. (#729) 2024-07-30 13:44:57 -03:00
fake.rb FEATURE: Set endpoint credentials directly from LlmModel. (#625) 2024-05-16 09:50:22 -03:00
gemini.rb DEV: Remove old code now that features rely on LlmModels. (#729) 2024-07-30 13:44:57 -03:00
open_ai_compatible.rb FIX: Add tool support to open ai compatible dialect and vllm (#734) 2024-08-02 09:52:33 -03:00
open_ai_tools.rb FIX: Make sure custom tool enums follow json-schema. (#718) 2024-07-16 14:23:17 -03:00
xml_tools.rb FIX: switch off native tools on Anthropic Claude Opus (#659) 2024-06-07 10:52:01 -03:00