948cf893a9
* FIX: Add tool support to open ai compatible dialect and vllm Automatic tools are in progress in vllm see: https://github.com/vllm-project/vllm/pull/5649 Even when they are supported, initial support will be uneven, only some models have native tool support notably mistral which has some special tokens for tool support. After the above PR lands in vllm we will still need to swap to XML based tools on models without native tool support. * fix specs |
||
|---|---|---|
| .. | ||
| dialects | ||
| endpoints | ||
| function_call_normalizer_spec.rb | ||
| llm_spec.rb | ||
| prompt_messages_builder_spec.rb | ||
| prompt_spec.rb | ||
| xml_tag_stripper_spec.rb | ||