discourse/discourse-ai
1
0
Fork 0
mirror of https://github.com/discourse/discourse-ai.git synced 2025-03-06 01:10:28 +00:00
Code Issues Packages Projects Releases Wiki Activity

FIX: Use vLLM if TGI is not configured for OSS LLM inference (#380)

Browse Source
This commit is contained in:
Rafael dos Santos Silva 2023-12-26 17:18:08 -03:00 committed by GitHub
parent 5db7bf6e68
commit 3c27cbfb9a
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
lib/completions/endpoints/hugging_face.rb
View File

@ -12,7 +12,7 @@ module DiscourseAi
Llama2-chat-hf
mistralai/Mixtral-8x7B-Instruct-v0.1
mistralai/Mistral-7B-Instruct-v0.2
].include?(model_name)
].include?(model_name) && SiteSetting.ai_hugging_face_api_url.present?
end
def default_options