discourse-ai/app/serializers/llm_model_serializer.rb
Roman Rizzi 8d5f901a67
DEV: Rewire AI bot internals to use LlmModel (#638)
* DRAFT: Create AI Bot users dynamically and support custom LlmModels

* Get user associated to llm_model

* Track enabled bots with attribute

* Don't store bot username. Minor touches to migrate default values in settings

* Handle scenario where vLLM uses a SRV record

* Made 3.5-turbo-16k the default version so we can remove hack
2024-06-18 14:32:14 -03:00

21 lines
423 B
Ruby

# frozen_string_literal: true
class LlmModelSerializer < ApplicationSerializer
root "llm"
attributes :id,
:display_name,
:name,
:provider,
:max_prompt_tokens,
:tokenizer,
:api_key,
:url,
:enabled_chat_bot,
:url_editable
def url_editable
object.url != LlmModel::RESERVED_VLLM_SRV_URL
end
end