discourse-ai

Commit Graph

Author	SHA1	Message	Date
Roman Rizzi	8d5f901a67	DEV: Rewire AI bot internals to use LlmModel (#638 ) * DRAFT: Create AI Bot users dynamically and support custom LlmModels * Get user associated to llm_model * Track enabled bots with attribute * Don't store bot username. Minor touches to migrate default values in settings * Handle scenario where vLLM uses a SRV record * Made 3.5-turbo-16k the default version so we can remove hack	2024-06-18 14:32:14 -03:00
Roman Rizzi	3a9080dd14	FEATURE: Test LLM configuration (#634 )	2024-05-21 13:35:50 -03:00
Roman Rizzi	62fc7d6ed0	FEATURE: Configurable LLMs. (#606 ) This PR introduces the concept of "LlmModel" as a new way to quickly add new LLM models without making any code changes. We are releasing this first version and will add incremental improvements, so expect changes. The AI Bot can't fully take advantage of this feature as users are hard-coded. We'll fix this in a separate PR.s	2024-05-13 12:46:42 -03:00

Author

SHA1

Message

Date

Roman Rizzi

8d5f901a67

DEV: Rewire AI bot internals to use LlmModel (#638 )

* DRAFT: Create AI Bot users dynamically and support custom LlmModels

* Get user associated to llm_model

* Track enabled bots with attribute

* Don't store bot username. Minor touches to migrate default values in settings

* Handle scenario where vLLM uses a SRV record

* Made 3.5-turbo-16k the default version so we can remove hack

2024-06-18 14:32:14 -03:00

Roman Rizzi

3a9080dd14

FEATURE: Test LLM configuration (#634 )

2024-05-21 13:35:50 -03:00

Roman Rizzi

62fc7d6ed0

FEATURE: Configurable LLMs. (#606 )

This PR introduces the concept of "LlmModel" as a new way to quickly add new LLM models without making any code changes. We are releasing this first version and will add incremental improvements, so expect changes.

The AI Bot can't fully take advantage of this feature as users are hard-coded. We'll fix this in a separate PR.s

2024-05-13 12:46:42 -03:00

3 Commits