discourse-ai/spec/lib/modules/ai_bot
Sam a3c827efcc
FEATURE: allow personas to supply top_p and temperature params (#459)
* FEATURE: allow personas to supply top_p and temperature params

Code assistance generally are more focused at a lower temperature
This amends it so SQL Helper runs at 0.2 temperature vs the more
common default across LLMs of 1.0.

Reduced temperature leads to more focused, concise and predictable
answers for the SQL Helper

* fix tests

* This is not perfect, but far better than what we do today

Instead of fishing for

1. Draft sequence
2. Draft body

We skip (2), this means the composer "only" needs 1 http request to
open, we also want to eliminate (1) but it is a bit of a trickier
core change, may figure out how to pull it off (defer it to first draft save)

Value of bot drafts < value of opening bot conversations really fast
2024-02-03 07:09:34 +11:00
..
jobs/regular DEV: AI bot migration to the Llm pattern. (#343) 2024-01-04 10:44:07 -03:00
personas REFACTOR: Represent generic prompts with an Object. (#416) 2024-01-12 14:36:44 -03:00
tools Revert "UX: Validate embeddings settings (#455)" (#456) 2024-02-01 14:06:51 -03:00
bot_spec.rb FEATURE: allow personas to supply top_p and temperature params (#459) 2024-02-03 07:09:34 +11:00
entry_point_spec.rb FEATURE: defer creation of bot users (#258) 2023-10-23 17:00:58 +11:00
playground_spec.rb FEATURE: even smoother streaming (#420) 2024-01-15 18:51:14 +11:00
site_setting_extension_spec.rb FEATURE: defer creation of bot users (#258) 2023-10-23 17:00:58 +11:00