discourse-ai/spec/requests
Sam 03fc94684b
FIX: AI helper not working correctly with mixtral (#399)
* FIX: AI helper not working correctly with mixtral

This PR introduces a new function on the generic llm called #generate

This will replace the implementation of completion!

#generate introduces a new way to pass temperature, max_tokens and stop_sequences

Then LLM implementers need to implement #normalize_model_params to
ensure the generic names match the LLM specific endpoint

This also adds temperature and stop_sequences to completion_prompts
this allows for much more robust completion prompts

* port everything over to #generate

* Fix translation

- On anthropic this no longer throws random "This is your translation:"
- On mixtral this actually works

* fix markdown table generation as well
2024-01-04 09:53:47 -03:00
..
admin FEATURE: scale up result count for search depending on model (#346) 2023-12-11 16:54:16 +11:00
ai_bot FEATURE: defer creation of bot users (#258) 2023-10-23 17:00:58 +11:00
ai_helper FIX: AI helper not working correctly with mixtral (#399) 2024-01-04 09:53:47 -03:00
topic_spec.rb FEATURE: HyDE-powered semantic search. (#136) 2023-09-05 11:08:23 -03:00