discourse-ai/lib/summarization
Sam 03fc94684b
FIX: AI helper not working correctly with mixtral (#399)
* FIX: AI helper not working correctly with mixtral

This PR introduces a new function on the generic llm called #generate

This will replace the implementation of completion!

#generate introduces a new way to pass temperature, max_tokens and stop_sequences

Then LLM implementers need to implement #normalize_model_params to
ensure the generic names match the LLM specific endpoint

This also adds temperature and stop_sequences to completion_prompts
this allows for much more robust completion prompts

* port everything over to #generate

* Fix translation

- On anthropic this no longer throws random "This is your translation:"
- On mixtral this actually works

* fix markdown table generation as well
2024-01-04 09:53:47 -03:00
..
models Mixtral (#376) 2023-12-26 14:49:55 -03:00
strategies FIX: AI helper not working correctly with mixtral (#399) 2024-01-04 09:53:47 -03:00
entry_point.rb FEATURE: Mixtral for summarization (#381) 2023-12-26 17:50:02 -03:00