discourse-ai/app
Sam 03fc94684b
FIX: AI helper not working correctly with mixtral (#399)
* FIX: AI helper not working correctly with mixtral

This PR introduces a new function on the generic llm called #generate

This will replace the implementation of completion!

#generate introduces a new way to pass temperature, max_tokens and stop_sequences

Then LLM implementers need to implement #normalize_model_params to
ensure the generic names match the LLM specific endpoint

This also adds temperature and stop_sequences to completion_prompts
this allows for much more robust completion prompts

* port everything over to #generate

* Fix translation

- On anthropic this no longer throws random "This is your translation:"
- On mixtral this actually works

* fix markdown table generation as well
2024-01-04 09:53:47 -03:00
..
controllers/discourse_ai FIX: AI helper not working correctly with mixtral (#399) 2024-01-04 09:53:47 -03:00
jobs FEATURE: Per post embeddings (#387) 2023-12-29 12:28:45 -03:00
mailers FEATURE: support sending AI report to an email address (#368) 2023-12-19 17:51:49 +11:00
models FIX: AI helper not working correctly with mixtral (#399) 2024-01-04 09:53:47 -03:00
serializers FIX: 500 error when reviewable has a missing message (#397) 2024-01-03 11:49:47 -03:00
views/list FIX: Corner cases on post embedding and crawler related (#391) 2023-12-29 14:05:02 -03:00