discourse-ai/lib/completions/dialects
Sam 03fc94684b
FIX: AI helper not working correctly with mixtral (#399)
* FIX: AI helper not working correctly with mixtral

This PR introduces a new function on the generic llm called #generate

This will replace the implementation of completion!

#generate introduces a new way to pass temperature, max_tokens and stop_sequences

Then LLM implementers need to implement #normalize_model_params to
ensure the generic names match the LLM specific endpoint

This also adds temperature and stop_sequences to completion_prompts
this allows for much more robust completion prompts

* port everything over to #generate

* Fix translation

- On anthropic this no longer throws random "This is your translation:"
- On mixtral this actually works

* fix markdown table generation as well
2024-01-04 09:53:47 -03:00
..
chat_gpt.rb FIX: AI helper not working correctly with mixtral (#399) 2024-01-04 09:53:47 -03:00
claude.rb FIX: Correctly translate and read tools for Claude and Chat GPT. (#393) 2024-01-02 11:21:13 -03:00
dialect.rb Mixtral (#376) 2023-12-26 14:49:55 -03:00
gemini.rb FIX: Correctly translate and read tools for Claude and Chat GPT. (#393) 2024-01-02 11:21:13 -03:00
llama2_classic.rb FIX: Correctly translate and read tools for Claude and Chat GPT. (#393) 2024-01-02 11:21:13 -03:00
mixtral.rb FIX: AI helper not working correctly with mixtral (#399) 2024-01-04 09:53:47 -03:00
orca_style.rb FIX: Correctly translate and read tools for Claude and Chat GPT. (#393) 2024-01-02 11:21:13 -03:00