discourse-ai/spec
Sam 03fc94684b
FIX: AI helper not working correctly with mixtral (#399)
* FIX: AI helper not working correctly with mixtral

This PR introduces a new function on the generic llm called #generate

This will replace the implementation of completion!

#generate introduces a new way to pass temperature, max_tokens and stop_sequences

Then LLM implementers need to implement #normalize_model_params to
ensure the generic names match the LLM specific endpoint

This also adds temperature and stop_sequences to completion_prompts
this allows for much more robust completion prompts

* port everything over to #generate

* Fix translation

- On anthropic this no longer throws random "This is your translation:"
- On mixtral this actually works

* fix markdown table generation as well
2024-01-04 09:53:47 -03:00
..
fabricators FEATURE: UI to update ai personas on admin page (#290) 2023-11-21 16:56:43 +11:00
fixtures/embeddings FEATURE: Embeddings to main db (#99) 2023-07-13 12:41:36 -03:00
jobs/regular DEV: Cook streamed suggestion (#354) 2023-12-13 12:24:22 -08:00
lib FIX: AI helper not working correctly with mixtral (#399) 2024-01-04 09:53:47 -03:00
models FIX: Custom instructions where missing when generating custom prompt input (#348) 2023-12-11 19:26:56 -03:00
requests FIX: AI helper not working correctly with mixtral (#399) 2024-01-04 09:53:47 -03:00
serializers Revert "FIX: Use Guardian.basic_user instead of new (anon) (#332)" (#337) 2023-12-06 16:26:43 +10:00
shared FIX: under certain conditions we would get duplicate data from llm (#373) 2023-12-20 14:28:05 -03:00
support REFACTOR: Summarization and HyDE now use an LLM abstraction. (#297) 2023-11-23 12:58:54 -03:00
system FIX: 500 error when reviewable has a missing message (#397) 2024-01-03 11:49:47 -03:00
plugin_spec.rb DEV: DiscourseAI -> DiscourseAi rename to have consistent folders and files (#9) 2023-03-14 16:03:50 -03:00