discourse-ai/lib/embeddings
Sam 03fc94684b
FIX: AI helper not working correctly with mixtral (#399)
* FIX: AI helper not working correctly with mixtral

This PR introduces a new function on the generic llm called #generate

This will replace the implementation of completion!

#generate introduces a new way to pass temperature, max_tokens and stop_sequences

Then LLM implementers need to implement #normalize_model_params to
ensure the generic names match the LLM specific endpoint

This also adds temperature and stop_sequences to completion_prompts
this allows for much more robust completion prompts

* port everything over to #generate

* Fix translation

- On anthropic this no longer throws random "This is your translation:"
- On mixtral this actually works

* fix markdown table generation as well
2024-01-04 09:53:47 -03:00
..
strategies FIX: Corner cases on post embedding and crawler related (#391) 2023-12-29 14:05:02 -03:00
vector_representations FIX: Skip embeddings for blank content (#392) 2023-12-29 14:59:08 -03:00
entry_point.rb FEATURE: Per post embeddings (#387) 2023-12-29 12:28:45 -03:00
semantic_related.rb FIX: Corner cases on post embedding and crawler related (#391) 2023-12-29 14:05:02 -03:00
semantic_search.rb FIX: AI helper not working correctly with mixtral (#399) 2024-01-04 09:53:47 -03:00
semantic_topic_query.rb DEV: port directory structure to Zeitwerk (#319) 2023-11-29 15:17:46 +11:00