mirror of
https://github.com/discourse/discourse-ai.git
synced 2025-02-07 12:08:13 +00:00
* FIX: AI helper not working correctly with mixtral This PR introduces a new function on the generic llm called #generate This will replace the implementation of completion! #generate introduces a new way to pass temperature, max_tokens and stop_sequences Then LLM implementers need to implement #normalize_model_params to ensure the generic names match the LLM specific endpoint This also adds temperature and stop_sequences to completion_prompts this allows for much more robust completion prompts * port everything over to #generate * Fix translation - On anthropic this no longer throws random "This is your translation:" - On mixtral this actually works * fix markdown table generation as well
9 lines
252 B
Ruby
9 lines
252 B
Ruby
# frozen_string_literal: true
|
|
|
|
class AddParamsToCompletionPrompt < ActiveRecord::Migration[7.0]
|
|
def change
|
|
add_column :completion_prompts, :temperature, :integer
|
|
add_column :completion_prompts, :stop_sequences, :string, array: true
|
|
end
|
|
end
|