mirror of
https://github.com/discourse/discourse-ai.git
synced 2025-03-07 01:39:54 +00:00
03fc94684b
* FIX: AI helper not working correctly with mixtral This PR introduces a new function on the generic llm called #generate This will replace the implementation of completion! #generate introduces a new way to pass temperature, max_tokens and stop_sequences Then LLM implementers need to implement #normalize_model_params to ensure the generic names match the LLM specific endpoint This also adds temperature and stop_sequences to completion_prompts this allows for much more robust completion prompts * port everything over to #generate * Fix translation - On anthropic this no longer throws random "This is your translation:" - On mixtral this actually works * fix markdown table generation as well
49 lines
1.4 KiB
Ruby
49 lines
1.4 KiB
Ruby
# frozen_string_literal: true
|
|
|
|
module DiscourseAi
|
|
module AiHelper
|
|
class Painter
|
|
def commission_thumbnails(theme, user)
|
|
stable_diffusion_prompt = difussion_prompt(theme, user)
|
|
|
|
return [] if stable_diffusion_prompt.blank?
|
|
|
|
base64_artifacts =
|
|
DiscourseAi::Inference::StabilityGenerator
|
|
.perform!(stable_diffusion_prompt)
|
|
.dig(:artifacts)
|
|
.to_a
|
|
.map { |art| art[:base64] }
|
|
|
|
base64_artifacts.each_with_index.map do |artifact, i|
|
|
f = Tempfile.new("v1_txt2img_#{i}.png")
|
|
f.binmode
|
|
f.write(Base64.decode64(artifact))
|
|
f.rewind
|
|
upload =
|
|
UploadCreator.new(f, I18n.t("discourse_ai.ai_helper.painter.attribution")).create_for(
|
|
user.id,
|
|
)
|
|
f.unlink
|
|
|
|
UploadSerializer.new(upload, root: false)
|
|
end
|
|
end
|
|
|
|
private
|
|
|
|
def difussion_prompt(text, user)
|
|
prompt = { insts: <<~TEXT, input: text }
|
|
Provide me a StableDiffusion prompt to generate an image that illustrates the following post in 40 words or less, be creative.
|
|
You'll find the post between <input></input> XML tags.
|
|
TEXT
|
|
|
|
DiscourseAi::Completions::Llm.proxy(SiteSetting.ai_helper_model).generate(
|
|
prompt,
|
|
user: user,
|
|
)
|
|
end
|
|
end
|
|
end
|
|
end
|