mirror of
https://github.com/discourse/discourse-ai.git
synced 2025-02-05 19:18:11 +00:00
0634b85a81
* UX: Validations to Llm-backed features (except AI Bot) This change is part of an ongoing effort to prevent enabling a broken feature due to lack of configuration. We also want to explicit which provider we are going to use. For example, Claude models are available through AWS Bedrock and Anthropic, but the configuration differs. Validations are: * You must choose a model before enabling the feature. * You must turn off the feature before setting the model to blank. * You must configure each model settings before being able to select it. * Add provider name to summarization options * vLLM can technically support same models as HF * Check we can talk to the selected model * Check for Bedrock instead of anthropic as a site could have both creds setup
107 lines
3.6 KiB
Ruby
107 lines
3.6 KiB
Ruby
# frozen_string_literal: true
|
|
|
|
RSpec.describe DiscourseAi::AiHelper::Assistant do
|
|
fab!(:user) { Fabricate(:user) }
|
|
let(:prompt) { CompletionPrompt.find_by(id: mode) }
|
|
|
|
before { SiteSetting.ai_helper_model = "fake:fake" }
|
|
|
|
let(:english_text) { <<~STRING }
|
|
To perfect his horror, Caesar, surrounded at the base of the statue by the impatient daggers of his friends,
|
|
discovers among the faces and blades that of Marcus Brutus, his protege, perhaps his son, and he no longer
|
|
defends himself, but instead exclaims: 'You too, my son!' Shakespeare and Quevedo capture the pathetic cry.
|
|
STRING
|
|
|
|
describe("#available_prompts") do
|
|
context "when no name filter is provided" do
|
|
it "returns all available prompts" do
|
|
prompts = subject.available_prompts
|
|
|
|
expect(prompts.length).to eq(6)
|
|
expect(prompts.map { |p| p[:name] }).to contain_exactly(
|
|
"translate",
|
|
"generate_titles",
|
|
"proofread",
|
|
"markdown_table",
|
|
"custom_prompt",
|
|
"explain",
|
|
)
|
|
end
|
|
end
|
|
|
|
context "when name filter is provided" do
|
|
it "returns the prompt with the given name" do
|
|
prompts = subject.available_prompts(name_filter: "translate")
|
|
|
|
expect(prompts.length).to eq(1)
|
|
expect(prompts.first[:name]).to eq("translate")
|
|
end
|
|
end
|
|
|
|
context "when illustrate post model is enabled" do
|
|
before { SiteSetting.ai_helper_illustrate_post_model = "stable_diffusion_xl" }
|
|
|
|
it "returns the illustrate_post prompt in the list of all prompts" do
|
|
prompts = subject.available_prompts
|
|
|
|
expect(prompts.length).to eq(7)
|
|
expect(prompts.map { |p| p[:name] }).to contain_exactly(
|
|
"translate",
|
|
"generate_titles",
|
|
"proofread",
|
|
"markdown_table",
|
|
"custom_prompt",
|
|
"explain",
|
|
"illustrate_post",
|
|
)
|
|
end
|
|
end
|
|
end
|
|
|
|
describe "#generate_and_send_prompt" do
|
|
context "when using a prompt that returns text" do
|
|
let(:mode) { CompletionPrompt::TRANSLATE }
|
|
|
|
let(:text_to_translate) { <<~STRING }
|
|
Para que su horror sea perfecto, César, acosado al pie de la estatua por lo impacientes puñales de sus amigos,
|
|
descubre entre las caras y los aceros la de Marco Bruto, su protegido, acaso su hijo,
|
|
y ya no se defiende y exclama: ¡Tú también, hijo mío! Shakespeare y Quevedo recogen el patético grito.
|
|
STRING
|
|
|
|
it "Sends the prompt to the LLM and returns the response" do
|
|
response =
|
|
DiscourseAi::Completions::Llm.with_prepared_responses([english_text]) do
|
|
subject.generate_and_send_prompt(prompt, text_to_translate, user)
|
|
end
|
|
|
|
expect(response[:suggestions]).to contain_exactly(english_text)
|
|
end
|
|
end
|
|
|
|
context "when using a prompt that returns a list" do
|
|
let(:mode) { CompletionPrompt::GENERATE_TITLES }
|
|
|
|
let(:titles) do
|
|
"<item>The solitary horse</item><item>The horse etched in gold</item><item>A horse's infinite journey</item><item>A horse lost in time</item><item>A horse's last ride</item>"
|
|
end
|
|
|
|
it "returns an array with each title" do
|
|
expected = [
|
|
"The solitary horse",
|
|
"The horse etched in gold",
|
|
"A horse's infinite journey",
|
|
"A horse lost in time",
|
|
"A horse's last ride",
|
|
]
|
|
|
|
response =
|
|
DiscourseAi::Completions::Llm.with_prepared_responses([titles]) do
|
|
subject.generate_and_send_prompt(prompt, english_text, user)
|
|
end
|
|
|
|
expect(response[:suggestions]).to contain_exactly(*expected)
|
|
end
|
|
end
|
|
end
|
|
end
|