From 54f2d34ccb10555b8a23ed1b441e7d82a740a296 Mon Sep 17 00:00:00 2001 From: Sam Date: Tue, 26 Nov 2024 07:49:33 +1100 Subject: [PATCH] DEV: skip flakey spec (#955) This spec fails inconsistently with: -fragment-n14 +You are a helpful Discourse assistant. +You _understand_ and **generate** Discourse Markdown. +You live in a Discourse Forum Message. + +You live in the forum with the URL: http://test.localhost +The title of your site: test site title +The description is: test site description +The participants in this conversation are: joe, jane +The date now is: 2024-11-25 20:23:02 UTC, much has changed since you were trained. + +You were trained on OLD data, lean on search to get up to date information about this forum +When searching try to SIMPLIFY search terms +Discourse search joins all terms with AND. Reduce and simplify terms to find more results. +The following texts will give you additional guidance for your response. +We included them because we believe they are relevant to this conversation topic. + +Texts: + +fragment-n10 +fragment-n9 +fragment-n8 +fragment-n7 +fragment-n6 +fragment-n5 +fragment-n4 +fragment-n3 +fragment-n2 +fragment-n1 + --- spec/lib/modules/ai_bot/personas/persona_spec.rb | 1 + 1 file changed, 1 insertion(+) diff --git a/spec/lib/modules/ai_bot/personas/persona_spec.rb b/spec/lib/modules/ai_bot/personas/persona_spec.rb index 34311761..86251d78 100644 --- a/spec/lib/modules/ai_bot/personas/persona_spec.rb +++ b/spec/lib/modules/ai_bot/personas/persona_spec.rb @@ -444,6 +444,7 @@ RSpec.describe DiscourseAi::AiBot::Personas::Persona do end it "uses the re-ranker to reorder the fragments and pick the top 10 candidates" do + skip "This test is flaky needs to be investigated ordering does not come back as expected" expected_reranked = (0..14).to_a.reverse.map { |idx| { index: idx } } WebMock.stub_request(:post, "https://test.reranker.com/rerank").to_return(