discourse-ai/app/jobs/regular
Sam 5cbc9190eb
FEATURE: RAG search within tools (#802)
This allows custom tools access to uploads and sophisticated searches using embedding.

It introduces:

 - A shared front end for listing and uploading files (shared with personas)
 -  Backend implementation of index.search function within a custom tool.

Custom tools now may search through uploaded files

function invoke(params) {
   return index.search(params.query)
}

This means that RAG implementers now may preload tools with knowledge and have high fidelity over
the search.

The search function support

    specifying max results
    specifying a subset of files to search (from uploads)

Also

 - Improved documentation for tools (when creating a tool a preamble explains all the functionality)
  - uploads were a bit finicky, fixed an edge case where the UI would not show them as updated
2024-09-30 17:27:50 +10:00
..
create_ai_chat_reply.rb FEATURE: Add support for contextualizing a DM to a bot (#627) 2024-05-21 17:17:02 +10:00
create_ai_reply.rb FEATURE: mentionable personas and random picker tool, context limits (#466) 2024-02-15 16:37:59 +11:00
digest_rag_upload.rb FEATURE: RAG search within tools (#802) 2024-09-30 17:27:50 +10:00
evaluate_post_uploads.rb DEV: port directory structure to Zeitwerk (#319) 2023-11-29 15:17:46 +11:00
generate_chat_thread_title.rb DEV: port directory structure to Zeitwerk (#319) 2023-11-29 15:17:46 +11:00
generate_embeddings.rb DEV: Update rubocop-discourse to version 3.8.0 (#641) 2024-05-28 11:15:42 +02:00
generate_rag_embeddings.rb FEATURE: Make tool support polymorphic (#798) 2024-09-16 08:17:17 +10:00
post_sentiment_analysis.rb DEV: port directory structure to Zeitwerk (#319) 2023-11-29 15:17:46 +11:00
shared_conversation_adjust_upload_security.rb FIX: Secure/unsecure uploads when sharing AI conversations (#554) 2024-04-11 10:00:41 +10:00
stream_post_helper.rb FEATURE: Stream other post helper options (#745) 2024-08-08 11:32:39 -07:00
stream_topic_ai_summary.rb FEATURE: smooth streaming animation for summarization (#778) 2024-08-29 15:07:07 -07:00
toxicity_classify_chat_message.rb DEV: port directory structure to Zeitwerk (#319) 2023-11-29 15:17:46 +11:00
toxicity_classify_post.rb DEV: port directory structure to Zeitwerk (#319) 2023-11-29 15:17:46 +11:00