830cc26075
* FEATURE: Add metadata support for RAG You may include non indexed metadata in the RAG document by using [[metadata ....]] This information is attached to all the text below and provided to the retriever. This allows for RAG to operate within a rich amount of contexts without getting lost Also: - re-implemented chunking algorithm so it streams - moved indexing to background low priority queue * Baran gem no longer required. * tokenizers is on 4.4 ... upgrade it ... |
||
|---|---|---|
| .. | ||
| create_ai_reply.rb | ||
| digest_rag_upload.rb | ||
| evaluate_post_uploads.rb | ||
| generate_chat_thread_title.rb | ||
| generate_embeddings.rb | ||
| generate_rag_embeddings.rb | ||
| post_sentiment_analysis.rb | ||
| stream_post_helper.rb | ||
| toxicity_classify_chat_message.rb | ||
| toxicity_classify_post.rb | ||
| update_ai_bot_pm_title.rb | ||