830cc26075
* FEATURE: Add metadata support for RAG You may include non indexed metadata in the RAG document by using [[metadata ....]] This information is attached to all the text below and provided to the retriever. This allows for RAG to operate within a rich amount of contexts without getting lost Also: - re-implemented chunking algorithm so it streams - moved indexing to background low priority queue * Baran gem no longer required. * tokenizers is on 4.4 ... upgrade it ... |
||
|---|---|---|
| .. | ||
| digest_rag_upload_spec.rb | ||
| generate_rag_embeddings_spec.rb | ||
| stream_post_helper_spec.rb | ||