Sam 830cc26075
FEATURE: Add metadata support for RAG (#553)
* FEATURE: Add metadata support for RAG

You may include non indexed metadata in the RAG document by using

[[metadata ....]]

This information is attached to all the text below and provided to
the retriever.

This allows for RAG to operate within a rich amount of contexts
without getting lost

Also:

- re-implemented chunking algorithm so it streams
- moved indexing to background low priority queue

* Baran gem no longer required.

* tokenizers is on 4.4 ... upgrade it ...
2024-04-04 11:02:16 -03:00
2023-02-17 11:33:47 -03:00
2023-12-26 14:49:55 -03:00
2023-02-17 11:33:47 -03:00
2023-11-03 11:30:09 +00:00
2023-11-03 11:30:09 +00:00
2024-03-06 15:23:29 +01:00
2023-02-17 11:33:47 -03:00
2024-01-13 00:28:06 +01:00
2023-09-04 15:46:35 -03:00
2023-07-15 00:56:15 +02:00
2024-01-13 00:28:06 +01:00

Discourse AI Plugin

Plugin Summary

For more information, please see: https://meta.discourse.org/t/discourse-ai/259214?u=falco

Languages
Ruby 79.2%
JavaScript 17.3%
SCSS 2.1%
CSS 0.6%
HTML 0.5%
Other 0.3%