discourse-ai/app
Sam 830cc26075
FEATURE: Add metadata support for RAG (#553)
* FEATURE: Add metadata support for RAG

You may include non indexed metadata in the RAG document by using

[[metadata ....]]

This information is attached to all the text below and provided to
the retriever.

This allows for RAG to operate within a rich amount of contexts
without getting lost

Also:

- re-implemented chunking algorithm so it streams
- moved indexing to background low priority queue

* Baran gem no longer required.

* tokenizers is on 4.4 ... upgrade it ...
2024-04-04 11:02:16 -03:00
..
controllers/discourse_ai FEATURE: AI Bot RAG support. (#537) 2024-04-01 13:43:34 -03:00
helpers/discourse_ai/ai_bot FIX: expire assets when CSS changes FIX: missing translation on share page (#528) 2024-03-13 20:52:33 +11:00
jobs FEATURE: Add metadata support for RAG (#553) 2024-04-04 11:02:16 -03:00
mailers FEATURE: support sending AI report to an email address (#368) 2023-12-19 17:51:49 +11:00
models FEATURE: Add metadata support for RAG (#553) 2024-04-04 11:02:16 -03:00
serializers FEATURE: AI Bot RAG support. (#537) 2024-04-01 13:43:34 -03:00
views UX: Add title suffix to shared AI pages (#531) 2024-03-15 10:31:58 +00:00