discourse-ai/lib/ai_bot
Sam 830cc26075
FEATURE: Add metadata support for RAG (#553)
* FEATURE: Add metadata support for RAG

You may include non indexed metadata in the RAG document by using

[[metadata ....]]

This information is attached to all the text below and provided to
the retriever.

This allows for RAG to operate within a rich amount of contexts
without getting lost

Also:

- re-implemented chunking algorithm so it streams
- moved indexing to background low priority queue

* Baran gem no longer required.

* tokenizers is on 4.4 ... upgrade it ...
2024-04-04 11:02:16 -03:00
..
personas FEATURE: Add metadata support for RAG (#553) 2024-04-04 11:02:16 -03:00
tools FEATURE: web browsing tool (#548) 2024-03-28 16:01:58 +11:00
bot.rb FEATURE: add Claude 3 Haiku bot support (#552) 2024-04-03 16:06:27 +11:00
entry_point.rb FEATURE: add Claude 3 Haiku bot support (#552) 2024-04-03 16:06:27 +11:00
playground.rb FEATURE: Add vision support to AI personas (Claude 3) (#546) 2024-03-27 14:30:11 +11:00
site_settings_extension.rb FEATURE: mentionable personas and random picker tool, context limits (#466) 2024-02-15 16:37:59 +11:00