discourse-ai/lib
Sam 830cc26075
FEATURE: Add metadata support for RAG (#553)
* FEATURE: Add metadata support for RAG

You may include non indexed metadata in the RAG document by using

[[metadata ....]]

This information is attached to all the text below and provided to
the retriever.

This allows for RAG to operate within a rich amount of contexts
without getting lost

Also:

- re-implemented chunking algorithm so it streams
- moved indexing to background low priority queue

* Baran gem no longer required.

* tokenizers is on 4.4 ... upgrade it ...
2024-04-04 11:02:16 -03:00
..
ai_bot FEATURE: Add metadata support for RAG (#553) 2024-04-04 11:02:16 -03:00
ai_helper FIX: Prevent AI chat thread titles from being created before replies are posted (#517) 2024-03-07 16:14:17 -03:00
automation FIX: unify automation model translation (#540) 2024-03-21 11:32:35 +11:00
completions FEATURE: Add vision support to AI personas (Claude 3) (#546) 2024-03-27 14:30:11 +11:00
configuration UX: Re-introduce embedding settings validations (#457) 2024-02-01 16:54:09 -03:00
database DEV: port directory structure to Zeitwerk (#319) 2023-11-29 15:17:46 +11:00
embeddings FEATURE: AI Bot RAG support. (#537) 2024-04-01 13:43:34 -03:00
inference FEATURE: AI Bot RAG support. (#537) 2024-04-01 13:43:34 -03:00
nsfw DEV: Fix various typos (#434) 2024-01-19 12:51:26 +01:00
sentiment FIX: Truncate content for sentiment/toxicity classification (#431) 2024-01-17 15:17:58 -03:00
summarization FIX: prompt engineering for summary prompt (#539) 2024-03-20 16:33:05 +11:00
tasks/modules FIX: Filter soft-deleted topics when backfilling sentiment (#527) 2024-03-12 21:01:24 -03:00
tokenizer FIX: Handle unicode on tokenizer (#515) 2024-03-14 17:33:30 -03:00
toxicity FIX: Truncate content for sentiment/toxicity classification (#431) 2024-01-17 15:17:58 -03:00
utils FEATURE: DNS SRV support for TEI (#363) 2023-12-18 13:21:21 -03:00
automation.rb FIX: unify automation model translation (#540) 2024-03-21 11:32:35 +11:00
chat_message_classificator.rb DEV: port directory structure to Zeitwerk (#319) 2023-11-29 15:17:46 +11:00
classificator.rb DEV: port directory structure to Zeitwerk (#319) 2023-11-29 15:17:46 +11:00
engine.rb DEV: port directory structure to Zeitwerk (#319) 2023-11-29 15:17:46 +11:00
guardian_extensions.rb FIX: don't show share conversation incorrectly (#526) 2024-03-13 11:24:22 +11:00
post_classificator.rb DEV: port directory structure to Zeitwerk (#319) 2023-11-29 15:17:46 +11:00