Sam 830cc26075 FEATURE: Add metadata support for RAG (#553) ... * FEATURE: Add metadata support for RAG You may include non indexed metadata in the RAG document by using [[metadata ....]] This information is attached to all the text below and provided to the retriever. This allows for RAG to operate within a rich amount of contexts without getting lost Also: - re-implemented chunking algorithm so it streams - moved indexing to background low priority queue * Baran gem no longer required. * tokenizers is on 4.4 ... upgrade it ...		2024-04-04 11:02:16 -03:00
..
fixtures	FEATURE: AI helper support in non English languages (#489)	2024-02-27 16:31:51 -03:00
migrate	FEATURE: Add metadata support for RAG (#553)	2024-04-04 11:02:16 -03:00
post_migrate	FIX: Explicit check for empty string in compat migration (#463)	2024-02-07 14:51:51 -03:00