discourse-ai/lib
Sam f6ac5cd0a8
FEATURE: allow tuning of RAG generation (#565)
* FEATURE: allow tuning of RAG generation

- change chunking to be token based vs char based (which is more accurate)
- allow control over overlap / tokens per chunk and conversation snippets inserted
- UI to control new settings

* improve ui a bit

* fix various reindex issues

* reduce concurrency

* try ultra low queue ... concurrency 1 is too slow.
2024-04-12 10:32:46 -03:00
..
ai_bot FEATURE: allow tuning of RAG generation (#565) 2024-04-12 10:32:46 -03:00
ai_helper FIX: Prevent AI chat thread titles from being created before replies are posted (#517) 2024-03-07 16:14:17 -03:00
automation FEATURE: Mixtral/Mistral/Haiku Automation Support (#571) 2024-04-11 09:50:46 -03:00
completions FEATURE: Add Cohere models to AI helper and automation (#576) 2024-04-12 14:46:58 +10:00
configuration UX: Re-introduce embedding settings validations (#457) 2024-02-01 16:54:09 -03:00
database DEV: port directory structure to Zeitwerk (#319) 2023-11-29 15:17:46 +11:00
embeddings FEATURE: Add BGE-M3 embeddings support (#569) 2024-04-10 17:24:01 -03:00
inference FEATURE: AI Bot RAG support. (#537) 2024-04-01 13:43:34 -03:00
nsfw DEV: Fix various typos (#434) 2024-01-19 12:51:26 +01:00
sentiment FIX: Truncate content for sentiment/toxicity classification (#431) 2024-01-17 15:17:58 -03:00
summarization FEATURE: remove gpt-4-turbo-0125 preview swap with gpt-4-turbo (#568) 2024-04-10 09:53:20 -03:00
tasks/modules FEATURE: Add BGE-M3 embeddings support (#569) 2024-04-10 17:24:01 -03:00
tokenizer FEATURE: allow tuning of RAG generation (#565) 2024-04-12 10:32:46 -03:00
toxicity FIX: Truncate content for sentiment/toxicity classification (#431) 2024-01-17 15:17:58 -03:00
utils FEATURE: DNS SRV support for TEI (#363) 2023-12-18 13:21:21 -03:00
automation.rb FEATURE: Add Cohere models to AI helper and automation (#576) 2024-04-12 14:46:58 +10:00
chat_message_classificator.rb DEV: port directory structure to Zeitwerk (#319) 2023-11-29 15:17:46 +11:00
classificator.rb DEV: port directory structure to Zeitwerk (#319) 2023-11-29 15:17:46 +11:00
engine.rb DEV: port directory structure to Zeitwerk (#319) 2023-11-29 15:17:46 +11:00
guardian_extensions.rb FIX: don't show share conversation incorrectly (#526) 2024-03-13 11:24:22 +11:00
post_classificator.rb DEV: port directory structure to Zeitwerk (#319) 2023-11-29 15:17:46 +11:00