discourse-ai/lib
Sam a66b1042cc
FEATURE: scale up result count for search depending on model (#346)
We were limiting to 20 results unconditionally cause we had to make
sure search always fit in an 8k context window.

Models such as GPT 3.5 Turbo (16k) and GPT 4 Turbo / Claude 2.1 (over 150k)
allow us to return a lot more results.

This means we have a much richer understanding cause context is far
larger.

This also allows a persona to tweak this number, in some cases admin
may want to be conservative and save on tokens by limiting results

This also tweaks the `limit` param which GPT-4 liked to set to tell
model only to use it when it needs to (and describes default behavior)
2023-12-11 16:54:16 +11:00
..
ai_bot FEATURE: scale up result count for search depending on model (#346) 2023-12-11 16:54:16 +11:00
ai_helper DEV: port directory structure to Zeitwerk (#319) 2023-11-29 15:17:46 +11:00
completions FIX: Don't echo prompt back on HF/TGI (#338) 2023-12-06 16:06:26 -03:00
database DEV: port directory structure to Zeitwerk (#319) 2023-11-29 15:17:46 +11:00
embeddings FIX: Handle truncation in HyDE search (#342) 2023-12-07 10:36:56 -03:00
inference FEATURE: implement GPT-4 turbo support (#345) 2023-12-11 14:59:57 +11:00
nsfw DEV: port directory structure to Zeitwerk (#319) 2023-11-29 15:17:46 +11:00
sentiment FEATURE: User sentiment on profile summary page (#329) 2023-12-04 18:17:43 -03:00
summarization FIX: Make FoldContent strategy more resilient when using models with low token count. (#341) 2023-12-06 19:00:24 -03:00
tasks/modules FEATURE: User sentiment on profile summary page (#329) 2023-12-04 18:17:43 -03:00
tokenizer DEV: port directory structure to Zeitwerk (#319) 2023-11-29 15:17:46 +11:00
toxicity DEV: port directory structure to Zeitwerk (#319) 2023-11-29 15:17:46 +11:00
chat_message_classificator.rb DEV: port directory structure to Zeitwerk (#319) 2023-11-29 15:17:46 +11:00
classificator.rb DEV: port directory structure to Zeitwerk (#319) 2023-11-29 15:17:46 +11:00
engine.rb DEV: port directory structure to Zeitwerk (#319) 2023-11-29 15:17:46 +11:00
post_classificator.rb DEV: port directory structure to Zeitwerk (#319) 2023-11-29 15:17:46 +11:00