discourse-ai/lib
Sam b2b01185f2
FEATURE: add support for new OpenAI embedding models (#445)
* FEATURE: add support for new OpenAI embedding models

This adds support for just released text_embedding_3_small and large

Note, we have not yet implemented truncation support which is a
new API feature. (triggered using dimensions)

* Tiny side fix, recalc bots when ai is enabled or disabled

* FIX: downsample to 2000 items per vector which is a pgvector limitation
2024-01-29 13:24:30 -03:00
..
ai_bot FEATURE: add support for new OpenAI embedding models (#445) 2024-01-29 13:24:30 -03:00
ai_helper DEV: Fix various typos (#434) 2024-01-19 12:51:26 +01:00
automation DEV: Fix various typos (#434) 2024-01-19 12:51:26 +01:00
completions FEATURE: support gpt-4-0125 which was just released (#443) 2024-01-26 09:08:02 +11:00
database DEV: port directory structure to Zeitwerk (#319) 2023-11-29 15:17:46 +11:00
embeddings FEATURE: add support for new OpenAI embedding models (#445) 2024-01-29 13:24:30 -03:00
inference FEATURE: add support for new OpenAI embedding models (#445) 2024-01-29 13:24:30 -03:00
nsfw DEV: Fix various typos (#434) 2024-01-19 12:51:26 +01:00
sentiment FIX: Truncate content for sentiment/toxicity classification (#431) 2024-01-17 15:17:58 -03:00
summarization FEATURE: support gpt-4-0125 which was just released (#443) 2024-01-26 09:08:02 +11:00
tasks/modules FEATURE: Per post embeddings (#387) 2023-12-29 12:28:45 -03:00
tokenizer Mixtral (#376) 2023-12-26 14:49:55 -03:00
toxicity FIX: Truncate content for sentiment/toxicity classification (#431) 2024-01-17 15:17:58 -03:00
utils FEATURE: DNS SRV support for TEI (#363) 2023-12-18 13:21:21 -03:00
automation.rb FIX: typo in Automation::AVAILABLE_MODELS (#442) 2024-01-25 11:56:28 -03:00
chat_message_classificator.rb DEV: port directory structure to Zeitwerk (#319) 2023-11-29 15:17:46 +11:00
classificator.rb DEV: port directory structure to Zeitwerk (#319) 2023-11-29 15:17:46 +11:00
engine.rb DEV: port directory structure to Zeitwerk (#319) 2023-11-29 15:17:46 +11:00
post_classificator.rb DEV: port directory structure to Zeitwerk (#319) 2023-11-29 15:17:46 +11:00