discourse-ai/spec
Sam dcafc8032f
FIX: improve embedding generation (#452)
1. on failure we were queuing a job to generate embeddings, it had the wrong params. This is both fixed and covered in a test.
2. backfill embedding in the order of bumped_at, so newest content is embedded first, cover with a test
3. add a safeguard for hidden site setting that only allows batches of 50k in an embedding job run

Previously old embeddings were updated in a random order, this changes it so we update in a consistent order
2024-01-31 10:38:47 -03:00
..
fabricators FEATURE: UI to update ai personas on admin page (#290) 2023-11-21 16:56:43 +11:00
fixtures/embeddings FEATURE: Embeddings to main db (#99) 2023-07-13 12:41:36 -03:00
jobs FIX: improve embedding generation (#452) 2024-01-31 10:38:47 -03:00
lib FIX: improve embedding generation (#452) 2024-01-31 10:38:47 -03:00
models DEV: Update linting (#423) 2024-01-13 00:28:06 +01:00
requests UX: Validations to LLM-backed features (except AI Bot) (#436) 2024-01-29 16:04:25 -03:00
serializers Revert "FIX: Use Guardian.basic_user instead of new (anon) (#332)" (#337) 2023-12-06 16:26:43 +10:00
shared FEATURE: add support for new OpenAI embedding models (#445) 2024-01-29 13:24:30 -03:00
support FEATURE: Move the default embeddings model to bge-large-en (#417) 2024-01-11 14:16:25 -03:00
system UX: Validations to LLM-backed features (except AI Bot) (#436) 2024-01-29 16:04:25 -03:00
plugin_spec.rb DEV: Update linting (#423) 2024-01-13 00:28:06 +01:00