discourse-ai/db
Rafael dos Santos Silva eb93b21769
FEATURE: Add BGE-M3 embeddings support (#569)
BAAI/bge-m3 is an interesting model, that is multilingual and with a
context size of 8192. Even with a 16x larger context, it's only 4x slower
to compute it's embeddings on the worst case scenario.

Also includes a minor refactor of the rake task, including setting model
and concurrency levels when running the backfill task.
2024-04-10 17:24:01 -03:00
..
fixtures FEATURE: AI helper support in non English languages (#489) 2024-02-27 16:31:51 -03:00
migrate FEATURE: Add BGE-M3 embeddings support (#569) 2024-04-10 17:24:01 -03:00
post_migrate FIX: Explicit check for empty string in compat migration (#463) 2024-02-07 14:51:51 -03:00