eb93b21769
BAAI/bge-m3 is an interesting model, that is multilingual and with a context size of 8192. Even with a 16x larger context, it's only 4x slower to compute it's embeddings on the worst case scenario. Also includes a minor refactor of the rake task, including setting model and concurrency levels when running the backfill task. |
||
|---|---|---|
| .. | ||
| inference | ||
| chat_message_classificator_spec.rb | ||
| classificator_spec.rb | ||
| post_classificator_spec.rb | ||
| tokenizer_spec.rb | ||