discourse/discourse-ai
1
0
Fork 0
mirror of https://github.com/discourse/discourse-ai.git synced 2025-08-01 10:53:27 +00:00
Code Issues Packages Projects Releases Wiki Activity
1,454 Commits 44 Branches 0 Tags
Commit Graph

1 Commits

Author SHA1 Message Date
Rafael dos Santos Silva
d792919ddf
DEV: Move tokenizers to a gem (#1481) 
Also renames the Mixtral tokenizer to Mistral.

See gem at github.com/discourse/discourse_ai-tokenizers


Co-authored-by: Roman Rizzi <roman@discourse.org>
 2025-07-02 14:43:03 -03:00