discourse/discourse-ai
1
0
Fork 0
mirror of https://github.com/discourse/discourse-ai.git synced 2025-07-04 13:32:13 +00:00
Code Issues Packages Projects Releases Wiki Activity
1,430 Commits 40 Branches 0 Tags
Commit Graph

2 Commits

Author SHA1 Message Date
Rafael dos Santos Silva
d792919ddf
DEV: Move tokenizers to a gem (#1481) 
Also renames the Mixtral tokenizer to Mistral.

See gem at github.com/discourse/discourse_ai-tokenizers


Co-authored-by: Roman Rizzi <roman@discourse.org>
 2025-07-02 14:43:03 -03:00
Rafael dos Santos Silva
9dccc1eb93
FEATURE: Add Qwen3 tokenizer and update Gemma to version 3 (#1440) 2025-06-17 10:25:03 -03:00