This website requires JavaScript.
Explore
Help
Sign In
discourse
/
discourse-ai
Watch
1
Star
0
Fork
0
You've already forked discourse-ai
mirror of
https://github.com/discourse/discourse-ai.git
synced
2025-03-07 17:59:56 +00:00
Code
Issues
Packages
Projects
Releases
Wiki
Activity
discourse-ai
/
lib
/
tokenizer
History
Rafael dos Santos Silva
3502f0f1cd
FEATURE: GPT4o Tokenizer (
#721
)
2024-07-22 15:26:14 -03:00
..
all_mpnet_base_v2_tokenizer.rb
…
anthropic_tokenizer.rb
…
basic_tokenizer.rb
FEATURE: Set endpoint credentials directly from LlmModel. (
#625
)
2024-05-16 09:50:22 -03:00
bert_tokenizer.rb
…
bge_large_en_tokenizer.rb
…
bge_m3_tokenizer.rb
…
llama3_tokenizer.rb
FEATURE: Llama 3 tokenizer (
#615
)
2024-05-13 12:45:52 -03:00
mixtral_tokenizer.rb
…
multilingual_e5_large_tokenizer.rb
…
open_ai_gpt4o_tokenizer.rb
FEATURE: GPT4o Tokenizer (
#721
)
2024-07-22 15:26:14 -03:00
open_ai_tokenizer.rb
FEATURE: allow tuning of RAG generation (
#565
)
2024-04-12 10:32:46 -03:00
