1d786fbaaf
* FEATURE: Set endpoint credentials directly from LlmModel. Drop Llama2Tokenizer since we no longer use it. * Allow http for custom LLMs --------- Co-authored-by: Rafael Silva <xfalcox@gmail.com> |
||
|---|---|---|
| .. | ||
| all_mpnet_base_v2_tokenizer.rb | ||
| anthropic_tokenizer.rb | ||
| basic_tokenizer.rb | ||
| bert_tokenizer.rb | ||
| bge_large_en_tokenizer.rb | ||
| bge_m3_tokenizer.rb | ||
| llama3_tokenizer.rb | ||
| mixtral_tokenizer.rb | ||
| multilingual_e5_large_tokenizer.rb | ||
| open_ai_tokenizer.rb | ||