discourse-ai/spec/shared
Rafael dos Santos Silva e457c687ca
FIX: OpenAI Tokenizer was failing to truncate mid emojis (#91)
* FIX: OpenAI Tokenizer was failing to truncate mid emojis

* Update spec/shared/tokenizer.rb

Co-authored-by: Joffrey JAFFEUX <j.jaffeux@gmail.com>

---------

Co-authored-by: Joffrey JAFFEUX <j.jaffeux@gmail.com>
2023-06-16 15:15:36 -03:00
..
inference FEATURE: disable smart commands on Claude and GPT 3.5 (#84) 2023-06-01 09:10:33 +10:00
chat_message_classificator_spec.rb DEV: Fix test (#43) 2023-04-18 15:43:10 -03:00
classificator_spec.rb DEV: DiscourseAI -> DiscourseAi rename to have consistent folders and files (#9) 2023-03-14 16:03:50 -03:00
post_classificator_spec.rb DEV: DiscourseAI -> DiscourseAi rename to have consistent folders and files (#9) 2023-03-14 16:03:50 -03:00
tokenizer.rb FIX: OpenAI Tokenizer was failing to truncate mid emojis (#91) 2023-06-16 15:15:36 -03:00