discourse/discourse-ai
1
0
Fork 0
mirror of https://github.com/discourse/discourse-ai.git synced 2025-08-07 05:33:47 +00:00
Code Issues Packages Projects Releases Wiki Activity
70 Commits 44 Branches 0 Tags
Commit Graph

2 Commits

Author SHA1 Message Date
Sam
e76fc77189
fixes (#53) 
* Minor... use username suggester in case username already exists

* FIX: ensure we truncate long prompts

Previously we

1. Used raw length instead of token counts for counting length
2. We totally dropped a prompt if it was too long

New implementation will truncate "raw" if it gets too long maintaining
meaning.
 2023-05-06 07:31:53 -03:00
Rafael dos Santos Silva
9783e3b025
FEATURE: Add a basic tokenizer API (#37) 
* FEATURE: Add a basic tokenizer API

* Add tests

* lint
 2023-04-19 11:55:59 -03:00