discourse-ai/tokenizers/README.md

mirror of https://github.com/discourse/discourse-ai.git synced 2025-02-17 17:04:48 +00:00
## bert-base-uncased.json

Licensed under Apache License

## claude-v1-tokenization.json

Licensed under MIT License
Refinements to embeddings and tokenizers (#61) * Refinements to embeddings and tokenizers * lint * Truncate with tokenizers for summary * fix 2023-05-15 15:10:42 -03:00			`## bert-base-uncased.json`

			`Licensed under Apache License`

			`## claude-v1-tokenization.json`

			`Licensed under MIT License`