Rafael dos Santos Silva 3c9513e754
Refinements to embeddings and tokenizers (#61)
* Refinements to embeddings and tokenizers

* lint

* Truncate with tokenizers for summary

* fix
2023-05-15 15:10:42 -03:00

8 lines
117 B
Markdown

## bert-base-uncased.json
Licensed under Apache License
## claude-v1-tokenization.json
Licensed under MIT License