Categories / Natural Language Processing

eliben

eliben / go-sentencepiece

Go implementation of the SentencePiece tokenizer

Last push 6 days ago

encoding go golang language-model llm sentencepiece tokenization

Created

Aug 2024

Total stars

51

7 days

0

30 days

0

12 months

+14

Star trends

README badge

Best of Go badge for eliben/go-sentencepiece
[![Best of Go](https://bestofgo.dev/badge/eliben/go-sentencepiece.svg)](https://bestofgo.dev/eliben/go-sentencepiece)