Categories / Text Processing

bzick

bzick / tokenizer

Tokenizer (lexer) for anything

Last push 3 weeks ago

Created

Oct 2021

Total stars

143

7 days

+1

30 days

+1

12 months

+7

Star trends

README badge

Best of Go badge for bzick/tokenizer
[![Best of Go](https://bestofgo.dev/badge/bzick/tokenizer.svg)](https://bestofgo.dev/bzick/tokenizer)