Categories / Text Processing

jimsmart

jimsmart / grobotstxt

grobotstxt is a native Go port of Google's robots.txt parser and matcher library.

Last push 4 years ago

go robots-exclusion-protocol robots-txt

Created

Apr 2020

Total stars

114

7 days

0

30 days

0

12 months

+2

Star trends

README badge

Best of Go badge for jimsmart/grobotstxt
[![Best of Go](https://bestofgo.dev/badge/jimsmart/grobotstxt.svg)](https://bestofgo.dev/jimsmart/grobotstxt)