grobotstxt is a native Go port of Google's robots.txt parser and matcher library.
Last push 4 years ago
go
robots-exclusion-protocol
robots-txt
Created
Apr 2020
Total stars
114
Last 7 days
0
Last 30 days
0
Last 12 months
+2
README badge
[](https://bestofgo.dev/jimsmart/grobotstxt)