A little like that j-thing, only in Go.
Created Aug 29, 2012 · 14 years ago
Initial scrape in progress. Star history is complete for 280 of 34,157 repositories (0%). Totals grow as it runs.
Owner
14,987
Across indexed repos
5
Visible in Best of Go
A little like that j-thing, only in Go.
Created Aug 29, 2012 · 14 years ago
A simple and flexible web crawler that follows the robots.txt policies and crawl delays.
Created Jan 6, 2014 · 12 years ago
Polite, slim and concurrent web crawler.
Created Sep 19, 2012 · 14 years ago
tiny Go library to normalize URLs
Created Sep 19, 2012 · 14 years ago
Package rehttp implements a Go HTTP transport that handles retries.
Created Feb 15, 2016 · 10 years ago