Categories / Security Tools

A command-line tool for recursively spidering webpages for URLs. It works by actively traversing websites, following links embedded in webpages, and parsing files (including sitemaps & robots.txt), to uncover every URL.

Last push 3 days ago

Created

Jul 2021

Total stars

110

7 days

0

30 days

0

12 months

+8

Star trends

README badge

Best of Go badge for hueristiq/xcrawl3r
[![Best of Go](https://bestofgo.dev/badge/hueristiq/xcrawl3r.svg)](https://bestofgo.dev/hueristiq/xcrawl3r)