GitHub topics

webscraping

Mostly in Text Processing 25%

Repositories

12

Total stars

3,740

Trending

browserutils

Go code to read cookies from browser cookie stores.

Created Dec 2017

browser cookies firefox go golang
Total 310
30 days +15
anaskhan96

Web Scraper in Go, similar to BeautifulSoup

Created Feb 2017

beautifulsoup go golang html-node web-scraper
Total 2,305
30 days +5
Hyper-Solutions

Go SDK for Bot Protection Bypass - Automate Akamai, Incapsula, Kasada, and DataDome. No browsers required. Solve challenges and generate valid sensors/cookies via API.

Created Dec 2023

akamai antibot api automation bot
Total 71
30 days +1
williamsjokvist

Realtime tracking of ranked matches in Street Fighter 6 and Tekken 8

Created Sep 2019

react server-sent-events sqlite street-fighter tekken
Total 91
30 days +1
DedSecInside

Concurrent Go web crawler with first-class Tor SOCKS5 support, a CLI, versioned JSON reports, and a job-controlled HTTP API.

Created Jun 2018

cli command-line command-line-tool docker go
Total 175
30 days +1

Top

anaskhan96

Web Scraper in Go, similar to BeautifulSoup

Created Feb 2017

beautifulsoup go golang html-node web-scraper
Total 2,305
browserutils

Go code to read cookies from browser cookie stores.

Created Dec 2017

browser cookies firefox go golang
Total 310
cornelk

Web scraper that can create an offline readable version of a website

Created Feb 2017

go golang scraper webscraping
Total 218
DedSecInside

Concurrent Go web crawler with first-class Tor SOCKS5 support, a CLI, versioned JSON reports, and a job-controlled HTTP API.

Created Jun 2018

cli command-line command-line-tool docker go
Total 175
cecobask

Automatic sync from IMDb to Trakt (watchlist, lists, ratings and history) using GitHub actions.

Created Apr 2022

github-actions golang imdb trakt webscraping
Total 131
tonywangcn

27.6% of the Top 10 Million Sites are Dead

Created Oct 2024

domain kubernetes scraper terraform webscraping
Total 118
siongui

Download/access photos, videos, stories, story highlights, postlives, following and followers of Instagram

Created Feb 2018

downloader go golang gopherjs instagram
Total 115
williamsjokvist

Realtime tracking of ranked matches in Street Fighter 6 and Tekken 8

Created Sep 2019

react server-sent-events sqlite street-fighter tekken
Total 91
dewey

Plugin based RSS feed generator for sites that don't offer any. Serves RSS, Atom and JSON Feeds.

Created Aug 2018

atom-feed jsonfeed-generator rss rss-generator scraping
Total 89
Hyper-Solutions

Go SDK for Bot Protection Bypass - Automate Akamai, Incapsula, Kasada, and DataDome. No browsers required. Solve challenges and generate valid sensors/cookies via API.

Created Dec 2023

akamai antibot api automation bot
Total 71
bosniankicks

A Golang based Undetected Web Automation Framework

Created Jan 2025

akamai anti antibot bot browser
Total 62
supacrawler

Supacrawler's ultralight engine for scraping and crawling the web. Written in go for maximum performance and concurrency.

Created Aug 2025

crawling playwright rag rag-chatbot webscraping
Total 55

Related

All topics →