spider
Repositories
48
Total stars
75,217
Trending
Golang短视频去水印:抖音,皮皮虾,火山,微视,最右,快手,全民小视频,皮皮搞笑,西瓜视频,虎牙,梨视频,acfun,好看视频...
Created Jul 2022
Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台,支持任何语言和框架
Created Feb 2019
小说下载|小说爬取|起点|笔趣阁|导出Markdown|导出txt|转换epub|广告过滤|自动校对
Created Mar 2019
Gospider - Fast web spider written in Go
Created Jan 2020
A tool for download asmr media from asmr.one(Thanks for the asmr.one)
Created Feb 2023
Golang Crawling and scraping framework
Created Mar 2023
Top
Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台,支持任何语言和框架
Created Feb 2019
Gospider - Fast web spider written in Go
Created Jan 2020
A download tools for clawing the ebooks from internets.
Created Apr 2022
Golang短视频去水印:抖音,皮皮虾,火山,微视,最右,快手,全民小视频,皮皮搞笑,西瓜视频,虎牙,梨视频,acfun,好看视频...
Created Jul 2022
小说下载|小说爬取|起点|笔趣阁|导出Markdown|导出txt|转换epub|广告过滤|自动校对
Created Mar 2019
Signal 18 repman - Replication Manager for MySQL / MariaDB / Percona Server
Created Oct 2015
GoScrapy: High perfomance webscraping framework in Go, inspired by Python's Scrapy.
Created Jul 2023
🕷️ An easy-to-use spider written in Golang. (previous named GOPA.)
Created Jul 2017
golang spider Crawler 爬虫 电影
Created Dec 2019
A fast tool to fetch URLs from HTML attributes by crawl-in.
Created Nov 2020
A tool for download asmr media from asmr.one(Thanks for the asmr.one)
Created Feb 2023
Golang Crawling and scraping framework
Created Mar 2023
一个 Golang 实现的相对智能、无需规则维护的通用新闻网站数据提取工具库。含域名探测、网页编码语种识别、网页链接分类提取、网页新闻要素抽取以及新闻正文抽取等组件。
Created Jul 2022
[https://www.sofineday.com], golang项目开发脚手架,集成最佳实践(gin+gorm+go-redis+mongo+cors+jwt+json日志库zap(支持日志收集到kafka或mongo)+消息队列kafka+微信支付宝支付gopay+api加密+api反向代理+go modules依赖管理+headless爬虫chromedp+makefile+二进制压缩+livereload热加载)
Created Aug 2019
一款分布式爬虫平台,帮助你更好的管理和开发爬虫。 内置一套爬虫定义规则(模版),可使用模版快速定义爬虫,也可当作框架手动开发爬虫。(兴趣使然的项目,用的不爽了就更新)
Created Oct 2017
A web crawling framework implemented in Golang, it is simple to write and delivers powerful performance. It comes with a wide range of practical middleware and supports various parsing and storage methods. Additionally, it supports distributed deployment. 基于golang实现的爬虫框架,编写简单,性能强劲。内置了丰富的实用中间件,支持多种解析、保存方式,支持分布式部署。
Created Apr 2023
文章采集工具 Article collection tool
Created Feb 2021
Grabs all of the audio files from all of the Blinkist books
Created Jan 2019
GOPA, a spider written in Go.(NOTE: this project moved to https://github.com/infinitbyte/gopa )
Created Jul 2013
Golang module to detect bots and crawlers via the user agent
Created Aug 2020
gathertool是golang脚本化开发库,目的是提高对应场景程序开发的效率;轻量级爬虫库,接口测试&压力测试库,DB操作库等。
Created Apr 2021