The API to search, scrape, and interact with the web at scale. 🔥

🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!

Give your AI agent eyes to see the entire internet. Read & search Twitter, Reddit, YouTube, GitHub, Bilibili, XiaoHongShu — one CLI, zero API fees.

Python scraper based on AI

🔥 The open-source no-code platform for web scraping, crawling, search and AI data extraction • Turn websites into structured APIs in minutes 🔥

A collection of awesome web crawler,spider in different languages

scrape data from Google Maps. Extracts data such as the name, address, phone number, website URL, rating, reviews number, latitude and longitude, reviews,email and more for each place

Self-hosted webscraper.

A list of practical knowledge-building projects.

Scrape Google AI Mode responses without blocks on a large scale.

PHP Curl Class makes it easy to send HTTP requests and integrate with web APIs

A Powerful web scraper powered by LLM | OpenAI, Gemini & Ollama

The process of extracting product data from Amazon using Python, including titles, ratings, prices, images, and descriptions.

Generate and download e-books from online sources.

Web Scraper in Go, similar to BeautifulSoup

A code for extracting best-selling items, search results, and currently available deals from Amazon using Python and Oxylabs E-Commerce Scraper API.

A guide for extracting titles, authors, and citations from Google Scholar using Python and Oxylabs SERP Scraper API.

Fast, local-first web content extraction for LLMs. Scrape, crawl, extract structured data — all from Rust. CLI, REST API, and MCP server.

CLI tool for saving a faithful copy of a complete web page in a single HTML file (based on SingleFile)

🚀 Stealth - Secure, Peer-to-Peer, Private and Automateable Web Browser/Scraper/Proxy