โ† Back to List
โš 
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
PythonD4Vinci/Scrapling

Scrapling

๐Ÿ•ท๏ธ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev

94.7/100
โ˜… 85.7KForks: 8.8K
View on GitHub โ†’Homepage โ†’
Loading report...

Similar Projects

crawlee-python

91

Crawleeโ€”A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Parsel, BeautifulSoup, Playwright, and raw HTTP. Both headful and headless mode. With proxy rotation.

Pythonโ˜… 9.6K

agentql

77

AgentQL is a suite of tools for connecting your AI to the web. Featuring a query language and Playwright integrations for interacting with elements and extracting data quickly, precisely, and at scale. Includes REST API, Python and JavaScript SDKs, browser debugger.

Pythonโ˜… 1.5K

crawl4ai

92

Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key.

Pythonโ˜… 84.8K

Scrapegraph-ai

87

Python scraper based on AI

Pythonโ˜… 31.5K
โ† Back to List