← Back to List
⚠
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
TypeScriptapify/crawlee

crawlee

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

93.7/100
★ 26.0KForks: 1.7K
View on GitHub →Homepage →
Loading report...

Similar Projects

firecrawl

95

Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥

TypeScript★ 188.6K

crawlee-python

91

Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Parsel, BeautifulSoup, Playwright, and raw HTTP. Both headful and headless mode. With proxy rotation.

Python★ 9.6K

spider

87

Foundational low latency web data collecting in Rust

Rust★ 2.8K

n8n

97

Fair-code workflow automation platform with native AI capabilities. Combine visual building with custom code, self-host or cloud, 400+ integrations.

TypeScript★ 206.7K
← Back to List