10 alternatives to crawlee
apify/crawlee — Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Pup (26,261 stars, Apache-2.0, scraping, ui, integration).
These are the closest projects in the JustClaw-It index that we serve licence-cleared code from, ranked by relevance and by our code-quality score (1–10, the mean over each repo's graded components: completeness, code quality, deployability, reusability, strategic value). JustClaw-It also serves 528 licence-cleared components from apify/crawlee itself.
| # | Repo | Score | Licence | Stars |
|---|---|---|---|---|
| 1 | scrapy/scrapy | 4.7 | BSD-3-Clause | 65,030 |
| 2 | gocolly/colly | 4.7 | Apache-2.0 | 25,573 |
| 3 | d4vinci/scrapling | 7.4 | BSD-3-Clause | 89,704 |
| 4 | autoscrape-labs/pydoll | 7.1 | MIT | 7,129 |
| 5 | puppeteer/puppeteer | 7.7 | Apache-2.0 | 95,728 |
| 6 | ntegrals/openbrowser | 7.4 | MIT | 9,570 |
| 7 | microsoft/playwright-mcp | 5.1 | Apache-2.0 | 38,471 |
| 8 | browserbase/stagehand | 6.3 | MIT | 25,766 |
| 9 | puppeteer/replay | 4.6 | Apache-2.0 | 1,391 |
| 10 | madi-s/lead-generation | 5.1 | MIT | 674 |
The alternatives in detail
-
Scrapy, a fast high-level web crawling & scraping framework for Python.
-
Elegant Scraper and Crawler Framework for Golang
-
🕷️ A Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_d
-
Pydoll is a library for automating chromium-based browsers without a WebDriver, offering realistic interactions.score 7.1/10 · MIT permissive · 7,129 stars · 141 components · search them
-
JavaScript API for Chrome and Firefox
-
Let AI agents browse the web. An autonomous toolkit for browser-based AI agents.score 7.4/10 · MIT permissive · 9,570 stars · 82 components · search them
-
Playwright MCP server
-
The SDK to extract data and interact with any site on the web. Get started with Claude Code, Codex, Eve, Mastra, and more.
-
Library that provides an API to replay and stringify recordings created using Chrome DevTools Recorderscore 4.6/10 · Apache-2.0 permissive · 1,391 stars · 21 components · search them
-
Python script, which empowers people with no programming background to generate robust leads on a mass scale. This repo will be compiled of various versatile techniques used in lead generation.score 5.1/10 · MIT permissive · 674 stars · 19 components · search them
Licence data: JustClaw-It's per-repo licence policy. Is crawlee still maintained? Check it. Licence details: licence checker. Ranking data from 2026-10-27T23:04:12Z.
Want code like crawlee without the licence risk? JustClaw-It is an MCP server with 1,449,000+ licence-cleared, quality-scored code components. Search is free; every result carries its licence and attribution.
Remote MCP endpoint: https://justclaw.it.com/mcp (API key auth). Works with Claude Code, Cursor,
Codex, Windsurf and other MCP clients. A one-line CLI installer (@justclaw-it/cli) is coming.