10 alternatives to unclecode/crawl4ai
unclecode/crawl4ai — Official Crawl4AI Cloud: a hosted web scraping, extraction, and search API for AI agents. Free API key, 1,000 credits a month, no card. Fully open source: this repo is the Apache-2.0 crawler that powers it, and you can self-host it. (86,946 stars, Apache-2.0, scraping, database, auth).
These are the closest projects in the JustClaw-It index that we serve licence-cleared code from, ranked by relevance and by our code-quality score (1–10, the mean over each repo's graded components: completeness, code quality, deployability, reusability, strategic value). JustClaw-It also serves 101 licence-cleared components from unclecode/crawl4ai itself.
| # | Repo | Score | Licence | Stars |
|---|---|---|---|---|
| 1 | apify/crawlee-python | 5.2 | Apache-2.0 | 9,626 |
| 2 | apify/crawlee | 5.2 | Apache-2.0 | 26,261 |
| 3 | brettdavies/crawl4ai-skill | 6.5 | Apache-2.0 | 49 |
| 4 | vectifyai/pageindex | 6.5 | MIT | 39,696 |
| 5 | coder-hxl/x-crawl | 7.5 | MIT | 1,890 |
| 6 | d4vinci/scrapling | 7.4 | BSD-3-Clause | 89,704 |
| 7 | scrapegraphai/scrapegraph-ai | 6.5 | MIT | 32,239 |
| 8 | scrapy/scrapy | 6.8 | BSD-3-Clause | 65,030 |
| 9 | gocolly/colly | 6.8 | Apache-2.0 | 25,573 |
| 10 | browser-use/browser-use | 7.0 | MIT | 119,124 |
The alternatives in detail
-
Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Parsel, Beautiscore 5.2/10 · Apache-2.0 permissive · 9,626 stars · 424 components · search them
-
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websscore 5.2/10 · Apache-2.0 permissive · 26,261 stars · 528 components · search them
-
Scrape JavaScript-heavy sites and extract structured data via reusable CSS schemas. Portable agent skill wrapping the Crawl4AI CLI and Python SDK.score 6.5/10 · Apache-2.0 permissive · 49 stars · 6 components · search them
-
📑 PageIndex: Document Index for Vectorless, Reasoning-based RAG
-
Flexible Node.js crawler libraryscore 7.5/10 · MIT permissive · 1,890 stars · 12 components · search them
-
🕷️ A Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_d
-
Python scraper based on AIscore 6.5/10 · MIT permissive · 32,239 stars · 127 components · search them
-
Scrapy, a fast high-level web crawling & scraping framework for Python.
-
Elegant Scraper and Crawler Framework for Golangscore 6.8/10 · Apache-2.0 permissive · 25,573 stars · 43 components · search them
-
Open-source Python library for AI browser agents, plus Browser Use Cloud: stealth browsers and a hosted agent API.
Licence data: JustClaw-It's per-repo licence policy. Is unclecode/crawl4ai still maintained? Check it. Licence details: licence checker. Ranking data from 2026-11-05T20:19:43Z.
Want code like unclecode/crawl4ai without the licence risk? JustClaw-It is an MCP server with 3,425,000+ licence-cleared, scored code components. Search is free; every result carries its licence and attribution.
Remote MCP endpoint: https://justclaw.it.com/mcp (API key auth). Works with Claude Code, Cursor,
Codex, Windsurf and other MCP clients. A one-line CLI installer (@justclaw-it/cli) is coming.