8 alternatives to D4Vinci/Scrapling
d4vinci/scrapling — 🕷️ A Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev (89,704 stars, BSD-3-Clause, files, scraping, ai).
These are the closest projects in the JustClaw-It index that we serve licence-cleared code from, ranked by relevance and by our code-quality score (1–10, the mean over each repo's graded components: completeness, code quality, deployability, reusability, strategic value). JustClaw-It also serves 54 licence-cleared components from d4vinci/scrapling itself.
| # | Repo | Score | Licence | Stars |
|---|---|---|---|---|
| 1 | scrapy/scrapy | 4.7 | BSD-3-Clause | 65,030 |
| 2 | scrapegraphai/scrapegraph-ai | 4.8 | MIT | 32,239 |
| 3 | apify/crawlee-python | 4.5 | Apache-2.0 | 9,626 |
| 4 | gocolly/colly | 4.7 | Apache-2.0 | 25,573 |
| 5 | apify/crawlee | 4.8 | Apache-2.0 | 26,261 |
| 6 | assafelovic/gpt-researcher | 6.2 | Apache-2.0 | 30,219 |
| 7 | ameshkov/mcp-compress-router | 5.9 | MIT | 21 |
| 8 | jina-ai/mcp | 1.8 | Apache-2.0 | 892 |
The alternatives in detail
-
Scrapy, a fast high-level web crawling & scraping framework for Python.
-
Python scraper based on AI
-
Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Parsel, Beautiscore 4.5/10 · Apache-2.0 permissive · 9,626 stars · 424 components · search them
-
Elegant Scraper and Crawler Framework for Golang
-
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from webs
-
An autonomous agent that conducts deep research on any data using any LLM providers
-
Compress all connected MCP into a single router MCP and save up to 99% on tokensscore 5.9/10 · MIT permissive · 21 stars · 125 components · search them
-
Official Jina AI Remote MCP Serverscore 1.8/10 · Apache-2.0 permissive · 892 stars · 10 components · search them
Licence data: JustClaw-It's per-repo licence policy. Is D4Vinci/Scrapling still maintained? Check it. Licence details: licence checker. Ranking data from 2026-10-29T06:21:36Z.
Want code like D4Vinci/Scrapling without the licence risk? JustClaw-It is an MCP server with 1,518,000+ licence-cleared, quality-scored code components. Search is free; every result carries its licence and attribution.
Remote MCP endpoint: https://justclaw.it.com/mcp (API key auth). Works with Claude Code, Cursor,
Codex, Windsurf and other MCP clients. A one-line CLI installer (@justclaw-it/cli) is coming.