JustClaw-It · component browser
The same live search your agent gets over MCP: real components with their quality score, licence and source repo. Open one to inspect it.
50 live results for scraping
Provides a standard interface for simulating single-point tap gestures on a page viewport during automated testing.
Tags: scraping, Scraping / Crawling
Provides configuration options for launching a Chromium-based browser instance for automation tasks.
Tags: scraping
Provides Flow type definitions for the Puppeteer library to enable type checking and autocompletion during browser automation development.
Tags: scraping
Public barrel for @crawlee/core. Re-exports configuration, logging, proxy, requests, storage, and events, and keeps internal utils off the semver surface.
Tags: scraping, integration, lang:typescript, tag:crawlee, tag:barrel
Generates research prompts for ML assistants by adapting to available tools.
Tags: scraping
TypeScript definitions for Puppeteer configuration options, including cache, executable, and browser settings.
Tags: scraping
A modal dialog component used to alert users of issues or request confirmation for actions, supporting various alert types and primary or secondary actions.
Tags: scraping
Defines the interface for creating API request contexts to send HTTP requests without a browser page.
Tags: scraping, Scraping / Crawling
Defines extraction strategies: LLM, cosine similarity, topic modeling, CSS selectors for crawling content.
Tags: unclassified, scraping
Fluent builder for Playwright PHP BrowserContext options, enabling easy configuration of viewport, user agent, locale, etc.
Tags: scraping, Scraping / Crawling
Asynchronous web crawler managing browser sessions, crawling strategies, and crawl result aggregation.
Tags: unclassified, scraping
High-level Node.js API to control headless Chrome/Firefox via DevTools Protocol or WebDriver BiDi, including page, browser, frame, and network interception primitives.
Tags: scraping
This class manages Playwright browser lifecycle for async Python projects.
Tags: scraping, Scraping / Crawling
A Zod schema defining the input parameters for a Google Hotels search scraper, including search queries, dates, and localization settings.
Tags: scraping
Base class for Scrapy spiders, handling request scheduling and parsing.
Tags: scraping, Scraping / Crawling
Configure Playwright for multi-browser end-to-end testing in one file.
Tags: scraping
Re-exports Playwright browser launchers and utilities for easy import.
Tags: scraping
Entry point for Puppeteer, re-exporting core APIs and initializing node instance.
Tags: scraping
Provides functional options to configure a web scraper's behavior, such as depth, concurrency, and URL blacklisting.
Tags: scraping
Exports Playwright crawler classes for headless browser automation and scraping.
Tags: scraping, Scraping / Crawling
Python Page class for Playwright, providing browser page API.
Tags: scraping, Scraping / Crawling
Exports various HTTP, BeautifulSoup, and file download crawlers. Use when building web scraping and data extraction pipelines.
Tags: scraping, integration, lang:python
Evaluates whether a crawler is permitted to index or follow links on a webpage based on robots.txt headers and meta tags.
Tags: scraping, crm, tag:web
Provides an interface for asserting API response states like status codes and JSON body content during automated tests.
Tags: scraping, Scraping / Crawling
BrowserType class for launching and managing browsers in Playwright.
Tags: scraping
Starts Playwright driver process and returns API client.
Tags: scraping
Configuration object for Playwright element fill commands with optional force, noWaitAfter, and timeout settings
Tags: scraping, Scraping / Crawling
Re-exports Playwright core API as a module entry point.
Tags: scraping
Pure logic for single-target CDP bridge, handling commands and responses.
Tags: scraping
Playwright JSHandle implementation for evaluating JavaScript on pages.
Tags: scraping, Scraping / Crawling
* Based on Playwright's stackTrace.ts See: https://github.com/microsoft/playwright/blob/release-1.51/packages/playwright-core/src/utils/isomorphic/stackTrace.ts / eslint-disable ma
Tags: scraping
Parses and normalizes a backlinks research target into API/display forms, resolving scope, subdomain inclusion, and path prefix for DataForSEO backlink queries.
Tags: integration, scraping, crm, tag:dataforseo, tag:backlinks
Python EventEmitter implementation supporting async listeners and error reporting.
Tags: scraping, Scraping / Crawling
Provides a Selenium selector to find web elements by their associated label text. Use when writing robust UI test automation scripts.
Tags: testing, scraping, lang:java, tag:selenide, tag:selector
Configure Playwright's clear action on locators with timeout and force options.
Tags: scraping, Scraping / Crawling
Custom JSON encoder that serializes Scrapy items, requests, responses, datetimes, decimals, sets, and Deferreds. Reuse when exporting scraped data or logging Scrapy objects to JSON
Tags: scraping, tag:json, tag:serialization, tag:encoder, tag:items
Abstract base class for managing request queue resources within a storage client. Reuse when implementing custom storage backends for web crawling request queues.
Tags: scraping, database, lang:python, tag:crawlee, tag:abstract-class
Normalizes, canonicalizes, and compares URLs for crawler deduplication, including query sorting, hostname handling, and URL template detection.
Tags: integration, scraping, crm, tag:url, tag:normalization
Convenience static methods for building Selenium By selectors in Java.
Tags: scraping, Scraping / Crawling
Represents screenshot data including image file, URL, and page source for test reporting. Reuse in automated testing frameworks for visual test artifacts.
Tags: testing, scraping, lang:java, tag:screenshots
Validates specific cookie name and value pairs on Selenium WebDriver instances. Use in UI test automation suites for verifying browser cookies.
Tags: testing, scraping, lang:java, tag:webdriver
Parses browser-related inputs like cookies and headers into structured Playwright context configuration objects.
Tags: scraping
Checks if a path is a Windows absolute path for cross-platform handling
Tags: scraping
Python wrapper for Playwright file chooser, allowing file selection in tests.
Tags: scraping, Scraping / Crawling
Production Playwright config template with CI/CD auth and reporting.
Tags: scraping
Represents a DOM element handle in Playwright for browser automation.
Tags: scraping, Scraping / Crawling
Defines a custom web element condition using a boolean predicate. Use in Selenium/Selenide tests for custom assertions on elements.
Tags: testing, scraping, lang:java, tag:selenide
Ported TypeScript type constants including lifecycle events for Playwright's Python client internal type system.
Tags: scraping, testing, dev-tools, automation, lang:python
Represents a browser frame in Playwright, providing navigation and element handling.
Tags: scraping, Scraping / Crawling
Core assertion utilities for Playwright Python, enabling expect-style matchers.
Tags: scraping, Scraping / Crawling