# web-scraping

Headless browser cloud built for AI agents

Browserbase is cloud infrastructure that runs headless Chromium browsers on demand for AI agents and automation workflows, exposing Playwright, Puppeteer, and Selenium endpoints with built-in session replay, residential proxies, CAPTCHA solving, and stealth fingerprints. It also hosts Stagehand and a Model Gateway, letting teams build browser-using agents without maintaining their own fleet of Kubernetes-managed Chromium instances.

Adaptive web scraping library with anti-bot evasion and smart selectors

Scrapling is a Python web scraping library that uses adaptive selectors and anti-bot evasion techniques to extract data from websites reliably. It generates selectors that survive website layout changes by understanding element context rather than relying on brittle CSS paths. Features stealth browser automation, automatic retry logic, and proxy rotation. 65K+ GitHub stars.

No-code AI web scraping platform with visual workflow builder

Maxun is a no-code web scraping platform that uses AI to extract structured data from websites through a visual workflow builder. Users point and click on the data they want to extract, and Maxun generates resilient scraping workflows that handle pagination, authentication, and dynamic content. Features anti-bot detection avoidance, scheduled runs, and API access for integration. Over 15,300 GitHub stars.

AI-powered web browser automation with Playwright

Stagehand is an open-source browser-agent SDK from Browserbase that combines deterministic browser automation with AI primitives such as act(), extract(), observe(), and agent(). Instead of relying only on brittle selectors, developers can use natural-language actions, Zod-backed structured extraction, page observation, action caching, and Browserbase cloud-browser infrastructure for production web automation.