Best Email Finders
Home / Web scraping APIs

Scrapy

Python framework for crawling and extraction

Scrapy is an open-source Python framework for crawling websites and extracting structured data. It provides spiders, item pipelines and middleware, and is maintained by Zyte and contributors.

scrapingpythoncrawlerframework
Scrapy alternatives

More in Web scraping APIs

Featured

Apify

Web scraping APIs

Scraping and automation platform with a scraper store

Freemiumscrapingautomation
Featured

Firecrawl

Web scraping APIs

Turn websites into markdown or structured data

Freemiumscrapingllm

Bright Data

Web scraping APIs

Proxies, scraping APIs and ready-made datasets

Paidproxiesscraping

Browserbase

Web scraping APIs

Cloud headless browsers for agents

Freemiumheadless-browseragents

Crawl4AI

Web scraping APIs

Open-source crawler that outputs LLM-ready markdown

Open sourcescrapingllm

Crawlee

Web scraping APIs

Scraping and browser automation library

Open sourcescrapingnode