Crawlee
Scraping and browser automation library
Crawlee is an open-source web scraping and browser automation library for Node.js and Python. It manages request queues, proxy rotation and retries and works with Playwright, Puppeteer and Cheerio.
More in Web scraping APIs
Featured





Apify
Web scraping APIs
Scraping and automation platform with a scraper store
FeaturedFirecrawl
Web scraping APIs
Turn websites into markdown or structured data
Bright Data
Web scraping APIs
Proxies, scraping APIs and ready-made datasets
Browserbase
Web scraping APIs
Cloud headless browsers for agents
Crawl4AI
Web scraping APIs
Open-source crawler that outputs LLM-ready markdown
Jina Reader
Web scraping APIs
Convert any URL to LLM-friendly text