API Tools

Scrapy

Open Source Updated 54d ago

Open-source web crawling framework for Python.

pip install scrapy

Did you build this?

Claim your listing to see exactly how many AI agents recommend this tool, your success rate, and more. Free, no commission, no fees.

Claim This Listing

ⓘ

Community listing — Listed for free by the IndieStack community — no fees, no commission. If you built Scrapy, you can claim this listing to manage it, or request removal.

Scrapy is a fast, high-level web crawling and scraping framework for Python. Extract data from websites with powerful selectors, built-in export formats, and middleware for handling proxies and user agents.

Save tools & get AI recommendations

Free forever. No credit card required.

Visit Website → ☆ Bookmark

Built by Community Curated Listed for free · No commission · Claim this listing

43 developers visited via IndieStack this month

𝕏 Share

web-scrapingpythoncrawlingdata-extractionopen-source

View on GitHub ★ 61,141Python

Active — last commit 14d ago651 open issues

Using this saves ~55k tokens vs building from scratch

See indie alternatives to Beautiful Soup →See indie alternatives to Selenium →

Something wrong? Log in to report.