ai-crawler-py
Crawl a website starting from a URL, find relevant pages, and extract data – all guided by your natural language prompt.
Claim its page: indexed whatever its rank, translated into six languages, and enriched with what you write yourself.
Crawl a website starting from a URL, find relevant pages, and extract data – all guided by your natural language prompt.
What is ai-crawler-py?
Crawl a website starting from a URL, find relevant pages, and extract data – all guided by your natural language prompt.
Is ai-crawler-py open source?
ai-crawler-py is an open-source project.
Is ai-crawler-py free?
Yes. ai-crawler-py is free and open source — you can use, modify and self-host it.
Add this live badge to your README — your GitHub stars and directory rank, refreshed daily.
[](https://olud.ai/project/oxylabs-ai-crawler-py.html)
Measured from GitHub topics shared by both projects, weighted by how rare each topic is.