Hi everyone! I built Crawly because I needed a good API to directly ask questions about any webpage or even an entire website. But that’s not all—I also wanted high-quality full-page screenshots in the response. Everything is neatly structured through one simple API.

The idea is simple: provide a link, specify what you want, and get a real-time response.

I’m planning to add many new features soon, including different models and deeper crawling to extract more information from websites.

Right now, you can ask about a specific page or an entire website. In the latter case, Crawly will automatically fetch 5–10 of the most important pages and include them in the context.

I hope it will be useful for developers!

Crawly

Smart Parser and Screenshot API

Do you use Crawly?

Review Crawly?