Free AI Crawler Log Analyzer Which AI crawlers really read your pages?

Paste your server logs or drop the file. You'll see which AI crawlers came, which pages they read, where they hit errors, and which visits came from fake bots.

Why look at AI crawlers in your logs

Your server logs are the only place where you can see AI crawlers actually at work: which ones come, how often, which pages they read and which ones fail. A robots.txt only says who may come in. The logs say who came.

Many visits that claim to be GPTBot or ChatGPT-User don't come from OpenAI at all. This analyzer checks each visit against the IP ranges the operators publish, leaves the fakes out of the totals, and gives you the pages read, the errors and the trend over time. Everything runs in your browser: your logs are never uploaded.

Frequently asked questions

Are my logs sent anywhere?

No. The file is read and analyzed by your browser, on your computer. Nothing is uploaded or stored, and IP addresses never appear in the results or in the CSV export.

Which log formats work?

Nginx and Apache access logs in the combined format, JSON lines (one JSON object per line, as most hosting and CDN log exports produce), and simple CSV files with a header row. The format is detected for you. Up to 200,000 lines are analyzed at a time.

How do you tell a real crawler from a fake one?

By its IP address. OpenAI, Google, Perplexity, Anthropic, Apple, Amazon and others publish the address ranges their crawlers use. A visit that claims to be one of them from elsewhere is marked fake and left out of the totals. Some operators publish nothing: their visits stay unverifiable.

Does a visit from a crawler mean I'll be cited?

No. A visit means the crawler could fetch the page, not that an assistant will quote it. Perplexity, for example, often answers from its own index without coming back.

Why don't I see Gemini?

Google's AI crawling is done by Googlebot, and when Gemini opens a page live for someone, the visit only says "Google". Both appear under Google in the results.

Free tools →