Crawler Verify Tool
Verify crawler traffic from your logs
Paste an IP and optional user-agent to tell whether the request is a verified crawler, a known-but-unverified crawler, or not a recognized crawler at all.
What gets verified
IPBot checks known crawler ranges first, then adds the strongest verification method available: reverse and forward DNS for Google or Bing, and IP-range plus user-agent token checks for OpenAI-family traffic.
Why site owners use it
It removes the ambiguity between search crawlers, training crawlers, and user-triggered fetchers so SEO, support, and WAF teams can make decisions from the same evidence.
What to do next
Use the result to decide whether to allow, rate-limit, or separately route the traffic, then move to the crawler hub for provider-specific guidance.
Open crawler hub