Evidence first.
Uncertainty visible.
A dated account of the public response, with each finding tied to its source.
Method in one sentence
SeeingOwl requests a public page and its discovery files, then reports what those responses support.
Observation states
Observed
Direct evidence answered the narrow question, such as a canonical link or sitemap response.
Needs attention
A useful signal was absent, malformed, or returned an error.
Blocked
A matching robots.txt rule or noindex directive restricted the examined behavior.
Unknown
The public response could not answer the question reliably.
Request method
- Only public HTTP and HTTPS domains on standard ports are accepted.
- Private targets, IP literals, URL credentials, and unsafe redirects are rejected.
- Requests follow up to four safe redirects and limit response time and size.
- The submitted page, robots.txt, llms.txt, and one declared or conventional sitemap are examined.
- Geography, WAF rules, rendering, cookies, or timing may change another crawler's response.
No overall score
Reachability, identity, directives, crawler rules, and optional files are unlike signals. A combined number would require defensible weights. SeeingOwl shows each result separately.
What the examination cannot prove
It cannot prove crawler visits, index inclusion, retrieval, citations, recommendations, traffic, or conversions. Access logs show requests; Google Search Console and Bing Webmaster Tools provide their own search evidence.
Source policy
Named crawler tokens link to current provider documentation and carry a review date. Changed definitions are updated rather than preserved for search traffic.
- Robots Exclusion Protocol, RFC 9309 ↗Protocol behavior for robots.txt parsing.
- OpenAI crawler documentation ↗Token purposes and published IP sources.
- Anthropic crawler documentation ↗Token purposes and robots.txt guidance.
- Perplexity crawler documentation ↗Search and user-requested fetchers.
- Google crawler documentation ↗Google-Extended purpose and scope.
Review date
Method and sources reviewed 28 August 2026. Provider definitions can change; follow the linked sources for current rules. Scans carry their own time.
Check your site.
See the observation beside each finding.