About SeoAuditBot
SeoAuditBot fetches pages of a website only when a visitor of this site asks for an audit of that address. It identifies itself in every request:
Mozilla/5.0 (compatible; SeoAuditBot/1.0; +https://seo.161.104.56.57.nip.io/bot)
What it does
- Reads robots.txt first and respects Disallow rules for inner pages (the home page the visitor asked about is always fetched).
- Fetches at most 25 HTML pages per audit, two at a time, with a delay between requests; a Crawl-delay in robots.txt is honoured.
- Audits the same site at most once per 24 hours — a second request within that window reuses the existing report.
- Reads at most 2 MB per page and gives up on a page after 20 seconds.
- Never submits forms, never executes JavaScript, never logs in.
How to opt out
Add this to your robots.txt and the crawler will fetch nothing beyond the page that was requested:
User-agent: SeoAuditBot Disallow: /
To have an existing report removed, contact the operator of this site.