LLMRankBot
LLMRankBot is the website audit crawler operated by LLMrank. It visits public pages that an LLMrank user has authorized for an AI-readiness and technical SEO audit.
Identification
Our crawler identifies its direct page requests with:
LLMRankBot/1.0 (+https://llmrank.app/bot)
Responsible crawl behavior
- Obeys the site's published robots.txt rules by default.
- Paces direct page requests within each audit, with a default of one request per second per domain. Performance audits may also load page resources in a controlled headless browser.
- Backs off when a site returns rate-limit or service errors.
- Caps each audit at the page limit selected for the account.
- Uses crawled content for the requested audit, not to train a general-purpose AI model.
Site owner controls
Site owners can control access through robots.txt. To block this crawler specifically, use:
User-agent: LLMRankBot
Disallow: /Contact
Questions or abuse reports can be sent to support@llmrank.app. Include the affected domain and approximate request time.