RotaRank Bot

What it is

RotaRank Bot is the technical SEO audit crawler of Rota.Rank, a RotaLabs product. It only visits a website after a Rota.Rank user adds that site as a project and starts an audit, either manually or on a schedule. It does not index content for search engines.

What it accesses

The crawler reads robots.txt, XML sitemaps and the site's public HTML pages, and extracts technical data: HTTP status, title, meta description, headings, canonical, links and similar signals. It does not submit forms, does not log in and does not run JavaScript. At the end of each audit it checks the HTTP status of up to 60 external links found on the pages, to report broken links.

Frequency and pace

The crawler works in batches of 5 pages at roughly 20 requests per minute, and gives up on a page after 10 seconds. Each audit visits at most 100, 500 or 1,500 pages, depending on the user's plan. A single project gets at most 4 audits per month; the Pro plan runs an automatic audit every 7 days.

How to block it

The crawler follows Disallow rules in robots.txt under "User-agent: *" and "User-agent: RotaRank". Changes apply from the project's next audit.

To block only RotaRank Bot, add this to your site's robots.txt:

User-agent: RotaRank
Disallow: /

To block a single folder:

User-agent: RotaRank
Disallow: /private/

Contact

If the crawler is causing problems on your website, email contato@rotalabs.co with the domain and, if possible, the time of the requests. We will look into it and reply.