SEO tool crawler · Semrush
RyteBot user agent, IP ranges and robots.txt
RyteBot is Semrush's SEO tool crawler. It identifies itself with the RyteBot user-agent token, honors robots.txt according to its operator, and has no official IP range file.
- Operator
- Semrush
- Reviewed
- September 2026
- Sources
- 1
- Operator
- Semrush
- User-agent token
- RyteBot
- Purpose
- SEO tool crawler
- robots.txt token
- RyteBot
- Honors robots.txt
- Yes, per the operator
- Published IP ranges
- No official range file
- Verification
- The operator does not document a verification method.
- Documentation
- www.semrush.com/bot/
Block or allow RyteBot in robots.txt
User-agent: RyteBot
Disallow: /User-agent: RyteBot
Allow: /Verify a request is really RyteBot
Anyone can put RyteBot in a User-Agent header. The operator does not document a verification method.
What RyteBot does
RyteBot is listed on Semrush's bot page as the crawler behind tools provided by Ryte.com, which Semrush describes as analyzing on-page SEO, technical and usability issues. It is controlled with the RyteBot robots.txt token, and Semrush documents a Disallow rule for it. Semrush's pages give no verification method and no IP range file for RyteBot.
In logs the crawler identifies itself with the RyteBot token. Semrush does not publish a full user agent string for it, so the exact format around the token is undocumented. Semrush's description ties the visits to the tools provided by Ryte.com, which analyze on-page SEO, technical and usability issues, so the crawler fetches pages to produce that analysis for users of those tools. Semrush does not describe the crawl as feeding a search index; the stated purpose is tool analysis only.
Semrush's bot page lists RyteBot as a robots.txt User-agent token with a Disallow: / example and presents that rule as the way to block it, which means the crawler honors robots.txt. Blocking it stops Ryte.com's tools from analyzing your site, which affects only people using those tools to study your pages; it has no documented connection to search engine visibility. Allowing it lets those SEO, technical and usability analyses run against your site. Semrush does not document whether RyteBot executes JavaScript or which IP addresses it uses, and this entry does not draw on Ryte.com's own documentation.
Operator note. Semrush lists RyteBot on its bot page as a robots.txt User-agent token that can be blocked with "Disallow: /". JavaScript execution and IP addresses are not documented.
Common questions
- Should I block RyteBot?
- Block it if you do not want Ryte.com's tools analyzing your site's on-page SEO, technical and usability issues. Semrush gives a robots.txt group with User-agent: RyteBot and Disallow: / for that. The only documented effect is that those tools stop crawling you; Semrush describes no impact on search rankings.
- How do I verify RyteBot?
- Semrush's pages give no verification method for RyteBot: no reverse DNS pattern and no IP range file, and no full user agent string beyond the RyteBot token. If you need stronger verification, Semrush's documentation does not provide it, and this entry does not draw on Ryte.com's own documentation.
- Does RyteBot run JavaScript?
- Semrush's documentation does not say. The bot page covers only the robots.txt token and the tools the crawler works for. Semrush documents neither JavaScript execution nor IP addresses for RyteBot, so both stay undocumented on the operator's pages.
Sources
The operator documentation used for this entry. Recorded review date September 2026; consult the linked pages for current policy and compare them with this dated snapshot.
This registry documents how operators describe their own bots so site owners can identify and control them. It does not publish third-party IP lists or guess at undocumented behaviour. To see how your own site responds to automated visitors, the bot detection scanner reads a URL's live response and names the protection it finds.