SemrushBot-FT
Semrush operates SemrushBot-FT to crawl sites for its Plagiarism Checker and similar tools, checking whether content being examined appears on a given website. Site owners control it through the SemrushBot-FT robots.txt token, which Semrush documents as honored. Semrush documents no verification method for it, stating that it uses no consecutive IP blocks, and documents no reverse-DNS check.
What SemrushBot-FT does
Semrush documents SemrushBot-FT only as a robots.txt User-agent token on its bot page, with a Disallow: / example for blocking it. Semrush publishes no full user-agent string for this crawler, so in logs you should expect the SemrushBot-FT token but cannot match against a documented complete string. Semrush says the crawler works for the Plagiarism Checker and similar tools. When someone checks a piece of text, the bot visits your site to verify whether that text appears there.
Allowing SemrushBot-FT lets Semrush's Plagiarism Checker confirm whether checked content appears on your pages. Blocking it with a Disallow rule under the SemrushBot-FT user agent stops those verification visits, so Semrush's tool can no longer confirm matches against your site. Semrush's page gives Disallow: / as the example, which refuses the whole site. Semrush documents the token as honored, and the effect it describes is limited to the Plagiarism Checker and similar tools.
There is no documented way to verify that a request claiming to be SemrushBot-FT is genuine. Semrush states that it does not use any consecutive IP blocks, documents no IP range list and documents no reverse-DNS hostname. Semrush also does not document whether the crawler executes JavaScript. Site owners can rely on the robots.txt token as a control, but not as proof of origin.
Operator note. Semrush documents this token only as a robots.txt User-agent that can be blocked with "Disallow: /" on its bot page. JavaScript execution and IP addresses are not documented.
Controlling SemrushBot-FT with robots.txt
Use the token SemrushBot-FT in robots.txt. Semrush documents that SemrushBot-FT honors robots.txt directives.
User-agent: SemrushBot-FT
Disallow: /User-agent: SemrushBot-FT
Allow: /Verifying a request is really SemrushBot-FT
Anyone can put SemrushBot-FT in a User-Agent header. The operator does not document a verification method. Semrush states that "we do not use any consecutive IP blocks".
Common questions
Should I block SemrushBot-FT?
Block it if you do not want Semrush's Plagiarism Checker and similar tools verifying whether checked text appears on your site. Add a Disallow rule under User-agent: SemrushBot-FT in robots.txt; Semrush documents the token as honored. Semrush's page describes no other consequence of blocking it.
How do I verify SemrushBot-FT?
Semrush documents no verification method. It states that it does not use any consecutive IP blocks, and it documents neither an IP range list nor a reverse-DNS suffix for this crawler. You can recognise the SemrushBot-FT token in a user-agent string, but Semrush provides nothing to confirm a request comes from Semrush.
Does SemrushBot-FT run JavaScript?
Semrush's documentation does not say. The bot page describes SemrushBot-FT only as a robots.txt token tied to the Plagiarism Checker and similar tools. It says nothing about how the crawler renders pages and nothing about the IP addresses it uses.
Sources
Every fact on this page was checked against Semrush's own documentation, listed below, and re-checked by a second reviewer before publication. Reviewed September 2026.
Related crawlers
This registry documents how operators describe their own bots so site owners can identify and control them. It does not publish third-party IP lists or guess at undocumented behaviour. To see how your own site responds to automated visitors, the bot detection scanner reads a URL's live response and names the protection it finds.