We run a large fleet of real mobile devices and a signature-verified registry of the anti-bot web, which lets us measure things most people can only guess at. When we find something worth publishing, it lands here - with the raw data attached and free to cite.
Anti-bot protection observed on 95 popular sites across 15 verticals, from public HTTP signatures. 61% are hard targets. Vendor market share, difficulty by vertical, and the raw data.
PROXIES.SX. (July 2026). Anti-Bot Census: anti-bot protection observed across 95 popular websites. https://www.proxies.sx/anti-bot/dataset
@misc{proxiessx_antibot_census,
title = {Anti-Bot Census: anti-bot protection observed across 95 popular websites},
author = {{PROXIES.SX}},
year = {2026},
note = {Reviewed July 2026},
url = {https://www.proxies.sx/anti-bot/dataset}
}Every figure traces to an evidence-backed source we can re-run. If we cannot verify it, we do not publish it.
Datasets are released under CC BY 4.0. Use them in articles, decks and research - just attribute proxies.sx and link back.
The web changes, so studies carry a review date and recurring editions, with the differences published as a changelog.
Data Works is our done-for-you pipeline for the hard targets in these datasets - you send the URLs and fields, we deliver clean data on real 4G/5G carrier IPs.