Dated website protection indicators, vendor references and observation limits.
| # | |||||
|---|---|---|---|---|---|
| 1 | Allegro allegro.pl | Online Marketplaces | DataDome | Hard | |
| 2 | Capterra capterra.com | Reviews & Ratings | Cloudflare (Bot/Challenge) | Hard | |
| 3 | Cars.com cars.com | Automotive | Cloudflare (Bot/Challenge) | Hard | |
| 4 | Carvana carvana.com | Automotive | Cloudflare (Bot/Challenge) | Hard | |
| 5 | Cdiscount cdiscount.com | Online Marketplaces | Cloudflare (Bot/Challenge) | Hard | |
| 6 | Chewy chewy.com | Retail & E-commerce | KasadaAkamai (CDN/WAF) | Hard | |
| 7 | Currys currys.co.uk | Retail & E-commerce | Cloudflare (Bot/Challenge) | Hard | |
| 8 | Depop depop.com | Online Marketplaces | Cloudflare (Bot/Challenge) | Hard | |
| 9 | END. Clothing endclothing.com | Sneakers & Limited Drops | Akamai Bot Manager | Hard | |
| 10 | Etsy etsy.com | Online Marketplaces | DataDome | Hard | |
| 11 | Expedia expedia.com | Travel & Hospitality | Akamai Bot Manager | Hard | |
| 12 | Fnac fnac.com | Retail & E-commerce | DataDomeAkamai (CDN/WAF) | Hard | |
| 13 | G2 g2.com | Reviews & Ratings | DataDomeCloudflare (Bot/Challenge) | Hard | |
| 14 | Gap gap.com | Retail & E-commerce | Akamai Bot Manager | Hard | |
| 15 | Glassdoor glassdoor.com | Jobs & Recruitment | Cloudflare (Bot/Challenge) | Hard | |
| 16 | GOAT goat.com | Sneakers & Limited Drops | Cloudflare (Bot/Challenge) | Hard | |
| 17 | Home Depot homedepot.com | Retail & E-commerce | PerimeterX / HUMANAkamai (CDN/WAF) | Hard | |
| 18 | Hotels.com hotels.com | Travel & Hospitality | Akamai Bot Manager | Hard | |
| 19 | Idealista idealista.com | Real Estate & Property Listings | DataDome | Hard | |
| 20 | Indeed indeed.com | Jobs & Recruitment | Cloudflare (Bot/Challenge) | Hard | |
| 21 | Leboncoin leboncoin.fr | Classifieds | DataDome | Hard | |
| 22 | LinkedIn linkedin.com | Social Platforms | PerimeterX / HUMANCloudflare (CDN/WAF)reCAPTCHA | Hard | |
| 23 | MediaMarkt mediamarkt.de | Retail & E-commerce | Cloudflare (Bot/Challenge) | Hard | |
| 24 | Mercari mercari.com | Online Marketplaces | Cloudflare (Bot/Challenge) | Hard | |
| 25 | Nike nike.com | Retail & E-commerce | KasadaAkamai (CDN/WAF) | Hard | |
| 26 | Otto otto.de | Online Marketplaces | Kasada | Hard | |
| 27 | Overstock overstock.com | Retail & E-commerce | Akamai Bot Manager | Hard | |
| 28 | Petco petco.com | Retail & E-commerce | Cloudflare (Bot/Challenge) | Hard | |
| 29 | Priceline priceline.com | Travel & Hospitality | PerimeterX / HUMANCloudflare (CDN/WAF) | Hard | |
| 30 | QVC qvc.com | Retail & E-commerce | Akamai Bot Manager | Hard | |
| 31 | realestate.com.au realestate.com.au | Real Estate & Property Listings | KasadaAkamai (CDN/WAF) | Hard | |
| 32 | Realtor.com realtor.com | Real Estate & Property Listings | Kasada | Hard | |
| 33 | Resy resy.com | Reservations & Dining | Imperva (Incapsula)reCAPTCHA | Hard | |
| 34 | Sam's Club samsclub.com | Retail & E-commerce | PerimeterX / HUMANAkamai (CDN/WAF) | Hard | |
| 35 | SeatGeek seatgeek.com | Tickets & Live Events | DataDome | Hard | |
| 36 | Sephora sephora.com | Retail & E-commerce | Akamai Bot Manager | Hard | |
| 37 | Skillshare skillshare.com | Online Learning & Other | Cloudflare (Bot/Challenge) | Hard | |
| 38 | Skyscanner skyscanner.net | Travel & Hospitality | PerimeterX / HUMAN | Hard | |
| 39 | Southwest Airlines southwest.com | Travel & Hospitality | Akamai Bot Manager | Hard | |
| 40 | SSENSE ssense.com | Retail & E-commerce | Cloudflare (Bot/Challenge) | Hard | |
| 41 | StockX stockx.com | Sneakers & Limited Drops | PerimeterX / HUMANCloudflare (Bot/Challenge) | Hard | |
| 42 | Target target.com | Retail & E-commerce | PerimeterX / HUMAN | Hard | |
| 43 | Trivago trivago.com | Travel & Hospitality | Akamai Bot Manager | Hard | |
| 44 | Trulia trulia.com | Real Estate & Property Listings | PerimeterX / HUMAN | Hard | |
| 45 | Uber Eats ubereats.com | Food Delivery | Cloudflare (Bot/Challenge) | Hard | |
| 46 | Udemy udemy.com | Online Learning & Other | Cloudflare (Bot/Challenge) | Hard | |
| 47 | Uniqlo uniqlo.com | Retail & E-commerce | Akamai Bot Manager | Hard | |
| 48 | Vivid Seats vividseats.com | Tickets & Live Events | Akamai Bot Manager | Hard | |
| 49 | Vrbo vrbo.com | Travel & Hospitality | Akamai Bot Manager | Hard | |
| 50 | Walgreens walgreens.com | Retail & E-commerce | Akamai Bot Manager | Hard | |
| 51 | Walmart walmart.com | Retail & E-commerce | PerimeterX / HUMANAkamai (CDN/WAF) | Hard | |
| 52 | Walmart Canada walmart.ca | Retail & E-commerce | PerimeterX / HUMANAkamai (CDN/WAF) | Hard | |
| 53 | Wayfair wayfair.com | Retail & E-commerce | PerimeterX / HUMANCloudflare (CDN/WAF) | Hard | |
| 54 | Yelp yelp.com | Reviews & Ratings | DataDome | Hard | |
| 55 | Zara zara.com | Retail & E-commerce | Akamai Bot Manager | Hard | |
| 56 | ZipRecruiter ziprecruiter.com | Jobs & Recruitment | Cloudflare (Bot/Challenge) | Hard | |
| 57 | Zoopla zoopla.co.uk | Real Estate & Property Listings | Cloudflare (Bot/Challenge) | Hard | |
| 58 | Adidas adidas.com | Retail & E-commerce | Akamai (CDN/WAF) | Moderate | |
| 59 | Agoda agoda.com | Travel & Hospitality | Akamai (CDN/WAF) | Moderate | |
| 60 | Airbnb airbnb.com | Travel & Hospitality | Akamai (CDN/WAF) | Moderate | |
| 61 | AliExpress aliexpress.com | Online Marketplaces | Akamai (CDN/WAF) | Moderate | |
| 62 | Amazon amazon.com | Online Marketplaces | AWS WAF | Moderate | |
| 63 | Apartments.com apartments.com | Real Estate & Property Listings | Akamai (CDN/WAF) | Moderate | |
| 64 | Argos argos.co.uk | Retail & E-commerce | Akamai (CDN/WAF) | Moderate | |
| 65 | ASOS asos.com | Retail & E-commerce | Akamai (CDN/WAF) | Moderate | |
| 66 | Autotrader autotrader.com | Automotive | Akamai (CDN/WAF) | Moderate | |
| 67 | AXS axs.com | Tickets & Live Events | Cloudflare (CDN/WAF) | Moderate | |
| 68 | Carrefour carrefour.fr | Retail & E-commerce | Cloudflare (CDN/WAF) | Moderate | |
| 69 | Costco costco.com | Retail & E-commerce | Akamai (CDN/WAF)Queue-it | Moderate | |
| 70 | Craigslist craigslist.org | Classifieds | hCaptcha | Moderate | |
| 71 | Crunchbase crunchbase.com | Data & Business Intelligence | Cloudflare (CDN/WAF) | Moderate | |
| 72 | CVS cvs.com | Retail & E-commerce | Akamai (CDN/WAF) | Moderate | |
| 73 | Domain domain.com.au | Real Estate & Property Listings | Akamai (CDN/WAF) | Moderate | |
| 74 | DoorDash doordash.com | Food Delivery | Cloudflare (CDN/WAF) | Moderate | |
| 75 | eBay ebay.com | Online Marketplaces | Akamai (CDN/WAF) | Moderate | |
| 76 | Funda funda.nl | Real Estate & Property Listings | Akamai (CDN/WAF)reCAPTCHA | Moderate | |
| 77 | Grailed grailed.com | Online Marketplaces | Cloudflare (CDN/WAF) | Moderate | |
| 78 | Groupon groupon.com | Retail & E-commerce | Cloudflare (CDN/WAF) | Moderate | |
| 79 | H&M hm.com | Retail & E-commerce | Akamai (CDN/WAF) | Moderate | |
| 80 | Kohl's kohls.com | Retail & E-commerce | Akamai (CDN/WAF) | Moderate | |
| 81 | Live Nation livenation.com | Tickets & Live Events | Queue-it | Moderate | |
| 82 | Lowe's lowes.com | Retail & E-commerce | Akamai (CDN/WAF) | Moderate | |
| 83 | Lululemon lululemon.com | Retail & E-commerce | Akamai (CDN/WAF) | Moderate | |
| 84 | Macy's macys.com | Retail & E-commerce | Akamai (CDN/WAF) | Moderate | |
| 85 | Newegg newegg.com | Retail & E-commerce | Cloudflare (CDN/WAF) | Moderate | |
| 86 | Rakuten rakuten.co.jp | Online Marketplaces | Akamai (CDN/WAF) | Moderate | |
| 87 | SHEIN shein.com | Retail & E-commerce | Cloudflare (CDN/WAF) | Moderate | |
| 88 | Snapchat snapchat.com | Social Platforms | hCaptcha | Moderate | |
| 89 | Temu temu.com | Online Marketplaces | Cloudflare (CDN/WAF) | Moderate | |
| 90 | Tesco tesco.com | Retail & E-commerce | Akamai (CDN/WAF) | Moderate | |
| 91 | TikTok tiktok.com | Social Platforms | Akamai (CDN/WAF)hCaptcha | Moderate | |
| 92 | Ulta Beauty ulta.com | Retail & E-commerce | Akamai (CDN/WAF) | Moderate | |
| 93 | United Airlines united.com | Travel & Hospitality | Akamai (CDN/WAF) | Moderate | |
| 94 | X (Twitter) x.com | Social Platforms | Cloudflare (CDN/WAF) | Moderate |
The whole registry as an open dataset: vendor market share, difficulty by category, downloadable CSV / NDJSON / JSON. Free to cite.
Anti-bot protection and scraping difficulty, by industry.
How hard large-scale public-data collection tends to be, measured at the network layer.
Enterprise bot & online-fraud protection
CDN with bot management & challenge layer
Enterprise bot management at the CDN edge
Enterprise bot defense & fraud prevention
Bot mitigation with client interrogation
WAF with advanced bot protection
Web application firewall with bot control
Virtual waiting room / traffic gating
CAPTCHA / risk-scoring challenge layer
CAPTCHA / challenge layer
Every site in the registry, grouped by category.
Saved protection observations for Retail & E-commerce. Records show the indicators associated with each site; they do not measure an industry-wide success rate or prescribe an IP class.
Saved protection observations for Online Marketplaces. Records show the indicators associated with each site; they do not measure an industry-wide success rate or prescribe an IP class.
Saved protection observations for Travel & Hospitality. Records show the indicators associated with each site; they do not measure an industry-wide success rate or prescribe an IP class.
Saved protection observations for Real Estate & Property Listings. Records show the indicators associated with each site; they do not measure an industry-wide success rate or prescribe an IP class.
Saved protection observations for Tickets & Live Events. Records show the indicators associated with each site; they do not measure an industry-wide success rate or prescribe an IP class.
Saved protection observations for Automotive. Records show the indicators associated with each site; they do not measure an industry-wide success rate or prescribe an IP class.
Saved protection observations for Jobs & Recruitment. Records show the indicators associated with each site; they do not measure an industry-wide success rate or prescribe an IP class.
Saved protection observations for Reviews & Ratings. Records show the indicators associated with each site; they do not measure an industry-wide success rate or prescribe an IP class.
Saved protection observations for Sneakers & Limited Drops. Records show the indicators associated with each site; they do not measure an industry-wide success rate or prescribe an IP class.
Saved protection observations for Classifieds. Records show the indicators associated with each site; they do not measure an industry-wide success rate or prescribe an IP class.
Saved protection observations for Food Delivery. Records show the indicators associated with each site; they do not measure an industry-wide success rate or prescribe an IP class.
Saved protection observations for Online Learning & Other. Records show the indicators associated with each site; they do not measure an industry-wide success rate or prescribe an IP class.
Saved protection observations for Data & Business Intelligence. Records show the indicators associated with each site; they do not measure an industry-wide success rate or prescribe an IP class.
Saved protection observations for Reservations & Dining. Records show the indicators associated with each site; they do not measure an industry-wide success rate or prescribe an IP class.
A read-only reference of the bot-protection technology observed on 94 popular websites across 15 categories, with a difficulty rating for collecting each site's public data. It answers questions like "does this site use Cloudflare or DataDome" and "how hard is this site to scrape". Reviewed July 2026.
Each entry is derived from public HTTP response signatures - cookies, headers and challenge assets observed on the site's landing response. We list a technology only when a canonical signal was present, so entries are evidence-backed rather than guessed. Providers change their stacks over time.
The three tiers are editorial groupings of saved indicators. They are not measured success rates and do not establish which IP class will be accepted. Review the individual observations and dates before applying them.
No. The registry describes defenses that exist; it does not explain how to defeat them. Respect each site's robots.txt, Terms of Service and applicable law, and collect only what you are permitted to.
The dataset is periodically re-reviewed against live signatures; the current review date is shown as "July 2026". The full registry is also published as an open, citable census dataset.
Hand it to Data Works and get clean, QA-checked data delivered, or run it yourself on real 4G/5G carrier IPs from $4/GB.
Research library
Find the reference behind a network decision. Browse the records, follow their sources and download the available datasets.
Social Platforms
4 sitesSaved protection observations for Social Platforms. Records show the indicators associated with each site; they do not measure an industry-wide success rate or prescribe an IP class.