The hardest public sites to collect data from at scale - these tend to require real mobile carrier IPs and careful session handling. We index 57 hard target sites; the most common protection is Cloudflare (Bot/Challenge), on about 35% of them. Reviewed July 2026.
| # | Site | Category | Protection observed |
|---|---|---|---|
| 1 | LinkedIn linkedin.com | Social Platforms | PerimeterX / HUMANCloudflare (CDN/WAF)reCAPTCHA |
| 2 | Chewy chewy.com | Retail & E-commerce | KasadaAkamai (CDN/WAF) |
| 3 | Fnac fnac.com | Retail & E-commerce | DataDomeAkamai (CDN/WAF) |
| 4 | G2 g2.com | Reviews & Ratings | DataDomeCloudflare (Bot/Challenge) |
| 5 | Home Depot homedepot.com | Retail & E-commerce | PerimeterX / HUMANAkamai (CDN/WAF) |
| 6 | Nike nike.com | Retail & E-commerce | KasadaAkamai (CDN/WAF) |
| 7 | Priceline priceline.com | Travel & Hospitality | PerimeterX / HUMANCloudflare (CDN/WAF) |
| 8 | realestate.com.au realestate.com.au | Real Estate & Property Listings | KasadaAkamai (CDN/WAF) |
| 9 | Resy resy.com | Reservations & Dining | Imperva (Incapsula)reCAPTCHA |
| 10 | Sam's Club samsclub.com | Retail & E-commerce | PerimeterX / HUMANAkamai (CDN/WAF) |
| 11 | StockX stockx.com | Sneakers & Limited Drops | PerimeterX / HUMANCloudflare (Bot/Challenge) |
| 12 | Walmart walmart.com | Retail & E-commerce | PerimeterX / HUMANAkamai (CDN/WAF) |
| 13 | Walmart Canada walmart.ca | Retail & E-commerce | PerimeterX / HUMANAkamai (CDN/WAF) |
| 14 | Wayfair wayfair.com | Retail & E-commerce | PerimeterX / HUMANCloudflare (CDN/WAF) |
| 15 | Allegro allegro.pl | Online Marketplaces | DataDome |
| 16 | Capterra capterra.com | Reviews & Ratings | Cloudflare (Bot/Challenge) |
| 17 | Cars.com cars.com | Automotive | Cloudflare (Bot/Challenge) |
| 18 | Carvana carvana.com | Automotive | Cloudflare (Bot/Challenge) |
| 19 | Cdiscount cdiscount.com | Online Marketplaces | Cloudflare (Bot/Challenge) |
| 20 | Currys currys.co.uk | Retail & E-commerce | Cloudflare (Bot/Challenge) |
| 21 | Depop depop.com | Online Marketplaces | Cloudflare (Bot/Challenge) |
| 22 | END. Clothing endclothing.com | Sneakers & Limited Drops | Akamai Bot Manager |
| 23 | Etsy etsy.com | Online Marketplaces | DataDome |
| 24 | Expedia expedia.com | Travel & Hospitality | Akamai Bot Manager |
| 25 | Gap gap.com | Retail & E-commerce | Akamai Bot Manager |
| 26 | Glassdoor glassdoor.com | Jobs & Recruitment | Cloudflare (Bot/Challenge) |
| 27 | GOAT goat.com | Sneakers & Limited Drops | Cloudflare (Bot/Challenge) |
| 28 | Hotels.com hotels.com | Travel & Hospitality | Akamai Bot Manager |
| 29 | Idealista idealista.com | Real Estate & Property Listings | DataDome |
| 30 | Indeed indeed.com | Jobs & Recruitment | Cloudflare (Bot/Challenge) |
| 31 | Leboncoin leboncoin.fr | Classifieds | DataDome |
| 32 | MediaMarkt mediamarkt.de | Retail & E-commerce | Cloudflare (Bot/Challenge) |
| 33 | Mercari mercari.com | Online Marketplaces | Cloudflare (Bot/Challenge) |
| 34 | Otto otto.de | Online Marketplaces | Kasada |
| 35 | Overstock overstock.com | Retail & E-commerce | Akamai Bot Manager |
| 36 | Petco petco.com | Retail & E-commerce | Cloudflare (Bot/Challenge) |
| 37 | QVC qvc.com | Retail & E-commerce | Akamai Bot Manager |
| 38 | Realtor.com realtor.com | Real Estate & Property Listings | Kasada |
| 39 | SeatGeek seatgeek.com | Tickets & Live Events | DataDome |
| 40 | Sephora sephora.com | Retail & E-commerce | Akamai Bot Manager |
| 41 | Skillshare skillshare.com | Online Learning & Other | Cloudflare (Bot/Challenge) |
| 42 | Skyscanner skyscanner.net | Travel & Hospitality | PerimeterX / HUMAN |
| 43 | Southwest Airlines southwest.com | Travel & Hospitality | Akamai Bot Manager |
| 44 | SSENSE ssense.com | Retail & E-commerce | Cloudflare (Bot/Challenge) |
| 45 | Target target.com | Retail & E-commerce | PerimeterX / HUMAN |
| 46 | Trivago trivago.com | Travel & Hospitality | Akamai Bot Manager |
| 47 | Trulia trulia.com | Real Estate & Property Listings | PerimeterX / HUMAN |
| 48 | Uber Eats ubereats.com | Food Delivery | Cloudflare (Bot/Challenge) |
| 49 | Udemy udemy.com | Online Learning & Other | Cloudflare (Bot/Challenge) |
| 50 | Uniqlo uniqlo.com | Retail & E-commerce | Akamai Bot Manager |
| 51 | Vivid Seats vividseats.com | Tickets & Live Events | Akamai Bot Manager |
| 52 | Vrbo vrbo.com | Travel & Hospitality | Akamai Bot Manager |
| 53 | Walgreens walgreens.com | Retail & E-commerce | Akamai Bot Manager |
| 54 | Yelp yelp.com | Reviews & Ratings | DataDome |
| 55 | Zara zara.com | Retail & E-commerce | Akamai Bot Manager |
| 56 | ZipRecruiter ziprecruiter.com | Jobs & Recruitment | Cloudflare (Bot/Challenge) |
| 57 | Zoopla zoopla.co.uk | Real Estate & Property Listings | Cloudflare (Bot/Challenge) |
57 sites in the registry are rated Hard target. The most common protection among them is Cloudflare (Bot/Challenge) (about 35% of them), then Akamai Bot Manager. Each site and its observed stack is listed below.
Enterprise bot management that scores IP reputation and browser signals before the page renders. Datacenter IPs are blocked wholesale and pooled residential ranges are increasingly pre-flagged. As a rule of thumb, Real mobile-carrier (4G/5G) IPs are the most durable class here, because carrier CGNAT is shared with millions of legitimate phone users and cannot be blocklisted wholesale. This describes the network layer only, not a way to defeat any protection.
From public HTTP response signatures observed on each site's landing response, reviewed July 2026. A technology is listed only when a canonical signal was present.
Hand it to Data Works for clean, QA-checked data, or run it yourself on real 4G/5G carrier IPs from $4/GB.