CrawlWitness

AI consent of the world's top websites

Which of the most visited websites allow AI training, RAG and AI search, updated every day.

15%reserve AI training
16%block GPTBot
15%block ClaudeBot
14%block Google-Extended
17%block CCBot

Daily AI-consent report →

#DomainAI trainingRAG and AI answersAI searchGPTBot
297steampowered.comNo signalNo signalNo signalPartly blocked
299myshopify.comNo signalNo signalNo signalAllowed
300app-analytics-services.comNo signalNo signalNo signalAllowed
301salesforce.comNo signalNo signalNo signalPartly blocked
303miui.comNo signalNo signalNo signalAllowed
304launchdarkly.comNo signalNo signalNo signalPartly blocked
305slack.comNo signalNo signalNo signalPartly blocked
309mybluehost.meNo signalNo signalNo signalAllowed
310alibaba.comNo signalNo signalNo signalBlocked
315avast.comNo signalNo signalNo signalAllowed
317vungle.comNo signalNo signalNo signalPartly blocked
319autodesk.comNo signalNo signalNo signalAllowed
321pubmatic.comNo signalNo signalNo signalAllowed
322debian.orgNo signalNo signalNo signalAllowed
324weibo.comReservedReservedReservedBlocked
325harvard.eduNo signalNo signalNo signalAllowed
326wiley.comNo signalNo signalNo signalAllowed
327rubiconproject.comNo signalNo signalNo signalAllowed
328grammarly.comNo signalNo signalNo signalPartly blocked
329ok.ruNo signalNo signalNo signalPartly blocked
330amazon.co.ukReservedReservedReservedBlocked
331cloudflareinsights.comNo signalNo signalNo signalAllowed
332onelink.meNo signalNo signalNo signalAllowed
334etsy.comNo signalNo signalNo signalPartly blocked
335mi.comNo signalNo signalNo signalAllowed
336clarity.msNo signalNo signalNo signalAllowed
337gmail.comNo signalNo signalNo signalPartly blocked
338browser-intake-datadoghq.comNo signalNo signalNo signalAllowed
339anthropic.comNo signalNo signalNo signalAllowed
340smartadserver.comReservedNo signalNo signalBlocked
341zendesk.comNo signalNo signalNo signalPartly blocked
342php.netNo signalNo signalNo signalPartly blocked
343naver.comNo signalNo signalNo signalPartly blocked
344unisys.comNo signalNo signalNo signalAllowed
345casalemedia.comNo signalNo signalNo signalAllowed
346bilibili.comNo signalNo signalNo signalPartly blocked
348ea.comNo signalNo signalNo signalPartly blocked
349trustpilot.comNo signalNo signalNo signalPartly blocked
350gnu.orgNo signalNo signalNo signalPartly blocked
351branch.ioAllowedNo signalNo signalAllowed
353tp-link.comNo signalNo signalNo signalPartly blocked
354weebly.comNo signalNo signalNo signalAllowed
355espn.comReservedNo signalNo signalBlocked
356aliyun.comNo signalNo signalNo signalAllowed
357checkpoint.comAllowedNo signalNo signalAllowed
358dell.comNo signalNo signalNo signalPartly blocked
359tradingview.comNo signalNo signalNo signalPartly blocked
360cdc.govNo signalNo signalNo signalPartly blocked
361nflxvideo.netReservedReservedNo signalPartly blocked
362nvidia.comAllowedAllowedAllowedPartly blocked
363un.orgNo signalNo signalNo signalPartly blocked
364cm.comNo signalNo signalNo signalAllowed
365adnxs.comNo signalNo signalNo signalAllowed
367google.cnNo signalNo signalNo signalAllowed
368archive.phNo signalNo signalNo signalPartly blocked
369paloaltonetworks.comNo signalNo signalNo signalPartly blocked
370globo.comNo signalNo signalNo signalAllowed
371opendns.comNo signalNo signalNo signalAllowed
372wsj.comNo signalNo signalNo signalPartly blocked
373nasa.govNo signalNo signalNo signalAllowed
374gitlab.comNo signalNo signalNo signalPartly blocked
376tagomi.comNo signalNo signalNo signalPartly blocked
378issuu.comNo signalNo signalNo signalPartly blocked
380stanford.eduNo signalNo signalNo signalPartly blocked
381dns.googleNo signalNo signalNo signalAllowed
382amazon.deReservedReservedReservedBlocked
384dotomi.comNo signalNo signalNo signalPartly blocked
386bloomberg.comNo signalNo signalNo signalBlocked
389live-video.netNo signalNo signalNo signalAllowed
391plesk.comNo signalNo signalNo signalPartly blocked
393bsky.appNo signalNo signalNo signalPartly blocked
394name.comNo signalNo signalNo signalPartly blocked
397cookiedatabase.orgReservedReservedReservedBlocked
398okta.comNo signalNo signalNo signalAllowed
402amazontrust.comNo signalNo signalNo signalAllowed
403netease.comNo signalNo signalNo signalAllowed
404sberbank.ruNo signalNo signalNo signalAllowed
405go.comNo signalNo signalNo signalBlocked
407yandex.comNo signalNo signalNo signalPartly blocked
410netflix.netReservedReservedNo signalPartly blocked
411wps.comNo signalNo signalNo signalPartly blocked
413calendly.comNo signalNo signalNo signalPartly blocked
415claude.aiNo signalNo signalNo signalBlocked
416archive.isNo signalNo signalNo signalPartly blocked
418dynatrace.comNo signalNo signalNo signalPartly blocked
419drom.ruNo signalNo signalNo signalPartly blocked
420expireddomains.comNo signalNo signalNo signalPartly blocked
421elasticbeanstalk.comNo signalNo signalNo signalPartly blocked
422duckduckgo.comNo signalNo signalNo signalPartly blocked
423line.meNo signalNo signalNo signalAllowed
424163.comNo signalNo signalNo signalAllowed
425indeed.comNo signalNo signalNo signalPartly blocked
426atlassian.netNo signalNo signalNo signalPartly blocked
427substack.comNo signalNo signalNo signalPartly blocked
428unsplash.comNo signalNo signalNo signalPartly blocked
429aol.comReservedNo signalNo signalBlocked
430xboxlive.comNo signalNo signalNo signalPartly blocked
431steamcommunity.comNo signalNo signalNo signalPartly blocked
434netangels.ruNo signalNo signalNo signalPartly blocked
435temu.comNo signalNo signalNo signalAllowed

← Previous Next →