CrawlWitness

AI consent of the world's top websites

Which of the most visited websites allow AI training, RAG and AI search, updated every day.

15%reserve AI training
16%block GPTBot
15%block ClaudeBot
14%block Google-Extended
17%block CCBot

Daily AI-consent report →

#DomainAI trainingRAG and AI answersAI searchGPTBot
582wildberries.ruNo signalNo signalNo signalAllowed
583mediatek.comNo signalNo signalNo signalPartly blocked
584time.comNo signalNo signalNo signalPartly blocked
585jquery.comNo signalNo signalNo signalPartly blocked
586ezvizlife.comNo signalNo signalNo signalPartly blocked
587threads.comReservedReservedReservedBlocked
5880xrpc.ioNo signalNo signalNo signalAllowed
590ddnss.deNo signalNo signalNo signalPartly blocked
592eset.comNo signalNo signalNo signalPartly blocked
593squarespace.comNo signalNo signalNo signalPartly blocked
595rakuten.co.jpNo signalNo signalNo signalPartly blocked
596deviantart.comNo signalNo signalNo signalPartly blocked
597ca.govNo signalNo signalNo signalPartly blocked
598360yield.comNo signalNo signalNo signalAllowed
599atlassian.comNo signalNo signalNo signalPartly blocked
600media.netNo signalNo signalNo signalPartly blocked
601mega.co.nzNo signalNo signalNo signalAllowed
6033lift.comNo signalNo signalNo signalAllowed
604free.frNo signalNo signalNo signalPartly blocked
605withgoogle.comNo signalNo signalNo signalPartly blocked
606adsrvr.orgNo signalNo signalNo signalAllowed
609mobile.deNo signalNo signalNo signalPartly blocked
610doubleverify.comNo signalNo signalNo signalPartly blocked
611vercel.appNo signalNo signalNo signalPartly blocked
612target.comNo signalNo signalNo signalPartly blocked
613digitalocean.comNo signalNo signalNo signalPartly blocked
614dailymail.comReservedReservedReservedBlocked
615wix.comNo signalNo signalNo signalPartly blocked
616ieee.orgNo signalNo signalNo signalAllowed
617aboutads.infoNo signalNo signalNo signalPartly blocked
619mdpi.comNo signalNo signalNo signalAllowed
620usatoday.comNo signalNo signalNo signalBlocked
623gosuslugi.ruNo signalNo signalNo signalPartly blocked
625sagepub.comReservedReservedNo signalAllowed
626unesco.orgReservedReservedAllowedBlocked
627telegraph.co.ukReservedReservedReservedBlocked
628hotjar.comAllowedNo signalAllowedAllowed
629berkeley.eduNo signalNo signalNo signalAllowed
630usercontent.googNo signalNo signalNo signalAllowed
631avito.ruNo signalNo signalNo signalPartly blocked
632techcrunch.comNo signalNo signalNo signalBlocked
633telefonica.deNo signalNo signalNo signalAllowed
634nintendo.comReservedNo signalNo signalBlocked
635shalltry.comNo signalNo signalNo signalAllowed
637sophos.comNo signalNo signalNo signalAllowed
639ikea.comNo signalNo signalNo signalAllowed
640amazon.frReservedReservedReservedBlocked
642amazon.caReservedReservedReservedBlocked
643accuweather.comNo signalNo signalNo signalAllowed
645onetrust.comNo signalNo signalNo signalPartly blocked
647merriam-webster.comNo signalNo signalNo signalPartly blocked
648verisign.comNo signalNo signalNo signalAllowed
650amagi.tvNo signalNo signalNo signalAllowed
651intercom.ioAllowedAllowedAllowedPartly blocked
652jotform.comNo signalNo signalNo signalPartly blocked
655ups.comNo signalNo signalNo signalAllowed
656bitrix24.ruNo signalNo signalNo signalPartly blocked
657hstgr.netReservedReservedReservedBlocked
658service.gov.ukNo signalNo signalNo signalPartly blocked
659stackadapt.comNo signalNo signalNo signalPartly blocked
660meta.comNo signalNo signalNo signalPartly blocked
661tencent.comNo signalNo signalNo signalAllowed
664loc.govNo signalNo signalNo signalPartly blocked
665optimizely.comNo signalNo signalNo signalPartly blocked
666iso.orgNo signalNo signalNo signalAllowed
667charter.netNo signalNo signalNo signalPartly blocked
668box.comNo signalNo signalNo signalPartly blocked
6692gis.comNo signalNo signalNo signalPartly blocked
673amazon.inReservedReservedReservedBlocked
676elpais.comNo signalNo signalNo signalPartly blocked
677beget.ruNo signalNo signalNo signalPartly blocked
678nike.comNo signalNo signalNo signalPartly blocked
679redhat.comNo signalNo signalNo signalPartly blocked
680juicyscore.comNo signalNo signalNo signalAllowed
681primevideo.comNo signalReservedNo signalPartly blocked
685palmplaystore.comNo signalNo signalNo signalAllowed
686britannica.comNo signalNo signalNo signalPartly blocked
687inner-active.mobiNo signalNo signalNo signalAllowed
688sharethrough.comReservedReservedReservedBlocked
689ring.comNo signalNo signalNo signalAllowed
690surveymonkey.comNo signalNo signalNo signalPartly blocked
692translate.googNo signalNo signalNo signalAllowed
693cambridge.orgNo signalNo signalNo signalPartly blocked
694xhamster.comNo signalNo signalNo signalPartly blocked
695ad-tech.ruNo signalNo signalNo signalAllowed
696kick.comReservedNo signalAllowedBlocked
697lemonde.frNo signalNo signalNo signalPartly blocked
698anydesk.comNo signalNo signalNo signalAllowed
700cbsnews.comNo signalNo signalNo signalBlocked
701yelp.comNo signalNo signalNo signalAllowed
702ovh.netNo signalNo signalNo signalAllowed
704binance.comNo signalNo signalNo signalPartly blocked
705bandcamp.comReservedNo signalNo signalBlocked
706fb.comReservedReservedReservedBlocked
707uber.comNo signalNo signalNo signalPartly blocked
710stripchat.comNo signalNo signalNo signalPartly blocked
711reverse.itNo signalNo signalNo signalPartly blocked
712amazon.esReservedReservedReservedBlocked
713perplexity.aiNo signalNo signalNo signalPartly blocked
714certcenter.comNo signalAllowedAllowedAllowed

← Previous Next →