CrawlWitness

AI consent of the world's top websites

Which of the most visited websites allow AI training, RAG and AI search, updated every day.

15%reserve AI training
16%block GPTBot
15%block ClaudeBot
14%block Google-Extended
17%block CCBot

Daily AI-consent report →

#DomainAI trainingRAG and AI answersAI searchGPTBot
715bugsnag.comNo signalNo signalNo signalAllowed
717outbrain.comNo signalNo signalNo signalPartly blocked
718rustore.ruNo signalNo signalNo signalAllowed
719dailymail.co.ukReservedReservedReservedBlocked
720fda.govNo signalNo signalNo signalPartly blocked
721360.cnNo signalNo signalNo signalAllowed
722ya.ruNo signalNo signalNo signalPartly blocked
723itch.ioNo signalNo signalNo signalAllowed
724cookielaw.orgNo signalNo signalNo signalPartly blocked
725maricopa.govNo signalNo signalNo signalAllowed
726pinimg.comReservedReservedReservedBlocked
728linode.comNo signalNo signalNo signalPartly blocked
729hihonorcloud.comReservedReservedReservedBlocked
731ngenix.netNo signalNo signalNo signalAllowed
732quantserve.comReservedReservedReservedBlocked
733fontawesome.comNo signalNo signalNo signalPartly blocked
735amazon.itReservedReservedReservedBlocked
736flurry.comNo signalNo signalNo signalAllowed
738conviva.comNo signalNo signalAllowedAllowed
739independent.co.ukNo signalNo signalNo signalAllowed
740hugedomains.comNo signalNo signalNo signalPartly blocked
741gumgum.comNo signalNo signalAllowedAllowed
742cnet.comReservedReservedReservedBlocked
743alipaydns.comNo signalNo signalNo signalAllowed
744mediafire.comNo signalNo signalNo signalPartly blocked
745wb.ruNo signalNo signalNo signalAllowed
746asus.comNo signalNo signalNo signalPartly blocked
747rfc-editor.orgNo signalNo signalNo signalPartly blocked
748imgsmail.ruReservedReservedReservedBlocked
751creativecdn.comReservedReservedReservedBlocked
752shopee.co.idNo signalNo signalNo signalPartly blocked
753viber.comNo signalNo signalNo signalPartly blocked
756webempresa.euNo signalNo signalNo signalPartly blocked
757yieldmo.comNo signalNo signalNo signalAllowed
759deepl.comNo signalNo signalNo signalPartly blocked
761globalsign.comNo signalNo signalNo signalAllowed
762python.orgNo signalNo signalNo signalPartly blocked
763bild.deReservedReservedNo signalPartly blocked
767homedepot.comNo signalNo signalNo signalAllowed
768craigslist.orgNo signalNo signalNo signalPartly blocked
769uk.comNo signalNo signalNo signalAllowed
770google.co.ukNo signalNo signalNo signalPartly blocked
771wpguardian.ioNo signalNo signalNo signalAllowed
772wpguardian.comNo signalNo signalNo signalAllowed
773g.coNo signalNo signalNo signalAllowed
774eeroup.comNo signalNo signalNo signalAllowed
778mailchimp.comNo signalNo signalNo signalAllowed
780mlb.comNo signalNo signalNo signalAllowed
782nikkei.comReservedReservedReservedBlocked
783bestbuy.comNo signalNo signalNo signalPartly blocked
784imgur.comNo signalNo signalNo signalAllowed
787welt.deNo signalNo signalNo signalPartly blocked
789wattpad.comNo signalNo signalNo signalBlocked
790shopee.com.brNo signalNo signalNo signalPartly blocked
793marriott.comNo signalNo signalNo signalPartly blocked
794zillow.comNo signalNo signalNo signalPartly blocked
795zoho.comNo signalNo signalNo signalPartly blocked
796apnews.comNo signalNo signalNo signalBlocked
799supabase.coAllowedAllowedAllowedAllowed
800sedo.comNo signalNo signalNo signalPartly blocked
801moloco.comNo signalNo signalNo signalPartly blocked
803ameblo.jpNo signalNo signalNo signalPartly blocked
804lenovo.comNo signalNo signalNo signalAllowed
805recaptcha.netNo signalNo signalNo signalPartly blocked
807rakuten.comNo signalNo signalNo signalPartly blocked
808prnewswire.comNo signalNo signalNo signalPartly blocked
809wp.plNo signalNo signalNo signalBlocked
810adjust.comNo signalNo signalNo signalAllowed
811google.com.brNo signalNo signalNo signalPartly blocked
812dv.techNo signalNo signalNo signalAllowed
814airbnb.comReservedNo signalNo signalBlocked
815discordapp.comNo signalNo signalNo signalPartly blocked
817fiverr.comNo signalNo signalNo signalPartly blocked
819disneyplus.comNo signalNo signalNo signalPartly blocked
82033across.comNo signalNo signalNo signalAllowed
821allegro.plNo signalNo signalNo signalPartly blocked
822people.comReservedReservedReservedPartly blocked
823ted.comReservedNo signalNo signalBlocked
824erome.comNo signalNo signalNo signalPartly blocked
826netlify.appAllowedAllowedAllowedAllowed
827mixpanel.comNo signalNo signalNo signalPartly blocked
828zoom.comAllowedAllowedAllowedPartly blocked
829onlyfans.comNo signalNo signalNo signalAllowed
830a-mo.netNo signalNo signalNo signalAllowed
832fbsbx.comNo signalNo signalNo signalAllowed
835usda.govNo signalNo signalNo signalAllowed
836teads.tvNo signalNo signalNo signalAllowed
839statuspage.ioNo signalNo signalNo signalPartly blocked
840liftoff.ioNo signalNo signalNo signalPartly blocked
841vivo.com.cnNo signalNo signalNo signalAllowed
842centinel-analytica.comAllowedAllowedAllowedPartly blocked
843life360.comNo signalNo signalNo signalAllowed
844adform.netReservedReservedReservedBlocked
846discogs.comNo signalNo signalNo signalAllowed
847agora.ioNo signalNo signalNo signalAllowed
848focus.deNo signalNo signalNo signalAllowed
850academia.eduReservedNo signalNo signalBlocked
852seznam.czNo signalNo signalNo signalAllowed
853appspot.comNo signalNo signalNo signalPartly blocked
854stackexchange.comNo signalNo signalNo signalAllowed

← Previous Next →