CrawlWitness

AI consent of the world's top websites

Which of the most visited websites allow AI training, RAG and AI search, updated every day.

15%reserve AI training
16%block GPTBot
15%block ClaudeBot
14%block Google-Extended
17%block CCBot

Daily AI-consent report →

#DomainAI trainingRAG and AI answersAI searchGPTBot
855auth0.comNo signalNo signalNo signalPartly blocked
856me.comNo signalNo signalNo signalPartly blocked
857pendo.ioNo signalNo signalNo signalAllowed
858px-cloud.netNo signalNo signalNo signalAllowed
859synology.comNo signalNo signalNo signalPartly blocked
862xvideos.comNo signalNo signalNo signalPartly blocked
863parklogic.comNo signalNo signalNo signalPartly blocked
864arcgis.comNo signalNo signalNo signalAllowed
865ebay.deReservedNo signalNo signalBlocked
866theverge.comNo signalNo signalNo signalAllowed
867chess.comNo signalNo signalNo signalPartly blocked
868unpkg.comAllowedNo signalNo signalAllowed
869frontiersin.orgNo signalNo signalNo signalPartly blocked
870amazon.com.brReservedReservedReservedBlocked
871vivoglobal.comNo signalNo signalNo signalAllowed
872www.gov.brNo signalNo signalNo signalPartly blocked
873agoda.comNo signalNo signalNo signalPartly blocked
874pexels.comReservedNo signalNo signalBlocked
875ebay.co.ukReservedNo signalNo signalBlocked
876cursor.shNo signalNo signalNo signalPartly blocked
877myspace.comNo signalNo signalNo signalPartly blocked
878deloitte.comNo signalNo signalNo signalPartly blocked
882biblegateway.comNo signalNo signalNo signalPartly blocked
883spiegel.deNo signalNo signalNo signalBlocked
885onetag-sys.comNo signalNo signalNo signalAllowed
888daum.netNo signalNo signalNo signalPartly blocked
889pikabu.ruNo signalNo signalNo signalPartly blocked
891unrulymedia.comNo signalNo signalNo signalAllowed
892no-ip.comNo signalNo signalNo signalPartly blocked
893appcenter.msNo signalNo signalNo signalAllowed
894readthedocs.ioNo signalNo signalNo signalAllowed
895worldbank.orgNo signalNo signalNo signalAllowed
896hostgator.com.brNo signalNo signalNo signalAllowed
897nbcnews.comNo signalNo signalNo signalBlocked
898porkbun.comNo signalNo signalNo signalPartly blocked
899digitaloceanspaces.comNo signalNo signalNo signalPartly blocked
900poki.comNo signalNo signalNo signalPartly blocked
901cloudinary.comNo signalNo signalNo signalPartly blocked
902mercadolivre.com.brNo signalReservedNo signalBlocked
903pornhub.comNo signalNo signalNo signalAllowed
904hbr.orgReservedNo signalNo signalBlocked
905bankofamerica.comNo signalNo signalNo signalPartly blocked
906figma.comReservedNo signalNo signalBlocked
907allaboutcookies.orgNo signalNo signalNo signalAllowed
908amazon.co.zaReservedReservedReservedBlocked
909fwmrm.netNo signalNo signalNo signalAllowed
910princeton.eduNo signalNo signalNo signalPartly blocked
912epa.govNo signalNo signalNo signalPartly blocked
915disqus.comNo signalNo signalNo signalPartly blocked
916lg.comNo signalNo signalNo signalPartly blocked
917wyzecam.comAllowedNo signalAllowedAllowed
918kleinanzeigen.deNo signalNo signalNo signalPartly blocked
920latimes.comNo signalNo signalNo signalBlocked
921mikrotik.comNo signalNo signalNo signalAllowed
922smilewanted.comNo signalNo signalNo signalAllowed
924classlink.comNo signalNo signalNo signalAllowed
925networkadvertising.orgNo signalNo signalNo signalAllowed
926qualtrics.comNo signalNo signalNo signalPartly blocked
928otto.deNo signalNo signalNo signalPartly blocked
929seedtag.comNo signalNo signalNo signalAllowed
930coupang.comNo signalNo signalNo signalAllowed
931mayoclinic.orgNo signalNo signalNo signalAllowed
932service-now.comNo signalNo signalNo signalAllowed
934tailscale.comNo signalNo signalNo signalAllowed
935patreon.comNo signalNo signalNo signalPartly blocked
936spamhaus.orgNo signalNo signalNo signalAllowed
938xiaohongshu.comReservedReservedReservedBlocked
939note.comNo signalNo signalNo signalPartly blocked
940ddns.netNo signalNo signalNo signalAllowed
941flashtalking.comNo signalNo signalAllowedAllowed
943genius.comNo signalNo signalNo signalAllowed
944state.govNo signalNo signalNo signalAllowed
945cootlogix.comNo signalNo signalNo signalAllowed
946repubblica.itNo signalNo signalNo signalBlocked
947amazonalexa.comReservedReservedReservedBlocked
950vkontakte.ruNo signalNo signalNo signalPartly blocked
951instructure.comNo signalNo signalNo signalPartly blocked
952cdnvideo.ruNo signalNo signalNo signalPartly blocked
953jetbrains.comNo signalNo signalNo signalPartly blocked
954youku.comNo signalNo signalNo signalAllowed
956character.aiNo signalNo signalNo signalPartly blocked
957odoo.comNo signalNo signalNo signalPartly blocked
958nexusmods.comNo signalNo signalNo signalAllowed
959leiniao.comNo signalNo signalNo signalAllowed
962mercadolibre.com.arNo signalReservedNo signalBlocked
963amazon.com.auReservedReservedReservedBlocked
964chaturbate.comNo signalNo signalNo signalAllowed
966corriere.itNo signalNo signalNo signalBlocked
967docker.ioNo signalNo signalNo signalPartly blocked
969bund.deNo signalNo signalNo signalPartly blocked
970washington.eduNo signalNo signalNo signalPartly blocked
971ancestry.comNo signalNo signalNo signalAllowed
973buydomains.comNo signalNo signalNo signalAllowed
974eporner.comNo signalNo signalNo signalPartly blocked
975gotinder.comNo signalNo signalNo signalPartly blocked
976onet.plNo signalNo signalNo signalPartly blocked
977curseforge.comNo signalNo signalNo signalAllowed
978singular.netNo signalNo signalNo signalPartly blocked
979lowes.comNo signalNo signalNo signalAllowed
980hm.comNo signalNo signalNo signalAllowed

← Previous Next →