CrawlWitness

AI consent of the world's top websites

Which of the most visited websites allow AI training, RAG and AI search, updated every day.

15%reserve AI training
16%block GPTBot
15%block ClaudeBot
14%block Google-Extended
17%block CCBot

Daily AI-consent report →

#DomainAI trainingRAG and AI answersAI searchGPTBot
437adobe.netNo signalNo signalNo signalPartly blocked
439firetvcaptiveportal.comNo signalNo signalNo signalAllowed
441telekom.deNo signalNo signalNo signalAllowed
444dailymotion.comNo signalNo signalNo signalPartly blocked
446inmobi.comNo signalNo signalNo signalAllowed
450hostgator.comNo signalNo signalNo signalAllowed
451pushy.ioNo signalNo signalNo signalAllowed
453intel.comNo signalNo signalNo signalPartly blocked
454statsigapi.netNo signalNo signalNo signalAllowed
455dropcatch.comNo signalNo signalNo signalAllowed
456ampproject.orgNo signalNo signalNo signalAllowed
457arxiv.orgNo signalNo signalNo signalPartly blocked
458taobao.comNo signalNo signalNo signalPartly blocked
459g.pageNo signalNo signalNo signalPartly blocked
461yahoo.co.jpNo signalNo signalNo signalAllowed
462chatgpt.siteNo signalNo signalNo signalPartly blocked
463eye4.cnNo signalNo signalNo signalAllowed
465pixabay.comReservedNo signalNo signalBlocked
466taboola.comNo signalNo signalNo signalPartly blocked
467bluehost.comNo signalNo signalNo signalAllowed
468duolingo.comNo signalNo signalNo signalPartly blocked
469prodregistryv2.orgNo signalNo signalNo signalAllowed
470speedtest.netNo signalNo signalNo signalAllowed
471lijit.comNo signalNo signalNo signalAllowed
472huawei.comNo signalNo signalNo signalPartly blocked
473run.appNo signalNo signalNo signalAllowed
475businessinsider.comNo signalNo signalNo signalPartly blocked
477cnbc.comReservedReservedReservedBlocked
478walmart.comNo signalNo signalNo signalPartly blocked
479aliexpress.comReservedNo signalNo signalBlocked
481wp.comNo signalNo signalNo signalPartly blocked
482goodreads.comNo signalNo signalNo signalBlocked
484shein.comNo signalNo signalNo signalPartly blocked
486selectel.ruNo signalNo signalNo signalPartly blocked
487fandom.comNo signalNo signalNo signalAllowed
489ietf.orgNo signalNo signalNo signalAllowed
490mzstatic.comNo signalNo signalNo signalPartly blocked
493amazon.co.jpReservedReservedReservedBlocked
495featureassets.orgNo signalNo signalNo signalAllowed
496statista.comNo signalNo signalNo signalPartly blocked
497quora.comNo signalNo signalNo signalBlocked
500scribd.comNo signalNo signalNo signalAllowed
501crpt.ruNo signalNo signalNo signalAllowed
502trendmicro.comReservedAllowedAllowedPartly blocked
503eventbrite.comNo signalNo signalNo signalPartly blocked
504sina.com.cnNo signalNo signalNo signalAllowed
505teamviewer.comNo signalNo signalNo signalPartly blocked
506addtoany.comNo signalNo signalNo signalPartly blocked
507foxnews.comNo signalNo signalNo signalPartly blocked
511netcraze.ioReservedReservedReservedBlocked
512indiatimes.comNo signalNo signalNo signalPartly blocked
513braze.comNo signalNo signalNo signalPartly blocked
515google.deNo signalNo signalNo signalPartly blocked
517markmonitor.comNo signalNo signalNo signalAllowed
518timeweb.ruNo signalNo signalNo signalPartly blocked
520trueconf.netNo signalNo signalNo signalPartly blocked
521share.googleNo signalNo signalNo signalAllowed
522amzn.toReservedReservedReservedBlocked
523google.com.hkNo signalNo signalNo signalPartly blocked
524noaa.govNo signalNo signalNo signalAllowed
525playstation.comNo signalNo signalNo signalPartly blocked
526openstreetmap.orgNo signalNo signalNo signalPartly blocked
527behance.netReservedNo signalNo signalBlocked
528tplinkcloud.comNo signalNo signalNo signalPartly blocked
529dyndns.orgNo signalNo signalNo signalAllowed
530adsafeprotected.comNo signalNo signalNo signalAllowed
531supercell.comNo signalNo signalNo signalAllowed
533oraclecloud.comNo signalNo signalNo signalAllowed
535docker.comNo signalNo signalNo signalPartly blocked
536appsflyer.comNo signalNo signalNo signalAllowed
538openx.netNo signalNo signalNo signalAllowed
540mysql.comNo signalNo signalNo signalPartly blocked
542stackoverflow.comNo signalNo signalNo signalAllowed
543capcut.comNo signalNo signalNo signalPartly blocked
544adriver.ruNo signalNo signalNo signalAllowed
545shop.appNo signalNo signalNo signalPartly blocked
548nease.netNo signalNo signalNo signalAllowed
549uol.com.brReservedReservedReservedPartly blocked
550mozilla.comNo signalNo signalNo signalPartly blocked
552ft.comNo signalNo signalNo signalPartly blocked
553force.comNo signalNo signalNo signalPartly blocked
554slideshare.netNo signalNo signalNo signalAllowed
555firefox.comNo signalNo signalNo signalPartly blocked
556cloudns.netNo signalNo signalNo signalAllowed
557icloud-content.comNo signalNo signalNo signalPartly blocked
558visualstudio.comNo signalNo signalNo signalPartly blocked
560tandfonline.comReservedReservedNo signalBlocked
561klaviyo.comNo signalNo signalNo signalPartly blocked
563oup.comNo signalNo signalNo signalAllowed
566sohu.comNo signalNo signalNo signalPartly blocked
567fast.comNo signalNo signalNo signalPartly blocked
570herokuapp.comNo signalNo signalNo signalAllowed
573cornell.eduNo signalNo signalNo signalPartly blocked
575wired.comNo signalNo signalNo signalPartly blocked
576newrelic.comNo signalNo signalNo signalPartly blocked
577tripadvisor.comReservedNo signalNo signalBlocked
578discord.mediaNo signalNo signalNo signalAllowed
579dreamhost.comNo signalNo signalNo signalPartly blocked
580ivi.ruNo signalNo signalNo signalPartly blocked
581comcast.comNo signalNo signalNo signalAllowed

← Previous Next →