CrawlWitness

AI consent of the world's top websites

Which of the most visited websites allow AI training, RAG and AI search, updated every day.

16%reserve AI training
16%block GPTBot
15%block ClaudeBot
13%block Google-Extended
17%block CCBot

Daily AI-consent report →

#DomainAI trainingRAG and AI answersAI searchGPTBot
1813ucsd.eduNo signalNo signalNo signalPartly blocked
1814medallia.comNo signalNo signalNo signalPartly blocked
1816xfinity.comNo signalNo signalNo signalPartly blocked
1818google.esNo signalNo signalNo signalPartly blocked
1820dns-shop.ruNo signalNo signalNo signalPartly blocked
1821vmware.comNo signalNo signalNo signalPartly blocked
1822hover.comAllowedAllowedAllowedPartly blocked
1823pusher.comNo signalNo signalNo signalAllowed
1824acs.orgNo signalNo signalNo signalAllowed
1825newyorker.comReservedReservedReservedPartly blocked
1826kaspi.kzNo signalNo signalNo signalPartly blocked
1828trustarc.comNo signalNo signalNo signalPartly blocked
1829trello.comNo signalNo signalNo signalPartly blocked
1830va.govNo signalNo signalNo signalPartly blocked
1831mparticle.comNo signalNo signalNo signalAllowed
1832hostinger.comReservedAllowedAllowedPartly blocked
1834overwolf.comNo signalNo signalNo signalAllowed
1835arstechnica.comReservedReservedReservedPartly blocked
1836rambler.ruNo signalNo signalNo signalAllowed
1837ryanair.comNo signalNo signalNo signalPartly blocked
1838pewresearch.orgAllowedAllowedAllowedPartly blocked
1839w3schools.comNo signalNo signalNo signalPartly blocked
1840enable-javascript.comNo signalNo signalNo signalAllowed
1841sciencedaily.comNo signalNo signalNo signalPartly blocked
1844bitdefender.comAllowedAllowedAllowedPartly blocked
1845moodle.orgNo signalNo signalNo signalAllowed
1846akismet.comNo signalNo signalNo signalPartly blocked
1847starlink.comNo signalNo signalNo signalPartly blocked
1848medal.tvNo signalNo signalNo signalPartly blocked
1850rbc.ruNo signalNo signalNo signalAllowed
1852utorrent.comNo signalNo signalNo signalAllowed
1853algolia.netNo signalNo signalNo signalAllowed
1854investing.comNo signalNo signalNo signalAllowed
1855nps.govNo signalNo signalNo signalPartly blocked
1857orcid.orgNo signalNo signalNo signalPartly blocked
1859screenconnect.comNo signalNo signalNo signalPartly blocked
1861zdnet.comReservedReservedReservedBlocked
1862websitewelcome.comNo signalNo signalNo signalAllowed
1863akamai.comNo signalNo signalNo signalAllowed
1864fortinet.netReservedReservedNo signalPartly blocked
1865apkpure.comNo signalNo signalNo signalAllowed
1867geocities.comReservedNo signalNo signalBlocked
1868deezer.comReservedReservedNo signalPartly blocked
1869google.itNo signalNo signalNo signalPartly blocked
1871sitescout.comNo signalNo signalNo signalAllowed
1872si.eduNo signalNo signalNo signalPartly blocked
1874onrender.comAllowedAllowedAllowedPartly blocked
1875livedns.co.ukNo signalNo signalNo signalAllowed
1876wps.cnNo signalNo signalNo signalAllowed
1877wpastra.comReservedAllowedAllowedPartly blocked
1879moengage.comNo signalNo signalNo signalPartly blocked
1880marketwatch.comReservedReservedReservedPartly blocked
1881uchicago.eduNo signalNo signalNo signalPartly blocked
1884appier.netNo signalNo signalNo signalPartly blocked
1885dynamics.comNo signalNo signalNo signalPartly blocked
1888www.nhs.ukNo signalNo signalNo signalPartly blocked
1889hulu.comNo signalNo signalNo signalPartly blocked
1890mega.nzNo signalNo signalNo signalPartly blocked
1891kicker.deNo signalNo signalNo signalAllowed
1892plex.tvNo signalNo signalNo signalPartly blocked
1893smartthings.comNo signalNo signalNo signalPartly blocked
1894utexas.eduNo signalNo signalNo signalPartly blocked
1895yimg.comNo signalNo signalNo signalAllowed
1896waze.comNo signalNo signalNo signalPartly blocked
1897adrta.comReservedReservedReservedBlocked
1899scientificamerican.comReservedNo signalReservedBlocked
1901indexww.comNo signalNo signalNo signalAllowed
1903hetzner.comNo signalNo signalNo signalPartly blocked
1906beeline.ruNo signalNo signalNo signalPartly blocked
1908mapbox.comNo signalNo signalNo signalPartly blocked
1911salesforceliveagent.comNo signalNo signalNo signalPartly blocked
1913clevelandclinic.orgNo signalNo signalNo signalAllowed
1914tappx.comNo signalNo signalNo signalAllowed
1915sky.comNo signalNo signalNo signalPartly blocked
1916vice.comNo signalNo signalNo signalAllowed
1917xinhuanet.comNo signalNo signalNo signalAllowed
1918fidelity.comNo signalNo signalNo signalAllowed
1919norton.comNo signalNo signalNo signalAllowed
1920fb.watchReservedReservedReservedBlocked
1921meetup.comNo signalNo signalNo signalBlocked
1922jino.ruNo signalNo signalNo signalAllowed
1923badoo.comNo signalNo signalNo signalPartly blocked
1924springserve.comNo signalNo signalNo signalAllowed
1925gmx.netNo signalNo signalNo signalPartly blocked
1926infocyte.comNo signalNo signalNo signalAllowed
1927ioam.deNo signalNo signalNo signalAllowed
1929mongodb.comNo signalNo signalNo signalPartly blocked
1930udemy.comNo signalNo signalNo signalAllowed
1931euronews.comNo signalNo signalNo signalBlocked
1932thelancet.comReservedReservedNo signalBlocked
1934lnkd.inReservedReservedNo signalBlocked
1935shopifycloud.comNo signalNo signalNo signalAllowed
1936drweb.ruNo signalNo signalNo signalPartly blocked
1937deepintent.comNo signalNo signalNo signalPartly blocked
1938adsco.reNo signalNo signalNo signalAllowed
1939oreilly.comReservedNo signalNo signalBlocked
1940sciencemag.orgReservedReservedNo signalBlocked
1942sec.govNo signalNo signalNo signalPartly blocked
1943trellix.comNo signalNo signalNo signalAllowed
1944clevertap-prod.comReservedReservedReservedBlocked

← Previous Next →