CrawlWitness

AI consent of the world's top websites

Which of the most visited websites allow AI training, RAG and AI search, updated every day.

15%reserve AI training
16%block GPTBot
15%block ClaudeBot
14%block Google-Extended
17%block CCBot

Daily AI-consent report →

#DomainAI trainingRAG and AI answersAI searchGPTBot
141nih.govNo signalNo signalNo signalAllowed
144apache.orgNo signalNo signalNo signalPartly blocked
145discord.ggNo signalNo signalNo signalPartly blocked
146webex.comNo signalNo signalNo signalAllowed
149vk.ruNo signalNo signalNo signalPartly blocked
150archive.orgNo signalNo signalNo signalPartly blocked
152forms.gleNo signalNo signalNo signalAllowed
153duckdns.orgNo signalNo signalNo signalAllowed
155vk.comNo signalNo signalNo signalPartly blocked
156crashlytics.comNo signalNo signalNo signalPartly blocked
157snapchat.comReservedNo signalNo signalBlocked
158tumblr.comReservedNo signalNo signalPartly blocked
159godaddy.comNo signalNo signalNo signalAllowed
162reg.ruNo signalNo signalNo signalAllowed
163nytimes.comReservedReservedReservedBlocked
167gravatar.comReservedNo signalNo signalBlocked
168ubuntu.comNo signalNo signalNo signalPartly blocked
170telegram.orgNo signalNo signalNo signalAllowed
171kaspersky.comAllowedAllowedAllowedAllowed
172shopify.comNo signalNo signalNo signalPartly blocked
174google-analytics.comNo signalNo signalNo signalPartly blocked
175paypal.comNo signalNo signalNo signalPartly blocked
176samsungcloud.comNo signalNo signalNo signalPartly blocked
177example.comNo signalNo signalNo signalAllowed
178scorecardresearch.comNo signalNo signalNo signalAllowed
179flickr.comReservedReservedNo signalBlocked
180pages.devNo signalNo signalNo signalAllowed
182w3.orgNo signalNo signalNo signalPartly blocked
183telekom.netNo signalNo signalNo signalPartly blocked
184discord.comNo signalNo signalNo signalPartly blocked
185creativecommons.orgNo signalNo signalNo signalAllowed
187unity3d.comNo signalNo signalNo signalPartly blocked
188ebay.comReservedNo signalNo signalBlocked
189soundcloud.comNo signalNo signalNo signalPartly blocked
190cnn.comNo signalNo signalNo signalBlocked
191meraki.comNo signalNo signalNo signalPartly blocked
193vkuserphoto.ruNo signalNo signalNo signalAllowed
194pki.googNo signalNo signalNo signalPartly blocked
195afternic.comNo signalNo signalNo signalAllowed
197theguardian.comNo signalNo signalNo signalPartly blocked
198mts.ruNo signalNo signalNo signalPartly blocked
200comcast.netNo signalNo signalNo signalAllowed
202medium.comNo signalNo signalNo signalBlocked
204stripe.comNo signalNo signalNo signalPartly blocked
208doi.orgNo signalNo signalNo signalAllowed
209app-measurement.comNo signalNo signalNo signalAllowed
210forter.comReservedAllowedAllowedAllowed
211bybanking.comNo signalNo signalNo signalAllowed
212oracle.comNo signalNo signalNo signalAllowed
216bbc.comNo signalNo signalNo signalBlocked
217criteo.comNo signalNo signalNo signalAllowed
218astrumu.ioNo signalNo signalNo signalPartly blocked
219xiaomi.comNo signalNo signalNo signalAllowed
222quickconnect.toNo signalNo signalNo signalAllowed
224firefox-portal-detection.comNo signalNo signalNo signalAllowed
225forbes.comNo signalNo signalNo signalAllowed
226wikimedia.orgNo signalNo signalNo signalAllowed
227twitch.tvNo signalNo signalNo signalPartly blocked
228arubanetworks.comNo signalNo signalNo signalAllowed
229publicnode.comNo signalNo signalNo signalPartly blocked
230sciencedirect.comReservedReservedNo signalAllowed
231hcaptcha.comNo signalNo signalNo signalPartly blocked
232researchgate.netNo signalNo signalNo signalPartly blocked
233mit.eduNo signalNo signalNo signalPartly blocked
235applovin.comNo signalNo signalNo signalPartly blocked
236nist.govNo signalNo signalNo signalPartly blocked
237bbc.co.ukNo signalNo signalNo signalBlocked
238skyhigh.cloudNo signalNo signalNo signalAllowed
239weather.comNo signalNo signalNo signalPartly blocked
240roku.comNo signalNo signalNo signalPartly blocked
241namecheap.comNo signalNo signalNo signalPartly blocked
246amplitude.comAllowedAllowedAllowedPartly blocked
247cpanel.netNo signalNo signalNo signalPartly blocked
248t.coReservedReservedReservedBlocked
250adtrafficquality.googleNo signalNo signalNo signalPartly blocked
251cisco.comNo signalNo signalNo signalPartly blocked
253sourceforge.netNo signalNo signalNo signalPartly blocked
256icanhazip.comNo signalNo signalNo signalAllowed
259dnsmadeeasy.comNo signalNo signalNo signalAllowed
260hubspot.comNo signalNo signalNo signalPartly blocked
263imdb.comReservedReservedReservedBlocked
264linktr.eeNo signalNo signalNo signalPartly blocked
266alidns.comNo signalNo signalNo signalAllowed
267googleadservices.comNo signalNo signalNo signalAllowed
270who.intNo signalNo signalNo signalAllowed
271googleblog.comNo signalNo signalNo signalPartly blocked
275brave.comNo signalNo signalNo signalAllowed
277ibm.comNo signalNo signalNo signalPartly blocked
278userapi.comNo signalNo signalNo signalPartly blocked
279canva.comReservedNo signalNo signalBlocked
282reuters.comNo signalNo signalNo signalBlocked
283datadoghq.comNo signalNo signalNo signalPartly blocked
284launchpad.netReservedReservedReservedBlocked
285hp.comNo signalAllowedAllowedAllowed
288tinyurl.comNo signalNo signalNo signalAllowed
289telegram.meNo signalNo signalNo signalAllowed
290booking.comNo signalNo signalNo signalPartly blocked
291www.gov.ukNo signalNo signalNo signalPartly blocked
293gamepass.comNo signalNo signalNo signalPartly blocked
296ip-api.comNo signalNo signalNo signalPartly blocked

← Previous Next →