CrawlWitness

merchantcircle.com: may AI use this website?

What merchantcircle.com tells AI bots today, read from its robots.txt and the newer AI-consent standards, checked daily and signed by CrawlWitness.

Analysed: 2026-11-13 22:25 UTC · Global rank (Tranco) #16,894

AI trainingReserved
robots.txt bloquea 6 de 6 bots de entrenamiento
RAG and AI answersReserved
robots.txt bloquea 5 de 5 bots de agentes de usuario
AI searchReserved
robots.txt bloquea 4 de 4 bots de búsqueda

Major AI bots in robots.txt

BotOperatorAccess
GPTBotOpenAIBlocked
ClaudeBotAnthropicBlocked
Google-ExtendedGoogleBlocked
Applebot-ExtendedAppleBlocked
meta-externalagentMetaBlocked
BytespiderByteDanceBlocked
CCBotCommon CrawlBlocked
OAI-SearchBotOpenAIBlocked
PerplexityBotPerplexityBlocked
ChatGPT-UserOpenAIBlocked

Signals found

AIPREF (IETF)—
Content-Signal—
TDMRep—
RSL 1.0—
llms.txt—

Notarised history

7 versions recorded since 2026-11-08; last change 2026-11-11. Each version is signed and anchored on Base. /v1/historial/merchantcircle.com

Recent changes

2026-11-13ChatGPT-UserAllowed → Blocked
2026-11-13OAI-SearchBotAllowed → Blocked
2026-11-13PerplexityBotAllowed → Blocked
2026-11-13BytespiderAllowed → Blocked
2026-11-13meta-externalagentAllowed → Blocked
2026-11-13Applebot-ExtendedAllowed → Blocked
2026-11-13CCBotAllowed → Blocked
2026-11-13Google-ExtendedAllowed → Blocked
2026-11-13ClaudeBotAllowed → Blocked
2026-11-13GPTBotAllowed → Blocked
2026-11-13AI searchNo signal → Reserved
2026-11-13RAG and AI answersNo signal → Reserved
2026-11-13AI trainingNo signal → Reserved
2026-11-13AI trainingNo signal → Reserved
2026-11-11ChatGPT-UserBlocked → Allowed
2026-11-11OAI-SearchBotBlocked → Allowed
2026-11-11PerplexityBotBlocked → Allowed
2026-11-11BytespiderBlocked → Allowed
2026-11-11meta-externalagentBlocked → Allowed
2026-11-11Applebot-ExtendedBlocked → Allowed

What it means by jurisdiction

EU: commercial text and data mining is allowed unless the rightholder reserves it in a machine-readable way (Art. 4(3) Directive 2019/790). General-purpose AI providers must respect those reservations (AI Act Art. 53), enforceable by the Commission since August 2026.

UK: the data-mining exception covers only non-commercial research. In 2026 the government dropped the proposed opt-out exception, so commercial AI training generally needs a licence.

US: there is no statutory opt-out; whether training is fair use is being decided in court. Signals like robots.txt are evidence of what the owner permitted.

Japan: Article 30-4 broadly allows use for AI training, except where it unreasonably prejudices the rightholder; technical measures such as robots.txt can matter in that assessment.

Information, not legal advice.

Own merchantcircle.com? Verify it, sign your AI-use declaration and get a dated evidence certificate.

CrawlWitness Publisher · 7 days free

Building AI or crawling the web? Check thousands of domains by API, MCP or x402 and pay per call.

API · MCP · x402 · 7 days free

Check another domain