# RFC 9309 — Robots Exclusion Protocol # Content Signals: https://contentsignals.org/ User-agent: GPTBot Content-Signal: ai-train=yes, search=yes, ai-input=yes Allow: / Allow: /sitemap.xml Allow: /use-cases Allow: /en Allow: /pt Allow: /docs/api.html Allow: /openapi.json Allow: /auth.md Allow: /.well-known/ Disallow: /api/ Disallow: /oauth/ User-agent: OAI-SearchBot Content-Signal: ai-train=yes, search=yes, ai-input=yes Allow: / Allow: /sitemap.xml Allow: /use-cases Allow: /en Allow: /pt Allow: /docs/api.html Allow: /openapi.json Allow: /auth.md Allow: /.well-known/ Disallow: /api/ Disallow: /oauth/ User-agent: Claude-Web Content-Signal: ai-train=yes, search=yes, ai-input=yes Allow: / Allow: /sitemap.xml Allow: /use-cases Allow: /en Allow: /pt Allow: /docs/api.html Allow: /openapi.json Allow: /auth.md Allow: /.well-known/ Disallow: /api/ Disallow: /oauth/ User-agent: Google-Extended Content-Signal: ai-train=yes, search=yes, ai-input=yes Allow: / Allow: /sitemap.xml Allow: /use-cases Allow: /en Allow: /pt Allow: /docs/api.html Allow: /openapi.json Allow: /auth.md Allow: /.well-known/ Disallow: /api/ Disallow: /oauth/ User-agent: Amazonbot Content-Signal: ai-train=yes, search=yes, ai-input=yes Allow: / Allow: /sitemap.xml Allow: /use-cases Allow: /en Allow: /pt Allow: /docs/api.html Allow: /openapi.json Allow: /auth.md Allow: /.well-known/ Disallow: /api/ Disallow: /oauth/ User-agent: anthropic-ai Content-Signal: ai-train=yes, search=yes, ai-input=yes Allow: / Allow: /sitemap.xml Allow: /use-cases Allow: /en Allow: /pt Allow: /docs/api.html Allow: /openapi.json Allow: /auth.md Allow: /.well-known/ Disallow: /api/ Disallow: /oauth/ User-agent: Bytespider Content-Signal: ai-train=yes, search=yes, ai-input=yes Allow: / Allow: /sitemap.xml Allow: /use-cases Allow: /en Allow: /pt Allow: /docs/api.html Allow: /openapi.json Allow: /auth.md Allow: /.well-known/ Disallow: /api/ Disallow: /oauth/ User-agent: CCBot Content-Signal: ai-train=yes, search=yes, ai-input=yes Allow: / Allow: /sitemap.xml Allow: /use-cases Allow: /en Allow: /pt Allow: /docs/api.html Allow: /openapi.json Allow: /auth.md Allow: /.well-known/ Disallow: /api/ Disallow: /oauth/ User-agent: Applebot-Extended Content-Signal: ai-train=yes, search=yes, ai-input=yes Allow: / Allow: /sitemap.xml Allow: /use-cases Allow: /en Allow: /pt Allow: /docs/api.html Allow: /openapi.json Allow: /auth.md Allow: /.well-known/ Disallow: /api/ Disallow: /oauth/ User-agent: * Content-Signal: ai-train=yes, search=yes, ai-input=yes Allow: / Allow: /sitemap.xml Allow: /use-cases Allow: /en Allow: /pt Allow: /docs/api.html Allow: /openapi.json Allow: /auth.md Allow: /.well-known/ Disallow: /api/ Disallow: /oauth/ Sitemap: https://vaulty.to/sitemap.xml Agentmap: https://vaulty.to/.well-known/ai-catalog.json