# Spezifische Erlaubnis für Claude/Anthropic User-agent: Claude-Web Allow: / Disallow: /admin/ User-agent: Anthropic Allow: / Disallow: /admin/ User-agent: AnthropicBot Allow: / Disallow: /admin/ # Andere KI-Assistenten explizit erlaubt User-agent: ChatGPT-User Allow: / Disallow: /admin/ User-agent: GPTBot Allow: / Disallow: /admin/ User-agent: Google-Extended Allow: / Disallow: /admin/ User-agent: CCBot Allow: / Disallow: /admin/ # Alle Suchmaschinen-Crawler erlaubt User-agent: Googlebot Allow: / Disallow: /admin/ User-agent: Bingbot Allow: / Disallow: /admin/ User-agent: Slurp Allow: / Disallow: /admin/ User-agent: DuckDuckBot Allow: / Disallow: /admin/ User-agent: Baiduspider Allow: / Disallow: /admin/ User-agent: YandexBot Allow: / Disallow: /admin/ User-agent: facebookexternalhit Allow: / Disallow: /admin/ # Crawl-Delay für höfliches Crawling (optional) Crawl-delay: 1