User-agent: * Allow: / Disallow: /admin/ Disallow: /private/ User-agent: GPTBot User-agent: Claude-Web User-agent: Anthropic-AI User-agent: PerplexityBot User-agent: GoogleOther User-agent: DuckAssistBot Disallow: / Allow: /llms.txt