User-agent: * Allow: / User-agent: googlebot-news Allow: /rss/showcase User-agent: googlebot Allow: /rss/showcase User-agent: SemrushBot Disallow: / User-agent: GPTBot Disallow: / User-agent: PetalBot Disallow: / User-agent: PerplexityBot Disallow: / User-Agent: Amazonbot Disallow: / User-Agent: anthropic-ai Disallow: / User-Agent: Applebot Disallow: / User-Agent: Applebot-Extended Disallow: / User-Agent: Bytespider Disallow: / User-Agent: CCBot Disallow: / User-Agent: ChatGPT-User Disallow: / User-Agent: Claude Disallow: / User-Agent: Claudebot Disallow: / User-Agent: Claude-Web Disallow: / User-Agent: Deepseek Disallow: / User-Agent: Perplexity Disallow: / User-Agent: openai Disallow: / User-Agent: OAI-SearchBot Disallow: /