# llms.txt — Permissions for AI Crawlers and LLM Agents # ------------------------- # Global rule for all AI crawlers # ------------------------- User-Agent: * Allow: / # ------------------------- # OpenAI (ChatGPT / GPT crawlers) # ------------------------- User-Agent: OpenAI-Explorer Allow: / User-Agent: GPTBot Allow: / # ------------------------- # Anthropic (Claude) # ------------------------- User-Agent: ClaudeBot Allow: / User-Agent: Anthropics-Web-Agent Allow: / # ------------------------- # Google (Gemini AI Crawler) # ------------------------- User-Agent: Google-Extended Allow: / # ------------------------- # Perplexity AI # ------------------------- User-Agent: PerplexityBot Allow: / # ------------------------- # Meta / Facebook LLaMA Crawler # ------------------------- User-Agent: Meta-External-Agent Allow: /