User-agent: * Allow: / Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php # AI Search & LLM Crawlers (Explicitly Allowed) User-agent: GPTBot Allow: / Allow: /llms.txt Allow: /*.md User-agent: PerplexityBot Allow: / Allow: /llms.txt Allow: /*.md User-agent: ClaudeBot Allow: / Allow: /llms.txt Allow: /*.md User-agent: Google-Extended Allow: / Allow: /llms.txt Allow: /*.md User-agent: Bytespider Allow: / Allow: /llms.txt Allow: /*.md # Sitemaps Sitemap: https://digitalcyril.in/sitemap.xml Sitemap: https://digitalcyril.in/page-sitemap.xml Sitemap: https://digitalcyril.in/post-sitemap.xml Sitemap: https://digitalcyril.in/sitemap-ai.xml Sitemap: https://digitalcyril.in/llm-sitemap.xml