User-agent: * Disallow: /wp-admin/ Disallow: /wp-login.php Disallow: /cgi-bin/ Disallow: /xmlrpc.php Allow: /wp-admin/admin-ajax.php # Allow important crawlers full access User-agent: Googlebot Allow: / User-agent: Googlebot-News Allow: / User-agent: Googlebot-Image Allow: / User-agent: Googlebot-Mobile Allow: / User-agent: Mediapartners-Google Allow: / # Sitemap locations (auto-updated by Rank Math or Yoast) Sitemap: https://everydaypost.in/sitemap_index.xml Sitemap: https://everydaypost.in/post-sitemap.xml Sitemap: https://everydaypost.in/page-sitemap.xml Sitemap: https://everydaypost.in/category-sitemap.xml # Crawl-delay (optional: adjust for shared hosting load) Crawl-delay: 5