# Robots.txt for dailydineup.com User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php # Explicitly allow major SEO crawlers User-agent: AhrefsBot Disallow: User-agent: SemrushBot Disallow: User-agent: ScreamingFrogSEOSpider Disallow: User-agent: MJ12bot Disallow: User-agent: DotBot Disallow: User-agent: BLEXBot Disallow: Sitemap: https://dailydineup.com/sitemap_index.xml