User-agent: * Allow: / # Private/auth-gated areas with no public content worth crawling. These are not # meant to be deindexed via noindex (they need a session to render anything), so # a crawl boundary here just saves crawl budget. Disallow: /api/ Disallow: /account/ Disallow: /checkout/ Disallow: /website/ # NOTE: auth/utility flows (/connect, /forgot-password, /reset-password, # /check-your-email, /verify-email, /unsubscribe) are deliberately NOT disallowed # here. They serve , and Google must be # able to CRAWL them to SEE that noindex. Disallowing them would leave URL-only # listings that can never be deindexed ("noindex never seen"). Sitemap: https://devdome.com/sitemap-index.xml