User-Agent: * Allow: / # App / dashboard URLs live on nevermined.app, not nevermined.ai. Disallowing # these here prevents Google from indexing legacy / cross-domain references # that have zero search value and, in the case of /permissions/sk-*, are a # credential-leak risk if surfaced in SERPs. Disallow: /permissions/ Disallow: /agents/ Disallow: /checkout/ Disallow: /api-keys/ Disallow: /profile Disallow: /analytics Disallow: /admin Disallow: /register Disallow: /revenue-events Disallow: /request-events Sitemap: https://nevermined.ai/sitemap.xml # Cross-submitted so docs discovery does not depend solely on the merge in # `app/sitemap.ts`. Crawlers only read robots.txt from the origin root # (RFC 9309 section 2.3), so the `Sitemap:` line inside /docs/robots.txt is # never seen. If the merge's host/prefix filter ever drops every entry, this # still reaches all docs URLs. Same host, so no cross-domain caveat applies. Sitemap: https://nevermined.ai/docs/sitemap.xml