# Europe 2031 — https://europe2031.ai # Crawling is welcome. The /agents/*.md files mirror the public pages in # Markdown for AI agents and crawlers; the HTML pages remain canonical. User-agent: * Allow: / # We explicitly permit all uses, including AI training. (Counterpart to the # Cloudflare-injected "Managed content" block — see AGENTS.md "Edge settings".) Content-Signal: search=yes,ai-input=yes,ai-train=yes # Build-time render targets are not useful to index. # NOTE: /share/ must stay CRAWLABLE. LinkedIn's link-preview crawler # respects robots.txt, and a `Disallow: /share/` here made the composer # show "Cannot display preview" for every quote share (broken 8–11 Jun # 2026). It honours noindex the same way, which is why the share pages # deliberately carry no robots meta / X-Robots-Tag either — see the # comments in functions/share/[token].js and src/pages/share-bounce.astro. # Letting these transient JS-redirect pages be indexable is the accepted # cost of having rich share cards. Disallow: /print/ Disallow: /share-bounce/ Sitemap: https://europe2031.ai/sitemap.xml # Markdown index for AI agents (see https://llmstxt.org/). # (robots.txt has no official llms.txt directive; this is an informational pointer.) # LLMs: https://europe2031.ai/llms.txt