User-agent: * Allow: / # App + auth surfaces (not content) Disallow: /dashboard Disallow: /links Disallow: /analytics Disallow: /settings Disallow: /campaigns Disallow: /bulk Disallow: /domains Disallow: /api-keys Disallow: /webhooks Disallow: /team Disallow: /integrations Disallow: /billing Disallow: /bio/ Disallow: /unlock/ Disallow: /blocked/ Disallow: /challenge/ Disallow: /login Disallow: /signup Disallow: /forgot Disallow: /reset-password Disallow: /onboarding Disallow: /payment-success # AI / LLM crawlers — we WANT citations, so allow public content; keep the # same app/auth surfaces blocked. (Training + live-retrieval bots.) User-agent: GPTBot User-agent: OAI-SearchBot User-agent: ChatGPT-User User-agent: ClaudeBot User-agent: Claude-User User-agent: anthropic-ai User-agent: PerplexityBot User-agent: Perplexity-User User-agent: Google-Extended User-agent: Applebot-Extended User-agent: CCBot User-agent: Bytespider User-agent: meta-externalagent Allow: / Disallow: /dashboard Disallow: /links Disallow: /analytics Disallow: /settings Disallow: /campaigns Disallow: /bulk Disallow: /domains Disallow: /api-keys Disallow: /webhooks Disallow: /team Disallow: /integrations Disallow: /billing Disallow: /bio/ Disallow: /unlock/ Disallow: /blocked/ Disallow: /challenge/ Disallow: /login Disallow: /signup Disallow: /forgot Disallow: /reset-password Disallow: /onboarding Disallow: /payment-success Sitemap: https://linklane.io/sitemap.xml Sitemap: https://docs.linklane.io/sitemap.xml