# beleeg.com — crawl rules # # Every route serves index.html (client-rendered SPA), so these path rules # are how we keep signed-in app surfaces out of search results. Public # marketing, league, team, org, tournament, and event pages stay crawlable. User-agent: * # Private / signed-in app surfaces — keep out of the index. Disallow: /admin Disallow: /account Disallow: /home Disallow: /me Disallow: /team Disallow: /welcome Disallow: /host Disallow: /officiate Disallow: /sponsor/ Disallow: /invite/ # /players/:userId is the PUBLIC player profile (PlayerProfilePublicPage) — # intentionally crawlable, so it is deliberately NOT disallowed. # Auth / onboarding routes. Disallow: /signin Disallow: /reset Disallow: /auth/ # Internal preview + dev routes (already noindex; belt-and-suspenders here). Disallow: /og-preview/ Disallow: /spinner # Media-author home is private; published articles are public. Disallow: /press Allow: /press/article/ # The raw app shell (every real page has its own address). Disallow: /app.html # AI search and assistant crawlers — welcome on public pages. A crawler obeys # only the most specific group that names it, so this group repeats the same # private-page rules as above (keep the two lists identical). Plain-text # summaries for language models live at /llms.txt and /llms-full.txt. User-agent: GPTBot User-agent: OAI-SearchBot User-agent: ChatGPT-User User-agent: ClaudeBot User-agent: Claude-SearchBot User-agent: anthropic-ai User-agent: PerplexityBot User-agent: Perplexity-User User-agent: Google-Extended User-agent: Applebot-Extended User-agent: CCBot User-agent: Amazonbot User-agent: DuckAssistBot User-agent: meta-externalagent Allow: / # Private / signed-in app surfaces — keep out of the index. Disallow: /admin Disallow: /account Disallow: /home Disallow: /me Disallow: /team Disallow: /welcome Disallow: /host Disallow: /officiate Disallow: /sponsor/ Disallow: /invite/ # /players/:userId is the PUBLIC player profile (PlayerProfilePublicPage) — # intentionally crawlable, so it is deliberately NOT disallowed. # Auth / onboarding routes. Disallow: /signin Disallow: /reset Disallow: /auth/ # Internal preview + dev routes (already noindex; belt-and-suspenders here). Disallow: /og-preview/ Disallow: /spinner # Media-author home is private; published articles are public. Disallow: /press Allow: /press/article/ # The raw app shell (every real page has its own address). Disallow: /app.html Sitemap: https://beleeg.com/sitemap-index.xml