# Vizible AI - robots.txt # Page-level control uses noindex meta tags and headers; this file only keeps crawlers out of the # app, auth and internal paths. # # AI crawlers are welcome (GPTBot, ChatGPT-User, PerplexityBot, ClaudeBot, Google-Extended...). # They are named in the group below rather than in groups of their own: a crawler follows only the # most specific group that names it (RFC 9309), so a separate "Allow: /" group made those bots # ignore every Disallow. Every crawler gets the same rules. # If a tool reports AI crawlers as blocked, the block comes from the hosting's bot protection # settings, not from this file. User-agent: * User-agent: GPTBot User-agent: ChatGPT-User User-agent: OAI-SearchBot User-agent: PerplexityBot User-agent: ClaudeBot User-agent: anthropic-ai User-agent: Google-Extended User-agent: Googlebot User-agent: Bingbot Allow: / # Private app routes (all language variants) Disallow: /dashboard Disallow: /en/dashboard Disallow: /fr/dashboard Disallow: /account Disallow: /en/account Disallow: /fr/account Disallow: /setup Disallow: /en/setup Disallow: /fr/setup Disallow: /insights Disallow: /en/insights Disallow: /fr/insights Disallow: /action-center Disallow: /en/action-center Disallow: /fr/action-center Disallow: /en/login Disallow: /fr/login Disallow: /en/signup Disallow: /fr/signup # "$" ends the match: a bare /en/auth would also block /en/author/ (the author pages). Disallow: /en/auth$ Disallow: /fr/auth$ Disallow: /en/auth? Disallow: /fr/auth? Disallow: /en/reset-password Disallow: /fr/reset-password Disallow: /en/plans Disallow: /fr/plans Disallow: /en/post-onboarding-plans Disallow: /fr/post-onboarding-plans Disallow: /en/post-onboarding-loading Disallow: /fr/post-onboarding-loading Disallow: /en/subscription-success Disallow: /fr/subscription-success # Email unsubscribe links and the Google Analytics connection callback (no language prefix) Disallow: /unsubscribe Disallow: /auth/ Sitemap: https://vizibleai.com/sitemap.xml