# Robots.txt para Conecta Fitness User-agent: * Allow: / # Block private areas from indexing Disallow: /admin Disallow: /app Disallow: /pagamento-confirmado Disallow: /pagamento-confirmado-no-trial Disallow: /minha-conta # Allow major search engines (must repeat Disallow rules — Allow: / overrides global block) User-agent: Googlebot Allow: / Disallow: /admin Disallow: /app Disallow: /pagamento-confirmado Disallow: /pagamento-confirmado-no-trial Disallow: /minha-conta Crawl-delay: 1 User-agent: Bingbot Allow: / Disallow: /admin Disallow: /app Disallow: /pagamento-confirmado Disallow: /pagamento-confirmado-no-trial Disallow: /minha-conta Crawl-delay: 1 User-agent: Slurp Allow: / Disallow: /admin Disallow: /app Disallow: /pagamento-confirmado Disallow: /pagamento-confirmado-no-trial Disallow: /minha-conta Crawl-delay: 1 # Allow social media bots User-agent: Twitterbot Allow: / User-agent: facebookexternalhit Allow: / User-agent: LinkedInBot Allow: / # Allow AI/LLM crawlers for search and discovery User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: Claude-Web Allow: / User-agent: ClaudeBot Allow: / User-agent: PerplexityBot Allow: / User-agent: Bytespider Allow: / User-agent: cohere-ai Allow: / User-agent: anthropic-ai Allow: / # Block unwanted bots User-agent: AhrefsBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: DotBot Disallow: / # Sitemap index - master file pointing to all sub-sitemaps Sitemap: https://conecta.fitness/sitemap.xml # Host directive (optional, for Google) Host: https://conecta.fitness