User-agent: * Disallow: /admin/ Disallow: /admin2009/ Disallow: /mobile/ Disallow: /association/ Disallow: /associations/ Disallow: /meteo/ Disallow: /include/ Disallow: /partenariat.php Disallow: /mon-compte/ # --- Bots SEO concurrentiels (aucun bénéfice pour nous) --- User-agent: AhrefsBot Disallow: / User-agent: SemrushBot Disallow: / User-agent: SemrushBot-SA Disallow: / User-agent: DataForSeoBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: DotBot Disallow: / User-agent: SERankingBot Disallow: / User-agent: SEOkicks Disallow: / User-agent: BLEXBot Disallow: / # --- Moteurs avec ~0% de part de marché en France --- User-agent: Bytespider Disallow: / User-agent: PetalBot Disallow: / # --- Entraînement IA sans bénéfice search (Meta = Llama) --- User-agent: meta-externalagent Disallow: / User-agent: FacebookBot Disallow: / # --- Anciens crawlers déjà bloqués --- User-agent: TurnitinBot Disallow: / User-agent: ConveraCrawler Disallow: / User-agent: QuepasaCreep Disallow: / User-agent: Jetbot Disallow: / Sitemap: https://www.le-site-de.com/sitemap_fiche.xml