User-agent: * Disallow: /gerer/abonnement/inscription/ User-agent: DataForSeoBot Disallow: / User-agent: Twiceler Disallow: / User-agent: twiceler Disallow: / User-agent: twiceler. Disallow: / User-agent: Spinn3r Disallow: / User-agent: IRLbot Disallow: / User-agent: HTTrack 3.0 Disallow: / User-agent: yandex bot Disallow: / User-agent: YandexSomething Disallow: / User-agent: Spinn3r Disallow: / User-agent: radian6_default Disallow: / User-agent: radian6 Disallow: / User-agent: R6_FeedFetcher Disallow: / User-agent: R6_CommentReader Disallow: / User-agent: Mediapartners-Google* Disallow: User-agent: dotbot Disallow: / User-agent: spinn3r Disallow: / User-agent: ia_archiver Disallow: / User-agent: NextGenSearchBot Disallow: / User-agent: CamontSpider Disallow: / User-agent: ccbot Disallow: / User-agent: spbot Disallow: / User-agent: coccoc Disallow: / User-agent: Cliqzbot Disallow: / User-agent: msnbot Crawl-delay: 1 User-agent: bingbot Crawl-delay: 1 User-agent: spbot Disallow: / User-agent: MJ12bot Disallow: / User-agent: proximic Disallow: / # Block Searchmetrics Bot #User-agent: SearchmetricsBot #Disallow: / # Block Eniro User-agent: ECCP/1.0 (search@eniro.com) Disallow: / # Block Baidu User-agent: Baiduspider User-agent: Baiduspider-video User-agent: Baiduspider-image User-agent: Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html) User-agent: Mozilla/5.0 (compatible; Baiduspider/3.0; +http://www.baidu.com/search/spider.html) User-agent: Mozilla/5.0 (compatible; Baiduspider/4.0; +http://www.baidu.com/search/spider.html) User-agent: Mozilla/5.0 (compatible; Baiduspider/5.0; +http://www.baidu.com/search/spider.html) User-agent: Baiduspider/2.0 User-agent: Baiduspider/3.0 User-agent: Baiduspider/4.0 User-agent: Baiduspider/5.0 Disallow: / # Block SoGou User-agent: Sogou Spider Disallow: / # Block Youdao User-agent: YoudaoBot Disallow: / # Block Nikon JP Crawler User-agent: gsa-crawler (Enterprise; T4-KNHH62CDKC2W3; gsa_manage@nikon-sys.co.jp) Disallow: / # Block MegaIndex.ru User-agent: MegaIndex.ru/2.0 Disallow: / User-agent: MegaIndex.ru Disallow: / User-agent: megaIndex.ru Disallow: / User-agent: Mail.RU_Bot/2.0 Disallow: / User-agent: Mail.RU Disallow: / User-agent: Mail.RU_Bot/2.0; +http://go.mail.ru/help/robots Disallow: / User-Agent: MJ12bot Disallow: / User-Agent: MJ12bot/v1.4.3 Disallow: / User-agent: PetalBot Disallow: / User-agent: SemrushBot-SA Disallow: / User-agent: SemrushBot-BA Disallow: / User-agent: SemrushBot-SI Disallow: / User-agent: SemrushBot-SWA Disallow: / User-agent: SemrushBot-CT Disallow: / User-agent: SemrushBot-BM Disallow: / User-agent: SemrushBot-SEOAB Disallow: / User-agent: AhrefsBot Disallow: / User-agent: ClaudeBot Disallow: /