User-agent: * Disallow: /cgi-bin/ Disallow: /images/ Disallow: /ys_stats/ Disallow: /styles/ User-agent: BecomeBot Disallow: / User-agent: Schmozilla/v9.14 Platinum Disallow: / User-agent: psbot Disallow: / User-agent: DiamondBot Disallow: / User-agent: NiceBot Disallow: / User-agent: aipbot Disallow: / User-agent: Gaisbot Disallow: / User-agent: OmniExplorer_Bot Disallow: / User-agent: obot Disallow: / User-agent: NaverBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: boitho.com-dc Disallow: / User-agent: NextGenSearchBot Disallow: / User-agent: Exabot Disallow: / User-agent: Gigabot Disallow: / User-agent: NG/1.0 NG/2.0 Disallow: / User-agent: T-H-U-N-D-E-R-S-T-O-N-E Disallow: / User-agent: IRLbot Disallow: / User-agent: girafabot Disallow: / User-agent: sogou spider Disallow: / User-agent: Snapbot/1.0 Disallow: / User-agent: LocalcomBot/1.3.0 Disallow: / User-agent: VoilaBot Disallow: / User-agent: SBIder Disallow: / User-agent: Visbot/1.0 Disallow: / User-agent: VisBot/2.0 Disallow: / User-agent: Nutch/Nutch-0.9 Disallow: / User-agent: NetResearchServer Disallow: / User-agent: Factbot 1.09 Disallow: / User-agent: WebAlta Crawler/1.3.33 Disallow: / User-agent: StackRambler/2.0 Disallow: / User-agent: Charlotte Disallow: / User-agent: envolk Disallow: / User-agent: panscient.com Disallow: / User-agent: Mozilla/5.0 (MrCarlito-0.1 http://www.mrcarlito.com/spider.html) Disallow: / User-agent: CazoodleBot/CazoodleBot-0.1 Disallow: / User-agent: Twiceler-0.9 Disallow: / User-agent: grub-client Disallow: / User-agent: Balihoo/Nutch-1.0-dev Disallow: / User-agent: Pingdom GIGRIB Disallow: / User-agent: GeonaBot/1.2 Disallow: / User-agent: Yandex/1.01.001 (compatible; Win16; I) Disallow: / User-agent: daumoa Disallow: / User-agent: MojeekBot Disallow: / User-agent: GurujiBot Disallow: / User-agent: Acoon-Robot v3.00 Disallow: / User-agent: Baiduspider Disallow: / User-agent: GedoodleCrawler/Nutch-0.9 Disallow:/