# Ruby Lane robots.txt User-agent: psbot User-agent: agent@mysimon.com User-agent: linksmanager User-agent: RedCarpet User-agent: OmniExplorer_Bot User-agent: TurnitinBot User-agent: Twiceler User-agent: grub-client User-agent: NaverBot User-agent: e-SocietyRobot User-agent: PCNBot User-agent: aipbot User-agent: PGBot User-agent: MJ12bot User-agent: VoilaBot Disallow: / User-agent: Teoma Crawl-delay: 4 Disallow: /ads Disallow: /cgi-bin Disallow: /clickv1 Disallow: /en Disallow: /enter Disallow: /graphics Disallow: /info/topic Disallow: /ni User-agent: msnbot Crawl-delay: 4 Disallow: /ads Disallow: /cgi-bin Disallow: /clickv1 Disallow: /en Disallow: /enter Disallow: /graphics Disallow: /info/topic Disallow: /ni User-agent: Slurp Crawl-delay: 4 Disallow: /ads Disallow: /cgi-bin Disallow: /clickv1 Disallow: /en Disallow: /enter Disallow: /graphics Disallow: /info/topic Disallow: /ni User-agent: * Disallow: /ads Disallow: /cgi-bin Disallow: /clickv1 Disallow: /en Disallow: /enter Disallow: /graphics Disallow: /info/topic Disallow: /ni