# robots.txt file # www.ololrmc.com # Version 4.1-ALL, 11/25/09 # Adjusted 1/5/2010 # BASIC robots.txt file for sitemaker websites. # All robots allowed, some pages excluded # Must be named "robots.txt" and be in the root folder. # ALL ROBOTS User-agent: * Disallow: Crawl-delay: 5 Disallow: /blank Disallow: /BLANK Disallow: /print Disallow: /PRINT # GOOGLEBOT User-agent: Googlebot Disallow: Disallow: /blank Disallow: /BLANK Disallow: /print Disallow: /PRINT Disallow: /?src= Disallow: /Body Disallow: /FluIq Disallow: /body.cfm/ Disallow: /body.cfm.cfm # GSA User-agent: gsa-crawler Disallow: Disallow: /blank Disallow: /BLANK Disallow: /print Disallow: /PRINT Disallow: /1