# robots.txt file # www.texashealth.org # Version 3.3 - 4/3/09 # excluded /main on 8/22/08 # excluded /Body etc on 10/9/08 # BASIC robots.txt file for sitemaker websites. # Must be named "robots.txt" and be in the root folder. # Certain files excluded. # Exclude some User-agent: * Disallow: /blank Disallow: /BLANK Disallow: /print Disallow: /PRINT User-agent: Googlebot Disallow: /?src= Disallow: /Body Disallow: /Default.cfm Disallow: /Landing Disallow: /Workfiles/ Disallow: /body.cfm/ Disallow: /body.cfm.cfm #The following was added by http://www.texashealth.org/smm_googleadmin.cfm User-Agent: THR-gsa-crawler Disallow: Disallow: /blank Disallow: /BLANK Disallow: /print Disallow: /PRINT Disallow: /secure Disallow: /images