User-agent: Googlebot Allow: /webadmin/scripts/ Allow: /webadmin/css/ User-agent: gsa-crawler Disallow: /directory/searchproviderpublic.htm* Disallow: /directory/viewprovider.htm* Disallow: /directory/searchresultspublic.htm* Disallow: /webadmin/ User-agent: * Disallow: /images/ Disallow: /media/ Disallow: /webadmin/ Disallow: /directory/searchprovideralphabetical.htm Disallow: /directory/ Disallow: /directory/searchproviderpublic.htm* Disallow: /directory/searchresultspublic.htm*