User-agent: Googlebot Disallow: /webadmin/ User-agent: Bingbot Disallow: /webadmin/ User-agent: DuckDuckGo Disallow: /webadmin/ User-agent: Applebot Disallow: /webadmin/ User-agent: gsa-crawler Disallow: /directory/searchproviderpublic.htm* Disallow: /directory/viewprovider.htm* Disallow: /directory/searchresultspublic.htm* Disallow: /webadmin/ User-agent: FunnelBack Disallow: /images/ Disallow: /media/ Disallow: /webadmin/ Disallow: /directory/searchprovideralphabetical.htm Disallow: /directory/ Disallow: /directory/searchproviderpublic.htm* Disallow: /directory/searchresultspublic.htm* Disallow: /search/ Disallow: /s/ User-agent: * Disallow: /