# Robots.txt file for http://www.lacanaldenavarres.com # User-agent: MS Search 4.0 Robot Disallow: / User-agent: Mozilla/4.0 (compatible; MSIE 4.01; Windows NT; MS Search 4.0 Robot) Microsoft Disallow: / User-agent: * Disallow: /admin/ Disallow: /App_Browser/ Disallow: /App_Code/ Disallow: /App_Data/ Disallow: /App_GlobalResources/ Disallow: /aspnet_client/ Disallow: /bin/ Disallow: /CGI-BIN/ Disallow: /Components/ Disallow: /controls/ Disallow: /database/ Disallow: /DesktopModules/ Disallow: /Documentation/ Disallow: /greybox/ Disallow: /images/ Disallow: /Install/ Disallow: /js/ Disallow: /Portals/_default/ Disallow: /Portals/msg/ Disallow: /Portals/foros/ Disallow: /*Terms/Default.aspx$ Disallow: /*Privacy/Default.aspx$ Disallow: /*Login/Default.aspx$ Disallow: /*Register/Default.aspx$ User-agent: msnbot Disallow: /admin/ Disallow: /App_Browser/ Disallow: /App_Code/ Disallow: /App_Data/ Disallow: /App_GlobalResources/ Disallow: /aspnet_client/ Disallow: /bin/ Disallow: /CGI-BIN/ Disallow: /Components/ Disallow: /controls/ Disallow: /database/ Disallow: /DesktopModules/ Disallow: /Documentation/ Disallow: /greybox/ Disallow: /images/ Disallow: /Install/ Disallow: /js/ Disallow: /Portals/msg/ Disallow: /Portals/foros/ Disallow: /Portals/_default/ Disallow: /*Terms/Default.aspx$ Disallow: /*Privacy/Default.aspx$ Disallow: /*Login/Default.aspx$ Disallow: /*Register/Default.aspx$ Crawl-delay: 5 User-agent: Slurp Disallow: /admin/ Disallow: /App_Browser/ Disallow: /App_Code/ Disallow: /App_Data/ Disallow: /App_GlobalResources/ Disallow: /aspnet_client/ Disallow: /bin/ Disallow: /CGI-BIN/ Disallow: /Components/ Disallow: /controls/ Disallow: /database/ Disallow: /DesktopModules/ Disallow: /Documentation/ Disallow: /greybox/ Disallow: /images/ Disallow: /Install/ Disallow: /js/ Disallow: /Portals/msg/ Disallow: /Portals/foros/ Disallow: /Portals/_default/ Disallow: /*Terms/Default.aspx$ Disallow: /*Privacy/Default.aspx$ Disallow: /*Login/Default.aspx$ Disallow: /*Register/Default.aspx$ Crawl-delay: 5 User-agent: Googlebot Disallow: /admin/ Disallow: /App_Browser/ Disallow: /App_Code/ Disallow: /App_Data/ Disallow: /App_GlobalResources/ Disallow: /aspnet_client/ Disallow: /bin/ Disallow: /CGI-BIN/ Disallow: /Components/ Disallow: /controls/ Disallow: /database/ Disallow: /DesktopModules/ Disallow: /Documentation/ Disallow: /greybox/ Disallow: /images/ Disallow: /Install/ Disallow: /js/ Disallow: /Portals/msg/ Disallow: /Portals/foros/ Disallow: /Portals/_default/ Disallow: /*Terms/Default.aspx$ Disallow: /*Privacy/Default.aspx$ Disallow: /*Login/Default.aspx$ Disallow: /*Register/Default.aspx$