#### RULES FOR ANY ROBOT User-agent: * ########################### # Pages with no real value Disallow: /error.htm Disallow: /login.aspx Disallow: /logout.aspx Disallow: /user/CreateUser.aspx Disallow: /user/EmailForgottenPassword.aspx Disallow: /user/EditProfile.aspx Disallow: /eventSearch.aspx Disallow: /GoogleSiteMap.ashx Disallow: /blogs/rsscomments.ashx Disallow: /WebResource.axd Disallow: /ScriptResource.axd Disallow: /blogs/rss.ashx Disallow: /aggbug.aspx ########################### # Directories to deny Disallow: /controlpanel/ Disallow: /msgs/ Disallow: /themes/ Disallow: /Themes/ Disallow: /user/ # Directories & files to deny from the old site Disallow: /home.pl Disallow: /homenf.htm Disallow: /about_pollstar.pl Disallow: /pollstarpremium/ Disallow: /tour/ Disallow: /news/ Disallow: /member/ Disallow: /photos/ Disallow: /reviews/ Disallow: /marketplace/ Disallow: /forums/ Disallow: /pssearch.exe/ # non-essential content (FAQ) Disallow: /languages/ # non-standard extensions, only 1 crawl every 5 seconds Crawl-delay: 5 Request-rate: 1/5 #### RULES TO DENY Yahoo Pipes User-agent: Yahoo Pipes 1.0 Disallow: /