#see http://www.google.com/remove.html#exclude_website #and http://www.robotstxt.org/wc/norobots.html #and http://www.google.com/webmasters/guidelines.html#quality #part: "Don't create multiple pages, subdomains, or domains with substantially duplicate content." User-agent: twiceler Disallow: /disc User-Agent: * Disallow: /activateBonusFunction.jsp Disallow: /address_ Disallow: /basket_ Disallow: /czc/products.nsf Disallow: /disca_ Disallow: /discadd.jsp Disallow: /favourite Disallow: /inshop/ Disallow: /manage Disallow: /product_doc Disallow: /program/ Disallow: /redir Disallow: /reg_ Disallow: /register.jsp Disallow: /register2.jsp Disallow: /rma_ Disallow: /statuser Disallow: /support_ Disallow: /user_profile Disallow: /user_remark.jsp Disallow: /user_review_list Disallow: /vote Disallow: /watchdog Allow: /