# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file User-agent: * Disallow: /shopping/ Disallow: /product/ Disallow: /go/ Disallow: /article/ Disallow: /word/ Disallow: /kw/ Disallow: /keyword/ Disallow: /tag/ Disallow: /lyrics/