# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file # # To ban all spiders from the entire site uncomment the next two lines: User-agent: * Disallow: /r/ Disallow: /rsg/ Disallow: /receiver_selectable_gift/* Disallow: /s/ Disallow: /cart/ Disallow: /receive/ Disallow: /gala/oauth/twitter/ Disallow: /account/* Disallow: /receipt/ Disallow: /business_gift/complete Disallow: /smartpass/2015* Disallow: /smartpass/thanks Disallow: /campaign/lot/ Disallow: /gift_card/edit/ Disallow: /order/ User-agent: Twitterbot Allow: /s/