File: www.potterybarn.com

package info (click to toggle)
python-protego 0.6.0%2Bdfsg-1
  • links: PTS, VCS
  • area: main
  • in suites: forky, sid
  • size: 30,048 kB
  • sloc: python: 1,492; perl: 190; cpp: 33; sh: 4; makefile: 3
file content (29 lines) | stat: -rw-r--r-- 734 bytes parent folder | download | duplicates (4)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
#
# robots.txt - Pottery Barn https://www.potterybarn.com
#

User-agent: EasouSpider
Disallow: /

User-agent: *
Disallow: /account/
Disallow: /checkout/
Disallow: /shoppingcart/
Disallow: /services/
Disallow: /shop_g/
Disallow: /shop_r/
Disallow: /products_g/
Disallow: /products_r/
Disallow: */minipip
Disallow: */quicklook
Disallow: /personalization/ 
Disallow: */show-mobile-email-signup 
Disallow: */show-join-email.jsonp 
Disallow: */registry/list.json 
Disallow: */apartment-
Allow: */apartment-furniture/

#Sitemaps
Sitemap: https://www.potterybarn.com/netstorage/ecom/sitemaps/registry/sitemapindex.xml
Sitemap: https://www.potterybarn.com/sitemap.xml
Sitemap: https://www.potterybarn.com/netstorage/sitemap-PB-tips-ideas.xml