File: www.hagerty.com

package info (click to toggle)
python-protego 0.5.0%2Bdfsg-1
  • links: PTS, VCS
  • area: main
  • in suites: forky, sid
  • size: 30,052 kB
  • sloc: python: 1,579; perl: 190; cpp: 33; sh: 4; makefile: 3
file content (42 lines) | stat: -rw-r--r-- 1,430 bytes parent folder | download | duplicates (4)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
# robots.txt for both Direct and Agent web sites

Sitemap: https://www.hagerty.com/sitemaps/sitemap-usdirect.xml
Sitemap: https://www.hagerty.ca/sitemaps/sitemap-cadirect.xml
Sitemap: https://www.hagerty.com/sitemaps/sitemap-mediasite.xml
Sitemap: https://www.hagerty.com/sitemaps/sitemap-ukdirect.xml
Sitemap: https://www.hagerty.com/apps/valuationtools/sitemap.xml
Sitemap: https://www.hagerty.ca/apps/valuationtools/sitemap.xml

User-agent: *
Disallow: /Admin/
Disallow: /bberry/
Disallow: /Documents/
Disallow: /DocumentTemp/
Disallow: /Encompass/
Disallow: /eRenewal/
Disallow: /Images2Upload/
Disallow: /LiveSupport/
Disallow: /Pollmanager/
Disallow: /SupApps/
Disallow: /Temp/
Disallow: /PrintApplication.asp
Disallow: /lifestyle/eventdetail.aspx
Disallow: /*.axd$
Disallow: /design/designersReport.aspx
Disallow: /qte/mobile/
Disallow: /qte/quoteinput.aspx?aff=*
Disallow: /*/sitecore/content/
Disallow: /valuationtools/HVT/VehicleSearch/Report
Disallow: /*/CaptchaImage.axd
Disallow: /apps/QuoteMyClassic/
Disallow: /apps/Resources/Chat/
Disallow: /~/media/Images
Disallow: /-/media/Images
Disallow: /~/media/images
Disallow: /-/media/images
Disallow: /articles-videos/-/media/images
Disallow: /articles-videos/~/media/images
Disallow: /articles-videos/-/media/Images
Disallow: /articles-videos/~/media/Images
Disallow: /yourstories
Disallow: /articles-videos/Featured-Classics/