File: www.emirates.com

package info (click to toggle)
python-protego 0.1.16%2Bdfsg-2
  • links: PTS, VCS
  • area: main
  • in suites: bullseye
  • size: 30,204 kB
  • sloc: python: 1,426; perl: 190; cpp: 33; sh: 12; makefile: 3
file content (17 lines) | stat: -rw-r--r-- 495 bytes parent folder | download | duplicates (4) 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
 
User-agent: *
Disallow: /SessionHandler.aspx
Disallow: /TealeafTarget.aspx
Disallow: /sessionhandler.aspx
Disallow: /tealeaftarget.aspx
Disallow: /sessionkeepalive.aspx
Disallow: */woyf/?*Cookie=
Disallow: */pop-ups/
Disallow: */certificate-request/*/certificate-request/*
Disallow: */destinations/city.aspx*
Disallow: */experience/login/
Disallow: */ekgroup/id*
Disallow: */woyf/?*arrAp=*

Crawl-delay: 3
Host: www.emirates.com
Sitemap: https://www.emirates.com/sitemapindex.xml