File: www.vrbo.com

package info (click to toggle)
python-protego 0.5.0%2Bdfsg-1
  • links: PTS, VCS
  • area: main
  • in suites: forky, sid
  • size: 30,052 kB
  • sloc: python: 1,579; perl: 190; cpp: 33; sh: 4; makefile: 3
file content (40 lines) | stat: -rw-r--r-- 976 bytes parent folder | download | duplicates (4)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
User-agent: *
disallow: /units/
disallow: /pm/
disallow: /index.cfm?exchangeRate=*
disallow: /listingpage.mvc/
disallow: /my/
disallow: /preview/
disallow: /traveler/profiles/
disallow: /calendar
disallow: /write
disallow: /*?q
disallow: /*?Q
disallow: /*td/profiles/
disallow: /listings/
disallow: /reviews/write/
disallow: /linktrip
disallow: /td/
disallow: /gd/
disallow: /vpv/
disallow: /forward
disallow: /auth/
disallow: /traveler/th
disallow: /traveler/api
disallow: /traveler/profile
disallow: /checkoutconfirmation
disallow: *?*adultscount*
disallow: *?emailaddress*
disallow: /paymentconfirmation
allow:  */api/vacation-rentals*

User-agent: Mediapartners-Google
Disallow:

User-agent: google-hoteladsverifier
Disallow:

Sitemap: https://www.vrbo.com/vacation-ideas/sitemap.xml
Sitemap: https://www.vrbo.com/sitemaps/PDP_Index_Sitemap_VRBO.xml
Sitemap: https://www.vrbo.com/sitemaps/SLP_Index_Sitemap_VRBO.xml
Sitemap: https://www.vrbo.com/vd2/temp/vrboserpindex.xml