File: www.univision.com

package info (click to toggle)
python-protego 0.5.0%2Bdfsg-1
  • links: PTS, VCS
  • area: main
  • in suites: forky, sid
  • size: 30,052 kB
  • sloc: python: 1,579; perl: 190; cpp: 33; sh: 4; makefile: 3
file content (115 lines) | stat: -rw-r--r-- 2,018 bytes parent folder | download | duplicates (4)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
User-agent: *
Allow: /
Disallow: /deportes/fantasy/template*
Disallow: /noticias/live-fyre-blog-test*
Disallow: /verizon-connecta-la-banda*
Disallow: /temas/verizon-connecta-la-banda*
Disallow: /temas/test*
Disallow: /test*
Disallow: /amp/test*
Disallow: /en/*
Disallow: /buscar
Disallow: /6881
Disallow: /beta
Disallow: /*playlist.xml
Disallow: /_preview

User-agent: Flipboard
Allow: /
Disallow: /deportes/fantasy/template*
Disallow: /noticias/live-fyre-blog-test*
Disallow: /verizon-connecta-la-banda*
Disallow: /temas/verizon-connecta-la-banda*
Disallow: /temas/test*
Disallow: /test*
Disallow: /amp/test*
Disallow: /en/*
Disallow: /buscar
Disallow: /6881
Disallow: /beta
Disallow: /*playlist.xml
Disallow: /_preview

User-agent: netseer
Disallow: /

User-agent: Clickagy Intelligence Bot v2
Disallow: /

User-agent: sitecheck.internetseer.com
Disallow: /

User-agent: Zealbot
Disallow: /

User-agent: MSIECrawler
Disallow: /

User-agent: SiteSnagger
Disallow: /

User-agent: WebStripper
Disallow: /

User-agent: WebCopier
Disallow: /

User-agent: Fetch
Disallow: /

User-agent: Offline Explorer
Disallow: /

User-agent: Teleport
Disallow: /

User-agent: TeleportPro
Disallow: /

User-agent: WebZIP
Disallow: /

User-agent: linko
Disallow: /

User-agent: HTTrack
Disallow: /

User-agent: Microsoft.URL.Control
Disallow: /

User-agent: larbin
Disallow: /

User-agent: libwww
Disallow: /

User-agent: ZyBORG
Disallow: /

User-agent: Download Ninja
Disallow: /

User-agent: UbiCrawler
Disallow: /

User-agent: DOC
Disallow: /

User-agent: Zao
Disallow: /

User-agent: Slurp
Disallow: /

User-agent: Maxthon
Disallow: /

User-agent: CNCDialer
Disallow: /

# Sitemaps and Autodiscovers
Sitemap: https://www.univision.com/sitemap.xml
Sitemap: https://www.univision.com/feed-sitemap/google-news
Sitemap: https://www.univision.com/seo-sitemaps/sitemap.xml
Sitemap: https://www.univision.com/video-sitemap.xml