File: www.dw.com

package info (click to toggle)
python-protego 0.2.1%2Bdfsg-1
  • links: PTS, VCS
  • area: main
  • in suites: bookworm
  • size: 30,208 kB
  • sloc: python: 1,430; perl: 190; cpp: 33; sh: 12; makefile: 3
file content (20 lines) | stat: -rw-r--r-- 543 bytes parent folder | download | duplicates (4)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
User-agent: * 
Disallow: /search/
Disallow: /overlay/
Disallow: /popups/mediaplayer/
Disallow: /popups/popup_gallery/
Disallow: /*/layoutvorlagen/
Disallow: /*/*/l-*/ler$
Disallow: /*/*/l-*/sum$
Disallow: /*/*/placement-*
Disallow: /*/*/final-*
Disallow: /*/user/account$
Disallow: /*/user/activity$
Disallow: /*/user/profile$
Disallow: /*/user/password/change$
Disallow: /*/user/password/set$
Disallow: /*/user/feedback/status?type=*
Disallow: /*/user/register/confirm$
Disallow: /*/user/email/change$

Sitemap: https://www.dw.com/sitemap.xml