File: www.polimi.it

package info (click to toggle)
python-protego 0.5.0%2Bdfsg-1
  • links: PTS, VCS
  • area: main
  • in suites: forky, sid
  • size: 30,052 kB
  • sloc: python: 1,579; perl: 190; cpp: 33; sh: 4; makefile: 3
file content (14 lines) | stat: -rw-r--r-- 465 bytes parent folder | download | duplicates (4) 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
 
# Da: http://www.typo3blog.nl/seo/what-robotstxt-to-use-with-typo3.html
User-Agent: *
Allow: /
Allow: /fileadmin/templates/*/*.css
Disallow: /fileadmin/templates/
Disallow: /typo3/
Disallow: /t3lib/
Disallow: /typo3conf/
Disallow: /typo3_src/
Disallow: /typo3temp/
#Disallow: /uploads/
Disallow: /*?id=*                             # Disable non-realurl
Disallow: /*&type=98                          # Disable print pages
Sitemap: https://www.polimi.it/sitemap.xml