File: robots.txt

package info (click to toggle)
ruby-openid 2.9.2debian-2
  • links: PTS, VCS
  • area: main
  • in suites: bookworm
  • size: 2,252 kB
  • sloc: ruby: 17,952; javascript: 6,183; xml: 219; sh: 78; python: 30; makefile: 2
file content (5 lines) | stat: -rw-r--r-- 204 bytes parent folder | download | duplicates (110) 
1
2
3
4
5
 
# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
#
# To ban all spiders from the entire site uncomment the next two lines:
# User-Agent: *
# Disallow: /