File: robots.txt

package info (click to toggle)
astropy 5.2.1-2
  • links: PTS, VCS
  • area: main
  • in suites: bookworm
  • size: 41,972 kB
  • sloc: python: 219,331; ansic: 147,297; javascript: 13,556; lex: 8,496; sh: 3,319; xml: 1,622; makefile: 185
file content (6 lines) | stat: -rw-r--r-- 208 bytes parent folder | download | duplicates (14) 
1
2
3
4
5
6
 
User-agent: *
Allow: /*/latest/
Allow: /en/latest/   # Fallback for bots that don't understand wildcards
Allow: /*/stable/
Allow: /en/stable/   # Fallback for bots that don't understand wildcards
Disallow: /