1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
|
Sitemap: https://dblp.uni-trier.de/sitemap.xml
User-agent: *
Crawl-delay: 1
Disallow: //
Disallow: /cgi-bin
Disallow: /maps
Allow: /db
Disallow: /db/indices
Allow: /pers
Disallow: /pers/hb
Disallow: /pers/hg
Disallow: /pers/hj
Disallow: /pers/hk
Disallow: /pers/hx
Disallow: /pers/tb
Disallow: /pers/te
Disallow: /pers/tr
Disallow: /pers/xr
Disallow: /pers/xx
Disallow: /pers/xs
Disallow: /pers/xc
Disallow: /pers/xk
Allow: /rec
Disallow: /rec/bib
Disallow: /rec/ris
Disallow: /rec/nt
Disallow: /rec/rdf
Disallow: /rec/xml
Disallow: /search
Allow: /search/$
Disallow: /lookup
Allow: /lookup/$
|
