1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
|
## Ask.com robots.txt
User-agent: *
Noindex: /Allabout
Noindex: /allabout?
Noindex: /ans
Noindex: /answers
Noindex: /ar?
Noindex: /News
Noindex: /news?
Noindex: /Pictures
Noindex: /pictures?
Noindex: /ref
Noindex: /settings
Noindex: /touch/
Noindex: /TouchWeb
Noindex: /touchWeb?
Noindex: /web
Noindex: /Web
Noindex: /Wiki
Noindex: /wiki
Noindex: /Youtube
Noindex: /youtube
Noindex: /popular-questions/
Noindex: /ja-question
Noindex: /browse
Noindex: /maps?
Noindex: /sports/
Noindex: /zoomad
Noindex: /Web-answers
Noindex: /web-answers
Noindex: /web-explore
Noindex: /Web-explore
Noindex: /Web-question
Noindex: /web-question
Noindex: /webans?
Noindex: /shopping/
Noindex: /shopping?
Noindex: /slideshow/
Disallow: /videos
Disallow: /article/
Disallow: /articles/
Disallow: /fragment
Disallow: *ad=
Disallow: *aq=
User-agent: Mediapartners-Google
Disallow:
User-agent: Teoma
Disallow:
User-agent: netseer
Disallow:
User-agent: AdsBot-Google
Disallow:
User-agent: AdIdxBot
Disallow:
User-agent: proximic
Disallow:
|
