1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
|
User-agent: *
Noindex: *=
Disallow: *=
Allow: /thmb/*
Allow: *utm_medium=social
Noindex: *.pdf
Disallow: *.pdf
Noindex: *quizResult=
Disallow: *quizResult=
Noindex: *globeNoTest
Disallow: *globeNoTest
Noindex: *globeResourceConcat
Disallow: *globeResourceConcat
Noindex: *globeTest_optimizelyInclusion
Disallow: *globeTest_optimizelyInclusion
Noindex: *?kw
Disallow: *?kw
User-agent: Mediapartners-Google
Disallow:
User-agent: Yahoo-MMCrawler
Allow: /z/cg/
User-agent: BecomeBot
Crawl-Delay: 10
User-agent: Pinterest
Disallow:
User-agent: Pinterestbot
Disallow:
Sitemap: https://www.liveabout.com/sitemap.xml
|
