1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
|
Sitemap: http://www.telstra.com.au/sitemap.xml
User-agent: *
Disallow: /mobile/mobiles/
Disallow: /partners
Disallow: /uberprod
Disallow: /uberprod/
Disallow: /idc
Disallow: /idc/
Disallow: /abouttelstra/media-centre/tv-reel
Disallow: /abouttelstra/media-centre/tv-reel/
Disallow: /misc/mobile-site/
Disallow: /abouttelstra/education-centre/
Disallow: /styleguide
Disallow: /telstraprepaidplus/myprepaid/
Disallow: /mobile-phones/product-catalogue/
Disallow: /small-business/product-catalogue/
Allow: /misc/mobile-site/index.html
Disallow: /aboutus/media/jump-page
Disallow: /products/
Disallow: /search
User-agent: telstra-gsa-crawler
Allow: /aboutus/media/jump-page
|
