File: www.foodnetwork.com

package info (click to toggle)
python-protego 0.6.0%2Bdfsg-1
  • links: PTS, VCS
  • area: main
  • in suites: forky, sid
  • size: 30,048 kB
  • sloc: python: 1,492; perl: 190; cpp: 33; sh: 4; makefile: 3
file content (30 lines) | stat: -rw-r--r-- 794 bytes parent folder | download | duplicates (4)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
User-agent: *
Allow: /content/dam/
Allow: /content/food-com/jcr:content/analytics.sitecatalyst.js
Disallow: /content/
Allow: /libs/granite/
Disallow: /libs/
Disallow: /services/
Disallow: /search/
Disallow: /features/apple-news/
Disallow: /mobile-app/
Disallow: /sponsored/in-the-kitchen/
Disallow: /shows/tv-schedule.*
Disallow: *.recipePrint
Disallow: *.embed
Disallow: */recentlyaired*
Disallow: */ratings*
Allow: *.lazy-fetch*
Allow: *hotspot*

User-agent: Mediapartners-Google
Disallow:

Sitemap: https://www.foodnetwork.com/sitemaps/sitemap_food_index.xml
Sitemap: https://www.foodnetwork.com/fn-dish/news-sitemap.xml
Sitemap: https://www.foodnetwork.com/healthyeats/news-sitemap.xml

User-agent: Googlebot-News
Allow: /fn-dish
Allow: /healthyeats
Disallow: /