Monday, August 8, 2016

Optimum Script for Robots.txt in Wordpress

Here is the best and optimum code for robots.txt for wordpress site

User-agent: *
Disallow: /cgi-bin
Disallow: /wp-admin
Disallow: /wp-includes
Disallow: /wp-content/plugins
Disallow: /wp-content/cache
Disallow: /wp-content/themes
Disallow: /category
Disallow: /tag
Disallow: /author
Disallow: /trackback
Disallow: /*trackback
Disallow: /*trackback*
Disallow: /*/trackback
Disallow: /*?*
Disallow: /*.html/$
Disallow: /*feed*


# Google Bot
User-agent: Googlebot
Disallow:
Allow: /*

# Google Image
User-agent: Googlebot-Image
Disallow:
Allow: /*

# Google AdSense
User-agent: Mediapartners-Google
Disallow:
Allow: /*

# Google AdBot
User-agent: Adsbot-Google
Disallow:
Allow: /*

Sitemap: http://autogarment.com/sitemapindex.xml

No comments:

Post a Comment