Be Confident! Confront Custom Robots.Txt For Blogspot? Positively.

Robots.txt provides to pose off spider web crawlers operate alongside spider web robots from accessing all or business office of a website if it is publicly persuasion able. Essentially a robots.txt file on a spider web site volition serve every mo a asking that specified robots ignore specified files or directories when crawling a site.

On the off gamble that you lot use the wordpress.org stage Online journal, robots.txt tape tin brand yourself yesteryear agency of document principal inwards cpanel, withal inwards the number that you lot are blogspot customer in addition to thus in that place are steps that should locomote earlier actuating robots.txt (crippled every mo a affair of course).

1. Login to your Blogger draw of piece of work concern human relationship in addition to larn to your spider web log dashboard.

2. Click on Settings >> Search preferences

3. Edit your Custom robots.txt the lead Yes to enable custom robots.txt content

4. Then fill upwards alongside the next command

User-agent: Mediapartners-Google

Allow:/

User-agent: Googlebot

Disallow: /?m=1

Disallow: /?m=0

Disallow: /*?m=1

Disallow: /*?m=0

User-agent: *

Disallow: /search?*

User-agent: Twitterbot

Allow:/

User-agent: *

Disallow: /search

Disallow: /p/*

Disallow: /view/*

Allow: /

Sitemap: http://blogsnucleus.blogspot.com/feeds/post/default?orderby=UPDATED

 Note: Green letters supersede alongside your ain blog

5. Save your jobs

For websites alongside several sub domains, each sub domain must bring its ain robots.txt file. If blogsnucleus.com had a robots.txt file only sub. blogsnucleus.com not, the dominion which would apply for blogsnucleus.com would non apply to a. blogsnucleus.com. 

If you lot liked this post, click hither in addition to locomote inwards your Email address to follow my advancement.

Subscribe to Blogsnucleus Today!