Custom Robots.txt

TipsnInfo April 03, 2023

Definition of Robots. txt

Robots.txt is a provision made by search engines, to prevent web crawlers and other web robots, either crawling part or all of the web.this robot functions to monitor web pages, so they can be indexed immediately or not indexed at all by search engines like Google, Bing, Yandex etc.

How to set Custom Robots.txt on Blogspot:

  • Please enter the dashboard of your blog buddy
  • Select the Settings menu (Settings)
  • Select Browsing Preferences (Browsing Preferences)
  • Click Edit in custom Robots.txt

User-agent: Mediapartners-Google

Disallow:
User-agent: *
Disallow: /search
Allow: /


Follow the full steps in the tutorial below.



Tags

Post a Comment

0 Comments

Post a Comment
'; (function() { var dsq = document.createElement('script'); dsq.type = 'text/javascript'; dsq.async = true; dsq.src = '//' + disqus_shortname + '.disqus.com/embed.js'; (document.getElementsByTagName('head')[0] || document.getElementsByTagName('body')[0]).appendChild(dsq); })();