At blogger also provides the facility to add robots txt, but by default robots.txt at blogger is empty. And blogger warned us to be careful in adding robots.txt, because if one in adding robots.txt, then the blog will be ignored by the search engine (blog can not be found by search engines.
Here is how to add a robots.txt on blogger:
- Please go to "google blogger login account", and do login with your email and password
- Settings> Search preferences
- Find Crawlers and indexing, and underneath there is a Custom robots.txt
- In the default position, robots.txt disable status. And to use it please click Edit
How to add robots.txt to blogger |
- After clicking edit, provide a check on Yes, and will show an empty box that you must fill in:
User-agent: Mediapartners-Google
Disallow:
User-agent: *
Disallow: / search
Allow: /
Sitemap: http://bloggermendalo.blogspot.co.id/feeds/posts/default?orderby=UPDATED
- Replace bloggermendalo.blogspot.co.id with your blog url
- Continue to click the Save Change
Hopefully, after the adding a robots.txt file, our blog will be easily crawled by search engines
No comments:
Post a Comment
You must already opened this page.
Make sure that you have left a comment before leaving this page