Wednesday, 31 May 2017

How to Add Custom Robots.txt File in Blogger (Blogspot)?


Under: ,
For better performance of our blog we need to optimize it for better SEO. A better SEO is also needed to get organic traffic from search engines. One great step towards a better SEO is adding robots.txt file to your blog. It tells the search engines crawlers about what page to crawl and what not to. In Blogger (Blogspot) we have the option to customize the robots.txt file according to our needs. But before adding it to your blog firstly as a beginner we need to know about what is robots.txt file. So lets start the tutorial.

What is Robots.txt?

Robots.txt is a file which tells the search engine crawlers what page to crawl and what not to. Simply, you can exempt your blog demo pages, label pages, archive pages and other which you don't consider as important. Search engine crawlers always scan the robots.txt file before crawling any blog.
So lets start adding this great SEO improver to your blog.

Adding Robots.txt to Blogger (Blogspot) Blogs:

To add Custom Robots.txt file to your blog, follow the basic steps mentioned below:
  1. Go to your blogger blog.
  2. Navigate to Settings >> Search Preferences ›› 
  3. Crawlers and indexing ›› Custom robots.txt ›› Edit ›› Yes
  4. Now paste the below robots.txt file code in the box.
    User-agent: Mediapartners-Google
    Disallow:

    User-agent: *
    Disallow: /search
    Allow: /

    Sitemap: http://example.blogspot.com/feeds/posts/default?orderby=UPDATED
  5. Remember to change the highlighted url (example.blogspot.com) with your blog address.
  6. Click on Save Changes button.

You are all done.

How to Check Your Robots.txt File?

Simply add /robots.txt after your blog address and you will be shown your robots.txt file. Take a look at the below example


All set!
I hope you all easily added the custom robots.txt file in your blog. If you have any query regarding any of the blogspot tutorial, drop a comment below.

28 comments:

Tech Sources on 25 October, 2017 said...

I have a web domain....like any domain i am using mysitename.blogspost.in replace my web domain? Give ans

Tech Sources on 25 October, 2017 said...

Seo robot txt file

Hammad Ansari on 27 October, 2017 said...

@Tech Sources

Yes! You can use your domain.blogspot.com in the sitemap url of robots.txt file.
Stay connected :)

Reshmi on 08 December, 2017 said...

thnks

Hammad Ansari on 10 December, 2017 said...

@Reshmi
Stay Connected with Us :)

Sheedal on 23 January, 2018 said...

Thanks.

Raphael Precious on 12 March, 2018 said...

Is this my site map?

"Sitemap: http://myblog.blogspot.com/feeds/posts/default?orderby=UPDATED"

Anonymous said...

thanks...

CINTA SI NANA MANIS on 20 March, 2018 said...

thanks

Sunny Technical on 26 March, 2018 said...

Thanks for sharing

taufik rachman on 02 April, 2018 said...

why we have to Disallow: /search ??

Lilis Hendrani on 09 April, 2018 said...

Hi thanks for the article
but i need to know what is difference between
using site.com/sitemap.xml with site.com//feeds/posts/default?orderby=UPDATED

because I need to use it for my website https://www.curhatzzz.com/

Lilis Hendrani on 09 April, 2018 said...

Hi thanks for the article
but i need to know what is difference between
using site.com/sitemap.xml with site.com//feeds/posts/default?orderby=UPDATED

because I need to use it for my website EASY DIY AND CRAFTS

Amna Ahmed on 23 April, 2018 said...

I got this message when I want to access robots.txt file
Sorry, the page you were looking for in this blog does not exist.

Aftab Ayub Onick on 25 April, 2018 said...

Thanks a lot. That was helpfull for my website https://www.greatbooks.ml/

admin on 30 April, 2018 said...

Great Post. I have my default robots txt by google because i am using blogger hosting. I have only one question what does it means
User-agent: *
Disallow: /search
Please explain it clearly.

all HD on 16 May, 2018 said...

THANKS NICE POST
https://www.naat.online/

চন্দ্রবিন্ধু on 19 May, 2018 said...

thnks..... I got my for my blogg https://ssgolpokotha.blogspot.com

Stephen Nsowa Okyere on 26 May, 2018 said...

Thanks for your good work. You are really a good teacher.

Stephen Nsowa Okyere on 26 May, 2018 said...

Please I did that but it showed me only the ads on the blog.

Techlab Pro9 on 28 May, 2018 said...

Wow Such a great Blog. I thought that it was exceptionally helpful. I discovered this which is exceptionally utilize full. Extraordinary article and data continue sharing more! Love yours blog. Heap of Thanks.

Shere Khuda Hazrat Ali Radiallahu Anhu on 11 June, 2018 said...

thank u for the information.

http://www.sherekhudahazratali.com/2018/06/shab-e-qadr-ki-nishaniyan.html

James Uka on 18 June, 2018 said...

Nice write up..Thanks

Editor on 19 June, 2018 said...

Hello Hammad,
Thanks for write this awesome information for blogspot SEO. After reading your post, I also write an awesome article as blogger robots.txt. You also can see my post.

Children cartoon on 19 June, 2018 said...

thank admin.

User-agent: Mediapartners-Google
Disallow:
User-agent: *
Allow: /search
Disallow: /search*
Allow: /
Allow: *max-results=10
Allow: /search/label/
Disallow: *archive.html
Disallow: *?updated-max*
Disallow: *?m=0
Sitemap: website your/posts/default?orderby=UPDATED
Sitemap:website your/sitemap.xml
Sitemap: website your/atom.xml?redirect=false&start-index=1&max-results=500

http://www.tienanhit.com/

Life on 27 June, 2018 said...

I am just a beginner, i would like to know what to write in privacy policy.

is it helpful to get a back-link if i add my blog address here?
my blog address is https://usefullproductsa2z.blogspot.com/

Timothy Eniola on 02 July, 2018 said...

How can i link my blog with other blogs to get updated.
or
how can i allow other bloggers to share post into my blog.

Vivian Onyinyechi on 12 July, 2018 said...

Whoever wrote this post, you are one in a million

Confused? Feel free to ask!

We love comments! We appreciate your queries but to protect from being spammed, all comments will be moderated by our human moderators. Read our full comment policy here.
Let's enjoy a happy and meaningful conversation ahead!

 

Facebook

Recent Comments

Copyright © 2017-18 All Rights Reserved by BBeginner.Com ׀ Designed by DMCA.com Protection Status