Skip to main content

Add Sitemap to Robots.txt

How to Add Sitemap in Robots.txt File and Why it is Important

Today in this article I will tell you how to add sitemap in Robots.txt file and why it is important?

There are thousands of search engines in the world and it is not possible to submit your site to every search engine, but when you add your sitemap to Robots.txt file, you do not need to submit your site or blog to all search engines.

However, it is necessary to submit your site in Google and Bing.

Add sitemap Robots txt File, How to Add Sitemap to Robots.txt, How to Add Sitemaps to Robots.txt, Creating a Robots.txt file, Adding sitemap to robots


What is Sitemap and Robots.txt File


Sitemap is a list of all the URLs on your website and blog that tells the search engine about all the pages and posts URLs on your website. Sitemap does not improve your search ranking, but it allows search engines to crawl your website better.

Robots.txt file helps search engines understand which part of your site to index and which part not. When search engine robots visit your site, they follow the robots.txt file on your site and index the part that you want to be indexed in search engines.


Is it necessary to add sitemap in robots.txt file?


This is a question that all bloggers want to know that is it necessary to add sitemap in robots.txt?

The simple answer is – No.


Still why do we add sitemap in robots.txt file?

There are many search engines in the world and it is not possible to submit the site in each one, but when you add your sitemap in robots.txt file, then search engines can easily crawl and index your webpage URLs.


So let’s start adding sitemap to robots.txt file…


How to Add Sitemap to Robots.txt File

First, go to the root directory of your site and select the robots.txt file and add your sitemap URL by clicking on the Edit button.


Sitemap: http://www.example.com/sitemap.xml

Now your robots.txt file will look something like this.


Sitemap: http://www.example.com/sitemap.xml

User-agent: *

Disallow: /wp-admin/

Allow: /wp-admin/admin-ajax.php


Sitemap can be placed anywhere in the robots.txt file. It doesn’t matter where you place it.

How to Add Multiple Sitemap in Robots.txt File

You can see below,


Sitemap: http://www.example.com/sitemap_index.xml


User-agent: *

Disallow: /wp-admin/

Allow: /wp-admin/admin-ajax.php

Or, you can add different URLs for your multiple Sitemap files,

Sitemap: http://www.example.com/sitemap_host1.xml

Sitemap: http://www.example.com/sitemap_host2.xml

User-agent: *

Disallow: /wp-admin/

Allow: /wp-admin/admin-ajax.php

This way, you can manage your sitemap with the help of robots txt file. You can comment for any related to this article.

Today in this post you learned how to add your sitemap to your robots.txt file. If this article proved helpful for you, then don't forget to share it!

Labels:

Comments

Post a Comment

Popular posts from this blog

Home Loan: Banks Provide 5 Types of Loans

Home Loan: Banks provide 5 types of home loans, know which one will be beneficial for you Home Loan: Banks provide 5 types of loans. Customers can take home loans according to their needs. Home Loan: We all have a dream of having our own house. Many times people take loans from banks to buy houses. Financial advisors say that knowing about different homes is a profitable deal because you take home loans according to your needs and are able to save a lot. So let's know the 5 types of home loans and their benefits. Types of Home Loans Home Purchase Loan: Taken to buy a house. Home Improvement Loan: Taken for repair/renovation of the house. Home Construction Loan: Taken to build a new house. Land Purchase Loan: Taken to buy a plot to build your own house.   1. Home loan for house construction- If you want to build your own house, you can take a home purchase loan. It can include the cost of the plot as well as the cost of building the house. The price of the plot is included only...
Post a Comment
Read more

Earn money from mobile

Earn money from mobile: If you want to earn money from your mobile and want to know how to earn money from mobile, then you have come to the right place. In this article, we will tell you easy ways to earn money from mobile, by which you can easily earn money sitting at home using mobile. Today there are lakhs of people in India who are earning a good amount every month only from their mobile. The best thing in this is that to earn money from mobile, you do not need much experience and education and neither do you have to make any kind of investment, but due to increasing competition, it is not that earning money is at all easy. In such a situation, if you also want to earn money from mobile, then let's start knowing about the easiest and free ways to earn money from mobile through this article. Earn money from mobile?  How to earn money from mobile? Today almost everyone in India has a smartphone and most people waste their precious time watching reels videos, there are very few p...
Post a Comment
Read more