What is the meaning of the metatag "ROBOTS"
How do you explain a spider of a search engine you only want him to index just the first page of your website or he is allowed to index the whole website. You use the so called ROBOTS tag.
<meta name="robots" content="selection">
Example metatag robots
Add the following metatag in the HTML source of your page:
<meta name="robots" content="index, follow">
- The spider will now index your whole website.
- The spider will not only index the first webpage of your website but also all your other webpages.
you are also allowed to type it like this:
<meta name="robots" content="INDEX, FOLLOW">
<META NAME="robots" CONTENT="INDEX, FOLLOW">
<META NAME="robots" CONTENT="index follow">
By changing the index to no-index and the follow to no-follow your are able to influence the behaviour of the spider. If you don't want the search engine spider to crawl through your whole website you use the following metatag :
<meta name="robots" content="index, no-follow">
- The spider will now only look at this page and stops there.
<meta name="robots" content="no-index, follow">
- The spider will not look at this page but will crawl through the rest of the pages on your website.
<meta name="robots" content="no-index, no-follow">
- The spider will not look at this page and will NOT crawl through the rest of your webpages.
This metatag can also be typed with the / in the end of the tag:
<meta name="robots" content="index, no-follow" />
<meta name="robots" content="no-index, follow" />
<meta name="robots" content="no-index, no-follow" />
Where do you add this robot tag?
You add this robot tag on the first index page and you tell the spider if you want your whole website to be crawled or not.
Make sure that on every page relevant metatags are added. Add keywords and phrases that are relevant and correspond to the text and the language on that specific page. It might be a lot of work to add specific metatags to each page but you will notice in time that it works!
Metatags Summary - Important SEO things to remember
|
We suggest that you use the Metatags in your index.htm or index.html page. Than in all other important pages and last but not least in all the pages of your website. Make sure to put some extra effort in it, it will attract extra visitors to your webpage. Create relevant different metatags for each and every page.
- Read why metatags are important and how they affect the search engines.
- Use our metatags generator to create the correct metatags.
- Use our website analyzer to get professional advice from the metatags experts.
- Submit your website to the search engines and choose one of our packages:
|
 |
|
 |
 |
| Free Trial |
USA Package |
North Atlantic Package |
World Package |
| |
|
|
|
Tags: metatags. robots, meta name
|
|
|
| Part of the MetaTags Company BV- Last update: 21-11-2008 |