Meta robots

1 - Assessments & Impacts

The robots meta tag allows robots to be directed to certain directives such as indexing the page viewed, tracking found links, caching and many other topics.

Example of setting up a robots meta tag in the <head> of an HTML page

<Html><Head><title> Page Title </ title><meta name = "robots" content = "noindex, nofollow"></ Head>

2 - Recommendations

By default

Do not use this tag unless it is directed by your SEO team. If the crawlers find no such directive on the requested page, they will understand that they can index it, cache it, follow the links found - in short, explore it freely.

It is therefore not necessary to add in your source code the following statement which is the default behavior of the engines:

<Html><Head><title> Page Title </ title><meta name = "robots" content = "index, follow"></ Head>

Possible guidelines

For information, here are the possible directives:

There are many others but use these tags only when requested by your SEO team. The main directives that you may be asked for are noindex, nofollow or in rarer cases unavailable_after.

Report abuse