Instructs visiting spiders not to index the page, and/or not to follow its links to other pages. Some robots disregard this tag and index at their discretion. Other spiders may index the pages regardless, but not report found links to their search engine.

more insights