![]() |
I was wondering about a couple meta tags...
name="revisit-after" content="7days" name="robots" content="index, follow" Do these tags tell bots and spiders to follow the links on the page they are crawling and to come back again in 7 days? I was also wondering if a spider or bot followed the links, does it include links outside of the site it is crawling... if so how do you control it? |
You are correct in your assumptions.
There's also a new anchor attribute rel="nofollow" that the major search engines are using. Links with this attribute set won't be followed by the spider. Code:
<A href="outlink.html" rel=nofollow">link</A> |
Quote:
|
| All times are GMT -4. The time now is 04:22 PM.. |
Powered by vBulletin® Version 3.7.4
Copyright ©2000 - 2026, Jelsoft Enterprises Ltd.
Copyright Evil Empire Inc. 2006-2022