PDA

View Full Version : Meta tags


iknowalttl
03-10-2005, 07:52 PM
I was wondering about a couple meta tags...

name="revisit-after" content="7days"

name="robots" content="index, follow"

Do these tags tell bots and spiders to follow the links on the page they are crawling and to come back again in 7 days?

I was also wondering if a spider or bot followed the links, does it include links outside of the site it is crawling... if so how do you control it?

DanB
03-11-2005, 10:23 AM
You are correct in your assumptions.

There's also a new anchor attribute rel="nofollow" that the major search engines are using. Links with this attribute set won't be followed by the spider.


<A href="outlink.html" rel=nofollow">link</A>

iknowalttl
03-11-2005, 12:39 PM
Originally posted by DanB@Mar 11 2005, 10:24 AM
You are correct in your assumptions.

There's also a new anchor attribute rel="nofollow" that the major search engines are using. Links with this attribute set won't be followed by the spider.


<A href="outlink.html" rel=nofollow">link</A>

thanks for the info.. :D