![]() |
|
||
|
|
|
||
|
|
|||
|
|
|||||||
| Notices |
| Legacy Archived Main Board Business chat and general industry chat. All participation is welcome. Dont post your fucking spam here. |

![]() |
|
|
Thread Tools | Display Modes |
|
|
|
|
#1 |
|
Members
Join Date: Mar 2005
Location: Florida
Posts: 215
|
I was wondering about a couple meta tags...
name="revisit-after" content="7days" name="robots" content="index, follow" Do these tags tell bots and spiders to follow the links on the page they are crawling and to come back again in 7 days? I was also wondering if a spider or bot followed the links, does it include links outside of the site it is crawling... if so how do you control it? |
|
|
|
|
|
#2 |
|
Members
Join Date: Aug 2004
Location: Atlanta, GA USA
Posts: 8
|
You are correct in your assumptions.
There's also a new anchor attribute rel="nofollow" that the major search engines are using. Links with this attribute set won't be followed by the spider. Code:
<A href="outlink.html" rel=nofollow">link</A> |
|
|
|
|
|
#3 | |
|
Members
Join Date: Mar 2005
Location: Florida
Posts: 215
|
Quote:
|
|
|
|
|
![]() |
| Bookmarks |
|
|