Letting spiders in

[Damian]

Hi

New here, so apologies if this is dull/OT/etc

I want to let search engine spiders in behind my registration so they can see the depth and breadth of content and how often we refresh it.

Anyone got a clue on how to do this as I don't!

Thanks in advance.

Damian Jennings
http://www.playboy.co.uk

[Newton]

The only question that is dull/ot/etc is the one that you don't ask .. so ask away and welcome to Oprano ;)

[Jace]

The only question that is dull/ot/etc is the one that you don't ask .. so ask away and welcome to Oprano ;)

he already did

[sarettah]

Hi
New here, so apologies if this is dull/OT/etc

I want to let search engine spiders in behind my registration so they can see the depth and breadth of content and how often we refresh it.

Anyone got a clue on how to do this as I don't!


I have several sites that I do that on. They are all php sites so I have a routine at the top that checks for known user agents, some I let in, some I don't. So, it would deppend on what exatcly your "registration" is. Is it a pay site or just a site you have to join to get into the back pages of ?

Oh, wlecom to the board btw :)

[sarettah]

he already did

You, my friend, have email :okthumb:

[Nickatilynx]

there are many ways to allow visitors you want to to spider your site , and prevent those you want to not.

Hell you can send some IPs one way , some the other. :)