Log in

View Full Version : Google went beserk today...


Winetalk.com
02-20-2005, 09:44 PM
it spidered more pages over the weekend than it's done in the entire month of February...

we were swarmed by bots today.

Googlebot 28334
the number was 13,000+ on Friday nite

Winetalk.com
02-22-2005, 07:46 AM
wow,
google goes for broke!

Robots/Spiders Last visit
Googlebot 54350 22 Feb 2005 - 07:01

..and the saddest part is:
we are not anywhere near to the top in Google...

Titan
02-22-2005, 01:52 PM
once a month they hit my forums with about 600 at a time

Winetalk.com
02-22-2005, 05:28 PM
Originally posted by Titan@Feb 22 2005, 01:53 PM
once a month they hit my forums with about 600 at a time
and? what is the end result?

imported_Technick
02-22-2005, 06:21 PM
As I understand it Google maintains a list of all the domains it can find. It then sends its spiders out to grab their content one by one. There are a whole lot of domains so it takes the spiders a month or so to run through them all. But when they hit your domain they look at every page they can find and update their records where neccessary. So every month or so you will see them spider you.

Then, my best guess is every couple of months they reindex the whole directory with the new info that they have. That's when you'll go up or down in position.

N.B. I don't work for Google so this is just my best guess :)

Titan
02-23-2005, 04:17 PM
google spiders as often as i tell it too .. every day :)

Inabon
02-25-2005, 01:28 PM
Originally posted by Titan@Feb 23 2005, 01:18 PM
google spiders as often as i tell it too .. every day :)
i hope you are not talking about the comeback in x days tag. <_<