colin if you optimise ur site with keywords , meta tags , descriptions , anchor tags , descriptions on images , naming your files what your files what u think people would type into a search engine to find them. the same with pages you are making the search engines will pick your pages up once u add in a robot.txt to get the pages spidered - just have them revisit every week and yeah slurp is an active bugger - i usually once a week get about 40 of them at once combing my forums and forums archives
|