Google Spider needs to be Faster?

Steve Myers · 06-25-2007, 09:30 PM

So we have a crawl speed that needed to be updated by the Google Spider in which was requesting it! I received an e-mail asking for the site to be literally pushed to the Faster rate for them to crawl.

To me this must be that their is to much content to crawl, server may be slow, or the spider visit is not able to gather all of it's information at a specific speed and do it accurately. Of course this is a 90 trial that will expire, but would you recommend it if they send you an e-mail asking for it to be updated?

What do you think?

NavyCS · 06-25-2007, 09:51 PM

Quote:

Originally Posted by Steve Myers

So we have a crawl speed that needed to be updated by the Google Spider in which was requesting it! I received an e-mail asking for the site to be literally pushed to the Faster rate for them to crawl.

To me this must be that their is to much content to crawl, server may be slow, or the spider visit is not able to gather all of it's information at a specific speed and do it accurately. Of course this is a 90 trial that will expire, but would you recommend it if they send you an e-mail asking for it to be updated?

What do you think?

Mmm, I think Google has stopped communicating via email with webmasters.
http://googlewebmastercentral.blogsp...tion-with.html

Alan · 06-25-2007, 09:56 PM

I put 1 of my clients sites at faster, and wow the number of googlebot visits went up, not just by a few, but almost trebled in the time that faster was selected. There wasn't an email however, just a recommendation in the webmaster tools.

Google definitely needs to be speeded up, checked stat, Slurp crawls one of my sites 20x more often than googlebot, at that how can google pick up all the updates (bit of overkill from Yahoo too?)

OldWelshGuy · 06-25-2007, 10:26 PM

Google is just giving you control. Anyhow Spiders don't technically 'crawl' any more

On dynamic sites, the s[iders show server respect as they know that page requests cost resources. To this end they spider slower.

Steve Myers · 06-25-2007, 10:37 PM

Excellent feedback guys, I really appreciate it a lot.

lwhite1203 · 06-26-2007, 06:49 PM

We have a lot of "spiders" and "crawlers" for our site...how do we know if they're helping?

charlesgan · 06-27-2007, 12:09 PM

its depend on site...
one of my sites get crawl and updated in google serp every 2-3 days i posted new content.

06-25-2007, 09:30 PM	#1
Steve Myers Junior Guru Join Date: Jul 2006 Posts: 544	Google Spider needs to be Faster? So we have a crawl speed that needed to be updated by the Google Spider in which was requesting it! I received an e-mail asking for the site to be literally pushed to the Faster rate for them to crawl. To me this must be that their is to much content to crawl, server may be slow, or the spider visit is not able to gather all of it's information at a specific speed and do it accurately. Of course this is a 90 trial that will expire, but would you recommend it if they send you an e-mail asking for it to be updated? What do you think?

06-25-2007, 09:56 PM	#3
Alan iWEBTOOL Moderator Join Date: Nov 2006 Location: Ayr, Scotland Posts: 1,055	Re: Google Spider needs to be Faster? I put 1 of my clients sites at faster, and wow the number of googlebot visits went up, not just by a few, but almost trebled in the time that faster was selected. There wasn't an email however, just a recommendation in the webmaster tools. Google definitely needs to be speeded up, checked stat, Slurp crawls one of my sites 20x more often than googlebot, at that how can google pick up all the updates (bit of overkill from Yahoo too?) __________________ ahb Solutions Consultancy and Web Development Seen a good post - Give some reputation click on the

06-25-2007, 10:26 PM	#4
OldWelshGuy iWEBTOOL SEO Advisor Contributor Join Date: May 2007 Posts: 675	Re: Google Spider needs to be Faster? Google is just giving you control. Anyhow Spiders don't technically 'crawl' any more On dynamic sites, the s[iders show server respect as they know that page requests cost resources. To this end they spider slower. __________________ Umbrella Consultancy Internet Marketing Company - Rugby Forum - Google Expert Blog

06-25-2007, 10:37 PM	#5
Steve Myers Junior Guru Join Date: Jul 2006 Posts: 544	Re: Google Spider needs to be Faster? Excellent feedback guys, I really appreciate it a lot.

06-26-2007, 06:49 PM	#6
lwhite1203 Newcomer Join Date: Jun 2007 Posts: 12	Re: Google Spider needs to be Faster? We have a lot of "spiders" and "crawlers" for our site...how do we know if they're helping?

06-27-2007, 12:09 PM	#7
charlesgan Senior Member Join Date: Jan 2007 Location: hosting-rebate.com Posts: 253	Re: Google Spider needs to be Faster? its depend on site... one of my sites get crawl and updated in google serp every 2-3 days i posted new content. __________________ Hostgator - Hostgator reviews hosted at hostgator.com Bluehost - Bluehost reviews hosted at bluehost.com Hostmonster - Hostmonster reviews hosted at hostmonster.com

Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)

Thread Tools	Search this Thread
Show Printable Version Email this Page	Search this Thread: Advanced Search
Display Modes
Linear Mode Switch to Hybrid Mode Switch to Threaded Mode

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Spider View - are all SE's the same ?	Indigo	Discuss iWEBTOOL	2	12-24-2006 03:00 PM
a tip for faster google inclusion (leaving sandbox)	freedir	Search Engine Optimization (SEO)	6	12-06-2006 02:26 AM
I am having problems using Spider View	keiscokr	Help and Support	4	11-01-2006 02:06 AM
Search Engine Spider Simulator : Testers Wanted	fnsbe	Tools & Software	1	10-16-2006 09:31 AM
MSN spider crawling my site at crazy rate	bpeh	Search Engine Optimization (SEO)	6	06-19-2006 06:44 PM