How can I tell when spiders last visited my site?

Cat · 10-17-2006, 12:17 PM

Hi,
I've only recently started editing the content of my string quartet's website.

The website was created just over a year ago, and until about a month ago, all editing was being done by my designer, which cost a lot. I got the website to a point where I was happy with the content, then I just left it.

It was static for about 6 months so I'm guessing the spiders eventually stopped visiting my site. Now that I have content management software

I have updated the most important parts of my site and am working on the copy for the rest - I've re-submitted my site to all the major search engines and a lot of the more obscure ones, and I just want to know if my plan to lure the spiders back to my site has worked!!

So basically, is there a website I can go to where I can type in my domain name which will tell me when my site was last crawled... and by which spiders...?

Many Thanks,

Cat

GDLEE · 10-17-2006, 01:41 PM

Does your webhost use cPanel? If so, you can choose web/ftp stats and then select awstats. Then you can select the last and full list of bots that have visited your site.

Im not sure about vdeck. You could also look at your access logs, but the cpanel route is the easiest.

ForumZClub · 10-17-2006, 02:08 PM

If You HAve CMS Check Your Logs to see who visited your website .

Cat · 10-18-2006, 08:28 PM

I knew I'd seen it something about being able to access that somewhere before! Have now got more statistics than I know what to do with - including my spider info!
Thanks.

Katey · 10-18-2006, 10:05 PM

Hi there,

If you use cPanel, use AWstats and it tell you; which spider (by name, e.g. GoogleBot), when it last visited, how many times, etc. AWstats is definatly one of the best statistics meters I have ever used. Try it out

.

Regards,
Kieran Taylor.

jumpenjuhosaphat · 10-18-2006, 10:32 PM

You can go to http://www.google.com/webmasters/ and sign up an account. There are alot of statistics that google is willing to share with you about your site. That, of course, will only show the Google stats. Awstats is the best site statistics package I've seen, but if you don't have it, there are others that you can install as well. You can also download your logs to your home or office computer and use a program to view your stats that way.

anielsen · 10-24-2006, 08:22 AM

You can also use Yahoo's site explorer. It will show you when they last visited.

https://siteexplorer.search.yahoo.com/mysites

Good luck.

Andrew

zapped · 11-18-2006, 10:56 AM

Awstats...the way to go...check if your host has cPanel...

Ray Miller · 11-18-2006, 04:28 PM

Your host should have supplied you with a statistics tracking software. Mine tells me the top 10 spiders date and time of visit and how much data they took. Since the first of Nov. Inkotomi (yahoo) has been in my site 143 times. Whereas others stop by once every 3 to 5 days. There are also some places on the net that would track it for you if your host does not supply a tracking system. Do you know how many hits your getting?

Ray Miller · 11-18-2006, 04:32 PM

AWSTAS thats the system I have too, great data gives you alot of information.

10-17-2006, 12:17 PM	#1
Cat Smurf Join Date: Oct 2006 Location: Ayr, Scotland Posts: 25	How can I tell when spiders last visited my site? Hi, I've only recently started editing the content of my string quartet's website. The website was created just over a year ago, and until about a month ago, all editing was being done by my designer, which cost a lot. I got the website to a point where I was happy with the content, then I just left it. It was static for about 6 months so I'm guessing the spiders eventually stopped visiting my site. Now that I have content management software I have updated the most important parts of my site and am working on the copy for the rest - I've re-submitted my site to all the major search engines and a lot of the more obscure ones, and I just want to know if my plan to lure the spiders back to my site has worked!! So basically, is there a website I can go to where I can type in my domain name which will tell me when my site was last crawled... and by which spiders...? Many Thanks, Cat __________________ Catriona Mackay www.rhapsodystringquartet.co.uk

10-17-2006, 01:41 PM	#2
GDLEE Junior Member Join Date: Oct 2006 Posts: 32	Re: How can I tell when spiders last visited my site? Does your webhost use cPanel? If so, you can choose web/ftp stats and then select awstats. Then you can select the last and full list of bots that have visited your site. Im not sure about vdeck. You could also look at your access logs, but the cpanel route is the easiest.

10-17-2006, 02:08 PM	#3
ForumZClub Member Join Date: Sep 2006 Posts: 144	Re: How can I tell when spiders last visited my site? If You HAve CMS Check Your Logs to see who visited your website .

10-18-2006, 08:28 PM	#4
Cat Smurf Join Date: Oct 2006 Location: Ayr, Scotland Posts: 25	Re: How can I tell when spiders last visited my site? I knew I'd seen it something about being able to access that somewhere before! Have now got more statistics than I know what to do with - including my spider info! Thanks. __________________ Catriona Mackay www.rhapsodystringquartet.co.uk

10-18-2006, 10:05 PM	#5
Katey Senior Member Join Date: Apr 2006 Location: Hull, United Kingdom. Posts: 317	Re: How can I tell when spiders last visited my site? Hi there, If you use cPanel, use AWstats and it tell you; which spider (by name, e.g. GoogleBot), when it last visited, how many times, etc. AWstats is definatly one of the best statistics meters I have ever used. Try it out . Regards, Kieran Taylor.

10-18-2006, 10:32 PM	#6
jumpenjuhosaphat Forum Admin Contributor Join Date: Jun 2006 Location: Denver Posts: 4,459	Re: How can I tell when spiders last visited my site? You can go to http://www.google.com/webmasters/ and sign up an account. There are alot of statistics that google is willing to share with you about your site. That, of course, will only show the Google stats. Awstats is the best site statistics package I've seen, but if you don't have it, there are others that you can install as well. You can also download your logs to your home or office computer and use a program to view your stats that way. __________________ Storage Sheds Lost Forum

10-24-2006, 08:22 AM	#7
anielsen Newcomer Join Date: Oct 2006 Posts: 25	Re: How can I tell when spiders last visited my site? You can also use Yahoo's site explorer. It will show you when they last visited. https://siteexplorer.search.yahoo.com/mysites Good luck. Andrew __________________ The Online Business Builder. Learn how to build a successful online business and make money online.

11-18-2006, 10:56 AM	#8
zapped Junior Member Join Date: Nov 2006 Posts: 35	Re: How can I tell when spiders last visited my site? Awstats...the way to go...check if your host has cPanel...

11-18-2006, 04:28 PM	#9
Ray Miller Newcomer Join Date: Nov 2006 Posts: 6	Re: How can I tell when spiders last visited my site? Your host should have supplied you with a statistics tracking software. Mine tells me the top 10 spiders date and time of visit and how much data they took. Since the first of Nov. Inkotomi (yahoo) has been in my site 143 times. Whereas others stop by once every 3 to 5 days. There are also some places on the net that would track it for you if your host does not supply a tracking system. Do you know how many hits your getting? __________________ http://www.smiledentalplan.com

11-18-2006, 04:32 PM	#10
Ray Miller Newcomer Join Date: Nov 2006 Posts: 6	Re: How can I tell when spiders last visited my site? AWSTAS thats the system I have too, great data gives you alot of information. __________________ http://www.smiledentalplan.com

Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)

Thread Tools	Search this Thread
Show Printable Version Email this Page	Search this Thread: Advanced Search
Display Modes
Linear Mode Switch to Hybrid Mode Switch to Threaded Mode

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
How to make the spiders visit	travj1	MSN	9	11-06-2006 08:15 PM
Do spiders see a difference in meta id="ctl00_mtaKeywords	yeyo	Search Engine Optimization (SEO)	2	04-22-2006 05:01 PM