| Return to iWEBTOOL |
| |
|
| |||||||
 | Welcome to iWEBTOOL Talk, where you talk about
webmaster-related stuff.
1 Register
2 Browse the board
3 Discuss whatever may interest you! | |||||||||||||
 |
| | Thread Tools | Search this Thread | Display Modes |
06-14-2007, 01:54 AM
| #1 |
| Moderator Join Date: Aug 2006
Posts: 1,128
 |  Have you seen this bot? http://www.networksolutions.com/whoi...main=cuill.com Is the Stanford student going to make the next best search engine? www.cuill.com
__________________ Webmaster Resources & Forums / Webmaster Tools & Forum / eCommerce Shopping Basket / Scene Releases |
|
|
| |||||||
|
06-14-2007, 01:52 PM
| #2 |
| Member Join Date: Mar 2007 Location: Somerset, UK
Posts: 219
| Re: Have you seen this bot? Do you know what the useragent is for it? If I can define it on my site then I will see it live on the site, that is if it visits 
__________________ █ Pregnancy and Parenting Advice █ Windows Hosting and Windows Reseller Hosting by Stormhosts █ 10% Discount on all hosting plans for iWebTool Members |
|
|
|
06-17-2007, 12:00 AM
| #3 |
| iWEBTOOL SEO Advisor Contributor Join Date: May 2006
Posts: 1,260
| Re: Have you seen this bot? useragent = "Twiceler www.cuill.com/robots.html" or Agent: Mozilla/5.0 (Twiceler-0.9 http://www.cuill.com/twiceler/robot.html) Doesn't seem to be a well behaved bot reading posts on the internet.
__________________ Eco Tours | Gift Baskets | Random Keyword See a good post? <--Give thanks by clicking  left of post.
|
|
|
|
06-17-2007, 06:21 AM
| #4 |
| Member Join Date: Mar 2007 Location: Somerset, UK
Posts: 219
| Re: Have you seen this bot? Excellent, thank you
__________________ █ Pregnancy and Parenting Advice █ Windows Hosting and Windows Reseller Hosting by Stormhosts █ 10% Discount on all hosting plans for iWebTool Members |
|
|
|
06-17-2007, 06:40 AM
| #5 |
| Junior Guru  Join Date: Mar 2007
Posts: 694
| Re: Have you seen this bot? I couldnt find the search page!!?
__________________ Yahoo Adwords Free £60 or $25 When you join Yahoo Adwords! e2save - etosave etosave UK's Best deals on mobile phone contracts, £1.99 12 Month contracts... No joke! |
|
|
|
06-17-2007, 07:34 PM
| #6 |
| iWEBTOOL SEO Advisor Contributor Join Date: May 2006
Posts: 1,260
| Re: Have you seen this bot? This bot arrived today! It's quite active and I'm wondering about blocking it. What does it do with it's collected information?
__________________ Eco Tours | Gift Baskets | Random Keyword See a good post? <--Give thanks by clicking left of post.
|
|
|
|
06-18-2007, 10:07 AM
| #7 |
| Member Join Date: Feb 2007
Posts: 134
| Re: Have you seen this bot? what the heck is this bot ? Last edited 06-23-2007 at 03:46 PM. |
|
|
|
06-22-2007, 07:39 PM
| #8 |
| Newcomer Join Date: Jun 2007 Location: IL
Posts: 31
| Re: Have you seen this bot? I wouldn't trust it intill i saw some information on a search engine. even then bots can't be trusted because the people that run them can probley get what ever info they want out of the site.
__________________ GamerzPlace |
|
|
|
06-22-2007, 07:54 PM
| #9 |
| iWEBTOOL Moderator Join Date: Nov 2006 Location: Ayr, Scotland
Posts: 887
| Re: Have you seen this bot? I haven't yet seen this "experimetal robot". What is this bot really doing?
__________________ |
|
|
|
06-22-2007, 07:57 PM
| #10 |
| Newcomer Join Date: Jun 2007 Location: IL
Posts: 31
| Re: Have you seen this bot? That is a great question. What is this bot really doing?
__________________ GamerzPlace |
|
|
|
06-23-2007, 12:05 AM
| #11 |
| iWEBTOOL SEO Advisor Contributor Join Date: May 2006
Posts: 1,260
| Re: Have you seen this bot? I've tried to prevent it with robots.txt but either I'm not naming it ocrrectly or the bot just ignores it. :sad: Anyone had any success adding this bot to robots.txt?
__________________ Eco Tours | Gift Baskets | Random Keyword See a good post? <--Give thanks by clicking left of post.
|
|
|
|
06-23-2007, 01:38 AM
| #12 |
| Moderator Join Date: Aug 2006
Posts: 1,128
| Re: Have you seen this bot? This bot rocks about 300 pages off my server a day.
__________________ Webmaster Resources & Forums / Webmaster Tools & Forum / eCommerce Shopping Basket / Scene Releases |
|
|
|
06-23-2007, 03:04 PM
| #13 | |
| iWEBTOOL SEO Advisor Contributor Join Date: May 2006
Posts: 1,260
| Re: Have you seen this bot? Quote:
Have it logged doing 4300 URLS on the 23rd.
__________________ Eco Tours | Gift Baskets | Random Keyword See a good post? <--Give thanks by clicking left of post.
| |
|
|
|
06-23-2007, 05:35 PM
| #14 |
| Junior Guru Join Date: Jul 2006
Posts: 544
| Re: Have you seen this bot? Not once has this bot hit my site. I am getting RSS Bots and SE Bots, but not this particular one. In fact, I am only getting the major search engine hits which apparently is a plus.  |
|
|
|
06-24-2007, 11:37 AM
| #15 | |
| iWEBTOOL SEO Advisor Contributor Join Date: May 2006
Posts: 1,260
| Re: Have you seen this bot? Quote:
It's stopped now. Seems that it doesn't check the robots.txt all the time - so didn't immediately stop, but did sometime later.
__________________ Eco Tours | Gift Baskets | Random Keyword See a good post? <--Give thanks by clicking left of post.
| |
|
|
| (Threads which have no activity for more than 30 days are automatically closed.) |
| Quick Reply | ||
|
| Currently Active Users Viewing This Thread: 1 (0 members and 1 guests) | |
| Thread Tools | Search this Thread |
| Display Modes | |
|
|
Similar Threads | ||||
| Thread | Thread Starter | Forum | Replies | Last Post |
| Adsense Bot | Chart Music | Adsense | 7 | 03-31-2007 07:58 PM |
| Bot view | Chart Music | Search Engine Optimization (SEO) | 8 | 03-03-2007 08:42 PM |
| Does yahoo get it's links from google bot? | Chart Music | Yahoo | 6 | 10-30-2006 03:24 PM |
| Google bot visiting | Chart Music | 4 | 08-04-2006 04:13 PM | |
Linear Mode
