| Return to iWEBTOOL |
| |
|
| |||||||
 | Welcome to iWEBTOOL Talk, where you talk about
webmaster-related stuff.
1 Register
2 Browse the board
3 Discuss whatever may interest you! | |||||||||||||
 |
| | Thread Tools | Search this Thread | Display Modes |
01-05-2007, 11:43 AM
| #1 |
| Member Join Date: Oct 2006
Posts: 123
 |  Need a web crawler, how do i set that up? Hi I have a free link exchange on my site and I need a web crawler to make sure my site isnt deleted when exchaning links, im not sure how to set one up or where to get one. i tried googling it but dont have a clue in coding. i only know simple html. Can any one help? its for page http://www.aussiepages.com.au/linkexchange.php thanks everyone danny |
|
|
| |||||||
|
01-05-2007, 11:53 AM
| #2 |
| Member Join Date: Nov 2006 Location: Indonesia
Posts: 43
| Re: Need a web crawler, how do i set that up? are you talking about reciprocal link checker ? or searching for a web crawler for yourself ? btw if you're searching for reciprocal checker i think you can find it easily on the web if you search using that keyword as for crawler ... you can try Nutch from http://wiki.apache.org/nutch/ |
|
|
|
01-09-2007, 04:58 PM
| #3 |
| Junior Member  Join Date: Jan 2007
Posts: 12
| Re: Need a web crawler, how do i set that up? If you want to implement a crawler, PHP isn't good for this task. Try Python or Ruby. At least they have multi-threading support. |
|
|
| (Threads which have no activity for more than 30 days are automatically closed.) |
| Quick Reply | ||
|
| Currently Active Users Viewing This Thread: 1 (0 members and 1 guests) | |
| Thread Tools | Search this Thread |
| Display Modes | |
|
|
Linear Mode
