site blocked with robot.txt for 6 months!

walkthetalk · 07-18-2006, 02:36 AM

I have been assigned to managing our company website at http://www.walkthetalk.com. The previous web developers added a robot.txt file to block google, but then forgot to remove it when the site went live. It's been that way for at least 6 months. Now I'm desperate to get Google back to the site. Any suggestions would be great! Thnx.

Steve Myers · 07-18-2006, 02:54 AM

Set the robots.txt file with 777 permission, then place Allow: / above the Disallow: /.

Submit your site to Googles engine. Also, make sure your site has rewrite enabled where if the links change on your pages, the links on the engines will just re-index them.

If you're not sure that rewrite is enabled, please contact your hosting provider for more information.

Let us know if you have anymore questions about this.

walkthetalk · 07-18-2006, 03:05 AM

Very cool. I'll give it a try.

mann3r · 07-18-2006, 10:18 AM

and also try to submit a sitemap on google sitemap then google will visit your site once again

kenni · 07-18-2006, 12:37 PM

Also, try to get some hard links from websites with high PageRank. If you can get a link from a PageRank 6 page, then you should be in the Google index within 24 hours.

dre · 07-18-2006, 03:22 PM

Dont forget google site maps

Submit your site map!

Daniel Malone · 07-18-2006, 03:50 PM

BTW, even if you don't submit a sitemap, you can still sign up for the program and see useful information like when Googlebot last visited your pages, and any 404 error pages, among others.

123_free_links · 07-24-2006, 01:45 AM

since you are going to allow all kinds robot bots
may be you do not need a robots.txt

by checking your PR and popularity
http://link.ezer.com/tools/pagerank_..._tool_code.asp
your site have current PR5 already .... good for you
you shall have no google index problem

Katey · 07-24-2006, 08:31 AM

Hi there,

Is robot.txt even necessary to be there then? I had a site quite a while ago and it never had the robot.txt file and Google still indexed it pretty well.

Is it better to actually have it? or not have it at all?

Regards,
Kieran Taylor.

07-18-2006, 02:36 AM	#1
walkthetalk Newcomer Join Date: Jul 2006 Posts: 3	site blocked with robot.txt for 6 months! I have been assigned to managing our company website at http://www.walkthetalk.com. The previous web developers added a robot.txt file to block google, but then forgot to remove it when the site went live. It's been that way for at least 6 months. Now I'm desperate to get Google back to the site. Any suggestions would be great! Thnx.

07-18-2006, 02:54 AM	#2
Steve Myers Junior Guru Join Date: Jul 2006 Posts: 544	Re: site blocked with robot.txt for 6 months! Set the robots.txt file with 777 permission, then place Allow: / above the Disallow: /. Submit your site to Googles engine. Also, make sure your site has rewrite enabled where if the links change on your pages, the links on the engines will just re-index them. If you're not sure that rewrite is enabled, please contact your hosting provider for more information. Let us know if you have anymore questions about this.

07-18-2006, 03:05 AM	#3
walkthetalk Newcomer Join Date: Jul 2006 Posts: 3	Re: site blocked with robot.txt for 6 months! Very cool. I'll give it a try.

07-18-2006, 10:18 AM	#4
mann3r Member Join Date: May 2006 Posts: 247	Re: site blocked with robot.txt for 6 months! and also try to submit a sitemap on google sitemap then google will visit your site once again __________________ New Gadget and Technology Weblog Article Directory Search Engine Optimization Blog used cars

07-18-2006, 12:37 PM	#5
kenni Registered Member Join Date: Dec 2005 Posts: 1,543	Re: site blocked with robot.txt for 6 months! Also, try to get some hard links from websites with high PageRank. If you can get a link from a PageRank 6 page, then you should be in the Google index within 24 hours. __________________ Wanna thank someone? Give 'em a rep. More info.

07-18-2006, 03:22 PM	#6
dre wo0h0o Join Date: Dec 2005 Location: Birmingham, UK Posts: 457	Re: site blocked with robot.txt for 6 months! Dont forget google site maps Submit your site map! __________________ Scrizzle.com - Dre's Blog Enjoy Yourself! SEOContest2008 Myspace Proxy

07-18-2006, 03:50 PM	#7
Daniel Malone Senior Member Join Date: May 2006 Posts: 252	Re: site blocked with robot.txt for 6 months! BTW, even if you don't submit a sitemap, you can still sign up for the program and see useful information like when Googlebot last visited your pages, and any 404 error pages, among others. __________________ Webmaster News and Daniel's blog can be found at Daniel Malone Free Webmaster Tools

07-24-2006, 01:45 AM	#8
123_free_links Junior Guru Join Date: Mar 2006 Location: www.ezer.com Posts: 549	Re: site blocked with robot.txt for 6 months! since you are going to allow all kinds robot bots may be you do not need a robots.txt by checking your PR and popularity http://link.ezer.com/tools/pagerank_..._tool_code.asp your site have current PR5 already .... good for you you shall have no google index problem __________________ Backorder Domain Names \| livePR.ezer.com Live PR PageRank checker \| link.ezer.com :BackLinks Update Checker 38 countries Google SERP checker SEO web tool \| Include magic future PR prediction tool Last edited 07-24-2006 at 02:02 AM.

07-24-2006, 08:31 AM	#9
Katey Senior Member Join Date: Apr 2006 Location: Hull, United Kingdom. Posts: 317	Re: site blocked with robot.txt for 6 months! Hi there, Is robot.txt even necessary to be there then? I had a site quite a while ago and it never had the robot.txt file and Google still indexed it pretty well. Is it better to actually have it? or not have it at all? Regards, Kieran Taylor.

Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)

Thread Tools	Search this Thread
Show Printable Version Email this Page	Search this Thread: Advanced Search
Display Modes
Linear Mode Switch to Hybrid Mode Switch to Threaded Mode

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
6 months later	UnKnown	Google	5	12-08-2006 10:42 PM
Joke Competition> ......Win****6 Months Of Free Advertising on my site	philski	Community Contests	1	11-26-2006 10:38 AM
Link on PR2 site. $2 for 3 months.	Jerlene	Links for Sale	1	09-21-2006 10:37 AM
More than $100K in 4 months	SearchFeature	Advertise your website	1	06-20-2006 11:14 PM
How to promote site with PR0 + Sandboxed + 1 months old??	Sxperm	Marketing and Promotion	8	01-29-2006 08:21 AM