Return to iWEBTOOL

Go Back   iWEBTOOL Talk > Search Engine > Google
Register FAQ Members List Calendar Search Today's Posts Mark Forums Read
 
Welcome to iWEBTOOL Talk, where you talk about webmaster-related stuff.
 
Discuss topics which interest you.
With over thousands of threads (topics), we're sure you'll find something that'll interest you.
Ask for help whenever you need it.
We have thousands of members who are available to help you if you need it.
It's absolutely FREE!

 1  Register           2  Browse the board           3  Discuss whatever may interest you!
 


Closed Thread
 
Thread Tools Search this Thread Display Modes
Old 09-11-2007, 02:29 PM   #1
jfranktoo
Member
 
jfranktoo's Avatar
 
Join Date: Aug 2006
Location: chichester england
Posts: 189
jfranktoo will become famous soon enough
Default Google is not indexing pages on my site - help please.

We had the site up and running in mid July. Google indexed most of it immediately. But there was one rather crucial page not indexed (out of a total of 11 at that time)
the page is http://www.lastminutecottageholiday....rscotland.html

Then about ten days ago I added another six or more pages but none of them has been indexed - maybe a bit early.

I use the Google sitemap.

Google's advice to webmasters is only to advise them of the index page.

Any advice? I'd be grateful as always.

John
jfranktoo is offline  
 
This is an Ad Revenue Sharing forum Place your advert here
SEO Checklist
Get yourself better ranking with
our "Do-it-Yourself" SEO Checklist.
Click Here
Old 09-11-2007, 03:52 PM   #2
Luke
iWEBTOOL Representative
 
Luke's Avatar
 
Join Date: Sep 2007
Posts: 54
Luke is on a distinguished road
Default Re: Google is not indexing pages on my site - help please.

Google may take some time updating. The best thing to do is remain patient with it. I do suggest you have a blank robots.txt file.

your-domain.com/robots.txt

All search engines use this file to determine rather to index a particular page or not. If this page is unreachable, some search engines do not index you at all. Upload a blank text file to robots.txt.
__________________
Need some iWEBTOOL Help? Contact us
Luke is offline  
Old 09-11-2007, 04:06 PM   #3
Bagi Zoltán
iWEBTOOL Moderator
 Contributor 
 
Bagi Zoltán's Avatar
 
Join Date: Aug 2006
Location: Hungary
Posts: 1,862
Bagi Zoltán is a glorious beacon of lightBagi Zoltán is a glorious beacon of lightBagi Zoltán is a glorious beacon of lightBagi Zoltán is a glorious beacon of lightBagi Zoltán is a glorious beacon of light
Default Re: Google is not indexing pages on my site - help please.

John, as far as i know mostly PageRank is determined to decide which page will be indexed and as i see at your main page there are many outgoing links ponting to different domains, which make indexing more difficoult because of the PR leakage. I think you could treat the situation with smart use of nofollow.
__________________
Time may come when you will need an excellent eCommerce shopping cart software
free seo related web directory precíziós mérleg Free shopping cart
Bagi Zoltán is offline  
Old 09-11-2007, 04:21 PM   #4
OldWelshGuy
iWEBTOOL SEO Advisor
 Contributor 
 
OldWelshGuy's Avatar
 
Join Date: May 2007
Posts: 675
OldWelshGuy will become famous soon enoughOldWelshGuy will become famous soon enough
Default Re: Google is not indexing pages on my site - help please.

Bagi I disagree with what you are saying as quality outbound links to on topic domains (preferably authorative) will theme your site, and get it ranking higher. Outbound links help rather than hinder, but adding 'nofollow' is basically telling Google that you don't trust the site you are linking too and too many no follow links more or less tells google that your site is a bag of old bones.

I NEVER use no follow, if a site is worth linking to then it gets full benefit, if not then I don't link to it.

A 20 page site should be spidered with a single link from another site. I would try to get a deep link to one of your pages if possible, that should wake google bot up.

That said, has google visited your site since you pinged it? I can see 17 pages listed in Google. Try getting a deep link to the autumn page and check if google has visited.

I would upload an xml sitemap for google just to see how it reacts. You see the way it works is that googlebots are busy little spiders, and the last thing they want to do is pop all the way back to your site if nothing has changed. SO this is how it works

they visit, then they visit within a day or so. Then again a day or so. If nothing has changed, they sett the revisit to 2 days, then 3 then up and up, until eventually it might be set to 90 days if nothing has changed for like 12 months. This is where the 'new content ranks better' myth comes from. That and the old boost Altavista used to give new pages.
__________________
Umbrella Consultancy Internet Marketing Company - Rugby Forum - Google Expert Blog
OldWelshGuy is offline  
Old 09-11-2007, 04:35 PM   #5
Bagi Zoltán
iWEBTOOL Moderator
 Contributor 
 
Bagi Zoltán's Avatar
 
Join Date: Aug 2006
Location: Hungary
Posts: 1,862
Bagi Zoltán is a glorious beacon of lightBagi Zoltán is a glorious beacon of lightBagi Zoltán is a glorious beacon of lightBagi Zoltán is a glorious beacon of lightBagi Zoltán is a glorious beacon of light
Default Re: Google is not indexing pages on my site - help please.

I need to insert a little explanation here. When i wrote smart use of nofollow i thought about the map links with anchor like this ky146ad or eh421nt.
__________________
Time may come when you will need an excellent eCommerce shopping cart software
free seo related web directory precíziós mérleg Free shopping cart
Bagi Zoltán is offline  
Old 09-11-2007, 05:03 PM   #6
jfranktoo
Member
 
jfranktoo's Avatar
 
Join Date: Aug 2006
Location: chichester england
Posts: 189
jfranktoo will become famous soon enough
Default Re: Google is not indexing pages on my site - help please.

Blimey, you blokes are fast. And good, obviously, thank you all three. Wish I could get this level of service from the local plod when I report undue noise from the neighbours. Lol

Kidding, my neighbours don't make undue noises, and I regularly send £60 to the Speed Cops Benevolent Fund to accumulate heart-warming sets of little points in exchange. 3 more and I can cash them all in for a bus pass.

I can get links to each of these pages from another site and will do so.

Old Welsh, I'm looking at my sitemap in google and they say they have indexed 11 pages - how did you "ping" it to see 17? Sorry it is such a dumb question.

Luke, does that mean I just add another page to the site, with the extension /robots.txt leave it blank and upload it. Sorry to be thick, I'm sure you don't mean this.

Really grateful chaps, truly.

John

Last edited 09-11-2007 at 05:06 PM. Reason: edit
jfranktoo is offline  
Old 09-11-2007, 10:29 PM   #7
OldWelshGuy
iWEBTOOL SEO Advisor
 Contributor 
 
OldWelshGuy's Avatar
 
Join Date: May 2007
Posts: 675
OldWelshGuy will become famous soon enoughOldWelshGuy will become famous soon enough
Default Re: Google is not indexing pages on my site - help please.

to see what google has indexed use site:www.yourdomain.com it will display all pages in the google index using that domain.
__________________
Umbrella Consultancy Internet Marketing Company - Rugby Forum - Google Expert Blog
OldWelshGuy is offline  
Old 09-11-2007, 10:38 PM   #8
Luke
iWEBTOOL Representative
 
Luke's Avatar
 
Join Date: Sep 2007
Posts: 54
Luke is on a distinguished road
Default Re: Google is not indexing pages on my site - help please.

jfranktoo; Yep! Just add a blank page with the filename robots.txt.
__________________
Need some iWEBTOOL Help? Contact us
Luke is offline  
Old 09-12-2007, 06:28 AM   #9
usearchme
Senior Member
 
usearchme's Avatar
 
Join Date: Nov 2006
Posts: 333
usearchme will become famous soon enough
Default Re: Google is not indexing pages on my site - help please.

Hi there

Your site is still relatively new, i wouldnt worry about it just yet, so long as you keep ur sitemap up to date, your sitemap looks fine, as old welsh guy said above you could get some deep link to your site, a few good quality links into your site, should help you.

Woc
usearchme is offline  
Old 09-12-2007, 07:01 AM   #10
Asso
Newcomer
 
Asso's Avatar
 
Join Date: Sep 2007
Posts: 17
Asso is on a distinguished road
Default Re: Google is not indexing pages on my site - help please.

Get good backlinks and you do not need sitemap i think
Asso is offline  
Old 09-12-2007, 07:39 AM   #11
OldWelshGuy
iWEBTOOL SEO Advisor
 Contributor 
 
OldWelshGuy's Avatar
 
Join Date: May 2007
Posts: 675
OldWelshGuy will become famous soon enoughOldWelshGuy will become famous soon enough
Default Re: Google is not indexing pages on my site - help please.

If google has set a time to revisit to say 2 months, then adding a sitemap will allow google to see what it is missing. This should then fire googlebot into action to visit the site and grab the new content. Ordinarily I wouldn't recommend a sitemap for a site as simple as this, and the deeplinks should do it.

The reason I suggested it was to speed things up, as the missing page is the autumn page, and autumn is but a few weeks away in the UK so time is of the essence here
__________________
Umbrella Consultancy Internet Marketing Company - Rugby Forum - Google Expert Blog
OldWelshGuy is offline  
Old 09-12-2007, 10:03 AM   #12
mit
Senior Member
 
mit's Avatar
 
Join Date: Feb 2006
Location: India
Posts: 452
mit will become famous soon enough
Default Re: Google is not indexing pages on my site - help please.

it can take time, just have patience...

Even some of my new web pages are indexed after 1 month but showing the cache date of creating date.
mit is offline  
Old 09-12-2007, 01:08 PM   #13
OldWelshGuy
iWEBTOOL SEO Advisor
 Contributor 
 
OldWelshGuy's Avatar
 
Join Date: May 2007
Posts: 675
OldWelshGuy will become famous soon enoughOldWelshGuy will become famous soon enough
Default Re: Google is not indexing pages on my site - help please.

I know people are saying just give it time, but when the original poster said 'new site' he meant newly redesigned site. The domain was already well known to google.
__________________
Umbrella Consultancy Internet Marketing Company - Rugby Forum - Google Expert Blog
OldWelshGuy is offline  
Old 09-12-2007, 05:01 PM   #14
jfranktoo
Member
 
jfranktoo's Avatar
 
Join Date: Aug 2006
Location: chichester england
Posts: 189
jfranktoo will become famous soon enough
Default Re: Google is not indexing pages on my site - help please.

Thanks everyone. Why is everyone so nice on this forum? The government must have set you all targets, obviously.

I used a couple of well rated and relevant blog sites to deep link to the missing pages, and Google has now found the new pages. The site is obviously going to go down with the weight of traffic now. To be honest I think Lady G would claim she was going to do it anyway.

But the Autumn page is still not there, and as that Old Head on Welsh shoulders has noted, it is getting a bit urgent.

I'm going to do the robots page now. Is that a good idea to do with all new sites, do you think?

Seriously, thanks.

John
PS You've made me a hero amongst my local internet experts. I tell them all how to do it with great confidence.
jfranktoo is offline  
Old 09-13-2007, 12:34 AM   #15
snowbirdcity
Smurf
 
snowbirdcity's Avatar
 
Join Date: Aug 2007
Posts: 22
snowbirdcity is on a distinguished road
Default Re: Google is not indexing pages on my site - help please.

I agree to create a robots.txt file. However, I would add the following:

User-agent: *
Sitemap: http://www.YOURDOMAINHERE.com/sitemap.xml

You can check your sitemap for errors in Google's Webmaster tools. If it's error free, just give Google some time to find your pages.
__________________
Web Directory
snowbirdcity is offline  
 
This is an Ad Revenue Sharing forum Place your advert here
Webmaster Tools Webmaster Tools Click Here
Closed Thread

(Threads which have no activity for more than 30 days are automatically closed.)



Quick Reply
Message:

Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 
Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are Off
Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
google still not indexing pages I want jamestl2 Google 23 05-08-2007 08:13 AM
Google sitemap and pages not indexing pch Web Development 4 04-17-2007 07:52 PM
Submit your site to WebzDirectory.com - PR 4 and over 7,000 pages indexed in Google eDom.co.uk Your directory 3 03-07-2007 05:41 AM
Problems with indexing of pages by Google rnikolov Google 3 02-13-2007 12:08 PM
why isn't google indexing my site? seobasics Search Engine Optimization (SEO) 18 06-19-2006 06:32 PM


All times are GMT. The time now is 06:25 PM.


Powered by vBulletin v3.6.7 © 2008, Jelsoft Enterprises Ltd. SEO by vBSEO © 2006, Crawlability, Inc.