UK SEO and Internet Marketing Forums
A $1 directory.

January 08, 2009, 06:47:08 PM *
Welcome, Guest. Please login or register.
Did you miss your activation email?

Login with username, password and session length
News:
 
   Home   Help Search Login Register  
Del.icio.us Digg FURL FaceBook Stumble Upon Reddit SlashDot

Pages: 1 [2]
  Print  
Author Topic: A $1 directory.  (Read 562 times)
0 Members and 1 Guest are viewing this topic.
daniboy
Administrator
Colonel
*****

Karma: +18/-0
Offline Offline

Posts: 1514



View Profile WWW
« Reply #15 on: August 06, 2007, 01:34:16 AM »

He'll be in bed.... It's 01.24hrs here in the UK and probably has to get up in the morning :lol:

I'll get by on 3hrs of sleep and a huge black coffee at 7am!

googlebot just went through at 19.34 texas time, which leads me to think that one link will signal a hit on robots.txt then another link will signal to go deeper... etc....
Logged

Discount Shopping UK for Voucher Codes and eVouchers
Some new sites not finished Sad www.tv-aerials.org.uk & www.bestgiftexperiences.co.uk
BabyChicken4u2
Colonel
*****

Karma: +2/-0
Offline Offline

Posts: 1109


PRO Webs Ecommerce Development


View Profile WWW
« Reply #16 on: August 06, 2007, 04:17:32 AM »

BabysBacks did not get a GoogleBot visit at all  :cry:

But it is a supp page....
Logged

BabyChicken4u2
Colonel
*****

Karma: +2/-0
Offline Offline

Posts: 1109


PRO Webs Ecommerce Development


View Profile WWW
« Reply #17 on: August 07, 2007, 01:51:38 AM »

No crawl, no backlink

On a related note, that directory link a client of mine bought from the mirrored "christian" site in the sups.....does not produce a backlink in Google Tools.  I can claerly see in analytics that it is linked for like 2 months or better now....but no credit in the webmasters tools.

Does credit a backlink in Yahoo however

 :arrow: Tim aren't you going to help us out here?  Tongue
Logged

daniboy
Administrator
Colonel
*****

Karma: +18/-0
Offline Offline

Posts: 1514



View Profile WWW
« Reply #18 on: August 07, 2007, 04:15:30 PM »

Quote from: "BabyChicken4u2"
No crawl, no backlink

Peculiar!

On a similar note I've just put up another blog, reg'd name on Sunday and got in this afternoon and put 1st post on it. Guess who showed up in 3 minutes?? G Bot! I haven't put it in any forum sigs or anything....

Could part of the Google algorithm could be telepathy?
Logged

Discount Shopping UK for Voucher Codes and eVouchers
Some new sites not finished Sad www.tv-aerials.org.uk & www.bestgiftexperiences.co.uk
gid
Major
*****

Karma: +2/-0
Offline Offline

Posts: 554



View Profile
« Reply #19 on: August 07, 2007, 04:19:24 PM »

Are you using WordPress for that blog?  I have been spidered just after doing my first post.  Also, they might look at domain name registrations and spider based on that.
I like the telepathy idea though...
Logged

My wife and I run a store where we sell Baby Slings and Carriers.  We also have a wide variety of Baby Wraps.
Other Projects:
My latest project is the babywearing.com forum.
ctabuk
Global Moderator
General
*****

Karma: +18/-0
Offline Offline

Posts: 8631



View Profile WWW
« Reply #20 on: August 07, 2007, 04:38:42 PM »

Google - telepathetic - more likely :lol:

Good posting - most enjoyable
Logged

daniboy
Administrator
Colonel
*****

Karma: +18/-0
Offline Offline

Posts: 1514



View Profile WWW
« Reply #21 on: August 07, 2007, 04:47:46 PM »

Quote from: "gid"
Are you using WordPress for that blog?  I have been spidered just after doing my first post.  Also, they might look at domain name registrations and spider based on that.
I like the telepathy idea though...

Yes it's wordpress, but I'm building it up first a bit before I stick links out (mind you it'll get spotted by people who check their stats before then). I'll use mybloglog, bumpzee, blogratedirectory :wink:  and all the usuals

I've just thought about and it could be related to Pings?

And I've had "Ask" stop by aswell! Wonders will never cease :lol:
Logged

Discount Shopping UK for Voucher Codes and eVouchers
Some new sites not finished Sad www.tv-aerials.org.uk & www.bestgiftexperiences.co.uk
BabyChicken4u2
Colonel
*****

Karma: +2/-0
Offline Offline

Posts: 1109


PRO Webs Ecommerce Development


View Profile WWW
« Reply #22 on: August 07, 2007, 05:20:54 PM »

My blog is generally indexed withing 10 minutes of a post now..but thats not the problem

the link is coming in from the sup page which has not been crawled.....no no backlink

If it EVER gets crawled we will see if G credits the backlink proper in Webmasters Tools.

Think about it though...dropping the link here and a new sitemap and ping failed to bring GoogleBot.....to this page http://www.babysbacks.com/bingo_ballz.htm

The cache date is still 7/24 and thats NOT the last crawl date for the domain which is Aug 3rd....but these pages are not crawled.  Hardly ever regardless of the links or content once they are put in the sup.  Thats why, it is recommended that pages like that have URLs rewritten....because the sup is much harder to get out of than people realize.  You fix the problems, then never get crawled...even linking from well ranked sites like the tip for example do not produce a crawl.

So if my cache for the page is 7/24...but Googlebot did not request that page on 7/24....then how can you say cache date is crawl date?

Thats the whole thing right there....not to mention many sites like the dollar dir. mentioned is that there is usually a penalty involved...so no transfer of PR is likely as a result of the penalty.
Logged

gid
Major
*****

Karma: +2/-0
Offline Offline

Posts: 554



View Profile
« Reply #23 on: August 07, 2007, 06:23:46 PM »

Quote
In essence, if a page hasn’t changed since the last time we fetched it, there’s no need to fetch it again. But even if we checked whether a page was unchanged, we didn’t update the crawl date in the cache–we’re changing that now.

From:
http://www.mattcutts.com/blog/video-crawl-dates-in-the-google-cache/
and
http://googlewebmastercentral.blogspot.com/2006/09/better-details-about-when-googlebot.html

I think this would explain why it looks like google has not spidered your site because most likely you are throwing a 304, which is done at the server level and depending on the stats you were using you would not see that they come by, because they never hit the page.  They hit your server and your server told them to move along.
Logged

My wife and I run a store where we sell Baby Slings and Carriers.  We also have a wide variety of Baby Wraps.
Other Projects:
My latest project is the babywearing.com forum.
BabyChicken4u2
Colonel
*****

Karma: +2/-0
Offline Offline

Posts: 1109


PRO Webs Ecommerce Development


View Profile WWW
« Reply #24 on: August 07, 2007, 06:58:43 PM »

Quote
Results for : http://www.babysbacks.com/bingo_ballz.htm  
 
Header Info
HTTP/1.1 200 OK
Date: Tue, 07 Aug 2007 17:38:09 GMT
Server: Apache
Last-Modified: Sun, 05 Aug 2007 20:17:16 GMT
ETag: "16240d1-1afe-46b6304c"
Accept-Ranges: bytes
Content-Length: 6910
Connection: close
Content-Type: text/html
From http://www.rankquest.com/tools/Server-Header.php

No 304 in the server response.  I can buy the cache dates not keeping up except 2 things

What about a cache date that is more recent than a crawl date?

And this does not explain Google bot not spidering.

Google bot does not as a rule hit those files in the sup, when they spider....not just for me, is everyones in sup.

http://seo-theory.com/wordpress/2007/07/27/supplemental-days-and-supplemental-nights/

Quote
1.Google has been using Internal PageRank to decide which pages are to be Supplemental or not
2.Google has not been indexing every word on Supplemental Results pages
3.Links from Supplemental Results Pages have not been passing anchor text

Quote
When Google launched the Bigdaddy Update in December 2005, Matt Cutts confirmed on his blog that Google was using two separate robots to crawl for the Main Web Index and the Supplemental Results Index. Googlebot-Supplemental didn’t get around to everyone’s pages as often as Googlebot tended to, but Google was being very picky about which pages Googlebot would not visit.

Google increased the Supplemental Results Index crawl rate as many people complained about their listings not updating. More recently Matt said again that Googlebot-Supplemental’s refresh rate had been increased. It now appears that Supplemental Results Pages are reindexed at least once a month. I have seen some pages refreshed twice in one month.

Not my sup pages....not any of them.  Can anyone validate this...that sup pages are being crawled monthly?

So anyways the sup page has a link to the non sup page....the non sup page has not been crawled...and no backlink is showing for the non sup page.
Logged

gid
Major
*****

Karma: +2/-0
Offline Offline

Posts: 554



View Profile
« Reply #25 on: August 07, 2007, 07:32:07 PM »

Quote from: "BabyChicken4u2"
Results for : http://www.babysbacks.com/bingo_ballz.htm  
 
Header Info
HTTP/1.1 200 OK
Date: Tue, 07 Aug 2007 17:38:09 GMT
Server: Apache
Last-Modified: Sun, 05 Aug 2007 20:17:16 GMT
ETag: "16240d1-1afe-46b6304c"
Accept-Ranges: bytes
Content-Length: 6910
Connection: close
Content-Type: text/html

The thing I am looking at now is how conditional GETs are handled.  From what I think I am reading it looks like it is at the server\os level and the page is never hit.  I think the server is passing a lower level header response code..... don't quote me on that though....



It looks like the sups on my personal blog are all Jun 30, July 24, and 25.  Going back to what I said earlier, I don't think sups matter all that much.  One of my sup pages on my personal blog got 3 or more really good backlinks and it is now sup.  That page should in no way be sup.
Logged

My wife and I run a store where we sell Baby Slings and Carriers.  We also have a wide variety of Baby Wraps.
Other Projects:
My latest project is the babywearing.com forum.
BabyChicken4u2
Colonel
*****

Karma: +2/-0
Offline Offline

Posts: 1109


PRO Webs Ecommerce Development


View Profile WWW
« Reply #26 on: August 08, 2007, 03:35:53 PM »

Quote
It looks like the sups on my personal blog are all Jun 30, July 24, and 25. Going back to what I said earlier, I don't think sups matter all that much. One of my sup pages on my personal blog got 3 or more really good backlinks and it is now sup. That page should in no way be sup.

It is my understanding that landing in  the sups is not generally the result of lack of backlinks, at least not that reason alone....

Landing in the sups generally comes from

>Duplication - Content and/or Meta, and Canonical issues.  Content uniqueness scored onder 60%.  Duplicate Meta, especially titles.

>Spam penalty on the Domain.

>Lack of Domain Trust and Credibility

>Lack of quality, relevant backlinks

>Distance from root URL.  
http:// www. domain. com/stuff/stuff2/stuff3/stuff4/too_long_url.html
This is dependent on the number of clicks to get there....So if you are practicing good strong internal linking, then this shouldn't be a problem.

Blogs are famous for sup pages, because of label and search pages getting indexed.  Again though, this is clearly duplication.  While the sup index is famed as not being a "penalty".... It is still less valued results, that are rarely returned in SERPs.  Less resources used by Google to crawl and maintain it, and frankly less overall concern for fixing the problem on Google's part.  You cannot do a reinclusion, as Google claims no penalty assesed.  So gaining good backlinks, and fixing what is suspected to have caused the placement in the sup, is the plan....then you wait absolutley forever to be properly crawled and re indexed.  

I am going to test a new theory I read about.  This weekend I am going to block a large percentage of my sup pages in robots.txt, for a month or so.  Theory is this....the will hopefully be de indexed, and then when I remove the block....reindexed on their merit as the result of a regular crawl...like new content.  This is hopefully going to prevent me from having to rewrite a TON of URLs, instead.

So as always...experiments and learning on the fly!

Melanie
Logged

beamup
Member
*****

Karma: +0/-0
Offline Offline

Posts: 20


View Profile
« Reply #27 on: August 10, 2007, 03:33:22 AM »

Hello

I have heard about it before. I am going to check it out today.
Thanks for sharing though!

Steve
Logged

Pages: 1 [2]
  Print  
 
Jump to:  

Powered by SMF | SMF © 2006-2008, Simple Machines LLC | Sitemap Valid XHTML 1.0! Valid CSS!


Google visited last this page December 06, 2008, 03:35:52 AM