UK SEO and Internet Marketing Forums
Question re: Indexing of sites etc

January 07, 2009, 04:48:12 AM *
Welcome, Guest. Please login or register.
Did you miss your activation email?

Login with username, password and session length
News:
 
   Home   Help Search Login Register  
Del.icio.us Digg FURL FaceBook Stumble Upon Reddit SlashDot

Pages: [1]
  Print  
Author Topic: Question re: Indexing of sites etc  (Read 747 times)
0 Members and 1 Guest are viewing this topic.
ash
Administrator
General
*****

Karma: +8/-0
Offline Offline

Posts: 4506


View Profile WWW
« on: December 06, 2006, 02:00:53 PM »

Hi Burf

I listed my site with you a couple of weeks back (remember me discussing a high burf rank?)

Now i can't find the site at all on burf.com.......

www.forumlettings.co.uk

Any ideas?

also a more general question, does burf spider the web? or do you only have sites listed that are submitted?

I'm guessing you don't spider the entire web otherwise your house would resemble a giant datacenter, or does it?
Logged

burf.com
Captain
*****

Karma: +0/-0
Offline Offline

Posts: 354



View Profile WWW
« Reply #1 on: December 06, 2006, 03:50:59 PM »

Well yes and well know and kinda

Burf.com takes submissions and indexes them BUT all the links it finds on the  submitted page (external etc) it will then follow them

I was doing ok with this, but yesterday had a backlog of 3 million sites (lol) and the disk decided to go on holiday

Back to 7.4 million pages indexes and plent more to come

I have been thinking or redesigning burf.com to deal with 100 million site +

Lot of stuff to consider tho
Logged

http://www.Burf.com Search Engine with cheap advertisment.
http://www.rorseek.com ROR Search Engine
http://www.findgoodsites.com Free Directory

New forums http://www.burf.com/forum/ and http://burfforum.co.uk
yourweb
Global Moderator
General
*****

Karma: +9/-0
Offline Offline

Posts: 10492



View Profile WWW
« Reply #2 on: December 06, 2006, 03:59:47 PM »

Do you have most of this stuff on automatic?
Logged

YourWeb.Info Shopping Mall is the friendliest on the net! - YourWeb Newsletter
BuyingFirstTime Real Estate Agent Directory
Buy And Go UK
burf.com
Captain
*****

Karma: +0/-0
Offline Offline

Posts: 354



View Profile WWW
« Reply #3 on: December 06, 2006, 04:05:02 PM »

Once machine is always creating search cache

One machine alway is indexing and finding new sites

One machine now and again sends out emails to submitted site

I want to automate it more lol
Logged

http://www.Burf.com Search Engine with cheap advertisment.
http://www.rorseek.com ROR Search Engine
http://www.findgoodsites.com Free Directory

New forums http://www.burf.com/forum/ and http://burfforum.co.uk
ash
Administrator
General
*****

Karma: +8/-0
Offline Offline

Posts: 4506


View Profile WWW
« Reply #4 on: December 06, 2006, 04:12:19 PM »

Do you mean sites or pages?

How many site does Google, MSN and Yahoo have indexed?
Logged

burf.com
Captain
*****

Karma: +0/-0
Offline Offline

Posts: 354



View Profile WWW
« Reply #5 on: December 06, 2006, 04:22:54 PM »

erm google have billions and i have millions but thats because its just me lol

If I had a bigger pipe, more people and more hardware I be massive lol
Logged

http://www.Burf.com Search Engine with cheap advertisment.
http://www.rorseek.com ROR Search Engine
http://www.findgoodsites.com Free Directory

New forums http://www.burf.com/forum/ and http://burfforum.co.uk
ash
Administrator
General
*****

Karma: +8/-0
Offline Offline

Posts: 4506


View Profile WWW
« Reply #6 on: December 06, 2006, 04:29:47 PM »

I knew you'd be nowhere near, was just interested in the comparison.....Still are we talking sites or pages?
Logged

burf.com
Captain
*****

Karma: +0/-0
Offline Offline

Posts: 354



View Profile WWW
« Reply #7 on: December 06, 2006, 04:47:51 PM »

Last time I heard, google had like 20 billion (maybe 200 billion) pages

I have 7.5 million pages

Still not a bad effort lol.  My one index server vs there 100,000
Logged

http://www.Burf.com Search Engine with cheap advertisment.
http://www.rorseek.com ROR Search Engine
http://www.findgoodsites.com Free Directory

New forums http://www.burf.com/forum/ and http://burfforum.co.uk
ash
Administrator
General
*****

Karma: +8/-0
Offline Offline

Posts: 4506


View Profile WWW
« Reply #8 on: December 06, 2006, 04:50:29 PM »

Not bad at all!

How does Burf decide which pages to have in its index? Is this why i can't find my site anymore? Did it get dropped?
Logged

burf.com
Captain
*****

Karma: +0/-0
Offline Offline

Posts: 354



View Profile WWW
« Reply #9 on: December 07, 2006, 08:04:38 AM »

Your site should be there mate and I will investigate it now
Logged

http://www.Burf.com Search Engine with cheap advertisment.
http://www.rorseek.com ROR Search Engine
http://www.findgoodsites.com Free Directory

New forums http://www.burf.com/forum/ and http://burfforum.co.uk
burf.com
Captain
*****

Karma: +0/-0
Offline Offline

Posts: 354



View Profile WWW
« Reply #10 on: December 07, 2006, 08:12:08 AM »

Your back for forums lettings and other stuff, cache was old!
Logged

http://www.Burf.com Search Engine with cheap advertisment.
http://www.rorseek.com ROR Search Engine
http://www.findgoodsites.com Free Directory

New forums http://www.burf.com/forum/ and http://burfforum.co.uk
ash
Administrator
General
*****

Karma: +8/-0
Offline Offline

Posts: 4506


View Profile WWW
« Reply #11 on: December 07, 2006, 02:14:04 PM »

Cheers burf, keep up the good work.  Smiley
Logged

burf.com
Captain
*****

Karma: +0/-0
Offline Offline

Posts: 354



View Profile WWW
« Reply #12 on: December 07, 2006, 02:32:52 PM »

People like you make it worth while,  just a single search a week and giving me info back is great but first I need to improve it more
Logged

http://www.Burf.com Search Engine with cheap advertisment.
http://www.rorseek.com ROR Search Engine
http://www.findgoodsites.com Free Directory

New forums http://www.burf.com/forum/ and http://burfforum.co.uk
Pages: [1]
  Print  
 
Jump to:  

Powered by SMF | SMF © 2006-2008, Simple Machines LLC | Sitemap Valid XHTML 1.0! Valid CSS!


Google visited last this page December 31, 2008, 03:04:52 AM