Results 1 to 13 of 13

Thread: Boitho stats

Hybrid View

Previous Post Previous Post   Next Post Next Post
  1. #1
    Administrator Bok's Avatar
    Join Date
    Oct 2003
    Location
    Wake Forest, North Carolina, United States
    Posts
    24,504
    Blog Entries
    13
    I'll leave the explanations to PCZ as I know very little about this..

    the link I'm using for the stats is

    http://dcsetup.boitho.com/cgi-bin/dc/topTeams.cgi

    Bok

  2. #2

  3. #3
    Keeper of the Fridge PY 222's Avatar
    Join Date
    Jul 2002
    Location
    San Jose, CA
    Posts
    2,706
    Ahh...

    This is a distributed crawler, where everybody can donate there superfluous computer resources and spare bandwidth, to help us create a bigger and better search engine.

    Our goal is to make a general internet search engine with a thumbnail picture of all the pages. The problem is that the bandwidth and computer resources needed to make a thumbnail of a internet page is several times the resources needed just to download a HTML page. This means that Boitho has to spend more resources on crawling than other search engines.

    To make the most of our available resources, and to allow volunteers to donate their superfluous bandwidth and idle CPU time, we have developed a distributed crawler for Boitho, like seti@home and Grub. That way people can install a program on their computers and help us with the crawling.
    Just like another Majestic12.

  4. #4
    Administrator PCZ's Avatar
    Join Date
    Jun 2003
    Location
    Chertsey Surrey UK
    Posts
    2,428
    A small warning.

    The client can crawl robots.txt and URL's.
    Crawling robots.txt the load on the PC is small but when it starts crawling URL's it a CPU hog.

  5. #5
    Administrator PCZ's Avatar
    Join Date
    Jun 2003
    Location
    Chertsey Surrey UK
    Posts
    2,428
    Bok hope this helps with the stats

    From AMD users forum
    runarb wrote:

    Stats formula is as follow:
    Rank = crawledpages + (robots.txt / 6)

    But one should probably use the "Place" column, not generate it's one. Sow we can change this later.

    Also project does have a forum
    http://www.boitho.com/forum/

  6. #6
    Hi

    I am one of the people behind Boitho.

    Where is the name Boitha coming from? The name is Boitho. Typo?

    More easy parsable stats are coming on Sunday. Probably tab separated. I will keep you informed.



    Any how, I watching this board sow just post here, or mail if I can bee of any assistants. Mail is: runarb [at] boitho dot com

  7. #7
    I started using this yesterday, I went out and when I came back in my computer had been restarted (sat waiting on login page), this has happened twice both times when I have not been here to see what happens.

    Any one have any ideas as to why this program would cause XP to shut down?

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •