Results 1 to 13 of 13

Thread: Mirrors

  1. #1
    Release All Zigs!
    Join Date
    Aug 2002
    Location
    So. Cal., U.S.A.
    Posts
    359

    Mirrors

    I was just wondering if Howard had given any thoughts to any official mirrors for the clients?

    Second, to everyone in general why not utilize P2P technology such as Fileshare or Kazaa for that purposes? Theoritically as more people download it should be a lot easier to spread the load out, assuming they stay on after downloading it and make sure it is shared...

    ~RuneStar½
    The SETI TechDesk
    http://egroups.com/group/SETI_techdesk
    ~Your source for astronomy news and resources~

  2. #2
    25/25Mbit is nearly enough :p pointwood's Avatar
    Join Date
    Dec 2001
    Location
    Denmark
    Posts
    831
    BitTorrent maybe?
    Pointwood
    Jabber ID: pointwood@jabber.shd.dk
    irc.arstechnica.com, #distributed

  3. #3
    Member
    Join Date
    May 2003
    Location
    Portland, OR USA
    Posts
    79

    Thumbs up

    BitTorrent Definitely!

    According to the website, there are now 19874 registered users out there and many will have more than one computer to update. I've got 130-something in my farm, but I plan to set-up the Auto-update Daemon mentioned on the download page. Others may have folding farms connected directly to the Internet and set to auto-update. When the update is ready, there will be a surge of 8-or-so MB download requests competing with the regular flood of pending Phase I structures and a growing trickle of Phase II structures. Thankfully, the results uploads are small files.

    With such a storm of update requests, BitTorrent would be a great help in reducing the bandwidth consumption by folks manually requesting a full download of the new client. It would also reduce the bandwidth consumed by new downloads in the long run.

    I wonder if the DF client could be modified easily to take advantage of BitTorrent for upgrades like mere protein changes?
    -djp
    I'm not a Stats Ho either. I just want to go and check to see that all my spare boxen are busy. Hang on a minute....

  4. #4
    For one thing we have much more bandwidth now than at the last update (we changed ISPs a while back dont forget, when our IP changed).

    However, we have asked for download mirrors before. We only have one mirror at the moment. We welcome any other volunteers to act as mirrors, if they have lots of bandwidth available. It is trivial to set up, just using the Daemon we supply.
    Howard Feldman

  5. #5
    25/25Mbit is nearly enough :p pointwood's Avatar
    Join Date
    Dec 2001
    Location
    Denmark
    Posts
    831
    Howard, I don't think you've quite understood the idea - to provide a normal mirror, you would need quite a lot of bandwidth - with BitTorrent (BT), you get everyone to that uses BT to download the client, to mirror it too. BitTorrent is different from the other P2P networks as you'll understand if you read more about it: http://bitconjurer.org/BitTorrent/

    Also there is a Slashdot interview with the developer behind it: http://interviews.slashdot.org/artic...tid=185&tid=95

    And in regards to security which I'm pretty sure you're quite interested in, here is a bit from the FAQ:
    How do I know the download isn't corrupted?

    BitTorrent does cryptographic hashing (SHA1) of all data. When you see "Download Succeeded" you can be sure that BitTorrent has already verified the integrity of the data. The integrity and authenticity of a BitTorrent download is as good as the original request to the tracker. Checking the MD5 of a file downloaded via BitTorrent is redundant.
    EDIT: Oh any news in regards to when the change to phase 2 will happen?
    Pointwood
    Jabber ID: pointwood@jabber.shd.dk
    irc.arstechnica.com, #distributed

  6. #6
    I have roughly 9Gb of free bandwidth a month. Would that be enough for a mirror? If so you can consider me a volunteer.

  7. #7
    25/25Mbit is nearly enough :p pointwood's Avatar
    Join Date
    Dec 2001
    Location
    Denmark
    Posts
    831
    Well, I have more than 9GB a month, but my upload rate is 512kb, which I believe, is not quite enough to be very useful as a mirror...
    Pointwood
    Jabber ID: pointwood@jabber.shd.dk
    irc.arstechnica.com, #distributed

  8. #8
    Release All Zigs!
    Join Date
    Aug 2002
    Location
    So. Cal., U.S.A.
    Posts
    359
    Originally posted by pointwood
    Well, I have more than 9GB a month, but my upload rate is 512kb, which I believe, is not quite enough to be very useful as a mirror...
    Well the idea is to SPREAD out the load. =)
    The SETI TechDesk
    http://egroups.com/group/SETI_techdesk
    ~Your source for astronomy news and resources~

  9. #9
    Senior Member
    Join Date
    Mar 2002
    Location
    MI, U.S.
    Posts
    697
    Originally posted by pointwood
    Well, I have more than 9GB a month, but my upload rate is 512kb, which I believe, is not quite enough to be very useful as a mirror...
    Yeah, same here. I've got no total upload amount limit per month, but the bandwidth is capped at about 64 kilobits/sec, which is pretty crappy.

    But it might just be enough for something like BitTorrent. Maybe -- and if I want to bother setting it up, that is. I'd need to install python on that box, then probably some other crap too, and whether it'd be worth it to poke another hole in my firewall is questionable at best...

  10. #10
    Target Butt IronBits's Avatar
    Join Date
    Dec 2001
    Location
    Morrisville, NC
    Posts
    8,619
    I think when Howard says "5 Mbit", he is referring to the size of the pipe bandwidth, not total monthly allocations
    I have unlimited allocation, however, I don't believe I would make a good mirror because the size of my upload, your download, pipe is only 31 KB/sec, 1 at a time...
    If 100 folks hit me all at once, my house would get sucked inside out, and they would be there for a week trying to get the files.

  11. #11
    Yes I meant 5Mbit pipe. Basically you won't be able to mirror from your house, it'll need to be a 'real' net connection at an institution or company. As for this BitTorrent thingy, it sounds like a neat idea, however, my 'daemon' software already accomplishes this task. All a 'mirror' is is someone running my daemon with it set to grab all OSes and which I have entered in the master list of mirrors (on our web server).
    Howard Feldman

  12. #12
    Originally posted by Brian the Fist
    As for this BitTorrent thingy, it sounds like a neat idea, however, my 'daemon' software already accomplishes this task. All a 'mirror' is is someone running my daemon with it set to grab all OSes and which I have entered in the master list of mirrors (on our web server).
    The reason you need mirrors is to increase the total bandwidth available so everyone can download the files at a reasonable pace. Your deamon software only works if people sign up to be mirrors and run your daemon software. They need to have large pipes to do this.

    BitTorrent spreads out the downloads among everyone who is downloading the software. So if you have 500 people hitting the server trying to download the latest client, BitTorrent will use those 500 users to start sending parts of the client amongst each other.

    It is an easy way to transform the users who are downloading your program to all become mirrors simultaneously. The cryptographic hashing ensures that nobody's files get tampered with on the way.

    idSoftware uses BitTorrent to distributed the free Wolfenstein - Enemy Territory FPS game since it is a 250MB+ download and thousands of people try to DL it at the same time. See here: http://zerowing.idsoftware.com/BT.html

    Jeff.

  13. #13
    Like I said above, we have significantly more bandwidth now (or so Im told) so lets just see what happens this time...
    Howard Feldman

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •