Page 5 of 6 FirstFirst 123456 LastLast
Results 161 to 200 of 226

Thread: RNA World

  1. #161
    =>Team Joker<= LAURENU2's Avatar
    Join Date
    Dec 2004
    Location
    Chicago IL USA
    Posts
    5,478
    Blog Entries
    1
    So I guess that means hold at a 40% commit mark

  2. #162
    New CMCs for Windows x64 have been fed into the server and will be delivered today. We expect these to run without complications unlike some WUs we delivered to Linux x64 a few weeks ago.
    Note that the CMS packets coming up tomorrow will require broadband internet connection. Transfer volumes will be one to two orders of magnitude higher for some WUs compared what you are used to. Computation times will range between a few minutes to up to 100 hrs on a 955 BE (3 GHz). The human genome will also be analyzed.

    Michael.
    http://www.rechenkraft.net - Germany's largest distributed computing community

    - - - - - - - - - -
    RNAs are nanomachines or nanomachine building blocks. Examples: The ribosome, RNase P, the cellular protein secretion machinery and the spliceosome.

  3. #163
    www.amdusers.com
    Join Date
    Apr 2002
    Location
    Sydney, Australia
    Posts
    266
    Quote Originally Posted by Michael H.W. Weber View Post
    Computation times ... up to 100 hrs ...

    Michael.
    Count me out then. I detest long running molecules.

  4. #164
    Maybe a few more details. This time we have a total of 1024 genome files that will be analyzed with two RNAs. Of these 1024 files,

    14 are sized > 200 MB (only 3 of these 14 > 300 MB)
    126 are sized > 100 MB
    319 are sized < 1 MB

    All given file sizes are in uncompressed format, i.e. the files actually delievered will be smaller by at least 30%. Run time distribution will approximately scale with to genome sizes but I do not have a detailed run time distribution table (an idea that came to my mind today, but which would cost considerably efforts to process, so I postponed this for a while). So, we picked out very large, intermediate and small genomes and tested these with a set of around 10 RNAs, amongst these of course also the two we use for today's test run. Maximum run time is below 100 hrs.

    Michael.

    [edit]: Some WUs seem to require well above 1 GB of RAM. Yet we have no means to determine the memory requirements prior to simply running the WU and checking things out in practice. So please report any issues, observed RAM requirements, etc. to me if possible such that we can act quickly if required (e.g. tweak the memory settings as we successfully did with the CMC WUs).
    Last edited by Michael H.W. Weber; 03-08-2010 at 06:15 AM.
    http://www.rechenkraft.net - Germany's largest distributed computing community

    - - - - - - - - - -
    RNAs are nanomachines or nanomachine building blocks. Examples: The ribosome, RNase P, the cellular protein secretion machinery and the spliceosome.

  5. #165
    Ancient Haggis Hound Angus's Avatar
    Join Date
    Jan 2002
    Location
    Seattle/Norfolk Island
    Posts
    828

    Too much RAM needed

    I had to abort all the WUs and go NNW on this project.

    The new CMS WUs use stupidly large amounts of RAM. My system used all the physical and page file space, and basically just stopped functioning. It's a pretty vanilla box, Win XP, 2GB RAM, and a dual core CPU. Probably representative of a high percentage of all the machines running BOINC.

    I guess this will be a high end, 64 bit machines only project.

  6. #166
    Member zombie67's Avatar
    Join Date
    Jan 2008
    Location
    Dublin, CA
    Posts
    88
    It would be nice is RNA had a page like this, showing requirements by app:

    http://boinc.umiacs.umd.edu/apps.php


  7. #167
    Quote Originally Posted by zombie67 View Post
    It would be nice is RNA had a page like this, showing requirements by app:

    http://boinc.umiacs.umd.edu/apps.php
    Thanks for the link, it indeed looks quite informative and worth to adapt to our needs as well.

    One more thing: We have a number of CMS WUs that unexpectedly demand really immense amounts of RAM. Could you please keep an eye on whether crashes of such WUs occur exclusively on 32-bit machines? We already have a suspicion what might go on here.
    Also, if you could provide RAM requirements observed for individual WUs on your systems, we may construct an improved WU assignment system such that the big ones are just not getting delivered anymore to machines that cannot handle them properly. As said before, we cannot yet forecast RAM consumption. So, annoyingly we have to go for tests and then adapt the project settings accordingly.
    If all these measures do not help, we must consider splitting the WUs into smaller chunks but that will result in "downstream result puzzle" efforts which I'd prefer to avoid if possible.

    Michael.
    http://www.rechenkraft.net - Germany's largest distributed computing community

    - - - - - - - - - -
    RNAs are nanomachines or nanomachine building blocks. Examples: The ribosome, RNase P, the cellular protein secretion machinery and the spliceosome.

  8. #168
    =>Team Joker<= LAURENU2's Avatar
    Join Date
    Dec 2004
    Location
    Chicago IL USA
    Posts
    5,478
    Blog Entries
    1
    Out of all my nodes I only have 1 nodes that can get and do work on this project.
    With that I will have to pull off this project till you can provide smaller bits of food for my Nodes to crunch

  9. #169
    Unfortunate for Lauren, but great for the rest of us. We will finally get some work without a server crash.

  10. #170
    =>Team Joker<= LAURENU2's Avatar
    Join Date
    Dec 2004
    Location
    Chicago IL USA
    Posts
    5,478
    Blog Entries
    1
    Quote Originally Posted by ARS-outlnder View Post
    Unfortunate for Lauren, but great for the rest of us. We will finally get some work without a server crash.
    Well see Good things come to those who wait
    But as Arnold said I Will Be Back

  11. #171
    I think we found a solution for the RAM issue. But this might take some time to implement.

    Michael.
    http://www.rechenkraft.net - Germany's largest distributed computing community

    - - - - - - - - - -
    RNAs are nanomachines or nanomachine building blocks. Examples: The ribosome, RNase P, the cellular protein secretion machinery and the spliceosome.

  12. #172
    =>Team Joker<= LAURENU2's Avatar
    Join Date
    Dec 2004
    Location
    Chicago IL USA
    Posts
    5,478
    Blog Entries
    1
    Quote Originally Posted by Michael H.W. Weber View Post
    I think we found a solution for the RAM issue. But this might take some time to implement.

    Michael.
    So Michael have You /RNA made any progress on the solution for the RAM issue And the No Checkpoint yet ?

  13. #173
    Member zombie67's Avatar
    Join Date
    Jan 2008
    Location
    Dublin, CA
    Posts
    88
    Quote Originally Posted by Michael H.W. Weber View Post
    Thanks for the link, it indeed looks quite informative and worth to adapt to our needs as well.
    Any progress on this? I know it seems low priority. But the memory requirements confuse potential crunchers. Something like this would really help.


  14. #174
    =>Team Joker<= LAURENU2's Avatar
    Join Date
    Dec 2004
    Location
    Chicago IL USA
    Posts
    5,478
    Blog Entries
    1
    Quote Originally Posted by laurenu2 View Post
    so michael have you /rna made any progress on the solution for the ram issue and the no checkpoint yet ?
    BUMP

  15. #175
    Since I am still in India, just quickly two notes concerning our project from the server's NEWS page:

    http://www.rnaworld.de/rnaworld/forum_thread.php?id=46
    http://www.rnaworld.de/rnaworld/forum_thread.php?id=47

    So, the WUs in process right now should be safe for (hopefully) any machine.

    Michael.
    http://www.rechenkraft.net - Germany's largest distributed computing community

    - - - - - - - - - -
    RNAs are nanomachines or nanomachine building blocks. Examples: The ribosome, RNase P, the cellular protein secretion machinery and the spliceosome.

  16. #176
    =>Team Joker<= LAURENU2's Avatar
    Join Date
    Dec 2004
    Location
    Chicago IL USA
    Posts
    5,478
    Blog Entries
    1
    Quote Originally Posted by Michael H.W. Weber View Post
    Since I am still in India, just quickly two notes concerning our project from the server's NEWS page:

    http://www.rnaworld.de/rnaworld/forum_thread.php?id=46
    http://www.rnaworld.de/rnaworld/forum_thread.php?id=47

    So, the WUs in process right now should be safe for (hopefully) any machine.

    Michael.
    Well since your in India I will speak loud NO IT IS NOT SAFE
    RNA still have a 1000 WU's to burn off

    http://www.rechenkraft.net/phpBB/vie...117573#p117573

  17. #177
    Quote Originally Posted by LAURENU2 View Post
    Well since your in India I will speak loud NO IT IS NOT SAFE
    RNA still have a 1000 WU's to burn off

    http://www.rechenkraft.net/phpBB/vie...117573#p117573
    As I wrote in the NEWS section (see links above), there may indeed be a few WUs around of the remaining batch. Their number, however, is definetely not 1000 but in the worst case scenario a few hundreds. Moreover, these will exclusively be sent out to machines with large RAM availability. We have improved the WU delivery settings and also added a failure counter that prevents a WU from being sent out again if it has not passed validation for a certain number of times. Finally, if you take a look at the server status page you will see that even in the worst case scenario, the fraction of WUs from the old batch will be significantly below 10% of what the server currently is sending out and should be zeroed out shortly.

    Michael.
    http://www.rechenkraft.net - Germany's largest distributed computing community

    - - - - - - - - - -
    RNAs are nanomachines or nanomachine building blocks. Examples: The ribosome, RNase P, the cellular protein secretion machinery and the spliceosome.

  18. #178
    Project is quite safe.. Any failing WUs on 2GB-doublecore machine since 10 march

  19. #179
    =>Team Joker<= LAURENU2's Avatar
    Join Date
    Dec 2004
    Location
    Chicago IL USA
    Posts
    5,478
    Blog Entries
    1
    Quote Originally Posted by Michael H.W. Weber View Post
    As I wrote in the NEWS section (see links above), there may indeed be a few WUs around of the remaining batch. Their number, however, is definetely not 1000
    Michael.
    Yes just after you posted the 3817.7 MB message stopped and I got WU"S
    AS soon as I complete my other project WU's I will start to Suck you dry
    Do you think you(RNA) can keep up?

  20. #180
    Quote Originally Posted by LAURENU2 View Post
    Yes just after you posted the 3817.7 MB message stopped and I got WU"S


    Quote Originally Posted by LAURENU2
    Do you think you(RNA) can keep up?
    Well, at present a few hundred thousands of WUs are waiting on the server to be processed for delivey and many more can be generated.

    Michael.
    http://www.rechenkraft.net - Germany's largest distributed computing community

    - - - - - - - - - -
    RNAs are nanomachines or nanomachine building blocks. Examples: The ribosome, RNase P, the cellular protein secretion machinery and the spliceosome.

  21. #181
    Ha, Lauren, it might take you a couple of days.

    So much for mister fast pants.

  22. #182
    =>Team Joker<= LAURENU2's Avatar
    Join Date
    Dec 2004
    Location
    Chicago IL USA
    Posts
    5,478
    Blog Entries
    1
    Quote Originally Posted by ARS-outlnder View Post
    Ha, Lauren, it might take you a couple of days.

    So much for mister fast pants.
    I'm like a big train
    Slow to start and hard to stop

    Turning On or Off a project is fast once I sign up all the Nodes
    It is the New projects that take time for me

    I could turn on RNA on all nodes in about 60 Min or so

  23. #183
    Member zombie67's Avatar
    Join Date
    Jan 2008
    Location
    Dublin, CA
    Posts
    88
    If you could get BAM to work, it would take 30 seconds...


  24. #184
    =>Team Joker<= LAURENU2's Avatar
    Join Date
    Dec 2004
    Location
    Chicago IL USA
    Posts
    5,478
    Blog Entries
    1
    Quote Originally Posted by zombie67 View Post
    If you could get BAM to work, it would take 30 seconds...
    But then What Would I do for the next 59.5 Min
    OH Well It Was A Thought

  25. #185
    I like to administer my pharm manually also. It's so much fun to plug and unplug the monitor, mouse and keyboard.

  26. #186
    =>Team Joker<= LAURENU2's Avatar
    Join Date
    Dec 2004
    Location
    Chicago IL USA
    Posts
    5,478
    Blog Entries
    1
    I use KVM's for the home 1 keyboard and 1 mouse and VNC to the Garage

  27. #187
    Member zombie67's Avatar
    Join Date
    Jan 2008
    Location
    Dublin, CA
    Posts
    88
    I use VNC for everything, even the boxes in the same room.


  28. #188
    =>Team Joker<= LAURENU2's Avatar
    Join Date
    Dec 2004
    Location
    Chicago IL USA
    Posts
    5,478
    Blog Entries
    1
    Quote Originally Posted by zombie67 View Post
    I use VNC for everything, even the boxes in the same room.
    Yes, But I have 2 DSL Networks And I don't understand how to bridge them.
    So I need a KVM to switch from 1 PC to the other to control both of my networks
    I have a 8 port KVM with 6 PC's just in my DC cave alone (big closet)

  29. #189
    =>Team Joker<= LAURENU2's Avatar
    Join Date
    Dec 2004
    Location
    Chicago IL USA
    Posts
    5,478
    Blog Entries
    1
    Quote Originally Posted by ARS-outlnder View Post
    Ha, Lauren, it might take you a couple of days.

    So much for mister fast pants.
    Well it looks like only a couple days will get me to 1st place now that I am up to speed that is if Michael's team can keep my heard happy
    Was that fast enough for you outlnder

  30. #190
    Wait a couple of hours. You may break it yet!!

  31. #191
    =>Team Joker<= LAURENU2's Avatar
    Join Date
    Dec 2004
    Location
    Chicago IL USA
    Posts
    5,478
    Blog Entries
    1
    Quote Originally Posted by ARS-outlnder View Post
    Wait a couple of hours. You may break it yet!!
    Well thats why I am only at partial commit So not to bog down there network
    I wonder about RNA database with all the small WU's taking up all the DP space

  32. #192
    =>Team Joker<= LAURENU2's Avatar
    Join Date
    Dec 2004
    Location
    Chicago IL USA
    Posts
    5,478
    Blog Entries
    1

    I took 1st Place

    _Free-DC_
    Takes 2 ND Place.

  33. #193
    WOW, salty rain, or is that the gods crying??

  34. #194
    As described in the projects NEWS section in more detail, we had to transiently disable the WU generator.

    Michael.
    http://www.rechenkraft.net - Germany's largest distributed computing community

    - - - - - - - - - -
    RNAs are nanomachines or nanomachine building blocks. Examples: The ribosome, RNase P, the cellular protein secretion machinery and the spliceosome.

  35. #195
    The WU generator is working again, the small WUs will now be processed on the server, except for very, very few which we will deliver to some remote machines. Please also note that the server response delay has been drastically reduced such that connection issues should be resolved by now as well. We have plenty of WUs, will not run out of work and hope for your further support which is very much appreciated.

    Michael.

    P.S.: Our new concept to resolve the massive RAM requirements of our "CMSEARCH Monster WUs" has resulted in a program which is currently in testing phase. So, even here I expect good progress in the upcoming weeks...
    http://www.rechenkraft.net - Germany's largest distributed computing community

    - - - - - - - - - -
    RNAs are nanomachines or nanomachine building blocks. Examples: The ribosome, RNase P, the cellular protein secretion machinery and the spliceosome.

  36. #196
    Not a single error-report in two weeks it now seems that our project is really running reliably and smoothly. Given the vast amounts of WUs in the server queue, we are actually in need of much more support. So, if you could spare some cycles it would be highly appreciated...

    Michael.
    http://www.rechenkraft.net - Germany's largest distributed computing community

    - - - - - - - - - -
    RNAs are nanomachines or nanomachine building blocks. Examples: The ribosome, RNase P, the cellular protein secretion machinery and the spliceosome.

  37. #197
    =>Team Joker<= LAURENU2's Avatar
    Join Date
    Dec 2004
    Location
    Chicago IL USA
    Posts
    5,478
    Blog Entries
    1
    Not a single error-report in two weeks
    OK I will see if I can Brake your new toy
    I Just had my Bandwidth increased on both DSL lines here

  38. #198
    =>Team Joker<= LAURENU2's Avatar
    Join Date
    Dec 2004
    Location
    Chicago IL USA
    Posts
    5,478
    Blog Entries
    1
    Quote Originally Posted by LAURENU2 View Post
    Not a single error-report in two weeks
    OK I will see if I can Brake your new toy
    I Just had my Bandwidth increased on both DSL lines here
    Michael H.W. Weber I thought you FIXED the problem with LOOOONNNG WU's
    I just aborted 6 WU's with 300 HRS of my time and the WU's still had 500 hrs to go
    A WU that runs for 100 to 200 HRS is absurd Michael
    Have you even put check point in Yet to save all that time ?

  39. #199
    Quote Originally Posted by LAURENU2 View Post
    Michael H.W. Weber I thought you FIXED the problem with LOOOONNNG WU's
    I just aborted 6 WU's with 300 HRS of my time and the WU's still had 500 hrs to go
    A WU that runs for 100 to 200 HRS is absurd Michael
    Have you even put check point in Yet to save all that time ?
    Well, we do not have such WUs in the pipeline (except for Yoyo would be doing some testing). Hence, I assume that this could just be one of these BOINC-related run time mispredictions. Could you please let me know a few more details on these cancelled "WUs" if still available?

    Michael.

    P.S.: Test apps are disabled, right (we are currently working on the user job submission forms)?
    Last edited by Michael H.W. Weber; 05-16-2010 at 12:27 PM.
    http://www.rechenkraft.net - Germany's largest distributed computing community

    - - - - - - - - - -
    RNAs are nanomachines or nanomachine building blocks. Examples: The ribosome, RNase P, the cellular protein secretion machinery and the spliceosome.

  40. #200
    =>Team Joker<= LAURENU2's Avatar
    Join Date
    Dec 2004
    Location
    Chicago IL USA
    Posts
    5,478
    Blog Entries
    1
    I guess you could find them here http://www.rnaworld.de/rnaworld/resu...ames=0&state=5
    I really do not know how to give you the info you are asking for.
    All I know Is I Do not want to work on Long WU's
    I see them I abort them And as long as I see them I wi9ll not port mor power here

    And Michael you avoided the question of
    Have you even put check point in Yet to save all that time ?
    Have you fixed this Problem yet ?

Page 5 of 6 FirstFirst 123456 LastLast

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •