Results 1 to 30 of 30

Thread: Some db issues

  1. #1
    Administrator Bok's Avatar
    Join Date
    Oct 2003
    Location
    Wake Forest, North Carolina, United States
    Posts
    24,444
    Blog Entries
    13

    Some db issues

    After the power outage today I have some crashed tables in need of repairing..In fact the combined boinc user table needs to be recovered from last night's backup.

    Shouldn't be too long.

  2. #2
    Administrator AMDave's Avatar
    Join Date
    Sep 2004
    Location
    deep in a while-loop
    Posts
    1,948
    Thanks for your owl-like attention, Bok.
    Impressed by your response and restoration times. A lot of private enterprises would be jealous.
    Hope the restore goes smoothly.
    . . . . . ___
    . . . . . . .\___/\______
    . . . . . . . \__AMD___\\__
    -----------------------------------------

  3. #3
    Crazy Old Man
    Join Date
    Feb 2009
    Location
    Netherlands
    Posts
    44
    Today when i try to view my stats nothing shows except my cpid
    Everything shows up with 0 for 2 days now

  4. #4
    Administrator Bok's Avatar
    Join Date
    Oct 2003
    Location
    Wake Forest, North Carolina, United States
    Posts
    24,444
    Blog Entries
    13
    Still having problems unfortunately..working on it.

  5. #5
    Administrator AMDave's Avatar
    Join Date
    Sep 2004
    Location
    deep in a while-loop
    Posts
    1,948
    Looks like that last command did the trick
    Well done Sir!

    (edit - I think I just Knighted you with a capital 'S', haha - edit)
    . . . . . ___
    . . . . . . .\___/\______
    . . . . . . . \__AMD___\\__
    -----------------------------------------

  6. #6
    Junior Member
    Join Date
    Feb 2010
    Location
    Raleigh, North Carolina, United States
    Posts
    25
    Good work on getting the stats mostly restored. In case you were not already aware of lingering problems. I am seeing some oddness in my stats and other teammates. For me I am showing a -6M which I have tracked to 4 missing projects; DNA, Leiden Classical, WEP, yoyo.

    Thanks for the hard work you put in.

  7. #7
    Last update stripped PrimeGrid off my account. -53 million. Ouch!

    CPID matches here and on PG site so I imagine it's something wonky in the DB rather than an ID split.

    Cross-project ID: 0f741dcc57d0944ef82a0c15bd4d42cc

    Just a heads-up Bok.

    Edit: Guess I'm not alone, must've started my reply right after Jeff did.

  8. #8
    BOINC Gypsy ChertseyAl's Avatar
    Join Date
    Aug 2008
    Location
    London, Englandshire
    Posts
    209
    Bok, is this just to stop me finally getting my 100 projects milestone?

    At least I only lost half a million credits - Looks likely just to be Primegrid that's missing.

    Al.

  9. #9
    Administrator AMDave's Avatar
    Join Date
    Sep 2004
    Location
    deep in a while-loop
    Posts
    1,948
    Bok had to restore some tables from the backup taken the previous day so some stats 'appeared' to have rolled back.
    The tables are now cycling through the progressive and nightly-rollover updates.
    Your points WILL re-appear when the update cycle gets through all of the projects.
    For some projects this can take up-to 24 hours depending on when they release the next updated stats file.
    (I think PG is about every 6 hours / 4 times per day - IMMSMC, but I can't find the reference right now to confirm that)

    In advance, may I say "Welcome to the 100 club!"
    . . . . . ___
    . . . . . . .\___/\______
    . . . . . . . \__AMD___\\__
    -----------------------------------------

  10. #10
    Administrator Bok's Avatar
    Join Date
    Oct 2003
    Location
    Wake Forest, North Carolina, United States
    Posts
    24,444
    Blog Entries
    13
    There are a few problem rows still in the user and host tables. I have backups and will restore those individual rows in the morning. Looks to have affected about 2000 rows from 3.5Million. It might mean that some users appear as new if there is new xml exports prior to me restoring, which is not a huge deal.

  11. #11
    Administrator Bok's Avatar
    Join Date
    Oct 2003
    Location
    Wake Forest, North Carolina, United States
    Posts
    24,444
    Blog Entries
    13
    Oh and congrats on the 100projects Al.

    I myself hit a very personal milestone yesterday which will be reflected on the next stats update from the project today.. 100K in Chess@Home - a hugely frustrating project to run, given the limited wu's/platform, short timeframe on wu's and the 1 hour backoff every time. Taken me a LONG time to get there...

  12. #12
    Crazy Old Man
    Join Date
    Feb 2009
    Location
    Netherlands
    Posts
    44
    The stats appear again so i guess in a short while all will be fixed and updated.
    Great work Bok you wizard and congratz on that project.
    I am currently trying to get all my projects at number 1 on the sign up date.
    But one project is gonna be a problem since some persons runs on that date which i never can catch up.
    they are simply is too rich to ever get near them, they simply buy everytime the newest gpu cards and speeds ahead.
    Last edited by uBronan; 09-03-2011 at 09:00 AM.

  13. #13
    BOINC Gypsy ChertseyAl's Avatar
    Join Date
    Aug 2008
    Location
    London, Englandshire
    Posts
    209
    Quote Originally Posted by Bok View Post
    Oh and congrats on the 100projects Al.
    Cheers Just need the latest update from YAFU and the MMs to update and I'll be there.

    I'm still hoping to hit 100k in Ye Olde Original LHC - Looks like the relaunch as SIXTRACK might be a sign of some work

    Al.

  14. #14
    Free-DC Semi-retire gopher_yarrowzoo's Avatar
    Join Date
    Mar 2002
    Location
    Knoxville, TN
    Posts
    3,985
    Yeah well we are hoping that the work we are doing with the stats that you don't see, will stay that way totally hidden so you don't even spot it but yeah thanks for the heads up to what to snafu'd...

    I'm doing some UI changes but well you won't see them until they get released
    Semi-retired from Free-DC...
    I have some time to help.....
    I need a new laptop,but who needs a laptop when you have a phone...
    Now to remember my old computer specs..


  15. #15
    Crazy Old Man
    Join Date
    Feb 2009
    Location
    Netherlands
    Posts
    44
    A bit off topic maybe but i had to change my logon info on all projects since i have seen some changes which i really did not like
    How long before the cpid gets settled so i can put it into the stats tool for quick access my stats and will the old retired projects follow up or does that needs some fixing in the dbase as well?

  16. #16
    Free-DC Semi-retire gopher_yarrowzoo's Avatar
    Join Date
    Mar 2002
    Location
    Knoxville, TN
    Posts
    3,985
    Quote Originally Posted by uBronan View Post
    A bit off topic maybe but i had to change my logon info on all projects since i have seen some changes which i really did not like
    How long before the cpid gets settled so i can put it into the stats tool for quick access my stats and will the old retired projects follow up or does that needs some fixing in the dbase as well?
    Hmm the cpid should settle once all your boinc boxes have contacted the projects and the new cpid hash has been passed to them, as for old & retired project hmm well we would need to do a fix on that for ya. You may get a split cpid for a bit...
    Hmm maybe something we could work on....
    Semi-retired from Free-DC...
    I have some time to help.....
    I need a new laptop,but who needs a laptop when you have a phone...
    Now to remember my old computer specs..


  17. #17
    Administrator Bok's Avatar
    Join Date
    Oct 2003
    Location
    Wake Forest, North Carolina, United States
    Posts
    24,444
    Blog Entries
    13
    If you only do BOINC projects, no need to use statstool as the userbycpid page will list everything. Statstool is mainly just for nonBOINC..

  18. #18
    Crazy Old Man
    Join Date
    Feb 2009
    Location
    Netherlands
    Posts
    44
    Well not yet, on many attempts to get full view.
    Somehow i still have not all projects on one page.
    Statstool made show some which i knew the userid on that user page but on cpid i get sometimes weird results including some german guy his stats
    But when i search on name, untill now i am still missing some projects under the total
    And ofcourse the old projects leap behind or fail entirely to follow
    like bbc cpdn, seasonal, rieselsieve not sure what aqua will do now it has been set to retired

    On the non boinc projects i totally forgot many info and since most no longer exist its also no longer possible to get them.
    Like i have been running some time on folding@home and at certain moment put the folding under (Webbie) evga team but since you can not control it in any way i stopped
    I also ran dpad,tsc both, seti@home(classic) and more of these projects but in time all got lost

  19. #19
    Administrator Bok's Avatar
    Join Date
    Oct 2003
    Location
    Wake Forest, North Carolina, United States
    Posts
    24,444
    Blog Entries
    13
    Looks like a few CPID's - http://stats.free-dc.org/stats.php?p...xact=N&cross=Y so you've definitely got a split CPID.

    Make sure you change your email address at Climate Prediction, Seti@Home, SetiBeta & Ufluids and make sure they are connected on one of your machines that is also connected to your other projects, then they should sync up on the next xml export from each project - I'll fix Seasonal Attribution for you in the database once you've done that as that is no longer exporting.

    As for the nonBOINC projects, you should certainly still be in the database but I have no idea what your userids are without knowing the name(s) you used in them

  20. #20
    Crazy Old Man
    Join Date
    Feb 2009
    Location
    Netherlands
    Posts
    44
    After 4 days as far as i can see almost everything lined up
    Except the dead projects

    As i remember i kept for a long time the same username uBronan

    For rieselsieve last position was 2851 with 7,545 credits
    For BBC experiment last pos i recorded was 53745 with 4,666 credits
    For seasonal user position recorded was 1101 with 14976 credits
    Send you the userid's from the ones i still have

    BBC experiment and ufluids is impossible to enter since it has giving me a db error for many months thats why i reported it dead like aqua
    The last time i could login is somewhere in 2010, the funny thing is that there is maybe a new bbc project 2 in the making
    To be honest i do not care about ufluids much since i ended very early in the project.
    Last edited by uBronan; 09-06-2011 at 02:00 PM.

  21. #21
    Administrator Bok's Avatar
    Join Date
    Oct 2003
    Location
    Wake Forest, North Carolina, United States
    Posts
    24,444
    Blog Entries
    13
    I'll find and fix tonight for you..

  22. #22
    Crazy Old Man
    Join Date
    Feb 2009
    Location
    Netherlands
    Posts
    44
    That would be awesome

    I am currently struggling to understand prpnet and the badges from primegrid
    Scary enough only 2 projects seem to be gpu ones and the cpu projects really take ages .... i got one of those sob ones and still is busy after roughly 5 days (122 hours and counting at 55%)
    It prolly gives crappy credits as well

    On the psa prpnet side was messing with the cuda dos client which after i think was 20 hours gave me 10k points on the prpnet but lol found out this is almost worth nothing, because they are worth if i read it right only 50 cobblestones or so.
    And could not find myself on the stats here as well on the primegrid stats, i guess it only shows up when you run for a year or so xD

    Good god i should have stayed just on gpu projects which pay tons of cobblestones very fast

  23. #23
    Administrator Bok's Avatar
    Join Date
    Oct 2003
    Location
    Wake Forest, North Carolina, United States
    Posts
    24,444
    Blog Entries
    13
    I'm doing it now actually.

    I think prpnet from PRimeGrid is completely separate from there BOINC part, though they do offer a badge in the PSA (Project Staging Area) which is run outside of BOINC, I don't think prpnet is part of that. You'll likely get close to a badge with just one SoB wu I think. IIRC they give ~9000 credits each, maybe more now that the exponent is higher, so hang in there with the one you are running. Yes, only two of their subprojects are cuda, they've had more in the past like the AP26 subproject but it was basically completed.

    You only show up in a BOINC xml export when you've got any sort of credit at all. What is your primegrid ID ? Perhaps run the ppsieve project on your cuda card, it's still pretty good credit and the wu's are only 10mins or so. They export stats 4 times per day so it wouldn't take long to show up..

    Let me fix your older id's now and I'll let you know.

  24. #24
    Administrator Bok's Avatar
    Join Date
    Oct 2003
    Location
    Wake Forest, North Carolina, United States
    Posts
    24,444
    Blog Entries
    13
    I've done seasonal attribution and ufluids.

    I found a 'Bronan' in BBC Climate, nothing remotely like it in Rieselsieve though. There is only a single user with 7,545 credits - Webbie ?? I think it must be you as if you click on the CPID at the top there is an entry for BBC Climate Prediction too..

    If you confirm I'll move the cpid's to your main one

  25. #25
    Crazy Old Man
    Join Date
    Feb 2009
    Location
    Netherlands
    Posts
    44
    hahahaha yes those are mine but could not change them since it went offline
    Rieselsieve should be Webbie cause thats the name which i used for many years on old projects tsc/dpad and older i once ran with some team also team_elteor_borislavj for a couple of months

  26. #26
    Looks like the Combined User Totals are either still messed up or messed up again since yesterday I think ...

  27. #27
    Administrator Bok's Avatar
    Join Date
    Oct 2003
    Location
    Wake Forest, North Carolina, United States
    Posts
    24,444
    Blog Entries
    13
    Damn. yes, I see the issue. I'll have to recover that from yesterday, it's caused all combined milestones to be regenerated too. Bah.. it'll get on it later this morning.

  28. #28
    Whoa, Looks fixed now, lets see somebody beat that 1 day Total ...

  29. #29
    Administrator Bok's Avatar
    Join Date
    Oct 2003
    Location
    Wake Forest, North Carolina, United States
    Posts
    24,444
    Blog Entries
    13
    Not yet, it's basically cycling around. I broke it yesterday when fixing the 'main' country for combined users using a materialized view. Just waiting on the current run to complete, then I'll restore the table from yesterday morning. It's going to mean today's totals are too high and yesterdays are too low, but I can probably fix that manually.

  30. #30
    In response to the concerns on PRPNet work and such hopefully I can add to what Bok said to help you understand how it works. PRPNet is seperate from Prime Grid Boinc because they consider prpnet to be manual sieving of projects. For prpnet projects you earn prpnet credits that are then converted over to BOINC credits. the conversion comes out to roughly 18 prpnet credits/boinc credit. Since users can gain huge amounts of PRPNet credits in a short amount of time the boinc credits are spread out so that the RAC doesn't get crazy high all at once. Also stats from PRPnet are manually added to boinc stats about once a month and it normally takes longer for new users to see credit.

    So for example here i have 163,489 PRPNet credits right now. If i stopped right now then once all the stats are processed i should end up with roughly 9000 Boinc credits for Prime Grid. currently my credits come in for boinc in 100-200 credit chunks each day although I'm not running the really long tests like 5oB or MEGA so that makes sense. It should be that the longer the test the more credit you will get.

    So as long as PRPNet settings are configured correctly to match your PG info and then that it shows up right here in the stats the credit should eventually transfer

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •