Stats for Aqua@Home added here ..
Interesting new project though I haven't received my password yet from the automatic user it set up for me :(
Bok
I see the usual suspects are already hard at work chasing 100K on it :p
Printable View
CUDA details should show up on the relevant hosts when both Gpugrid and seti update next...
I have a test one at http://stats.free-dc.org/stats.php?p...3&hostid=16280 where the info show near the bottom prior to the graphs (which I also started adding today).
Once the data is in, I'll look into doing some indexing and grouping by various card types..
Schweet! :)
:idea:
OK in the top of the stat pages you have this
Last Checked : Sun Dec 28, 22:18:59 2008 CST
Data Updated : Sun Dec 28, 19:19:56 2008 CST
Current Time : Sun Dec 28, 23:37:09 2008 CST
Could you also do this
Next Update : Mon Dec 29, 01:19:56 2008 CST
Last Checked : Sun Dec 28, 22:18:59 2008 CST
Data Updated : Sun Dec 28, 19:19:56 2008 CST
Current Time : Sun Dec 28, 23:37:09 2008 CST
To show what time the next Update is Due (if all goes well)
I know I know I am a pest :blush:
Hmm you don't ask for much do YOU! Now I know the update times are held in the db so i'm sure it is probably possible to do this, but then again given the size of the db now another coloumn might just be a push to far...
http://celsathome.bme.utexas.edu/cels/index.php
new Cels url.
Thanks Death URL updated in stats
It's actually not really doable. The updates are not set in stone, they are dynamic and completely depend on what else is going on as well..
There could be a guesstimate put in based on average update time in the past week/month but that's all it would be - I'm not sure it's really worth it.
No I read the "Old website" and it says they are moving to a new place, thus curtailing what they are putting out but continuing where the left off in the new place or that's how I read it..
No Need gopher Most every body already knows it:lmao:
And to prove it I found a GLITCH in the stat page :Pokes:
On a norm these 2 pages will be insink
http://stats.free-dc.org/stats.php?page=proj&proj=nqe
http://stats.free-dc.org/stats.php?page=users&proj=nqe
But if you open them at like 1:00 am Central time this page
http://stats.free-dc.org/stats.php?page=proj&proj=nqe
has the total for the day before and not what is current
And it happens Evey night at that time
I am Not sure at what point the pages go back into sink but they do
no glitch.
Check the FAQ :Pokes:
http://stats.free-dc.org/stats.php?page=faq
FAQ #9
interesting...
it's certainly possible. The rollover occurs in mountain time and there is a slight chance of a misalignment of tables which will occur. This ordinarily is less than 20 seconds or so.. I spent a LOT of time tuning this and within infrastructure I'm working with (which is excellent), believe me, it's about as good as we can get.... :p and I mean lots better than a lot of big companies I work with!! :p
Bok
It lasts about 2 hours here on the West Coast.
I do not think so look at my history taken from the 30th to the 31st
Last 28 days Current Time : Wed Dec 31, 01:34:14 2008 CST
Dec 31 Dec 30 Dec 29 Dec 28 Dec 27 Dec 26 Dec 25
49,574 45,776 32,519 9,432 0 0 0
Last 28 days Current Time : Tue Dec 30, 23:43:29 2008 CST
Dec 30 Dec 29 Dec 28 Dec 27 Dec 26 Dec 25 Dec 24
49,574 45,776 32,519 9,432 0 0 0
Says the same total but gets the days mixed up but only 2 hrs difference
And Bok it is much longer then 20 sec. or even 20 min more like over 2 hrs
PS
So I guess at that time I see my totals that are 2 days old not just yesterdays totals
/me backs the truck up.
Intriguing.
Time to look at the process scheduling and sequencing.
It 'shouldn't' happen as far as I can remember the scripts, and yet it does.
A juicy mystery to fill out the rest of the day.
I wonder what the last "Update" time is on those pages...
I mean I just checked my Rosetta @ Home Page -
Last Checked : Wed Dec 31, 02:47:52 2008 GMT
Data Updated : Wed Dec 31, 02:19:58 2008 GMT
I think I suspect that if you looked these 2 pages will have different times in these slots, maybe a cached page somehow..
I think I misunderstood what you said..
The 'rollover' occurs approx at midnight MST (it's in a loop along with everything else) and does take up to 2 hours to finish as there is a crapload of processing taking part there, but it all happens on a different database to the one which displays the data. When it finishes it's processing it then drops the web tables and renames the new ones across which does not take long at all, this is the 20secs I'm talking about. The totals will still show as today for this period of time, is this what you mean? The 'last update time' will be static at this point as it comes from a table, shifted depending on your timezone, if you are logged in, whereas current time is realtime.
There may be a problem I'm not understanding though. Can you expand on exactly which fields are not matching up ?
Sorry, I'm a bit groggy this morning :)
Bok
I took the time stamp from the page top so you could see at what time the page was loaded And I used my history to show the difference
So Gopher is this pest'y enough for you hehe:lmao:
Bok I am not sure I could expand on exactly which fields are not matching up
I do not communicate vary well in type
I do better with my :jabber: Ask my wife :slap:
If you want to voice about it just let me know
We'll get there in the end :)
Ok, so as you talk about 'last 28 days' I think I know where you are coming from now and that indeed could be a problem (though semantically only).
The code we use to figure out the 'day numbers' uses the machine date as a base. So, you are correct, in that it will be displaying wrongly in that timeframe.
Gopher/ AMDave,
I'll update our thread in the stats forum with what I mean..
Bok :rock:
I am still not sure you can understand what I am seeingQuote:
We'll get there in the end :)
Ok, so as you talk about 'last 28 days' I think I know where you are coming from now and that indeed could be a problem (though semantically only).
This page http://stats.free-dc.org/stats.php?page=proj&proj=nqe
At some time after 12:00 am (my time) it displays the data for 2 days past
It is suppose to display the data that was entered the night or last update
I see it as a timing issue
I think it is told to look back in history before the stats update so it picks the Wrong data to display.
You have to load the page at that time to see it
http://stats.free-dc.org/stats.php?page=proj&proj=nqe
http://stats.free-dc.org/stats.php?page=users&proj=nqe
But as you said (We'll get there in the end :) ) and it does right itself by morning
I do get it I think. During that update immediately after midnight, we should not be calculating the last day (i.e today) YET. I'm going to be adding something so that it uses a date in the database for this which will be updated immediately after the rollover has occurred. This should cure it..
I was going to try and do it this afternoon but the Wii overtook me :p
Bok
Bok,
I realize it might be a lot of work --or-- it will be a snap... When do projects rollover? Do they rollover at local midnight, 0000 UTC or GMT, or ??????
I presume our stats roll at server midnight?
Most BOINC sites roll at 0000Z ???
Is this a correct presumption?
Thanks,
Chuck
server midnight, well not exactly as they aren't cron'd as such but in a loop, but soon after in practice.
It can actually be anytime we wish it to be, if there was a clear concensus to change it I'd be happy to implement..
Bok
Bok,
Would it be easier for you to implement them on specific times.... eg.... project rollover (usually 0000Z) + some delay factor for the final stats data to be output to you?
Or,
Given approx US Pacific 00:30 is about the latest for any project + stats... would that work or does it take longer for end-of-day stats to reach you?
Just some thoughts about what would be most helpful (?). I know you work hard on stats and anything to make them predictable (so people like me don't fall into update/rollover holes again and cause undo work again) seems to make sense.... I would be willing to handle that.. The only downside I see is that UTC and UTC+1 projects would already be 8 and 9 hours into their 'day'.
Almost seems like a no-win scenario... true?
Edit: As a PS: WOuldn't having a predictable/ fixed rollover for server end-of-day would make the incremental updates easier / more predicable as well ? (that is what got me).
Edit2: Does the DB allow for 'end-of-day' rollover time for each project's stats you keep as well as the incremental update time(s) ?
C.
My screen shows the following for stats:
Nqueens - Free-DC Overview
Last Checked : Mon Jan 05, 18:47:41 2009 HST
Data Updated : Mon Jan 05, 13:24:19 2009 HST
Current Time : Mon Jan 05, 16:22:43 2009 HST
This is on page:
http://stats.free-dc.org/stats.php?p...oj=nqe&team=66
Is this a bug or server reporting prob?
Thanks,
C.
Nqueens - Free-DC Overview
Last Checked : Mon Jan 05, 19:36:01 2009 MST
Data Updated : Mon Jan 05, 19:36:01 2009 MST
Current Time : Mon Jan 05, 19:40:06 2009 MST
Looks correct to me...
No, I don't want it to be specific times and I don't do incremental as such. The stats are basically as up to date at any one time as they possibly can be. The only thing which is not updated immediately are the Boinc combined user scores - they are just too intensive - instead I update them every 6 interations of updates which tends to mean they can be up to ~ 2 hours out of sync.
I'd be happy to share a high level version of the scripts, but in a nutshell, they are all within loops. At the beginning of each rotation across projects, I check to see whether I've crossed a threshold (in this case into a new day) and perform the rollover, check for backups and various other things.
I did implement a fix for the rollover to keep the stats that Lauren had found in-sync. I meant to let Lauren know about it but forgot that part today..it's only displayed on stats4 right now, but if you want to check them after midnight MST time you can compare what it shows in the 28 days columns on stats4 to those on stats and you'll see the difference..As soon as they are confirmed by anyone else but me I'll roll them into stats..
Bok
IB,
I run over a VPN to my machines at home... Could that be causing the time variations? I did set everything to HST. I'm sure it's fine... but it 'once again' looked weird. Perhaps I caught it at a weird time??? Or (don't all agree at once please :clap: ) Am I just weird ???? :lmao:
Thanks,
C.
Bok,
Thanks for the feedback... I trust your stats scripting & skills completely... I was just thinking of a way, if possible, to make things easier for you...AND avoid weird stuff like me who have hosts on one side of the server (EST) and a client on the other side (HST).... or just 'weird' users... like Lauren or myself. :)
My linux boxen are all running UTC... perhaps time to get the windows box in UTC mode as well ??? (that is what I view my stats and forum stuff on as well as my email.
I think more than just my brain is 'jet lagged'..... :)
C
Chuck,
I'll have a look into that "time" thing does seem rather strange but I think I know why, it's the way the dates' are calc out..
I Thought I had this fixed, just need to do a roll on the date which I thought I did do :cry:, I'll fire my editor up and look at it, of course trying to "simulate" this one isn't easy naturally..
http://12121.vocabulate.com/rank.php
How about this?
And this
http://12121.vocabulate.com/27k/rank.php
Very minimal info there and no teams at all...I could do it but it would not be very pretty!!
you know very well, that free-dc can be a good project poosher.
if the stats appear at stats.free-dc.org - a lot of people including those from other teams that use free-dc stats will try this project.
teams appear - i promise. right now I'm crunching one of their WU's (thats just llr, you know), my usernamу at this project is Death [Ukraine]. When I finish it - a week or so - you got teams.
You can crunch as BoK [Free-DC]. )))))
And ofcourse if you add this to stats please take this in mind. We can check the project boost after appearing at stats. And also I can bet a dollar on penny that at least 5 teams appear in a two weeks.
ok, will see what I can do....
Thank you!
http://stats.free-dc.org/stats.php?page=proj&proj=2721
http://stats.free-dc.org/stats.php?page=proj&proj=12121
I just put everyone into a team of spaces for now. Can change that later if and when teams come along..
Note that as I'm parsing the html, if it changes it breaks, so let me know if you notice that..
How often and when do they update ? I've set it to be daily for now at 3am MST..
Bok