Older stats issue

[outlnder]

How does [SG-SPEG]Puzzle-Peter earn 320,000 cobbles a day in PrimeGrid when he shows nothing being produced in the Sub-Project Breakdown??

This has happened several times. I don't get it.

[Bok]

*EDITED*

No idea actually. Well, maybe a little idea. Looking in the xml exported by primegrid for the subproject data I see

<user>
<id>24128</id>
<subproject name="TPS_333333">
<workunits>4325</workunits>
<primes>3</primes>
<credit>5972.93234399994</credit>
</subproject>
<subproject name="WOO">
<workunits>55</workunits>
<primes>0</primes>
<credit>26944.8146502457</credit>
</subproject>
<subproject name="CUL">
<workunits>37</workunits>
<primes>0</primes>
<credit>22649.1178906861</credit>
</subproject>
<subproject name="GCWSIEVE">
<workunits>6411</workunits>
<factors>16</factors>
<credit>46957.6348216878</credit>
</subproject>
<subproject name="PSP_sr2sieve">
<workunits>4225</workunits>
<factors>51</factors>
<credit>57980.27816279</credit>
</subproject>
<subproject name="PPS_sr2sieve">
<workunits>308</workunits>
<factors>16973</factors>
<credit>60440</credit>
</subproject>
<subproject name="321_LLR">
<workunits>261</workunits>
<primes>0</primes>
<credit>24232.732558</credit>
</subproject>
<subproject name="PSP_LLR">
<workunits>51</workunits>
<primes>0</primes>
<credit>48458.0309689517</credit>
</subproject>
<subproject name="PPS_LLR">
<workunits>12192</workunits>
<primes>2</primes>
<credit>23911.954157616</credit>
</subproject>
<subproject name="AP26">
<workunits>91</workunits>
<credit>1238.51</credit>
</subproject>
</user>

so, it's likely a fault at PrimeGrid not reporting this correctly. Is there a Beta project perhaps ? Very odd that he only has 3 hosts showing too. Might be a split CPID somewhere amongst this. I'll post at PrimeGrid and see what is going on..

[Bok]

Looks like some of the subprojects are not exported :(

linky (http://www.primegrid.com/forum_thread.php?id=1400)

[outlnder]

No stats showing, just the page headings.

[Bok]

should be fixed soon. The webserver got automatically blocked by the database for too many connections to it.

Might need to wait 30mins or so for any cached queries to be released, though I'm freeing them up now.

I'm looking to see what happened, might have been some form of DOS attack.

Bok

[outlnder]

Fixed.

Good man.

[(_KoDAk_)]

http://stats.free-dc.org/stats.php?page=userbycpid&cpid=8f4450984aae338fcbdc6ec6ee4ec32a

today's points not add to Combined points :mad:

[AMDave]

The aggregation just ran and completed, on schedule, worked the same today as most other days.

There is a short time between when the daily roll-over occurs, the server tries to refresh all projects and then re-does all of the aggregations into the Combined total.

Guess what time it was when you looked! :p

Good total btw.
Keep at it!

[Bok]

Due to the hugely expensive update queries for combined points they are only done every 5 loops around the project. On average this means an update once per hour or so..delayed during the daily rollover/backup

[(_KoDAk_)]

http://stats.free-dc.org/stats.php?page=teams&proj=aqu
L'Alliance Francophone Yesterday 570,110,218 !!!
where they gets ??

[Bok]

They are having 'issues'..

See this thread (http://aqua.dwavesys.com/forum_thread.php?id=213) for info..

I'm sure it'll all get cleared up soon :)

Bok

[leavitron]

I'm having issues with the stats pages. I was refreshing Friday afternoon on my work computer and it came back and said I was not logged in. I went to Forum and it said I was. Back to stats, says I am not. So I went back to the Forum, logged out, logged in, tried again. No dice. I closed browser and tried again. No dice. Time to leave so I dropped it.

I repeated above again today, on my home computer. It does the same thing. Stats say I am not logged in, forum says I am. I verified cookies using Bok's info on page one of the thread, no help.

I even tried using one of my kids computers. No go. I have deleted the cookies and recreated them. What's next?

[Bok]

Do you have the 'keep me logged in' or 'Remember Me' or whatever the checkbox is on the forum checked ?

Which browser ?

Bok

[leavitron]

Do you have the 'keep me logged in' or 'Remember Me' or whatever the checkbox is on the forum checked ?

Which browser ?

Bok
Yes I do. On work machine, home machine, and son's machine. I saw that tip on page 1 of the thread.

Also:
Work machine - IE7 and Chrome.
My machine - IE8 and Chrome.
Son's machine - IE 6.

EDIT: This is freaky. When I did the first post, my stats did not show up in my "signature." Neither did anyone else on the page. Now they are all filled in, including mine.

EDIT mk2: And stats are now working. I should also note that page loads were glacier slow before. They are speedy now. Methinks it was something on your end that is disrupting logins and page loads.

[Bok]

so, it's working now ?

Yes, there was a problem with the stats earlier and in fact for a few days now. DNS problems unfortunately so that the database server was rejecting requests from the webserver after 50 connection errors as it was not getting the lookup information fast enough from DNS a high proportion of the time. I switched it to not do name lookups within mysql to fix that and all seems well now. Not sure it would have affected logins though as the forum database is physically seperate to the database stats server.

I've actually not tested much wth Chrome, will give it a go later today..

Bok

[AMDave]

Supplementary observation:
all ok from here during the same period
WinXP: IE6, IE7, FF3.0.x
Linux: FF3.0.11, Seamonkey 1.1.15
+ Various in KVM windows sessions
Interesting.

[(_KoDAk_)]

I http://stats.free-dc.org/stats.php?page=userbycpid&cpid=8f4450984aae338fcbdc6ec6ee4ec32a

yesterday get 2.5 M
but i can't see them in Most Milestones ?

[Bok]

well. I think I'll go hide.. This explains why John Galt only has 17 50k's instead of 18 as well.. :blush:

My fault completely.
Suffice to say I fsck'ed up and they haven't been running....

I'm re-running them all now..

Done, your page is cached so give it 30mins and it'll show up :)

[(_KoDAk_)]

http://stats.free-dc.org/stats.php?page=team&proj=alm&team=720
Kaboom!
in one day 1.5M !!!!
WTF
in AlmereGrid
:Pokes:

[Bok]

http://boinc.almeregrid.nl/

They've fixed it so it'll revert back when their stats export once again...

Bok

[LAURENU2]

OK who took away the ((boinc page)) from the NAV menu:mad:
And now "Logged in as Laurenu2 " does not fit in the Cell anymore
someone is looking to get a :whip:

[Bok]

I changed the names of them to try and fit the width's better. It's now 'Your CPID page'

My Logged in piece seems ok though, can you do a screenshot ?

[Cappy]

bro i can log into the forums but cant get logged into the stats page :(

that suppost to work hand in hand with the forum correct???

[Bok]

Make sure you have the 'Keep me logged in' or 'Remember Me' checked (whichever it is) when you log into the forum..

[AMDave]

Another opportune reminder that the FAQ can be quite handy :thumbs:

FAQ item #2
http://stats.free-dc.org/stats.php?page=faq

[Pedregulho]

In stats at what time "today" begins?
And at what time "today" becames "yesterday"?

[Bok]

It's MST (where the server is located)

so UDT - 7

[IronBits]

I suppose you can find that information up in the right hand corner of the stats page where it shows something like this:
Current Time : Fri Aug 07, 06:52:30 2009 MST

[Pedregulho]

I can see "Current Time" but I don't know when last update was done.

[Bok]

Within any project data it shows the following. For instance for WCG


World Community Grid - Free-DC Overview
Last Checked : Sun Aug 09, 11:42:09 2009 EST
Data Updated : Sun Aug 09, 10:14:45 2009 EST
Current Time : Sun Aug 09, 12:31:24 2009 EST

This is in Eastern Standard Time for me as I'm on the east coast, it should be a different timezone for you.

which tells you when that particular project's data was last updated.

Each individual project is updated as soon as new data is available.

Bok

[LAURENU2]

:umm: Is it on the To Do List to make these pages active

Alternative Fun stats across BOINC projects

http://stats.free-dc.org/stats.php?page=mmakers&subproj=p10

[Bok]

They are already active...just with a different value :)

http://stats.free-dc.org/stats.php?page=mmakers&subproj=pranktop10

Bok

[LAURENU2]

Then your link to it from Your CPID page is wrong

Most Milestones
Type Many RankT RankP
5M's 1 1 162

2.5M's 2 2 166

1M's 7 1 65

750k's 7 2 84

500k's 11 1 41

250k's 13 2 59

100k's 16 3 117

50k's 18 4 175

25k's 19 4 283

10k's 19 5 691

Top10 Ranks 7 1 10 <-- bad Link it is http://stats.free-dc.org/stats.php?p...rs&subproj=p10
................... it should be >>>>>>http://stats.free-dc.org/stats.php?p...roj=pranktop10
#1 Ranks 2 1 6 <-- bad Link to

[Bok]

hmm, yeah you're right. I actually don't recall why I made it pranktop10 in the links seeing as the table key uses p10.

Probably needs further looking at, but I changed it for now to work with p10 and change the link down the side to use that too..

Bok :cheers:

[LAURENU2]

hmm, yeah you're right. I actually don't recall why I made it pranktop10 in the links seeing as the table key uses p10.

:
OH I see you :jester: were playing a prank on me and I fell for it :weggy:

[Bok]

Rofl

[outlnder]

Wieferich hasn't updated in awhile.


Free-DC Logo
Wieferich@Home - Project Overview
Last Checked : Sat Sep 12, 04:51:47 2009 PST
Data Updated : Sat Sep 12, 04:51:47 2009 PST

[alpha]

The RC5-72 and OGR-27 stats haven't updated for a while either:

RC5-72 - Project Overview
Last Checked : Fri Sep 11, 21:27:22 2009 BST
Data Updated : Fri Sep 11, 21:27:22 2009 BST
Current Time : Tue Sep 15, 08:16:43 2009 BST

The official stats were down for a bit but they came back online several days ago.

[(_KoDAk_)]

whay a don't have anu record in free-dc stat
about Project Staging (Prime Grid sub project)
i use it about 2 day's
when info update's?

[Bok]

Have you returned any units ?

When you go to your profile at the Primegrid pages, do you see any scores for the Project Staging subproject there ?

I've looked in the exported xml files and there is definitely no stats for that subproject for you id so far......


<user>
<id>24023</id>
<subproject name="TPS_333333">
<workunits>8194</workunits>
<primes>3</primes>
<credit>11904.2080079977</credit>
</subproject>
<subproject name="WOO">
<workunits>41</workunits>
<primes>0</primes>
<credit>46967.5664686788</credit>
</subproject>
<subproject name="CUL">
<workunits>21</workunits>
<primes>0</primes>
<credit>21172.0784926703</credit>
</subproject>
<subproject name="GCWSIEVE">
<workunits>7935</workunits>
<factors>15</factors>
<credit>66394.6866575095</credit>
</subproject>
<subproject name="PSP_sr2sieve">
<workunits>25370</workunits>
<factors>171</factors>
<credit>439121.383095136</credit>
</subproject>
<subproject name="PPS_sr2sieve">
<workunits>132</workunits>
<factors>377</factors>
<credit>20988</credit>
</subproject>
<subproject name="321_LLR">
<workunits>452</workunits>
<primes>0</primes>
<credit>55834.3261693692</credit>
</subproject>
<subproject name="PSP_LLR">
<workunits>22</workunits>
<primes>0</primes>
<credit>23286.8476039626</credit>
</subproject>
<subproject name="PPS_LLR">
<workunits>10180</workunits>
<primes>1</primes>
<credit>20812.1597775064</credit>
</subproject>
<subproject name="Sophie Germain Search">
<workunits>1571</workunits>
<primes>0</primes>
<credit>10418.1495459299</credit>
</subproject>
<subproject name="AP26">
<workunits>737</workunits>
<credit>10030.5837890625</credit>
</subproject>
<subproject name="321_sr2sieve">
<workunits>105</workunits>
<factors>18</factors>
<credit>20000.311502525</credit>
</subproject>
</user>


Bok

[Bok]

stupid nonBOINC projects. Looks it it was held up on one of them. They all work differently...

I've kicked it.

Bok

[(_KoDAk_)]

We import credit to PSA credit 1-2 timrs/month.

There is no formula. We test average time on the range and compare to simular numbers on Boinc.
Lennart
waiting....

[gopher_yarrowzoo]

Hmm maybe we should kick them at the same time? See if we can't increase the rate they update.

[vaughan]

On the NPLB stats the individual stats page occasionally shows something like this:

Page Cached 0 days,0 hours & 16 mins ago..

I have watched it progressively count up from 0 mins ago to 16 mins ago.

When does it finish updating? There are only 5 people actively running the project.

I have tried a Ctrl-F5 to update the page in Firefox 3.5.3

[Bok]

It's a server side cache, max is one hour, but they gets expired if the stats update.

[Razor_FX_II]

SOB Sieve stats don't seem to be updating nor have they for a long time.

[Bok]

ok, spent some time re-organizing the code for sbs and explicitly setting some of the UserAgent fields and it appears to have worked...

The data should be getting copied over to the display side within 30 mins or so.

Bok

[rilian]

http://stats5.free-dc.org/mosttag.php?cpid=a848091602d6dade8ee661252d106d2d&img=.png

new image is too dark on right and too light on left... could you make more balanced default theme like it was before? thanks!!

[gopher_yarrowzoo]

Well someone adjusted the "overlay" alpha level will see if we can't custom it per theme or we erm may have to change a few things..

[Bok]

It can be customized within the theme ok, just defaults to 50 if it's not in there...more likely it's due to using truecolor now.. though personally I think even the default theme looks better, but that's me :)

[rilian]

hello

how do you set country for CPID team? Please set Ukraine country for cpid team Ukraine. Thanks :)

http://stats.free-dc.org/stats.php?page=teambycpid&team=Ukraine

[Bok]

It's not as simple as just updating it. Some of the projects must have it set to international and it's pulled it from there so it would just overwrite on the next update.

I changed the way users get their combined team and name generated by creating an aggregate table to get the team/name used the most, I'll have to code that for the teams country as well. It's not that hard but it'll take a few days till I can get around to completing it..

Bok

[rilian]

ok, no worries!

btw, anyone knows why VTU@Home stats stopped?

http://stats.free-dc.org/stats.php?page=proj&proj=vtu

[Bok]

Site is down by the looks of it.

[outlnder]

Is Collatz stuck? No update since 0400

[Bok]

yup, stuck on the Collatz site... :)

http://boinc.thesonntags.com/collatz/stats/

No updated xml...

[zombie67]

Is something going on with SHA Collision? I just got 100k today, for a total of 100k. But it has been shut down for months. And my score there is 191k, not 100k. Odd stuff.

Edit: It's actually listed twice. Both as 100k total, and 191k total.

[Bok]

It's anansi, I just normally copy out the the SHA-1 row to another whenever I create a new project :) Usually I have time to update the description and like before it propagates to live (which I have an online admin page to do) but it seems I hit it just before one of the propagations was happening.

It's already fixed though, might still be cached, so give it 30mins.. You'll get another 100K project tonight when the 'most' stats run :)

Bok

[zombie67]

It's anansi, I just normally copy out the the SHA-1 row to another whenever I create a new project :) Usually I have time to update the description and like before it propagates to live (which I have an online admin page to do) but it seems I hit it just before one of the propagations was happening.

It's already fixed though, might still be cached, so give it 30mins.. You'll get another 100K project tonight when the 'most' stats run :)

Bok

Ah! They are exporting now. Awesome!

[Bok]

hello

how do you set country for CPID team? Please set Ukraine country for cpid team Ukraine. Thanks :)

http://stats.free-dc.org/stats.php?page=teambycpid&team=Ukraine

I've completed the work needed for this now....

[outlnder]

I'm guessing EDGes only updates once a day?

[Bok]

for now yes, though I did ask them to increase it to every 6 hours as I do for every project :)

[outlnder]

Wieferich stuck

[CanoeBeyond]

Wieferich stuck
Some stats not being updated, Examples:

Wieferich@Home - All Teams
Last Checked : Fri Oct 30, 06:34:55 2009 CST
Data Updated : Fri Oct 30, 06:34:55 2009 CST
Current Time : Sat Oct 31, 10:39:49 2009 CST

Dimes - Overview
Last Checked : Fri Oct 30, 12:33:04 2009 GMT
Data Updated : Fri Oct 30, 12:33:04 2009 GMT
Current Time : Sat Oct 31, 16:09:20 2009 GMT

Thanks Bok!

[Bok]

indeed, the non-boinc script crashed due to out of memory and swap!.. That's not good. Maybe I need to scale back the mysql memory use on that box as it's got 15 or the 16Gb itself..

It's running again now, doing the folding@home stats first, the others will follow..

Bok

[CanoeBeyond]

Thanks Bok! :thumbs:

[outlnder]

Can you check server for the subproject breakdown in Primegrid. My TPS daily score has been stuck for several days.

[Bok]

There isn't any TPS work (that I'm aware of!) otherwise I'd be going for my badge there :) Hasn't been any for quite some time unfortunately..

According to my stats you have



mysql> select subproject,metric1 from proj_user_work where proj = 'pgrid' and id = 3550 and subproject like 'TPS%';
+------------+------------------+
| subproject | metric1 |
+------------+------------------+
| TPS | 156748.380312153 |
| TPS_195000 | 1.17 |
| TPS_333333 | 156747.210312153 |
+------------+------------------+
3 rows in set (0.00 sec)


and according to the xml file from Primegrid..



<user>
<id>3550</id>
<subproject name="TPS_195000">
<workunits>3</workunits>
<primes>0</primes>
<credit>1.17</credit>
</subproject>
<subproject name="TPS_333333">
<workunits>107894</workunits>
<primes>39</primes>
<credit>156747.210312153</credit>
</subproject>


So all is well :)

[alpha]

There seems to be a typo on the user page (http://stats.free-dc.org/stats.php?page=user&proj=bwcg&name=584908) for each project: "Country Percentle".

Also, some of the numbers on this page which are >1000 aren't comma separated. For instance, for "Project rank" the first number isn't, but the second is. Same for "Rank for this country", but possibly some others too.

Small things I know, sorry to nit pick. :)

[gopher_yarrowzoo]

Well I've looked at it did the changes to the number formatting so this should ripple through once the cache is refreshed. I've checked it with other users and it does work... :)

[Bok]

There seems to be a typo on the user page (http://stats.free-dc.org/stats.php?page=user&proj=bwcg&name=584908) for each project: "Country Percentle".

Also, some of the numbers on this page which are >1000 aren't comma separated. For instance, for "Project rank" the first number isn't, but the second is. Same for "Rank for this country", but possibly some others too.

Small things I know, sorry to nit pick. :)

Cool, thanks foor pointing it out and Gopher for fixing.. I only just started adding these in the last few days, doing small fixes to a page (and chart) at a time....

[alpha]

Thanks, looks good! :thumbs: Just the typo remains. :)

[Bok]

fixed..

[CanoeBeyond]

Hi Bok,

I've been having a conversation with the SIMAP admins over here:

http://boinc.bio.wzw.tum.de/boincsimap/forum/viewtopic.php?f=3&t=990&p=8271#p8271

They seem to think that they're updating their stats data 4 times a day but if so it sure isn't getting picked up anywhere.

Your mission if you choose to accept it:

Log on to the SIMAP site and give them a heads up as to what might be the problem.

Thanks in advance for checking it out:

:allhail:

[Bok]

hmm, well it's definitely not working correctly if they are..I check the tables.xml file for a change to the last_update_time field. It's a very low bandwidth check. If it's changed I'll download the files and process on the next iteration of my script running. It means that I should pick up and process any updated stats certainly no more than an hour after they are published and usually faster.

Have a look at some crude output I produce here (http://stats.free-dc.org/stats.php?page=statsrun&proj=sim) - that's fairly odd in that you see 3 updates on the 13th but usually just one on any other day. Looking through my logfiles show that the timestamp is certainly not being updated..

I would ask them to check if perhaps they are running the exports but somehow the timestamp is not being updated.

If you look at http://boinc.bio.wzw.tum.de/boincsimap/stats/ you can see there is certainly no updated files for today (as of writing this mail anyway) - all files are timestamped with the 16th - so, given they are in germany, where it's well past the middle of the day...

Bok

[CanoeBeyond]

Thanks Bok! This turned out to be the problem:

Yes, we had a mix up here on our side:
The stats are (re)generated 4 times a day,
the db_dump for the export only once every 24h.
:|party|:

[KAMCOBILL]

FDCPS Team and Project stats are not updating. Looks like since the 12th. When you don't have too much to do or just propping up your feet :D maybe give them a check. Thanks

[Bok]

hmm, that's a problem on the other side a it happens - which is now out of my control.. I'll ping them and try and get it sorted..

Bok

[KAMCOBILL]

Thanks Bok! I didn't know if anyone knew or not.

[Bok]

nope, didn't know. so :cheers: for that :)

Should be fixed soon I think, I wrote the original sql script that's failing now, but the database has evolved since then and is now on a server I don't have access to, but it's a minor change to correct it and I've let the relevant people know.. :)

Bok

[PCZ]

fdcps stats should be updating now.

Dave has fixed the issue.

[KAMCOBILL]

Team stats are updating, but project daily stats aren't.

Thanks

[Bok]

It'll definitely change overnight, though it should be updating 'today's' total but for now I can't seem to see where it's doing this. Must be as it works for other nonboinc projects.

I'll dig around later on and see what's going on.

[KAMCOBILL]

No Hurry. It's not a big deal.

Project just updated for Nov 20. Looks ok now. Hehe, looks like almost everyone is on Free-DC Team now, too.

[alpha]

Also, some of the numbers on this page which are >1000 aren't comma separated. For instance, for "Project rank" the first number isn't, but the second is. Same for "Rank for this country", but possibly some others too.

Just found another on the "User by CPID Stats (http://stats.free-dc.org/stats.php?page=userbycpid&cpid=2e7128cb5b62e72689bf4bd06ff51029)" page. The first number of "Overall rank" is not comma separated.

TIA. :thumbs:

[Bok]

yeah, good spot. Fixed..

though you'll need to wait for the cache to expire to see it..

[vaughan]

Bok:
In the Your Stats list (usermain) it doesn't include Goldbach Conjecture. It is shown in the User CPID.

[Bok]

You need to add it in statstool for it to display on usermain.

I've toyed with the idea of letting it build the list of BOINC projects dynamically whilst getting the list of nonBOINC projects from the entries on statstool but then we have userbycpid to do that anyway and that lets usermain be used by people who have split CPID's too.

Bok

[outlnder]

I know why the difference exists, but is there anyway to sync up the World Community numbers and your numbers??

It's difficult to see where we are with almost nine million points there and only 1 + million here.

[Bok]

They export the boinc figures (which I use and display), then they multiply them x7 to get their own points which they display.

I could simply display the x7 (not store it or use it in any calculations), but it's likely a moot point anyway as they will be going away from the x7 fairly soon I seem to have read recently (though I can't find the post on the WCG forums at the moment).

Bok

[alpha]

yeah, good spot. Fixed..

though you'll need to wait for the cache to expire to see it..

That overall rank thousands comma separator on the stats by CPID page still isn't showing. Not sure if you meant my local cache or some remote server-side cache which needs to expire but I've given it over two weeks and it still isn't there.

Sorry for being so pedantic, I know it's a really small issue but reading large numbers without comma separation makes my eyes bleed. :)

[Bok]

Actually I'd fixed it on the row not at the top which you are pointing out.

Fixed that one now, it will have to wait for the cache(server side) to expire but I've just done it manually for you. That page is only cached for 15mins anyway, so you never have to wait longer than that :)

Bok

[CanoeBeyond]

I think the Wieferich stats might need a kick:

Wieferich@Home - Ars Technica Overview
Last Checked : Thu Dec 24, 14:13:42 2009 CST
Data Updated : Thu Dec 24, 14:13:42 2009 CST
Current Time : Fri Dec 25, 00:51:36 2009 CST

:saber:

[Bok]

Hmmm. Think they worked themselves out as they were still updating. Not sure what was hogging all the cpu time in the meantime though.

[zombie67]

No stats in "Today" or "Last Update", as of 7:00 AM PST.

[Bok]

Sunday is always the worst. The weekly tables get updated overnight saturday and they badly need optimizing so are taking some time to run. I haven't had the time to take the stats offline and do it. Everything is still running though and look to be updating right now.

Tables are upwards of 1/2 billion rows in some of the cases :)

I'll get them fixed up this week with a few hours of downtime.

Bok

[CanoeBeyond]

Looks like the Wieferich stats are stuck again:

Wieferich@Home - All Teams
Last Checked : Mon Jan 04, 09:59:28 2010 CST
Data Updated : Mon Jan 04, 09:59:28 2010 CST
Current Time : Mon Jan 04, 20:29:50 2010 CST

A good kick might do it, or maybe a poke :Pokes:

[Bok]

hmm, looks like it had a bad update from the site around that time and flagged it for failure. It auto-corrects itself overnight anyway, but I've cleaned it up manually. Next run it *should* update.

Bok

[CanoeBeyond]

Thanks Bok, that did it. Didn't know that it resets itself daily. Next time I'll give it more time before reporting... :cheers:

[Bok]

No worries, I'd still rather know than waiting till the overnight updates :)

[CanoeBeyond]

No worries, I'd still rather know than waiting till the overnight updates :)
Will do. Feature request/question: on a user's project page, hovering the mouse pointer over a machine ID shows CPU and OS specs. Would it be possible to add info about the GPU?

[Bok]

It would, though it needs a little db work too as they altered the specification of how they display gpu data in the exports which broke my implementation of it. <rant>I wish they would provide some form of standard on it...</rant>

You can go to the individual hostpage and see what I mean when looking at an ATI card..

I'll look into it, first I'm going to look at the vb4 upgrade for the forum, which requires an upgrade to php first...

Bok

[Darkness Productions]

http://stats.free-dc.org/charts/teampietoday.php?proj=rc572&team=Free-DC is complaining about ChartDirector not being able to be loaded... did someone upgrade the box and break it?

[Bok]

dang it.

yes, I had to upgrade php on the box for vb4 which required a minimum of php 5.2.

Probably just a case of checking the paths in php.ini.

hang on

[CanoeBeyond]

You can go to the individual hostpage and see what I mean when looking at an ATI card..
Never noticed that the GPU info was listed on the hostpage. No big deal then, that's what I was looking for. Thanks!

[CanoeBeyond]

No worries, I'd still rather know than waiting till the overnight updates :)
The overnight reset didn't even seem to do it this time:

Wieferich@Home - All Teams
Last Checked : Wed Jan 06, 21:01:38 2010 CST
Data Updated : Wed Jan 06, 21:01:38 2010 CST
Current Time : Thu Jan 07, 13:51:25 2010 CST

[Bok]

new problem. Never seen that before. It was stuck on Eon..

hmm, That's one of the last ones that have not been converted to use a real handler, which would timeout gracefully. I'll do that now. Kicked it so it is at least running.

Bok :cheers:

[outlnder]

Why don't the individual totals for the day add up to the team total for the day??

Whiz has 69,501 in Leiden and I have 27,609 but Ars has only 75,946.

I've noticed this for the last couple of days.

[LAURENU2]

Why don't the individual totals for the day add up to the team total for the day??

Whiz has 69,501 in Leiden and I have 27,609 but Ars has only 75,946.

I've noticed this for the last couple of days.
:jester:Maybe you have not heard Free-DC has imposed a TAX:jester:

[Bok]

Why don't the individual totals for the day add up to the team total for the day??

Whiz has 69,501 in Leiden and I have 27,609 but Ars has only 75,946.

I've noticed this for the last couple of days.

Because Leiden fsck up their exports. Have done for a LONG time. I guess I could put some debug in to prove it..

Basically, 2 steps forward and 1 step back. Overall they are correct though..

[outlnder]

Sorry, didn't mean to upset.

[LAURENU2]

Sorry, didn't mean to upset.
I doubt Vary much that you could upset Bok He just tells it like it IS :metal:

[Bok]

yeah, not upset at all :)

Well, maybe at Leiden :p

And Eon, seeing as we haven't been able to access their raw stats for the past week..

[Darkness Productions]

Bok -- seems like the pproxy pages aren't updating, can you take a look?

http://stats.free-dc.org/dnet/rc572/byemail.html

[Bok]

sigh, looks like a gnuplot error since I upgraded php.

I'll see what I can do.

[Bok]

it chokes on this now which is set within ppstats.pl

set terminal png small color (the color part is invalid now)

I've removed the color piece, we'll see what happens. I don't have time to read through all the gnuplot docs right now :)

[Angus]

yoyo shows as the "top user" on the Stats Index page, but on the project page he is nowhere near the top.

Looking further, it appears that the RNA World line is just not being updated at all on the Index page.

[Bok]

Should be fixed on next update. It's because it relies on me having to manually set the free-dc team id in the database and I hadn't done it, so it used the default of 0 (no team)..

Bok

[vaughan]

It appears that the Wieferich stats are stuck.

[Bok]

look ok to me. I think you just caught them during the nightly (and weekly) rollover cycle.

[Cappy]

it appears that all the stats are stuck :P

or Free DC is stuck and hassnt asked for updates :P

[Bok]

sunday, sunday blues....

They've finished the weekly cycle now, but are taking way too long. I'm optimizing the tables now, so it'll be quicker next week, but that's going to slow things down today (but not stop). The combined monthly table just took 45mins to optimize. I think the host weekly might take 4 hours or more..

I WILL add into the scripts to optimize them after running the weekly/monthly cycle (all the other tables do). It'll not take long if they are maintained, it's just when I've left them for 6-8 weeks or more, they get badly fragmented. Ad of course the host weekly one has quite a few rows... ;)

Bok

[gopher_yarrowzoo]

If your wondering why the post count seems to be down for this thread it is because I'm in the process of splitting this thread up - all resolved issues now have their own sub-forum :thumbs:

[vaughan]

It appears that the Wieferich stats are stuck.
This is frustrating:
Page Cached 0 days,0 hours & 51 mins ago..

[gopher_yarrowzoo]

There aren't stuck they the cache time for those pages is set to 1 hour I just checked the code since this page doesn't really change that often, only when new stats are available it's best to keep it fairly static, thus the 1 hour cache time.

[vaughan]

OK but why is the stats page empty 51 minutes after the stats were checked. I often see this phenomenon seconds or occasionally minutes after a project's stats get updated but 50+ minutes is exceptional.

[Bok]

we need to remove all the database caching now that the pages (at least some of them) are cached. It's a fair bit of work though.

[gopher_yarrowzoo]

%user@stats>ftp myserver.net as u=me p=mine
myserver.net:%user> put db_cache_purge.php
### 3298 bytes sent.
myserver.net:%user> logout
%user@stats> exec db_cache_purge.php
working..........................
done
%user@stats>logout
session ended....
We'll get to work on that ..:guntotin:

[Darkness Productions]

The link on http://stats.free-dc.org/stats.php?page=index for Free-DC Majestic-12 links to http://stats.free-dc.org/stats.php?page=team&proj=maj&team=Free-DC which is apparently wrong; it should be linking to http://stats.free-dc.org/stats.php?page=team&proj=maj&team=16

[Bok]

You should have the ability to change this actually, I'm fairly sure you are flagged as one of the admins :)

If you are on one of the pages for maj, i.e. as long as it has proj=maj, look on the left side to see if you have the ADMIN section showing and go to the 'This projects conf', alter the Free-DC team piece and update!

It'll need upto 20-30mins after that to migrate to live..

Bok :cheers:

[Darkness Productions]

Ha! I did! Thanks :D

[Darkness Productions]

Top Free-DC user for MAJ shows Py, but only with ~6B:

Majestic-12 4 6,133,560,719 - PY 222 0 0 8,116,700 52m and 10s ago

his actual total is close to 5x that... Bug?

[Bok]

misconfiguration.

It should fix on next update. Basically it's not been updating that field because we had the 'free-dc' team wrong and in that one and only place it still reads it from a config file and not the database. I updated the config file.

[AMDave]

There is the possibility of slow response from the site during the next 4 hours while one of the sites is migrated to another host.

The transfer is at about 50% and the pages are responding ok at the moment.
I am keeping an eye on things.
If I :stretcher: it up then you can :spank: me later.

[AMDave]

File transfers completed without incident. :thumbs:

[zombie67]

Problem with QCN stats? Looks like something went funky over the past several days.

[Bok]

I just think they haven't exported any new stats at all..the scripts will keep checking..

[zombie67]

Something more than that. See how the charts spike way up, then way negative, then back?

[gopher_yarrowzoo]

Yeah I see that seems a few teams got dropped out then came back would account for the massive swings... Oh and I've changed the QCN F-DC team to 0 since we don't appear to have one....

[rilian]

why

BBC Climate
Cels
Eternity@Home
EAPS

etc are still in "active projects" ?

[rilian]

another issue:

http://stats.free-dc.org/stats.php?page=proj&proj=bat

not updating!

[Bok]

If you look at the times

Boinc Alpha Test - Project Overview
Last Checked : Mon Feb 08, 17:35:11 2010 EST
Data Updated : Mon Dec 14, 12:00:23 2009 EST
Current Time : Mon Feb 08, 18:29:33 2010 EST

It shows that the stats attempted to update but did not find any updated xml data to update with. I don't think they've been running the cronjob to export the stats for some time..

As for the active/achive, just haven't updated them. It's not really a big deal as it's just a flag and I don't separate them in anything but the usermain and the old combined signature. No calculations are affected at all.

Bok

[rilian]

1) So we should ask at BAT forum about stats?

well, http://isaac.ssl.berkeley.edu/alpha/forum_thread.php?id=85

2) As for the active/achive, dead projects look like empty holes in statstool configuration page... :)

[Bok]

1) So we should ask at BAT forum about stats?

well, http://isaac.ssl.berkeley.edu/alpha/forum_thread.php?id=85


yup.




2) As for the active/achive, dead projects look like empty holes in statstool configuration page... :)

They do? You can still configure them, regardless of the section they are in?

[rilian]

2) yes, i mean, as i have no and cannot create accounts in dead projects, those remain empty (inputs)

[zombie67]

Something is still wrong with QCN stats. Look at the graphs here:

http://stats.free-dc.org/stats.php?page=proj&proj=qcn

and then compare them to BOINCstats

http://boincstats.com/stats/project_graph.php?pr=qcnalpha

See? BOINCstats does not have the ups and downs like the graphs here. So I suspect it is a problem just here.

[Bok]

nod. It's not a problem with the update of the stats, they are all fine. But there is an issue with the rollover script which computes those daily figures seen on that chart. I've seen it intermittently over the past year but never did track it down.

Taking a fresh look now.

Bok

[Bok]

I found it. Stupid, stupid error on my part. Doh!

Tonight's rollover will be correct, though for QCN it will in fact put the numbers back up correctly to the 5.5M range. It *should* be correct going forward now though.

That actually fixes a number of issues..

Bok :cheers:

[zombie67]

Sweet! Thanks!

[rilian]

BOINC alpha test stats issue forwarded to David Anderson. Hope, they'll run xml cron job soon.

[rilian]

BOINC alpha test stats issue forwarded to David Anderson. Hope, they'll run xml cron job soon.

http://isaac.ssl.berkeley.edu/alpha/forum_thread.php?id=85

:firedevil:

this sux

edit: maybe David is not aware that there are other WUs than those 1-min/4MB WUs for testing download/upload/resume on new clients?

[rilian]

well, sent again email to Jeremy (PyMW developer) with CC to David

does anybody see a problem running stats cron job once a day?

[Bok]

Not really, no. It likely takes seconds to run on their machine given the very few participants.

Bok

[rilian]

Most Team #1's
Most Team top 10's
Most Team 100M's
Most Team 50M's
Most Team 25M's
Most Team 10M's
Most Team 5M's
Most Team 1M's

are br0k3n (no team name)

[Bok]

hmm. I'll look into this in the morning..

[(_KoDAk_)]

Badge Milestones
do you have full history ? mmore then last 10 ?

[Bok]

Only since I started tracking them..which is Sept. 09

[vaughan]

bok can you get the NPLB stats working again please?

[AMDave]

@bok email 28/02/10 18:23:24 "NPLB stats export"

[Bok]

hmm, I'd have to rewrite the driver now that you've changed it to be a tar.gz file rather than the previous straight .php file

Any reason for the change ?

Bok

[AMDave]

same email about 25 lines further down
sent you another email :D

[Bok]

ah, ok. I've added the test part in, we'll see if it retrieves the data ok now.

Bok

[AMDave]

ah no.
That will retrieve data from the test site.
You have my emails with the correct info.

[rilian]

usernames in DPAD team pages are not correct (team name disappeared like previously in Most__ stats)

http://stats.free-dc.org/stats.php?page=team&proj=dpad&team=Team%20Ukraine

[LAURENU2]

usernames in DPAD team pages are not correct (team name disappeared like previously in Most__ stats)

http://stats.free-dc.org/stats.php?page=team&proj=dpad&team=Team%20Ukraine
They should learn to pay there Rent On Time :lmao:

[rilian]

They should learn to pay there Rent On Time :lmao:

do you accept payments in Cobblestones? :rotfl:

[Bok]

usernames in DPAD team pages are not correct (team name disappeared like previously in Most__ stats)

http://stats.free-dc.org/stats.php?page=team&proj=dpad&team=Team%20Ukraine

Teamname is not supposed to be part of the username here. Way back when it was agreed with DPAD (I think) that the teamname would be enclosed with [] and I would then safely strip those out which I do.. Yours and a few others seem to be enclosed with () which I've never stripped out. The teamname does get pulled out as it matches with one in the teamdata.

I think I'll just add a piece of code to regex out any /()/ that remain after the team is stripped..

Bok

[outlnder]

No stats today??

[Bok]

They are still running, but I chose to do some maintenance today on the gargantuan host weekly table to split it into years and it's taking a VERY long time to delete out the older years. In fact the query has been running for 12 hours now :( This is causing major slowdowns on the rest of the updates.

In hindsight I should have just copied the table over to another machine and done it like that.

It had 750million rows in it and this one is the main cause of the 'sunday' slowdown so that will hopefully be a bit better tomorrow and LOT better next week once I finish.

So let's just hang on and hopefully it'll complete soon. If it's not finished in the next couple of hours though I'm going to kill it..

Bok

[John Galt 007]

Have they stopped exporting stats? Just a bit curious, as my stats haven't updated since this weekend. Thanks...

[Bok]

yup.

No changes to the xml in 3 days now.

[John Galt 007]

yup.

No changes to the xml in 3 days now.

Guess there was a change now...stats updated...

Nice work, Bok...:clap:

Thanks...

[vaughan]

Bok something strange has happened to the BOINC Combined Users stats today. The first 18 people all scored 1 Billion points (well nine hundred and ninety eight thousand million or so in English or a Trillion points in US nomenclature)!

Edit: It appears to be Seti Beta that is the cause of the aberration.

[zombie67]

Bok something strange has happened to the BOINC Combined Users stats today. The first 18 people all scored 1 Billion points (well nine hundred and ninety eight thousand million or so in English or a Trillion points in US nomenclature)!

I saw that too. Something very odd.

[Bok]

yeah. Seti Beta has really fsck'd it up.

I'll fix those users up later today

[JohnWayne]

At http://stats.free-dc.org/stats.php?page=proj&proj=wie I've only been able to get "Page Cached 0 days,0 hours & 48 mins ago.." for over 3 days.

I have tried Firefox and IE8.

[Bok]

hmm, that's a little bizarre. I see the zero length cached page, but am unsure how it was created. I cleared it manually and it's loaded correctly now.

I need to spend a bit more time on this, perhaps add in a sanity check on the length of the cached file prior to writing it.

Let me know if it happens again

[vaughan]

This happens all the time, usually in the evenings here so I guess that's early hours of the morning your timezone.

Previously I recall something about its "normal" for it to occur for up to an hour.

[Bok]

ah, I see the problem. Should be fixed. Looks like only for this particular page. It shouldn't happen I don't think, but in this case I'd left the code in that script to write the cached page AND done an include which means the it's duplicated. It wrote it out correctly, then overwrote it with a blank file..

Let me know if you see it again...

Bok

[LAURENU2]

Are the Stats Down ?

[AMDave]

No.

They are just mildly depressed :rotfl:

/ed - something is hanging / taking too long ... needs a size-12 with Bok's foot in it :D - ed/

[LAURENU2]

Any body have a shot of Prozac for Mr Stats:lmao:

[Bok]

Looks ok now? Not sure what the problem was.

*EDIT* actually looking at the logs, it was the weekly rollover that took 2 1/2 hours. Mostly inserting the weekly user data as I stopped the weekly host data altogether. I'll optimize those tables this week.

[gopher_yarrowzoo]

Hmm pity you couldn't multi-thread it so that queries could continue but marked as (*) data maybe refreshing.

[Bok]

Queries do and always have been available still. All computations are done in a separate database (and physical Hard Drive) and once complete, replicated to the live web facing database.

[JohnWayne]

Can we get a kick start of the Wieferich stats,


Free-DC Logo
Wieferich@Home - Project Overview
Last Checked : Fri Jul 02, 17:12:30 2010 MST
Data Updated : Fri Jul 02, 17:12:30 2010 MST
Current Time : Sat Jul 03, 16:41:39 2010 MST

[the-mk]

a question to the stats-god: why do we have 3 "Mustard"s on http://stats.free-dc.org/stats.php?page=team&proj=ogr27&team=Free-DC ?

From the numbers produced, these 3 look like the same man:
"Participant #473,297" --> http://stats.free-dc.org/stats.php?page=user&proj=ogr27&name=473297Free-DC
"Mustard" --> http://stats.free-dc.org/stats.php?page=user&proj=ogr27&name=471588Free-DC , http://stats.free-dc.org/stats.php?page=user&proj=ogr27&name=473390Free-DC , http://stats.free-dc.org/stats.php?page=user&proj=ogr27&name=475132Free-DC (which seems to be the most recent)

[Bok]

nonboinc stats kicked.

I don't auto-delete users, so those are old ones. They are flagged for deletion though, so I've gone ahead and done that now.. give it a short time to replicate into live..

[Bok]

hmm, actually those are separate accounts for Mustard.

[JohnWayne]

Wieferich is at it again, er not doing it again.

[Bok]

yeah, see my last post on DPAD. As all of the nonboinc projects run in a loop, r5prp is causing a sticky.. I'll take it out or convert it to to die gracefully to allow the others to continue.

[zombie67]

No new stats today? Everything shows zeros.

[Bok]

Standard sunday service :) It takes a few hours overnight on saturday to do the weekly stuff including backups.. usually about 9am PST it's updating again.

I've thinking about putting something in which shows what the current status is, but haven't quite got my head around how to display it..

[zombie67]

Standard sunday service :) It takes a few hours overnight on saturday to do the weekly stuff including backups.. usually about 9am PST it's updating again.

I've thinking about putting something in which shows what the current status is, but haven't quite got my head around how to display it..

D'oh! Sorry, my memory is shot. I think this question was already asked/answered. Sorry!

[LAURENU2]

How come mopac@home has Free-DC listed as a stat lister
But Free-DC does not have stats for Mopac:Pokes:

[Bok]

They aren't exporting their stats yet :(

[Maxwell]

They aren't exporting their stats yet :(

Speaking of which, we need to give DistRTGen a kick in the hind end...:hair:

[Bok]

Yeah, Stats files are still there but have not been updated in a long time..

[alpha]

I think the Folding@home stats might be stuck:

Last Checked : Thu Jul 29, 12:20:37 2010 BST
Data Updated : Thu Jul 29, 12:20:37 2010 BST
Current Time : Fri Jul 30, 08:57:25 2010 BST

[Bok]

yup. Restarted the nonboinc ones

[AMDave]

I just fielded a question or two about the apparent 'double' scores on 30-07-2010.

To help answer the same question for anyone else, the dates on the "Last 28 Days" table are calculated labels on the table in the web page (eg today, today -1, -2 etc).

Because the non-BOINC process froze and did not fail, the nightly rollover was prevented from shifting the data across in the daily data table, which in theory should have created a column full of zeros because the refresh did not happen on 29th.

Consequently the table appears to be out by a day prior to 30-7-2010.
The date label saying 29-7-2010 contains the volumes from 28-7-2010.
The date label saying 30-7-2010 contains the volumes from 29-7-2010 and 30-7-2010.

The volumes are correct.
No data is missing.
No data has been duplicated.
The 'apparent' anomaly is self correcting and will shift itself out of the "Last 28 Days" table day by day.
This does not affect the weekly or monthly stats.

Trust us. It is Auto-magic :thumbs:

[alpha]

Some people are reporting particular milestones on Whatpulse not being announced, like 10 million keystrokes. How are the milestones flagged up these days? Is it still a hard-coded list of thresholds?

[gopher_yarrowzoo]

I do believe it is still hard coded so should be working fine it all depends on what data we get from what pulse itself.. you got any particular user(s) in mind so we can look at this closer.

Thanks

[Bok]

No, it's dynamic, based on entries in a table which can be tailored per project if needed. I'd need to know a particular example as Gopher mentioned in order to check it out.

Crude milestone page (http://stats.free-dc.org/stats.php?page=projusermilestones&proj=what) shows some 10M and the last log certainly showed that it tested for 10M

Bok

[alpha]

Sellyme (http://stats.free-dc.org/stats.php?page=user&proj=what&name=275248) says his 10 mil didn't show. Indeed, it isn't listed in the recent milestones.
VG (http://stats.free-dc.org/stats.php?page=user&proj=what&name=302646) says his 2.5 mil didn't show. Also not listed in recent milestones.

[Bok]

I see, actually they've found a bug! And it's been like that forever, perhaps it's just that the exact rounded type numbers from whatpulse have made it more pronounced.

In VG's case on August 1st he dropped 150,000 points to reach EXACTLY 2,500,000 then on the 3rd he dropped another 50,000 to be a 2,550,000

However my sql was checking for new value > 2,500,000 and old value < 2,500,000 which did not match under either condition. It should actually be

new value >= milestone and old value < milestone

WOW, that code has been in place for about 8 years now.. fixed and I manually added those two milestones.

[alpha]

Nice bug! :)

Thanks for addressing this so quickly. :thumbs:

[Sellyme]

Yay! I feel useful :)

[gopher_yarrowzoo]

Hmm appears this needs a major kick again... I'll look at it when I get a chance.

[alpha]

I have another query regarding the Whatpulse stats. According to our team page (http://stats.free-dc.org/stats.php?page=team&proj=what&team=Free-DC), we lost over 4 million keystrokes on 17th August. At a glance, I can't see this as a result of someone leaving the team, and I can't find another team with a stat reduction for that day. Any clue what happened here?

edit: Additionally, it looks like there might be something wrong with user ranking. The project stats page (http://stats.free-dc.org/stats.php?page=proj&proj=what) shows that the current top two users overall ([db]Deluxy, qwertycomputer) each have less keystrokes than the guy in third place (Orznorz). Also, clicking on each of the names of these users shows that they all have "project rank" of 1.

[Bok]

Not sure what happened on the 17th. The tracking of user movement is not perfect for some of the non boinc projects though.

User ranking is a simple one though. I don't 'hard' delete users which are gone (often name changes), I simply mark them for deletion. They are not used as part of the project ranking at all and in some places I don't actually show them, but by no means all places. I've deleted them now, so next time it runs they won't be visible.

[alpha]

Thanks Bok. The project rankings look in order for the top 5 now, and their scores look sensible. I might contact the Whatpulse guys about the 4+ million drop on 17th because that's around a tenth of our entire team total! Hopefully they can shed some light on what happened.

[Paratima]

Hey, Bok. Quantum Fire Alpha seems to be stalled. The project site shows me over 1 million, while our stats aren't updating. TIA!

[Bok]

All the stats are a little backed up today, a monthyl job went a little haywire. They are running now. On my parallel (faster) server though, according to the latest exported xml you are still only at 999,782 :) So you might have to wait a few more hours yet..

[Paratima]

THANKS! The champagne is in the cooler! :)

[kingcarcas]

Can someone help me out here, for years i simply used the alternative sig images, but now i joined a DIMES team and they don't display with the others, just free-dc it seems....

I could never get my sig to display properly, the other scores aren't showing up:confused:
http://stats.free-dc.org/tag.php?name=kingcarcas

My old folding (http://stats.free-dc.org/stats.php?page=user&proj=fah&name=kingcarcas36362) stats don't have a cross project identifier and the team name is spelled differently so i fear i won't be able to attach those to me :confused:
Same with DIMES (http://stats.free-dc.org/stats.php?page=user&proj=dimes&name=kingcarcas), can you fix this?

[Bok]

I can indeed. The tag.php as you are using should only be used when trying to display projects which are nonBOINC as it provides a way to link ANY projects togetehr by allowing you to input your project name. Therefore it is not automatic at all and does not use any form of cross project identifier.

Consequently for you these are your names :

Folding@Home : kingcarcas36362 (I have to concatenate with the teamname to prevent duplicates in Folding.. :) )
GpuGrid : 47002
WCG (Boinc) : 522633

The last two are your id's in those two projects which you can see either at the project or going to your userpage (http://stats.free-dc.org/stats.php?page=user&proj=bwcg&name=522633) here

I've updated it for you and purged the cache so it shows up immediately :) Hope that helps!

Bok

[kingcarcas]

Thank you!!!!!!!!!!!!!!!!:thumbs::D Here is a cupcake
http://adashofcinnamon.files.wordpress.com/2008/11/cupcake_011.jpg

[alpha]

Do we need to request specific teams to be added to the Whatpulse stats? I can't remember what the deal is with that (and the forum search is returning nothing relevant). If so, please could you add "Kongregate Elite (http://whatpulse.org/stats/teams/18150/)".

[Bok]

yes, I have to scrape each one as they don't provide a full file of stats in any form :(

Added that team.

[alpha]

Many thanks.

[vaughan]

Could you check the NPLB individual user stats page please? It hasn't updated correctly in the last day.

[enderak]

Seventeen or Bust stats have been screwy the past few days as well with zero's across the board for daily work, total work, etc.

[gopher_yarrowzoo]

Could you check the NPLB individual user stats page please? It hasn't updated correctly in the last day.
Hmm Just looked at your page now and it seems fine where are you looking and what do think is wrong?
http://stats.free-dc.org/stats.php?page=user&proj=nplb&name=vaughan


Seventeen or Bust stats have been screwy the past few days as well with zero's across the board for daily work, total work, etc.
Hmm looked at this I do see 0.00's but I don't see major issues with your personal stats page maybe a glitch although I do notice there is no last update time on the user pages now... hmm odd sure there should be.

[Bok]

There was a crashed table on the nonboinc side of things. I set off a repair yesterday evening and then the normal automated scripts take over and correct it all. I'm getting this very occasionally but haven't found any reason for it as of yet. It never affects the stats tables themselves just the replicated version that the website uses so no harm is ever done.

I haven't found a way to automate the repair (or notify me) yet so am relying on anyone noticing it to keep letting me know here :)

Oh and yes there is a glitch in the TZ times I noticed it too yesterday.

[gopher_yarrowzoo]

There was a crashed table on the nonboinc side of things. I set off a repair yesterday evening and then the normal automated scripts take over and correct it all. I'm getting this very occasionally but haven't found any reason for it as of yet. It never affects the stats tables themselves just the replicated version that the website uses so no harm is ever done.

I haven't found a way to automate the repair (or notify me) yet so am relying on anyone noticing it to keep letting me know here :)

Oh and yes there is a glitch in the TZ times I noticed it too yesterday.
Gotta love those TZ glitches...
Hmm I've had an idea but i'll need to look at the table(s) in question to see if it would work.

[LAURENU2]

I thought of a good add on
In our CPID page http://stats.free-dc.org/stats.php?page=userbycpid&cpid=c4b4c71414f8e0247cd79febe1b85a39
In the Project Rank column of each project If the Rank # could be a link to bring you to that project rank page.
What do you Think

[Bok]

Done..

The link on the combined row is a little off due to split cpid's messing up the offset earlier in the list. Not too much I can do about that at the moment.

[LAURENU2]

Thats Way Cool Bok Your the MAN
__:allhail:

That should save some page loads

[Paratima]

I don't know if this has been reported yet, but for the last week or so, the HOSTS report on individual stats pages is not working. I have done nothing to set the "Hide My Hosts" switch, but all I see on my personal stats page on any project is the HOSTS header line, followed by the column headers for the Hosts report, then it immediately displays the Historic Team Movements header. No biggie, but sometimes I like to see how my far-flung hosts are performing. TIA

[Bok]

No, didn't know about it. Corrupt host table on the webside. Should be fixed soon...

Tx

Bok

[LAURENU2]

OK I have a new one In the "Combined Users" page

http://stats.free-dc.org/stats.php?page=boincusers

You Can Not sort in the "Today" " Last Update" " Yesterday"
Like you can in the project user's page I Like Sorting He He:blush:
It was nice with the old stats that sorted All columns except one

[gopher_yarrowzoo]

OK I have a new one In the "Combined Users" page

http://stats.free-dc.org/stats.php?page=boincusers

You Can Not sort in the "Today" " Last Update" " Yesterday"
Like you can in the project user's page I Like Sorting He He:blush:
It was nice with the old stats that sorted All columns except one

Now looking at the code Today / Yesterday are calculated fields i.e they are current score - day1 ; yesterday is day1 - day2 so really not that easy to do, last update yes since that is already a DB field. The reason we can do it on users&proj=....&sort=today is there are the DB fields in place now i've just checked how many DB rows are in the table used
there are 2,085,143 that is a lot of rows to work on to add 2 extra fields and then adding it into the update scripts so it works... the old stats were also not very efficient.

[Bok]

actually, there is a 'today' field on that table, I coded it quite some time ago, not sure why I never updated this page to use it rather the calculated number, so it can be added easily (I fixed the sql at least now). It's not currently indexed on the table but that's easy.

I'll add a new column for 'yesterday' too and fix up the perl scripts to calculate it during rollover when I get a chance.. I did add them to the regular user table long time ago just for this.

Need a better way to keep track of the 'todo' list as I get lost...

[gopher_yarrowzoo]

Need a better way to keep track of the 'todo' list as I get lost...

Hmm don't we all ;) I do believe there is one of sorts already maybe we should add things like this to it too :)

[LAURENU2]

Hmm don't we all ;) I do believe there is one of sorts already maybe we should add things like this to it too :)

Blog It
The To-Do Blog :thumbs:

+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

OK I found 1 more Glitch
Our Supercomputer is MIA :cry:
http://supercomputer.free-dc.org/

[Bok]

Hmm, very broken. I've fixed up quite a bit of it but still no data showing. Mostly caused by a tightening of the rules for php so the shorthand notation of '<?' which is used extensively is not allowed anymore and I have to change it all to <?php..

[LAURENU2]

Ya that is a problem when you upgrade
I guess that's why I still have my 1st wife
Just to much work getting it all back right :slap:

[gopher_yarrowzoo]

Ya that is a problem when you upgrade
I guess that's why I still have my 1st wife
Just to much work getting it all back right :slap:
That and you probably can't afford the divorce :p and keep the pharm.

[LAURENU2]

That and you probably can't afford the divorce :P and keep the pharm.
:catfight:

[gopher_yarrowzoo]

:catfight:
Ha Ha Ha Ha Ha Ha Ha Ha Ha sorry dude you walked into that one..
I mean do you get this one, Woman walks on her husband 10 yrs ago they did have a kid together - he is paying maintenance and gets access to the kid...
roll forward to today, he wins 26 million on the euro lottery, he was going to give her 1 million of it, she didn't think that was enough so took him to court got 2 million and the maintenance up'd to 2,000 a month...
Yeah she walked out on him for someone else.

[Paratima]

Thanks for the quick fix on the "Hosts" problem. :thumbs: It really helps when we can see what the individual units are producing.

Have a question: I was just checking on my progress in Docking and the numbers were a bit strange. It's likely just a quirk in the updating process - Docking's server has been up and down like a wild yo-yo the last couple of weeks. Anyway, I looked at the Update times in the upper right corner and found the following:

Docking@Home - Free-DC Overview
Last Checked : Fri Nov 26, 14:38:29 2010 EST
Data Updated : Fri Nov 26, 11:42:37 2010 EST
Current Time : Fri Nov 26, 13:07:11 2010 EST

According to my system clock, it was around 13:10 when I made the check. Plenty of slop in clocks to account for the difference on Current Time. However, I got to wondering about the "Last Checked" time. Does the server actually reach ahead an hour and a half to get the upcoming stats? If so, I'd like to suggest a stock market application for that piece of code. You could have a real winner here!

[Bok]

We think there is a bug in the timezone code somewhere. The dates held in the database are based on EST time as that is where the box is, but when it shows it it attempts to convert it to a localtime but it's going wrong. Might just revert this to using UTC at somepoint perhaps. It's gopher's baby though so I'll lte him take a look first. (perhaps we had some hacks in the tz code that didn't come over from the old box? )

[Paratima]

Pooh! I thought you were onto something really good in the Predictive Computing area! Oh, well. If it's just a TZ error, then it's a small one. If you do decide to get into PC, let me know! :cool:

[gopher_yarrowzoo]

Hmm okay I'll have a look at it. I did do a few code changes back and forth to get it work, I guess it broke...

AH found the problem - had to set the TZ to a custom one since it just wouldn't behave since AZ doesn't do DST but the server kept thinking it did.. fixed line removed and tested working - porting to live :) or I will as soon as it allows me to :p

[Paratima]

Thanks, Gopher. A small item, but good to get it fixed. You guys do great work! :clap: :clap:

[gopher_yarrowzoo]

Thanks, Gopher. A small item, but good to get it fixed. You guys do great work! :clap: :clap:
Yeah something we overlooked when the move happened - totally forgot the line was in there, although I should have remembered the amount of code / recode I did when the DST / BST kicked in / out..
I'm working on getting the "radar" to be a bit more well flexible, and then have it hide / reveal as requested.

[LAURENU2]

I Like Radar It helps in a Fog

[gopher_yarrowzoo]

I Like Radar It helps in a Fog
Yes well writing it and then making it work were two different things, condensing what was basically 4 separate calls to the database into one function so that the function gets the right data and then checks the data to see if it should be "included" i.e there is a threat / opportunity there wasn't easy and making sure it was passed all the right information in order to do that was harder.. it's a function and not part of the normal flow of data so variables and lots of them need to be passed to make it work..
if anyone wants to have a look at it, I'll try and port it to the "live" stats rather than the "dev test" pages which means a little clean up here and there ;)

[alpha]

All the WCG stats I've looked at today have been showing as negative. Presumably this is something their end but just thought I'd mention it here on the off chance that it isn't.