Older stats issue

[Cappy]

it appears that all the stats are stuck :P

or Free DC is stuck and hassnt asked for updates :P

[Bok]

sunday, sunday blues....

They've finished the weekly cycle now, but are taking way too long. I'm optimizing the tables now, so it'll be quicker next week, but that's going to slow things down today (but not stop). The combined monthly table just took 45mins to optimize. I think the host weekly might take 4 hours or more..

I WILL add into the scripts to optimize them after running the weekly/monthly cycle (all the other tables do). It'll not take long if they are maintained, it's just when I've left them for 6-8 weeks or more, they get badly fragmented. Ad of course the host weekly one has quite a few rows...

Bok

[gopher_yarrowzoo]

If your wondering why the post count seems to be down for this thread it is because I'm in the process of splitting this thread up - all resolved issues now have their own sub-forum

[vaughan]

It appears that the Wieferich stats are stuck.

This is frustrating:
Page Cached 0 days,0 hours & 51 mins ago..

[gopher_yarrowzoo]

There aren't stuck they the cache time for those pages is set to 1 hour I just checked the code since this page doesn't really change that often, only when new stats are available it's best to keep it fairly static, thus the 1 hour cache time.

[vaughan]

OK but why is the stats page empty 51 minutes after the stats were checked. I often see this phenomenon seconds or occasionally minutes after a project's stats get updated but 50+ minutes is exceptional.

[Bok]

we need to remove all the database caching now that the pages (at least some of them) are cached. It's a fair bit of work though.

[gopher_yarrowzoo]

%user@stats>ftp myserver.net as u=me p=mine
myserver.net:%user> put db_cache_purge.php
### 3298 bytes sent.
myserver.net:%user> logout
%user@stats> exec db_cache_purge.php
working..........................
done
%user@stats>logout
session ended....
We'll get to work on that ..

[Darkness Productions]

The link on http://stats.free-dc.org/stats.php?page=index for Free-DC Majestic-12 links to http://stats.free-dc.org/stats.php?p...j&team=Free-DC which is apparently wrong; it should be linking to http://stats.free-dc.org/stats.php?p...oj=maj&team=16

[Bok]

You should have the ability to change this actually, I'm fairly sure you are flagged as one of the admins

If you are on one of the pages for maj, i.e. as long as it has proj=maj, look on the left side to see if you have the ADMIN section showing and go to the 'This projects conf', alter the Free-DC team piece and update!

It'll need upto 20-30mins after that to migrate to live..

Bok

[Darkness Productions]

Ha! I did! Thanks

[Darkness Productions]

Top Free-DC user for MAJ shows Py, but only with ~6B:

Majestic-12 4 6,133,560,719 - PY 222 0 0 8,116,700 52m and 10s ago

his actual total is close to 5x that... Bug?

[Bok]

misconfiguration.

It should fix on next update. Basically it's not been updating that field because we had the 'free-dc' team wrong and in that one and only place it still reads it from a config file and not the database. I updated the config file.

[AMDave]

There is the possibility of slow response from the site during the next 4 hours while one of the sites is migrated to another host.

The transfer is at about 50% and the pages are responding ok at the moment.
I am keeping an eye on things.
If I : it up then you can me later.

[AMDave]

File transfers completed without incident.

[zombie67]

Problem with QCN stats? Looks like something went funky over the past several days.

[Bok]

I just think they haven't exported any new stats at all..the scripts will keep checking..

[zombie67]

Something more than that. See how the charts spike way up, then way negative, then back?

[gopher_yarrowzoo]

Yeah I see that seems a few teams got dropped out then came back would account for the massive swings... Oh and I've changed the QCN F-DC team to 0 since we don't appear to have one....

[rilian]

why

BBC Climate
Cels
Eternity@Home
EAPS

etc are still in "active projects" ?

[rilian]

another issue:

http://stats.free-dc.org/stats.php?page=proj&proj=bat

not updating!

[Bok]

If you look at the times

Boinc Alpha Test - Project Overview
Last Checked : Mon Feb 08, 17:35:11 2010 EST
Data Updated : Mon Dec 14, 12:00:23 2009 EST
Current Time : Mon Feb 08, 18:29:33 2010 EST

It shows that the stats attempted to update but did not find any updated xml data to update with. I don't think they've been running the cronjob to export the stats for some time..

As for the active/achive, just haven't updated them. It's not really a big deal as it's just a flag and I don't separate them in anything but the usermain and the old combined signature. No calculations are affected at all.

Bok

[rilian]

1) So we should ask at BAT forum about stats?

well, http://isaac.ssl.berkeley.edu/alpha/...read.php?id=85

2) As for the active/achive, dead projects look like empty holes in statstool configuration page...

[Bok]

1) So we should ask at BAT forum about stats?

well, http://isaac.ssl.berkeley.edu/alpha/...read.php?id=85

yup.

2) As for the active/achive, dead projects look like empty holes in statstool configuration page...

They do? You can still configure them, regardless of the section they are in?

[rilian]

2) yes, i mean, as i have no and cannot create accounts in dead projects, those remain empty (inputs)

[zombie67]

Something is still wrong with QCN stats. Look at the graphs here:

http://stats.free-dc.org/stats.php?page=proj&proj=qcn

and then compare them to BOINCstats

http://boincstats.com/stats/project_...hp?pr=qcnalpha

See? BOINCstats does not have the ups and downs like the graphs here. So I suspect it is a problem just here.

[Bok]

nod. It's not a problem with the update of the stats, they are all fine. But there is an issue with the rollover script which computes those daily figures seen on that chart. I've seen it intermittently over the past year but never did track it down.

Taking a fresh look now.

Bok

[Bok]

I found it. Stupid, stupid error on my part. Doh!

Tonight's rollover will be correct, though for QCN it will in fact put the numbers back up correctly to the 5.5M range. It *should* be correct going forward now though.

That actually fixes a number of issues..

Bok

[zombie67]

Sweet! Thanks!

[rilian]

BOINC alpha test stats issue forwarded to David Anderson. Hope, they'll run xml cron job soon.

[rilian]

BOINC alpha test stats issue forwarded to David Anderson. Hope, they'll run xml cron job soon.

http://isaac.ssl.berkeley.edu/alpha/...read.php?id=85



this sux

edit: maybe David is not aware that there are other WUs than those 1-min/4MB WUs for testing download/upload/resume on new clients?

[rilian]

well, sent again email to Jeremy (PyMW developer) with CC to David

does anybody see a problem running stats cron job once a day?

[Bok]

Not really, no. It likely takes seconds to run on their machine given the very few participants.

Bok

[rilian]

Most Team #1's
Most Team top 10's
Most Team 100M's
Most Team 50M's
Most Team 25M's
Most Team 10M's
Most Team 5M's
Most Team 1M's

are br0k3n (no team name)

[Bok]

hmm. I'll look into this in the morning..

[(_KoDAk_)]

Badge Milestones
do you have full history ? mmore then last 10 ?

[Bok]

Only since I started tracking them..which is Sept. 09

[vaughan]

bok can you get the NPLB stats working again please?

[AMDave]

@bok email 28/02/10 18:23:24 "NPLB stats export"

[Bok]

hmm, I'd have to rewrite the driver now that you've changed it to be a tar.gz file rather than the previous straight .php file

Any reason for the change ?

Bok