Stats Stuck

[Beyond]

It appears that the Prime Grid stats are stuck on "stats updating". :Pokes:

[Bok]

Thanks. I've reset that along with a few others that were stuck too .

Of course, these (http://stats3.free-dc.org/stats.php?page=proj&proj=pgrid)

are available and have the added bonus of showing individual project scores too if you hover over the names when in users...

[vaughan]

Hi Bok,
eOn stats seem stuck on the old stats system.

Request:
On the stats3 system could you add the ability to re-order the stats based on Today and also Last Update fields please (as per the current stats site).

Thanks in advance.

[Bok]

I think the eon stats are fine. They look like they've just updated..

As for the ordering, well, it's not that easy..it's one of the big problems on the old site as they are non-indexed queries, so mysql gets hammered. I could add a whole boat load of indexes to get around it, but performance whilst gathering the stats would suffer.

The 'today' ones aren't too bad as I'm already creating a temp table with the top 1000 users/teams and can display that, but lastupdate would be a horrific column to index. Perhaps I can create a temp table for this as well. Can't imagine anyone would want to see more than the top 1000 or so anyway..

Bok

[AMDave]

...As for the ordering, well, it's not that easy..it's one of the big problems on the old site as they are non-indexed queries, so mysql gets hammered. I could add a whole boat load of indexes to get around it, but performance whilst gathering the stats would suffer....

copy the front end table to make a background table which has no index
begin stats gather on copy
finish stats gather on copy
rebuild index on copy
replace "read" table with copy (which has an index) by dropping the read version and renaming the background copy to the table name of the foreground copy.

Should make it look like magic.
Takes more db space due to the table copy but keeps an indexed table at the front end and allows the grunt to be done in the background.

Is that workable?

[Bok]

Well, yeah, I already do that (to some degree).. but it would still require more multiple indexes to be rebuilt. In the case of 'today' though, that's not even actually a column but the difference between yesterdays score and the total score, so though I could use a view or update the whole table to generate the today score into a highly fluid indexed field, it's much more efficient to create a seperate table of just the top x users.

I've got some backend changes I'm going to try today which might increase the speed 5 or 10 fold anyway. If they work I would not mind having the indexes on at all.

Bok

[vaughan]

Docking@Home has changed URLs to http://docking.cis.udel.edu/ and the stats are stuck on July 9th last year.

[Bok]

Thanks,

changed the url and updated the stats..

Bok

[vaughan]

cels@home stats seem to be stuck.

[IronBits]

You're right. Fixed...

Bok (posting from IB's machine as I'm staying with him for a few days here in Phoenix :) )

[glennpat]

LCH@HOME website is back up after being down for many days. Not sure if the states here are stuck, but it didn't update when data was last checked and I miss the data.

Data Checked : 2008-04-10 16:06:36 CDT | Data Updated : 2008-03-30 09:25:35 | Current Time : 2008-04-10 17:20:51

Thanks.

[Bok]

If it was checked then it means they haven't re-exported any new stats yet.

I'm sure they'll get to them at some point.

Bok

[BlackMountainCow]

Not wanting to press anything, but are you sure that the LHC stats aren't stalled? All the other stats sites I visit have new LHC stats for the last two days, so there must be new stats exported by LHC. Or am I missing something?

:thumbs:

[Bok]

unless the url has changed ?

http://lhcathome.cern.ch/lhcathome/stats/

is where I pull them from and you can see that it is the 11th for the last update there.

Bok

*EDIT* looking at the message boards show this one http://lhcathome.cern.ch/lhcathome/forum_thread.php?id=2743

So, I don't think they are being updated.

[BlackMountainCow]

Hehe, you got a point there. :)

[glennpat]

*EDIT* looking at the message boards show this one http://lhcathome.cern.ch/lhcathome/forum_thread.php?id=2743

So, I don't think they are being updated.

That was the thread on LHC I started about the stats I get from here not working.

[Bok]

Cool, and they have started updating again I see

http://stats4.free-dc.org/stats.php?page=teams&proj=lhc

Bok :thumbs:

[glennpat]

The stats for LHC that have not been updated since 3/30 are these:

http://stats.free-dc.org/new/allteams.php?proj=lhc

edit: Just wanted to add that it looks like these are what get used to get the DCR.

Glenn

[Bok]

Yes, they are the old ones due to be phased out. DCR will disappear at the same time as I'm not going to move it on to the new stats right now.

I'll kick them when I can get back on the server.

Unfortunately stats4 seems to have completely borked for all boinc projects right now. I can't even imagine what could have possibly happened, but I can;t get to the box to find out until I get back to my hotel tonight anyway :(

Bok

[Paladin]

Poem@Home stats seem to have been stuck since 3am last night. Don't know if you can remote bounce it from your location, Bok.

[IronBits]

Have you tried here? http://stats3.free-dc.org/stats.php?page=index
5 hours, 24 mins ago
Last Checked : 2008-04-22 21:21:18 MST

[alpha]

LHC is still stuck on stats, but OK on stats4.

[IronBits]

The current stats located at stats.free-dc.org is going away and is not really maintained.
Bok has been putting all his efforts into the new stats system which is just about ready to go.
http://stats3.free-dc.org will become the new stats.free-dc.org very very soon. :thumbs:

Everyone should take the time to visit http://stats3.free-dc.org and help find us some bugs, and request some features you might like to see.

Thank you for all the hard work and many many many hours of time and labor Bok! :rock: :cheers:

[Bok]

Actually it's Stats4 to be precise though I've now pointed stats3 to the same place so it should mostly work too

http://stats4.free-dc.org/stats.php?page=index

though I tend to use

http://stats4.free-dc.org/stats.php?page=usermain&name=Bok the most as well as my boinccpid page

http://stats4.free-dc.org/stats.php?page=userbycpid&cpid=c843714b32e467b97d2571d1af9971f8

:thumbs:

I'll have this page added to all of the boinc projects out there too, so you'll get the option on your userpage at each of the projects.

[Paladin]

I see. Yes, the new stats partially work. The comparative graphs and data are still blank and there's no Child Care or Minicity link. I hope the blinding white background is configurable to the same color theme as the forums. The DPI on the search box titles bleeds over into the boxes themselves for me (WinXP64, Firefox 2.0.0.14, 1024x768, normal (96) dpi).

[Bok]

There probably won't be the links to childcare and minicity (I'm not trying to make it identical, it's actually a mostly complete rewrite).

You'll have to give me some more info on the 'comparitive data' - I know some graphs aren't working, especially non-BOINC ones which is just a variable problem as the data is in different tables.

I wasn't really planning on making the background colors 'themeable', at least not anytime soon, but it wouldn't be that difficult.

Haven't seen the overlap effect on the search box, I'll see if I can recreate it. I know there is a css problem on lower resolutions on the right hand side which I haven't corrected yet..

Bok

[mike047]

Hi there,

It seems as though Poem@Home stats are stuck, at least for me.

mike

[LAURENU2]

Ya EoN has been updateing for the past Hr or more :Pokes:

[em99010pepe]

Ya EoN has been updateing for the past Hr or more :Pokes:

Texas page is down so are the stats. I already sent an email to Lijun with no reply until now.

[Bok]

Hi there,

It seems as though Poem@Home stats are stuck, at least for me.

mike

Use http://stats4.free-dc.org/stats.php?page=proj&proj=poe

old ones are going away soon.. I'll kick them tomorrow though. Had a miserable delay at LaGuardia today coming from from NY, 7 hours in an airport with 2 young kids is NOT fun...:swear:

Bok :cheers:

[gopher_yarrowzoo]

Yeah Bok at least they were your kids, it's worse if it's someone else's that's bugging ya.

[Bok]

Yeah, but I would have just gone to the bar then.....:banana:

[LAURENU2]

Yeah, but I would have just gone to the bar then.....:banana:
Well don't they have storage lockers there :jester:

[BlackMountainCow]

[capture thread]

Hey Bok, could you give the LHC stats on the old stats site a little kick? It has been stuck for quite a while now. Or is it already turned off?

:thumbs:

[/capture thread]

[Bok]

It's still running through the end of the month, but I can't get it to it from the site I'm currently on (no traffic out allowed on port 22).

I'll take a look from the hotel tonight.

Bok

[Spacehead]

Do you plan on making the various columns on the new site sortable like they are currently?

[Bok]

Those are non-indexed right now, which was one of the reasons for the rewrite..

I'll be making last_update and yesterday sortable though..

Bok

[Scribe]

Hi Bok, could you please check the WCG stats? Seems not to have updated for 10 days or so.

Cheers mate:thumbs:

[plewdawg]

Could you give the Boinc-WCG server a kick? It seems to be stuck...

[Bok]

These ones are fine....

http://stats4.free-dc.org/stats.php?page=proj&proj=bwcg

I've kicked the old ones, but they only have 11 days left before they go offline..

Bok

[Beerknurd]

WhatPulse stats seem to not be updating... It may be on their end though...

[Bok]

They need looking at. Not currently running them as they have issues, but I might take a look when I arrive at my hotel tonight in Hartford.. :)

Bok

[Beerknurd]

Awesome!!! Thanks Bok!!