Any ETA on WCG stats tool being fixed?

[Philosophy]

Im not by any means rushing anyone, just asking when it or if it will be fixed, few ppl on XS have asked so I figured id ask the nice fellas over here and maybe get a quicker responce..

Also, I cant seem to find Boinc WCG statstool, is it by another name or something im missing?

Thnx in advance.. :rock:

[Bok]

I think this is the only place you'd get a response :)

It's difficult. WCG do not provide any kind of mechanism for 3rd party stats to extract data from. So, the only option is to grab the individual webpages. Problem is that this is not very reliable with WCG. Often times they are half updated or missing altogether. My stats engine basically disables all users, then as it parses each one it is enabled (a little more complicated than that but that's a good enough explanation..) in order to track name movement. So if a page is half updated, half the users are missing etc. Those users are then flagged as disabled. They then reappear later maybe a couple of days later. It all adds up to chaos...

Unfortunately I'm pretty busy in real life, doing a lot of travelling etc, so I've asked DP to take a look at it with my suggestion of what we could do to try and alleviate the problems. It's a somewhat complex solution but if he can pull it off it should work I think.

As a run down (gathering is all in perl) we need to preparse the pages by retrieving all the pages into a cache, then only parsing them if we get them all, perhaps attempting each GET a few times..

So, no ETA yet I'm afraid..

Hope that explains it :)

oh, BOINC WCG used to be named FightAids@Home, I renamed in on statstool but it's still in amongst the F's just after Folding@Home..

Bok

[movieman]

Just a thanks Bok for all you do..
People may not knock down your door thanking you, but a lot do in their hearts..:cheers:

[riptide]

Just a thanks Bok for all you do..
People may not knock down your door thanking you, but a lot do in their hearts..:cheers:
I'll second that. The best god dammit stats there is!:thumbs:

[j3pflynn]

Bok, any chance of adding "nForcersHQ.com" to the WCG stats?

[Bok]

Get me your userpage over at WCG and I'll add it..

[j3pflynn]

Bok,
Thanks! Sorry so slow to reply; didn't realize I had a reply - better check my profile settings! Here's the team's WCG page:
http://www.worldcommunitygrid.org/team/viewTeamInfo.do?teamId=0200ZZFB6R1

[Bok]

Added, should be in next update.

Bok

[j3pflynn]

:thumbs: Thankee kindly, sir!

[ToshPower]

If you find the time Bok, could you add those pesky Power Cows to your :notworthy statssite? Would be great!

Our team ID: http://www.worldcommunitygrid.org/team/viewTeamInfo.do?teamId=025RSMBR9N1

Would also be great for you guys, should be fun to see how much we are behind you guys :swear: :D

[Bok]

Added,

Always happy to add the cows. They always have my respect and I do so love visiting Amsterdam :)

Bok

[ToshPower]

Added,

and I do so love visiting Amsterdam :)

Bok

Me&you both :thumbs:

Thanks again!

[j3pflynn]

Bok,
You know a lot more about this than I do, but MiniMax(our other nFHQ team member) wanted to make sure you were aware of the RSS feeds WCG has for team and individual stats. Here are a couple of examples for layout info's sake:

nForcersHQ.com team stats feed:
http://www.worldcommunitygrid.org/rss?feed=team&teamId=0200ZZFB6R1

j3pflynn member stats feed:
http://www.worldcommunitygrid.org/rss?feed=member&userName=j3pflynn

Hope it's useful info!:thumbs:

[Bok]

Yes,

I looked at them a couple of months ago. Unfortunately the team one does not contain the teammembers information, otherwise I could use it :(

:cheers:

Bok

[j3pflynn]

Oh, well. Worth a shot! :)

[ToshPower]

Wich name is to be used for the stats image below?

My WCG is "_mcintosh_", but if I click down to my name in the FDC stats I see "_mcintosh_Dutch+Power+Cows" in the status bar of IE explorer.

I tried _mcintosh_ but that doesn't work, altough FDC stats do show me my 2130 points today.

[Bok]

try _mcintosh_Dutch Power Cows

The '+'s are just HTML formatting so you remove them. The reason the team name is in there is that the names are not unique so I add the team name to try and make them unique..

Bok

[ToshPower]

try _mcintosh_Dutch Power Cows

The '+'s are just HTML formatting so you remove them. The reason the team name is in there is that the names are not unique so I add the team name to try and make them unique..

Bok

That works :thumbs:

Only thing is that it doesn't fit into the "WCG BOINC" field. But it seems to show my stats correctly with the normal WCG field filled out, alltough I use BOINC.

Thanks :cheers:

[Bok]

The boinc project has different names...as they are in exported XML stats

Your's is 218930 as can be seen from
here (http://stats.free-dc.org/new/userstats.php?proj=bwcg&name=218930)

Bok :cheers:

[ToshPower]

The boinc project has different names...as they are in exported XML stats

Your's is 218930 as can be seen from
here (http://stats.free-dc.org/new/userstats.php?proj=bwcg&name=218930)

Bok :cheers:


All fixed, great :thumbs:

[umccullough]

Bok,

Can you also add Team Haiku to the WCG stats?

http://www.worldcommunitygrid.org/team/viewTeamInfo.do?teamId=LZJ514Q9R1

Thanks!

[Bok]

Added, they will appear in the next update :)

Bok :cheers::santa:

[Cordovader]

hi Bok :)

Can you add overclocking.es to the WCG stats please?

http://www.worldcommunitygrid.org/team/viewTeamInfo.do?teamId=7HJJR3KFR1

Thanks in advance for your effort & BTW, hi to all the community :cheers:

[Bok]

sure,

it'll be in the next update.

Bok :thumbs:

[JPG]

Hi,
I'm not sure I'm at the right place I have tried to search and I'm not able to find where I can request to add this team to the stats:
http://www.worldcommunitygrid.org/team/viewTeamInfo.do?teamId=0MV6V88PP1

Thank you,
JPG

[Bok]

Here is fine.

Added, will be in next update..

Bok :cheers:

[Gamma^Ray]

Hi Bok,

Would appreciate it if you could add BOINC Synergy to the stats list for WCG, Our page at WCG is http://www.worldcommunitygrid.org/team/viewTeamInfo.do?teamId=CFN98JHPP1

Thanks !
G^R

[Bok]

Added they should show up here (http://stats.free-dc.org/new/projpage.php?proj=wcg)

and here (http://stats3.free-dc.org/stats.php?page=proj&proj=wcg) at the next update..

Bok :thumbs:

[Gamma^Ray]

Much Appreciated !
:cheers:
G^R

[AETiglathPZ]

If you can please add US-Distributed
http://www.worldcommunitygrid.org/team/viewTeamInfo.do?teamId=B9P91PFQP1

And 2CPU.com
http://www.worldcommunitygrid.org/team/viewTeamInfo.do?teamId=F221SPD4BN1

Thank You!

[Bok]

sorry, will do this today..

[Johnny Cool]

sorry, will do this today..

Greetings, Bok! :cheers:

I gather that the WCG stats has been fixed as of late (today). Was this WCG's fault? I have a post going on at WCG ...

http://www.worldcommunitygrid.org/forums/wcg/viewthread?thread=21266

(thread is called "Can the WCG make it possible for Free-DC Stats to get "fresh stats"?")

Anyway, it all looks fine now. Perhaps I should have waited on posting that at the WCG.

Have a great day / night and thank you for those great Free-DC stats!! :)

[Bok]

Actually I didn't do anything in the last day or so, I tried something late last week but it didn't appear to fix anything that I could see. I was going to rewrite the parser to use the XML engine instead. (though it's painfully slow to download these as well)

However I've been looking over the WCG website and it appears to me that the classic engine has been discontinued ? Is this true, is it all BOINC now ?

Because if so, I'll just discontinue the stats there and people can use the BOINC WCG (http://stats.free-dc.org/stats.php?page=proj&proj=bwcg) stats instead which are MUCH more reliable..

Can you or anyone else confirm this ?

Bok

[Johnny Cool]

Actually I didn't do anything in the last day or so, I tried something late last week but it didn't appear to fix anything that I could see. I was going to rewrite the parser to use the XML engine instead. (though it's painfully slow to download these as well)

However I've been looking over the WCG website and it appears to me that the classic engine has been discontinued ? Is this true, is it all BOINC now ?

Because if so, I'll just discontinue the stats there and people can use the BOINC WCG (http://stats.free-dc.org/stats.php?page=proj&proj=bwcg) stats instead which are MUCH more reliable..

Can you or anyone else confirm this ?

Bok

Bok, if you get time, please check the thread that I had posted above. WCG techs and admins are there awaiting any reply from you.

My only thoughts concerning covering just Boinc stats (I mean, what about all the stats from the now (or will be) defunct UD client)?

Thank you Bok, for all that you have done for so many crunchers around the World. :cheers:

[Bok]

I will, in fact I'm waiting on my password being reset from the board right now.

If there truly is not any results being returned from the UD agent though, I would just set the WCG stats to be archived, so they wouldn't go away.

Bok

[Bok]

From the WCG admins...



There will be no more stats coming with the UD agent.


http://www.worldcommunitygrid.org/forums/wcg/viewthread?thread=21266&lastpage=yes

Time to archive the WCG stats in that case....

[Johnny Cool]

From the WCG admins...



http://www.worldcommunitygrid.org/forums/wcg/viewthread?thread=21266&lastpage=yes

Time to archive the WCG stats in that case....

Greetings, Bok!

Now that the WCG UD stats have been archived, what can I do to supply my Team Andrax with stats now? I see you have a Top Ten list for WCG and Boinc credits (etc). What can I/we do now??

Looking for guidance from you. :cheers:

Cheers,

Johnny Cool

[Bok]

Just use the boinc stats, looks like this (http://stats.free-dc.org/stats.php?page=team&proj=bwcg&team=5567) is your team right ?

Position 47 (http://stats.free-dc.org/stats.php?page=teams&proj=bwcg) in the teams list :)

Bok :cheers:

[Johnny Cool]

Just use the boinc stats, looks like this (http://stats.free-dc.org/stats.php?page=team&proj=bwcg&team=5567) is your team right ?

Position 47 (http://stats.free-dc.org/stats.php?page=teams&proj=bwcg) in the teams list :)

Bok :cheers:

Ah yes! :santa: Thank you very kindly, Bok! :)

[Bok]

I just had a quick look over at your forums too.

If you want some form of custom script to output the stats in a format you can post, just let me know what the format is and I'll create one for you..

I already do this for Team Anandtech and am doing one for the DPC too..

Bok

[Johnny Cool]

I just had a quick look over at your forums too.

If you want some form of custom script to output the stats in a format you can post, just let me know what the format is and I'll create one for you..

I already do this for Team Anandtech and am doing one for the DPC too..

Bok

Bok, that would be great!! I'll ask Team Mates what format it should be. We had been doing it using Excel.

Yet again, thank you so very much! :cheers:

[Courine]

i have seen this, but unfortunately have lost the link to the spot where the stream is from.

I have a guy that runs stats WCG_SPORTS (Your recognized leader in quality cybernet sports entertainment) and if I cant find that link again, I can point you to Geo at UserFriendly.org.

Considering the gravity, I dont think he would mind. :cheers:

[Johnny Cool]

i have seen this, but unfortunately have lost the link to the spot where the stream is from.

I have a guy that runs stats WCG_SPORTS (Your recognized leader in quality cybernet sports entertainment) and if I cant find that link again, I can point you to Geo at UserFriendly.org.

Considering the gravity, I dont think he would mind. :cheers:

Courine, is this info for Bok or me. :D

I went to the dentist today and I am *not* thinking clearly. :rotfl:

Bok, just got this from a Team Mate who helps me with the "Pie Chart" stats:

I would explain to Bok how we do the stats now. Tell him I copy and paste the chart data to Excel in Unicode, then put the information you need into a small chart. You can tell him what you do with the info. Then he can figure out what format to send to you. Since he uses several formats, he might already have a quick way to do it. I would tell him exactly what data we process from his charts, and see what he recommends. Hope this helps.

I take that info from my Team Mate and just post stats in text.

Well, in our WCG threads and in our own WCG forum at Andrax, I would simply post the name of the Team Mate and the "points he/she got during the last update. Team stats as well, of course; also Team Mates who exceed "milestones".

Something like this using the new Boinc stats:

All the Pie Eaters:

Killer Tomato ... 3,565
ovo2.0 ... 3,550
Dick_Dastardly ... 2,798

and so on. Anything that you can think of would be uber great. I hope this makes sense as I am taking some serious meds from my dentist today. :eek:

Cheers! :cheers:

JC

[Bok]

ok, easy enough ....

[Courine]

Courine, is this info for Bok or me. :D

I went to the dentist today and I am *not* thinking clearly. :rotfl:

........
Cheers! :cheers:

JC

I'm still hunting for that link. :rock:

[Courine]

Do you have an XML interface for the statistics?
You may obtain an XML version for most of the public statistics pages by simply adding either "?xml=true" if there are no other parameters in the URL or "&xml=true" if there already are parameters on the URL for the page.

Alternatively, you can view the XML page and follow the references provided on that XML document to go to locate pages that are in XML format.

Viewing the xml: <A class=contentLink href="http://www.worldcommunitygrid.org/xml/introspection.do">
http://www.worldcommunitygrid.org/images/spacer.gif

[Bok]

Not for the classic stats, but all boinc projects have their stats exported via xml, so I do parse them like that.

As has been stated though, the 'classic' WCG stats are essentially frozen, now, hence I've moved them to archive..

I was about to write one until I was told by the WCG admins that it wasn't worth the effort..no point writing a parser for their xml, when it's not going to update :)

Bok

[Courine]

Hehe, I wasnt on the same page. It seems that this point is covered.