Chessbrain stats update

[magnav0x]

Not much going on but getting it settled in on mysql.

08.06.03
=======

Changes:

Ported and switched to mysql server with much more bandwith
Added active/total user numbers in all teams display



http://chessbrain.ezracing.net

[IronBits]

:smoking: :cheers: :thumbs:
/me goes off to install it on more boxen :D

[cygnussphere]

Originally posted by IronBits
:smoking: :cheers: :thumbs:
/me goes off to install it on more boxen :D

You Rock Target Butt:thumbs:

And for all who check out magnavox's most excellant statage you will see that Team Free-Dc is second only to the Fobot Juggernaut lead team Anandtech in current out put. Fobots productions seems to have gone down some with the start of DF pII but others on their team have stepped it up. The number 2 spot is out there to be taken its just a matter of how many boxen we throw at it <hint>

Current production Kudo's to
rshepard*
Condor (http://chessbrain.ezracing.net/user.php?uID=827)
magnav0x (http://chessbrain.ezracing.net/user.php?uID=746)
supp (http://chessbrain.ezracing.net/user.php?uID=619)
mashRinx (http://chessbrain.ezracing.net/user.php?uID=976)
Ironbits (http://chessbrain.ezracing.net/user.php?uID=755)

and Thanks to all past contributers come on back if you get the chance.:thumbs:

*rshepard has 11 differant handles that I can find and would be at the top of Free-Dc teams stats if they were all combined. He also should get credit as founder and leader of the Free-DC ChessBrain effort.:notworthy

[rshepard]

rshepard has 11 differant handles that I can find

/me considers forming a new subteam:
FreeDC Hydra rshepard

:rotfl: :rotfl: :rotfl: :rotfl: :rotfl: :rotfl: :rotfl: :rotfl:

[cygnussphere]

Originally posted by rshepard
/me considers forming a new subteam:
FreeDC Hydra rshepard

:rotfl: :rotfl: :rotfl: :rotfl: :rotfl: :rotfl: :rotfl: :rotfl:

You would be the #10 team on the planet all buy yourself right now:thumbs:


:tempted:

:cheers:

[rsbriggs]

Hmmmmm. What is it that goes on over here, anyways????

[cygnussphere]

Originally posted by rsbriggs
Hmmmmm. What is it that goes on over here, anyways????

Well Thank you for asking:D

The following are links to the ChessBrain project.

ChessBrain Home Page (http://www.chessbrain.net/index.html)
ChessBrain Official Forums (http://www.chessbrain.net/bbs/)
ChessBrain Official Stats Page (http://www.chessbrain.net/nos.php)
ChessBrain Peernode Client Download area (http://www.chessbrain.net/downloads.html)
Most Excellant Statage By Our Own magnav0x (http://chessbrain.ezracing.net/)

In short the project is working on premise that DC can be used effectivly to run a competative chess engine vs a single node ect.. Deep Blue. In addition they are working on going for the record of number of computers involved to play a single game online

The CB client does not run all the time only when a job is sent from the servers making possible to running it on your boxen along with another DC project like DF.

You are invited to join in the fun here :banana:


:tempted:

:cheers:

[IronBits]

We went Orange ! :D

[rsbriggs]

I added it to a couple of comps. When do stats show up? Days from now?

[rshepard]

They should show up tomorrow- stats get updated daily :thumbs:

[cygnussphere]

Originally posted by rsbriggs
I added it to a couple of comps. When do stats show up? Days from now?

You Rock:thumbs:


Stats are updated once a day so tomorrow you should see statage. CJ is working on real time stats but there is no time frame right now.


:tempted:

:cheers:


rshepard quick on the draw today:D

[cygnussphere]

Originally posted by IronBits
We went Orange ! :D

We were red but I had issues with several boxen yesterday causing a drop to orange. With the new addistions we should be able to maintain Redling status now:thumbs:

Oh IB would you sticky my post above for info in this forum? and could I get access to edit it when needed?

Thanks:thumbs:

:tempted:

:cheers:

[IronBits]

Slight problem - there are TWO IronBits! :scared:

Can you combine 755 and 996 to make it into one?

I don't think the world is ready for TWO of us :rotfl:

Any reason there would be TWO of us? Did I fubar something?

[rsbriggs]

There are a couple of cases like that - and what's up with rshepard???

I finally made the list, but I'm greyed out......

[cygnussphere]

Originally posted by IronBits
Slight problem - there are TWO IronBits! :scared:

Can you combine 755 and 996 to make it into one?

I don't think the world is ready for TWO of us :rotfl:

Any reason there would be TWO of us? Did I fubar something?

If you didn't enter your handle or team name exactlly the same way you can wind up with 2 stats handles. Note the 2 FreeDC hydra west handles.


:tempted:

:cheers:

[IronBits]

Originally posted by cygnussphere
If you didn't enter your handle or team name exactlly the same way you can wind up with 2 stats handles. Note the 2 FreeDC hydra west handles.
exactly eh ;) Fixed, upper/lower case should not have anything to do with it, but it did... :bang:
Fixed I think :blush:

[rsbriggs]

Originally posted by IronBits
Slight problem - there are TWO IronBits! :scared:

Can you combine 755 and 996 to make it into one?
Heck - that's not a problem - think how it will help out during the bguinto1 gauntlet....

(BTW - you and PCZ beat him combined currently, but who is to say that he won't just switch the other 75% of the corporate farm over to DF during the guantlet?)

[IronBits]

Exactly! That's why I said the stakes were too high and made a counter offer that would only affect myself, and PCZ if he was willing to throw down with me (which PCZ did!) :thumbs: :D

It's one thing to challenge an individual or two to a gauntlet, but not to drag an entire Team's effort into it.

He probably has another 300 boxen he has access to, or more, who's to say, as he is a commercial pharmer. ;)

He is only showing what he's willing to work at to maintain the DF client. ;)
I'd still put my money on Dyyryath in a heart beat tho :D
or xj10bt for that matter, IF the client proves stable and does not require babysitting.
:|ot|:

[cygnussphere]

Target Butt is the wise and cagey veteran of the DC conquest.

:notworthy :notworthy :notworthy :notworthy


:tempted:

:cheers:

[magnav0x]

I'll look into combining the duplicates soon. Just gotta figure out how I want to do it. It's been something I been wanting to do for a while, but every time I sit down and try to think of a good logical way to do it, I get a huge brain fart and go play with gentoo.

[cygnussphere]

I will be interesting too see if you can make that happen... If for nothing else but to combine rshepards stats.:thumbs:

:notworthy :notworthy :notworthy

:tempted:

:cheers:

[Chinasaur]

Yo Cyg,

Per phonecon this PM, I've got an 800Mhz G3 running Chessbrain on team free-dc.

Is that the right team name?

If it gives no probs, I'll push out to other boxes.


:thumbs:



:cheers:

[magnav0x]

FREE-DC

I believe we're using all caps, but I could be wrong. Someone here should remember.

[Chinasaur]

Well @#$%

Is it too late for this client? it's still on standby...do I just retype and save .conf file?

[magnav0x]

Just edit the cbspn.conf (or whatever) and put in FREE-DC. Save it then restart the client.

[Chinasaur]

Just got off the phone with Cyg..he says lowercase.

I'm working on getting 5 more Ghz online by tonight for CB

[cygnussphere]

YOU ROCK Chinasaur:drums: :thumbs:



:tempted:

:cheers:

[Chinasaur]

5.8Ghz online as of 1745 PST.

Yo Cyg..you were right. It has allocated the 32mb for itself and not released it. I'll let it alone for a day or so and if I don't need it, I'll give it another 64mb on the Mac box.

Seems to be active today. Each time I acrtivated a Linux box, it started crunching right away.

I'll be interested to see the affect on my DF production tho ... :rolleyes:



:cheers:

[cygnussphere]

Originally posted by Chinasaur
5.8Ghz online as of 1745 PST.

That number 2 spot it getting closer and closer:thumbs:


:banana: :banana: :banana:


:tempted:

:cheers:

[Chinasaur]

You've been assimilated....into the DC collective....

Sorry :)



:cheers:



Now if I could just Borg the Fire Control computer of my HERC/Mech :D~~


:jester:


NO WAIT!!!!


BORG PROMMIE!!!!!!! :lmao:

[cygnussphere]

I still have the infamous e-mail that started it all.:thumbs:


:tempted:

:cheers:

[rsbriggs]

Hey - how often do the CB stats get updated - or, rather, I know they get updated once per day - What time do they get updated?

[magnav0x]

The official stats are updated at 3:00 AM CST. My stats update at 3:30AM CST (just in case they are a tad behind).

BTW rshepard and Ironbits multiple accounts have been merged!

Tough luck cyg, you'll have to settle for 2nd place now.

Sorry guys but you lost your last 7 days of info in when I was doing it. But they will begin to reaccumilate starting next stats update......if not then I'll pull some hair out and fix it.

[rsbriggs]

Well, you could always work on hydra west, supp, and Nitrousine, too.... Just in case you didn't have something better to do :D

[magnav0x]

All on my to-do list :D

Now that I figured out how I'm going to do it, it won't be a problem, but it is a tedious job and I'm going to take a break for a bit :gone:

BTW congrats to rshepard on being in the top 10 for the project :thumbs:

[IronBits]

/me listens intently and begins to :D

You HEAR that ruckus?

I'm a coming for ya :scared:
:whip: mush doggies mush! :whip: :D

[Beyond]

me prepares to grab IB's coattail as he passes by in hopes of getting pulled along by his momentum. :)

[rsbriggs]

Hmmm. Wonder why IB was the only person to update....

[rshepard]

Better recheck your code, guy--- as a team we now show >8000 nodes, and in second place,
and my total shows>2000 nodes. I'm pretty sure both of these values are roughly twice what they ought to be. But thanks for the hard work-- it's getting there :thumbs:

[Chinasaur]

I joined yesterday and I'm not showing up at all???

**Later** I found myself on Macks stats. I am correctly shown as belonging to FREE-DC and did 2.54 yesterday. But not showing up on Mag's stats.

Just info

:cheers:

[rshepard]

gotta be a glitch-- you show up on the chessbrain.net Individual stats, registered as part of the FREE-DC team

>edit--- pfffftt-- never mind then :D

[magnav0x]

Got em fixed. Apparently chessbrain was running way late on their stats update and my scripts decided they wanted to update any how. Unfortunately...Ironbits and rshepard's merged accounts did get to accumilate daily/weekly stats, because I had to restore a backup of the database. Sorry guys :( I'm in the process of putting a timestamp check to determine if CB has updated stats on their side before allowing the scripts to run.

[Beyond]

5 FREE-DC 4128.307474 from ChessBrains top DC teams page

5 FREE-DC 3741.45 from your stats page.

?

[magnav0x]

Interesting enough. I just woke up...gonna go have my nicotine and I'll look into that.

[Beyond]

Your Private Messages Inbox is also full........:rolleyes: :)

[IronBits]

What do you use to monitor the progress of each client?
I am using the peer node monitor version 1.0 and the stuff just scrolls off the screen :(
I'm also seeing a lot of "Job aborted at request of Server" messages, after the work has been done and apparantly during the upload process. :cry:

[Beyond]

You stil get credit for total jobs done. :D

the borkage is;

64 TheRealm FREE-DC 227.746102
124 TGC FREE-DC 88.540080
148 BeyondTheRealm FREE-DC 66.941834



:crazy:

[rshepard]

IB- for what it's worth, I just watch mine from the command line (low-tech me :D )

The Job aborted message is normal-- it just means that some other box returned a result before your's did, so the server aborts your job to give it another one--- you still get credit for the work done, however

[magnav0x]

Cleaned my inbox beyond

[IronBits]

I was RED :bang:

I was RED :swear:

I saw it with my own two eyes! :bang: I did, I did, it's true!!! :cry:

/me goes sulking off into the darkness to plot revenge ;) :D

[magnav0x]

Thanks to Beyond's good eyes we found 3 straglers, which for some reason did not get a tID of 31 (free-dc), but we still seem to be missing 4 billion nodes somewhere. I don't know why our team is the only one that had this problem :trash: Must be a sign.


Official nodes:
4128.307474

Nodes according to my stats:
4124.68


I browsed the stats.txt file on chessbrain's server but didn't see anyone that was missing. Unfortunately I am heading out in about 30 minutes.

[IronBits]

Found it! :D <whew> 80+ Total Jobs
/me relaxes - BUT, still plotting for take over if DF isn't impacted to hard. :gone:

Username Team Jobs Accepted Total Jobs Total Nodes Change CPU Time
IronBits FREE-DC 6289 28358 61.5083 15.1934 86.44
IronBits FREE-DC 380 9221 18.9480 9.1572 32.08
:cheers:

[Beyond]

433 Beyond FREE-DC 3.632069 -- perhaps...I must be trying to match rshepard in number of accounts, anyone else care to join in the fun of multiple account creation? :rolleyes: :D

[IronBits]

They definately need to remove the 'case sensitive' BS :trash:

[Beyond]

Originally posted by IronBits
They definately need to remove the 'case sensitive' BS :trash:

Yeah!!! that's it, that's the ticket, it's thier fault. If it wasn't for that all these rogue accounts would not be popping up. :D

[rsbriggs]

It actually is their fault. If you look at the XML data for their stats, you see things like:



<data f1="IronBits" f2="FREE-DC" f3="US" f4="61.508300" f5="6289" f6="28358" f7="311173.13" />
<data f1="IronBits" f2="FREE-DC" f3="US" f4="18.948020" f5="1380" f6="9221" f7="115492.55" />
and
<data f1="dabion" f2="DGD" f3="US" f4="0.368488" f5="8" f6="314" f7="4282.54" />
<data f1="dabion" f2="DGD" f3="US" f4="20.552289" f5="956" f6="12027" f7="170144.63" />


These kinds of duplications are scattered all through the XML that you retrieve when you ask for all the stats. Only possibility that comes to my mind: might it be that the same named accounts were created with different email addresses ????

I'm not certain about case-sensitivity - they say that all team names are rolled to upper case. Ahh - but perhaps they keep case-sensitivity in the database and just DISPLAY the team names in upper case ???

They definitely have something loose rattling around in their stats that needs to be fixed....

[cygnussphere]

Originally posted by magnav0x

Tough luck cyg, you'll have to settle for 2nd place now.


the cygnusphere always consitered itself in second place behind our fearless leader rshepard:thumbs:

The only second plays we are conserned with now is the one behind Team Anandtech:thumbs:


:tempted:

:cheers:

[Chinasaur]

Any announced plans to update stats more than once a day?

<StatsWhine>It kind of sucks to not be able to see what affect you are having and how the clients are working. </StatsWhine>

[cygnussphere]

Originally posted by Chinasaur
Any announced plans to update stats more than once a day?

<StatsWhine>It kind of sucks to not be able to see what affect you are having and how the clients are working. </StatsWhine>

This (http://www.chessbrain.net/bbs/viewtopic.php?t=515) is the only referance that I can find regarding real time stats.

:tempted:

:cheers:

[magnav0x]

I've sent message after message to cjus regarding the realtime stats and he NEVER replies at all. Case of selective hearing I guess.

[Chinasaur]

Sounds like it's in the works anyway :(

[magnav0x]

Supposedly "been in the works" for a very long time.

[rsbriggs]

Well, let's see. I'm ahead of 4 copies of IronBits, and behind 5 copies. I'm behind about 29 copies of rshepard accounts, and ahead of about 16 copies...

Doing OK, it looks like.... From the Magnav0x stats it looks like we might make first place tomorrow. Official stats show differently.... Dunno what to think.... :scratch:

[Chinasaur]

ROFLMAO!!! I make the Top Ten OS X producers after 1.5 days production on an 800Mhz G3 :jester:

http://www.chessbrain.net/stats-top-machines-graph.html

A graphic representation of Apple's 2.5% market penetration. :banana:


:cheers:

[rsbriggs]

Heh - it would be hard NOT to make the top ten in a category where there are only 9 total participants... :thumbs:

[Chinasaur]

Shhh...you're not supposed to have seen that it's really only EIGHT ;)

:D

[magnav0x]

This is driving me nuts. I'll have to work on it when I get home from work tonight. Sorry guys.

[IronBits]

No worries mate - you'll get there. :)

This might help put our efforts into perspective :D

Team Total Nodes Change in Period Total CPU Time
NONE 17129.6074 711.8129 46753.27
FREE-DC 4372.6245 244.3170 7750.95
TEAMANANDTECH 9521.7598 105.1870 19852.24
EXTREMEDC 5475.9976 97.5731 10192.54
SWISSTEAM.NET 7867.2529 55.6912 21682.0 Top Ten Graph (http://chessbrain.bass-speaker.com/toptenteamsgraph.jsp) :fireboun: :cheers:

[cygnussphere]

Originally posted by IronBits
No worries mate - you'll get there. :)

This might help put our efforts into perspective :D

Team Total Nodes Change in Period Total CPU Time
NONE 17129.6074 711.8129 46753.27
FREE-DC 4372.6245 244.3170 7750.95
TEAMANANDTECH 9521.7598 105.1870 19852.24
EXTREMEDC 5475.9976 97.5731 10192.54
SWISSTEAM.NET 7867.2529 55.6912 21682.0 Top Ten Graph (http://chessbrain.bass-speaker.com/toptenteamsgraph.jsp) :fireboun: :cheers:


:notworthy :notworthy :notworthy

Let the Big Dogs Hunt:machgun:

:banana: :banana: :banana:

err and hope Fobot dosn't get down wind:whistle:


:tempted:

:cheers:

[rsbriggs]

Nice. :thumbs: Looks like our graph took a nice turn upwards.

Hmmmm.... Those "NONE" guys look like they are going to be hard to beat, though....

[cygnussphere]

and if there was just some way to contact team "none" for recruiting:D


:tempted:

:cheers:

[magnav0x]

Good news:
I found out what was causing the problems.

Bad news:
I reset the stats (again :dunno: sorry)
The problem lied in the way I was doing the merger system which realy messed things up when my stat update script ran.

More good news:
It dawned one me (rays of happyness shine down on magnav0x). I know of a great (efficient) way of doing the merging that will not cause problems down the road.

More bad news:
You'll have to wait until this weekend when I have time to rewrite my stat grabber script.

[rshepard]

:notworthy :notworthy :notworthy

Really appreciate all your hard work :thumbs: :thumbs:

[rsbriggs]

Some of these chess brain people are going to be hard to beat:


link: http://www.zuses-hirn.maczock.info/

http://www.zuses-hirn.maczock.info/Resources/xservebearbeitet.jpeg

Now is that a farm, or what??

[IronBits]

:scared:
The processing power of 42 fullsize Xserve Racks will push us on highest position in the stats. Each Rack contains 84 G4 1.33 GHz - ITF can deliver up to an astonishing 33516 gigaflops of processing power!

:shocked:

[rsbriggs]

Makes me wonder what I put out here. A flop? A handful of flops? A floppy disk? :confused: ;)

Wonder if those guys know about DF ???

[Chinasaur]

You guys know it's humour right? The last paragraph is the kicker -


The german IFT (Institut für Tellerrandforschung) is using the cluster to research new optimized construction designs for traditional virtual instruments (TVI) like airguitars. well known is their april-theory and their attempts with anti-gravity socks (AGS).


:jester:

[IronBits]

:rotfl:

[rsbriggs]

I was kind of wondering why the team had like 40K nodes overall, rather than doing more like 40K per day.... Nice picture of some farm animals, though....

[Chinasaur]

Did the main stats at CB run last night? My totals didn't change on either stats site.

???

[Chinasaur]

ROFL

I have Two Top Ten slots...Linux and Mac OS X :thumbs:

http://www.chessbrain.net/stats-top-machines-graph.html

Hard to believe that that few people are running Linux on this project. Amazing.

Too bad teams don't show..be good advertising :)


:cheers:

[IronBits]

I've pulled the client from all boxen.
I made it to the top 8, close to Condor, now I need to get focused for the gauntlet.
It's been fun, hope I helped out in some small way :)
:cheers:

[Chinasaur]

IB,

Look at your production go up and tell us what the Chessbrain performance hit was. It's been about 10-20K for me I think over 5 cpu's.

[Beyond]

It's 15%-20% hit on Dnet. :(

[IronBits]

Originally posted by Chinasaur
IB,
Look at your production go up and tell us what the Chessbrain performance hit was. It's been about 10-20K for me I think over 5 cpu's. That's gonna be a tough call with DF ouput, the way it cycles fast/slow. Just keep an eye on my stats.
I was breaking into 1.8 mil per day, now it's down to 1.5 mil ...
If I remember right, you can watch how much CPU time it takes away from the DF client with task manager... it's about 1-2 hours a day x how many boxen.
It's not as passive as I thought it was gonna be... If you only have a few boxen, probably not a big deal, but if you have alot of boxen and are getting ready for a gauntlet, it all adds up quickly ;)

[magnav0x]

Good news:
*Rewrote the merge script and all appears to be ok. If you have other accounts that you need merged just give me the names and I'll merge them in with whatever you want.

*Fixed the issue where some Free-DC members where being assigned incorrect tID identifiers.


Bad news:
*I fixed some other things but I don't recall what they are :gone:
*There's no more good news




Hopefully after tonights stats update I won't need to make any more changes :dunno:

[magnav0x]

ezracing.net domain will be down for a bit, "routine er....yeah you know the drill" time :moon:

[magnav0x]

All problems seem to be rectifyed. Site is back up.

[Chinasaur]

:thumbs:

[cygnussphere]

Originally posted by IronBits
I've pulled the client from all boxen.
I made it to the top 8, close to Condor, now I need to get focused for the gauntlet.
It's been fun, hope I helped out in some small way :)
:cheers:

We would expect no less.... But after you and PCZ Fold your way to victory...
:whip: :D


:tempted:

:cheers:

[cygnussphere]

Originally posted by magnav0x
All problems seem to be rectifyed. Site is back up.

thanks for all the hard work magnav0x:thumbs:


:tempted:

:cheers:

[cygnussphere]

/bump

never though I would see a CB thread with 4 pages.:thumbs:

oh and while I have your attention please review THIS (http://www.free-dc.org/forum/showthread.php?s=&threadid=3958)

[Beyond]

ripped from the CB forum;

I found a problem in the stats generation code that was improperly totaling stats for some individuals. I’ve fixed the problem and now some users will see an increase in their stats. This will likely cause a headache for individuals who generate their own stats reports. If you’re such a person (Mack, and magnav0x are at least two!) then contact me and I’ll help answer questions and provide you with any assistance you need to adjust stats at your end.

The relative ranking of individuals and teams hasn’t changed much because the problem seems to have been rare.

- CJ

So it looks like a longggg climb to regain the #4 position

:(

[magnav0x]

I'm glad you pointed this out ot me Beyond. I was beginning to think there was a coding problem with my stats again when I saw todays numbers. At least the problem is fixed now and we don't have to worry about it again (hopefully). I'm going to email CJ tonight and see what the problem was.

[cygnussphere]

:whistle:

paranoid post removed.

Faith in CB stats restored

./me scurries off to reciently dug hole to take my meds and hide.

sorry.:blush:

:tempted:

:cheers:

[magnav0x]

Cyg i'll try to get a straight answer from CJ tonight.

[Beyond]

The really odd thing is that we moved (gained) very little if anything from this "adjustment", when everyone one else in the top 20 or so seems to have had a significant jump in thier stats. :scratch: :confused: :bang:


I don't think we were singled out :D but it is odd that we did not benefit to the degree the others.

[magnav0x]

Still no response from CJ :bang:

[cygnussphere]

:whistle:

paranoid post removed.

Faith in CB stats restored

./me scurries off to reciently dug hole to take my meds and hide.

sorry.:blush:

:tempted:

:cheers:

[Beyond]

"shades of Genome@Home come to mind" :(

[ECL]

"Brain" is not a word I'd associate with this project.

I've deleted this piece of garbage from my machine (of course the uninstaller doesn't work) and moved on. Life is too short to waste any more time on this turkey. There are worthwhile projects out there; this isn't one of them.

[magnav0x]

From CJ:



Yesterday evening I was trying to find the cause of a problem that was
reported by animal on behalf of gistech1978.
http://www.chessbrain.net/bbs/viewtopic.php?t=541

Gistech1978 was climbing steadily in the rankings until the 19th when
his stats slipped from 273 to 2. I've seen this problem before on
rare occasions with other members.

Before continuing let me first explain how stats are logged. While
the SuperNode server is running it records all PeerNode client
transactions in a memory hashmap. Every five minutes the contents of
the hashmap is flushed to a disk file. This approach is considerably
faster than a database access and has the advantage that the resulting
disk files can be easily scanned and ultimately imported into a
database. This was important when the SuperNode was running on our
old PIII-1GHz machine with only 256MB. Now that we're using a P4
3GHz sever with 768MB its clearly less of an issue! However we're
still in the process of making the transition to a new stats system.

With our current approach, stats data is recorded based on game
sessions. This allows us to see exactly what happens during a single
game. In fact this information is stored in a game database.

A problem arises when the hashmap is being flushed to disk and the
server crashes for some other reason. The SuperNode server is a
heavily multithreaded application and so any number of things may be
happening while stats are being flushed. So it's not the flushing
of stats that causes a crash - its any other thing that may happen
on the server. Keep in mind that this is all relatively rare. The
SuperNode is quite stable at this point.

During the past six months, the times when the server has crashed, the
stats file has been incompletely written. This is a problem because
the same file is used by the server when it restarts. When the
SuperNode restarts it loads an incomplete user list into memory. This
causes users who connect and are not in the hashmap to receive new
records.

IMPORTANT: This is a reset in their stats for that session only!

When the stat session file is later imported into the database there
is a discrepancy for the users that were affected (that is the users
data which was not written into the incomplete stats files).

This happened often during the start of stage two, and less often
over time. What I did was rebuild the database by scanning all prior
stat data files and compensating for when the server crashed by adding
the total stats for that session to the users last recorded data.

The data is real and represents actual recorded transactions - the
problem was entirely in the program that scans the stats files and
imports into the database! I fixed the program so that it correctly
tallies user stats and so some users

The important thing to keep in mind is that the stats generated for
each user is stored in files so we can recreate a database in any form
and track problems over the cause of a project phase.

So I realized that if I "fixed" the import problem all users
will get their fair share of corrections and so this was the honest
thing to do. However, there was no way to avoid the disappointment of
contributors who thought that they were a bit further along and
slipped when another competitor moved up the ranks because of the
correction. It's a difficult decision to make however; I felt that
it's best to choose honesty - no matter what the consequences.

I suspect that other (larger) DC projects would probably hide this
sort of thing for fear of losing contributors. So I wonder how
contributors really know when their stats results are real..?
Perhaps the answer is open source stats J certainly open source in
general. That was part of my reason for openly releasing stats2.txt,
stats3.txt and the new rtstats.txt - so that problems could be
quickly identified and the results open to public scrutiny.


I don't know if this is a good enough answer for you guys, but he has layed everything out in front of me and these stat changes look very legit to me. I know it doesn't seem "fair", but things like this can happen.

[rshepard]

Things are back to the way they were- This from CJ:


I found a problem in the code that auto-generates the stats related web pages. The stats display should be back to normal at this point. During the past two days the stats have visually fluctuated but the problem was only due to the display and not the logging (tracking) of actual stat data. Its what I get for making late night changes

Please report any discrepancies to me and I'll investigate the database if necessary.

- CJ

[rsbriggs]

1 TEAMANANDTECH 10624.962450
2 SWISSTEAM.NET 8408.483223
3 EXTREMEDC 6353.575556
4 FREE-DC 5477.563132
5 ZUSES_HIRN 5412.212998

[IronBits]

Are there any 3rd party stats out there for Free-DC.
:mouserun: :help:

[PCZ]

IB

What's wrong with these (http://mag.chessbrainstats.com/)

[IronBits]

Nothing, I just want more :D

[danzigrules]

Hello all

was wondering if anyone could tell me why magnavox's site only shows me with 1.66 total nodes and the main stat site has me at 22,497,171,452. I also have 4 pc's running and not the 3 that show up.

edit: guess I should say my nick too :bang: ziggy


and if Bok sees this 30 minutes ago I was on your stats, now I am gone :D


if it helps any I am on Team-TNT


Thanks for all the hard work you all put into these stats :notworthy

[Bok]

I think it's probably because the .txt files from the chessbrain site that magnav0x uses to generate his stats are not quite accurate.

I'm using the same ones and get big discrepancies as you can see here (http://stats.open-dc.org/cb)

I'm sure mag hits the same obstacles.

I'm presuming cjus has a DB which his stats are generated from which is accurate.

Bok :D

[magnav0x]

Bok is right. For some odd reason they can't keep the text files updated correctly. I talked to CJ a few weeks back and he is having problems with the company he is with right now. Real life problems come first over stats :thumbs:

[danzigrules]

ah ok,


Thanks for the super fast replies :D

[IronBits]

Originally posted by magnav0x
Bok is right. For some odd reason they can't keep the text files updated correctly. I talked to CJ a few weeks back and he is having problems with the company he is with right now. Real life problems come first over stats :thumbs: Do they need a new hosting site? I could possibly host it like chessbrain.dbestern.com if they need a new home!