Stats

[PCZ]

I just checked the stats and they show me as having returned 2 results in the last 6 hours.
This is not good since I uploaded at least ten times that.

Are the stats flaky ?

[magnav0x]

I think FAD is having issues with their stats right now. I know the CSV files I've been importing data from aren't anywhere near up to date. That might be the case with which ever stats you are looking at.

[Bok]

My one team only stats use the html to pull down the results and the experimental all team/all users using magnavox's data gathering can be found

http://stats.free-dc.org/new/projpage.php?proj=fad2

but as he says the data is a week or two old :(

The results are sometimes a few hours behind I think too, so check for the 2am GMT update. I've also added 8 or so clients today and will add maybe 10-15 more tonight, time depending.

Bok

[IronBits]

These look ok no?
http://woo.gotdns.com/FrameStats/index.htm

[Bok]

I guess they trawl all of the HTML pages... yuk!

Bok

[magnav0x]

I'm suprised they haven't got their IP banned. They will do that if you crawl all their HTML pages for stats.

[PCZ]

I just checked my server.log and found eighteen missing WU's.
noted the m numbers incase they ever appear in my stats.

Please no suggestions that i ask on the FAD forum, its not working

[Bok]

I'm confused too.

When I look at all the jobs I've uploaded in the past 2 days they are all

1qzy

but I've also (supposedly) uploaded quite a few

1rv1 & 1s8f jobs

Where are they going to ?????

Bok

[PCZ]

Bok
I have even more missing jobs now.

All my FAD clients connect to one server on my network and i can see from the server log which jobs have been returned.

At least one of the FAD servers is messed up, my bet is its the one the forum is running on.
Or more precisely not running on !!

We are probably screwed till january as no one seems to have fixed the server today they are probably on holiday.

[Bok]

Well, there is at least a new message on the website when you try to get to the forums, so perhaps there is hope of it being fixed sooner rather than later :)

Bok

[Fozzie]

Looks like US-D have passed BEOS so we have both those to RK.

Who knows where we are with no official stats site up.

:swear:

EDIT

It's back!!!!

Less tan 7.9 million GFLOPS to go, hit it hard guys we need some dumpage tomorrow.

[PCZ]

Fozzie

Those stats are wrong.
I have lots of WU's that have gone AWOL and so have many others.
Checking the last update shows even more missing WU's.

I will give it a little while longer before pulling the plug

[Fozzie]

Sometimes FaD is notoriously tardy about crediting WUs, I've seen it myself.

Appreciate the GHZ you've mobilised, among many others. :cheers:

[PY 222]

I am not producing as I should have.

Perhaps I am also losing workunits here and there. I can't be sure though.

Anyway, more GHz into the fire.

[PCZ]

Guess I will have to swap over some more boxes to make up for the AWOL WU's :D

[Helix_Von_Smelix]

will switch back over to other stuff on 25th, not much else to do:D

/'am sure the wife said something was happening then/

[Bok]

PCZ, have your WU's shown up??

I see a lot more of the 1rv1 & 1s8f jobs showing for me now.

Bok

[ronbo54]

I finally got 1 to show up :bang:

[PCZ]

Bok

Looks like they have all turned up :D

[PCZ]

Dont like these 6 hour stats updates much :(

[Vester]

The forums at Find-a-Drug are on phpBB 2.0.11 which was released at the end of November and is the latest revision. FaD's message board and the find-a-drug.org.uk server were down for almost 24 hours. That is the primary stats server as well. While the distributed servers do not miss your uploads, the consolidation of statistics was deleayed by the disruption of find-a-drug.org.uk .

Here is some history about the phpBB woes.

Net Worm Uses Google to Spread

Posted by michael (http://it.slashdot.org/it/04/12/21/2135235.shtml?tid=220&tid=217&tid=169) on Tuesday December 21, @05:15PM

from the web-service-takes-on-new-meaning dept.

troop23 writes "A web worm that identifies potential victims by searching Google is spreading among online bulletin boards using a vulnerable version of the program phpBB, security professionals said on Tuesday. Almost 40,000 sites may have already been infected. In an odd twist if you use Microsoft's Search engine to scan for the phrase 'NeverEverNoSanity'-- part of the defacement text that the Santy worm uses to replace files on infected Web sites--returns nearly 39,000 hits." Reader pmf sent in a few more information links: F-Secure weblog and Bugtraq posting. Update: 12/22 03:34 GMT by T: ZephyrXero links to this news.com article that says Google is now squashing requests generated by the worm.
Although FaD's forums were not breached, the web host's server was affected. Blame Texas. :)

[willy1]

It appears the FaD forum is down again :bang:

[PCZ]

Willy1

It is up again.
The forum appears to run on more than one server and when there is a problem they change the DNS record to point to a working server.

This DNS record has a TTL of 4 hours so it appears to be down a lot longer than it actually is.

My DNS server obeys the TTL and doesn't try to resolve the name until the TTL expires so the forum is down as far as i'm concerned.
Over the last few days the DNS records have changed quite a few times and my first instinct now when the forum is down is to clear the DNS record for the forum from my DNS server forcing it to resolve it again.

I wish they would lower the TTL a bit or get more reliable servers !!

[sharder8]

Originally posted by Bok
I guess they trawl all of the HTML pages... yuk!

Bok

WoO's stats are generated from the *.csv files and are used by many of the teams for stats tracking.

I'm surprised you didn't figure that out based on this comment: :rolleyes:
Originally posted by magnav0x
I'm suprised they haven't got their IP banned. They will do that if you crawl all their HTML pages for stats.

YUP, the BIG BOYS :confused: are waitin' for ya' ta' show up in force so we can play! :eek:
(BTW, TIMO isn't a team ya' wanna under estimate either. :p)

:moon:

:shocked:

Harder

[Bok]

I was j/k at the time. We knew that some of the mirrors weren't updating.

We also all use the woo stats at the moment, excellent as they are until our own have a few bugs fixed.....

Bok

[Bok]

I think I've sorted out the allteams/allusers stats for FAD now. I'll let them accumulate for a couple of days then make them live :)

btw as I only track 3 metrics I've chosen

points, molecules and jobs

is that what is preferred ? Or should I use hits instead of jobs/molecules ?

Bok

[CaptainMooseInc]

points = gflops right? That's the "official" score thingy now.

-Jeff

P.S. Can you fix my signature Bok when you get a chance? Thanks.

[rshepard]

Well, since you're asking, I'd rather see hits as opposed to jobs-- I know they are not used for rankings, but I think its an interesting stat. :cheers:

[Bok]

Originally posted by CaptainMooseInc
points = gflops right? That's the "official" score thingy now.

-Jeff

P.S. Can you fix my signature Bok when you get a chance? Thanks.

points = Gflops / 8

well, if the new ones are ok, I'll switch to using that DB instead, so hang fire on that one..


Originally posted by rshepard

Well, since you're asking, I'd rather see hits as opposed to jobs-- I know they are not used for rankings, but I think its an interesting stat.



It's a simple change :) Done!

[Bok]

Ok,

they will look a bit odd until another update and really until a couple of days, but here you go... fad3 will change to fad once live..

http://stats.free-dc.org/new/projpage.php?proj=fad3

Bok

[PY 222]

Thanks Bok for the wonderful stats.

[Bok]

You're welcome.

ack, looks like they fubared on the last update. It'll correct itself on moving into a new day, so I'll just leave it. I forgot about that bug (it's a problem with resetting a temp column) which is why I normally don't have them public until it's ran more than one day :)

Bok :cheers:

[FluffyChicken]

I would use hits or time as opposed to Jobs, as Jobs ~ the same measurment as molecules. (or use jobs and not molecules as it takes less space)

I still prefer Points as opposed to gflops.
Glops is only used in the stats pages. Points is used in the client itself.


But hey, this isn't my teams stats ;)

[IronBits]

Originally posted by FluffyChicken
But hey, this isn't my teams stats ;) :bonk: Are to!
Bok just makes em :smoking: , but, they belong to us :D
:moto:

[Bok]

OK, made a couple more bugfixes to the FAD stats.

1. It wasn't rolling over the date in my control table, thereby thinking every update was a new day :crazy:

2. I've finally given up and changed the key to be the name rather than the id behind it since this changes when you register a new cpu. Hopefully the names are unique (they appear to be)

I'll fix up the stats image attributes once the data rolls over another day and migrate it to the primary fad table rather than fad3.

Bok

[FluffyChicken]

The name is unique :)

If a user signs up with the same Nickname but a different email address then ;1 ;2 ;3 is appended to the Nickname keeping it unique (since all stats are merged on the email address/nickname)

[Bok]

:thumbs:

Bok :cheers:

[MerePeer]

Stats lookin good. Thanks!

[Bok]

As far as I can see I have one bug left in the stats..

It's manifesting as an update of 0 every time I check even if there are no changes. I know what it is caused by....

One user has a line in the csv file as such (makes it an invalid csv really!)

7002455,'WildGibbon P 2,6',2047,51,6,548,59,127,57,3098,8,781,1099289952,6554,-19

When I pull the data out I'm doing a split(/,/,$line) in perl

however this individual has a comma inside his name which causes it to go out.

Anyone have an elegant solution to this in perl ?

I guess I could change all commas to something else inside of the quotes somehow ahead of time, then change them back - not pretty though.

Anyone :) Where are DP and Dyy when I need them :p

Bok

[magnav0x]

Does perl not have a built in CSV parsing functions? In PHP it just trancates that user to WildGibbon.

[Bok]

Which is what mine does too, though it messes up my regexp,not particularly elegant though...

Perl does have a few modules for handling csv's Text::CSV I think, I'll maybe look into using them.

Looks like the woo.gotdns stats don't handle it either :(

Bok

[Bok]

This Text::xSV (http://perlmonks.thepen.com/65094.html) looks somewhat better

Trying it out :)

Bok

[Bok]

Nope,

doesn't handle it either :(

Bok

[magnav0x]

Now that I looked I see my PHP script skipped over that entry as well. It would probably be benificial to parse the entire text file first and look for comma's between ' ' and just strip them out.

[Bok]

I've stuck some regexp in to convert a comma when it is between quotes for now and then convert it back afterwards.

regexp courtesy of DP :) Still testing it

Of course it will fail if someone has the exact string I'm changing it to already in there name, but that's highly unlikely :moon:

Bok

[MerePeer]

Bok --

http://stats.free-dc.org/new/projpage.php?proj=fad

When I look at the "Top 10 teams" for "Today" in the 1/23 12:58 update, I see Free-DC having 1,004,993:

{Pasted}
2,484,579 Note this line has no name/unassigned?
TSC! Russia 1,628,263
XPC 1,122,644
FreeDC 1,004,993
Deep Thought 852,404

But when I click on Free-DC to look at the team members, the total for column "Today" at the bottom is
2,534,365.

Shouldn't these be equal?

{Pasted}
Totals 2,534,365 400,420 1,476,157 1,491,165 0 11,223,840 21,249,444 1,895,485,802 7,261,774 165,572,928

Signed,

The Auditor.

[willy1]

I think it's that 'oddity' that causes users to appear as new for some reason.

Redukt is showing with a today points score of about 1.5M - the difference you're seeing.

[Bok]

In a perfect world, yes....

but the teamstats.php page actually totals each of the individual (user) scores, the frontpage (and the allteams) takes the scores from a team table.

In this case redukt looks to have had his name changed (from redukt;1I guess) so the real team score didn't change by his score, but he is a new user in the database so it appears from the teamstats page that we gained 1.5M.

It's come up before, if I use the team table to show the totals on the teamstats page, they would be correct but the column wouldn't tally in this case, so there is no real solution. I guess I could show both ??

Bok (who missed his flight to Brazil today, due to a tire blowout on the way to the airport!!)


Originally posted by MerePeer
Bok --

http://stats.free-dc.org/new/projpage.php?proj=fad

When I look at the "Top 10 teams" for "Today" in the 1/23 12:58 update, I see Free-DC having 1,004,993:

{Pasted}
2,484,579 Note this line has no name/unassigned?
TSC! Russia 1,628,263
XPC 1,122,644
FreeDC 1,004,993
Deep Thought 852,404

But when I click on Free-DC to look at the team members, the total for column "Today" at the bottom is
2,534,365.

Shouldn't these be equal?

{Pasted}
Totals 2,534,365 400,420 1,476,157 1,491,165 0 11,223,840 21,249,444 1,895,485,802 7,261,774 165,572,928

Signed,

The Auditor.

[IronBits]

Originally posted by Bok
Bok (who missed his flight to Brazil today, due to a tire blowout on the way to the airport!!) :cry: :bang: :spank: You need :help: :bonk: :|punch|: :Pokes: :swear: :haddock:
That sux0rs Bok.

[Helix_Von_Smelix]

Originally posted by Bok
In a perfect world, yes....

...................................................

Bok (who missed his flight to Brazil today, due to a tire blowout on the way to the airport!!)

i take it the blow out was on your car, not some sexy chick's on the hard sholder:blush: :Pokes: BOK:blush: :Pokes:

[MerePeer]

re: stats
Don't change anything. It sounds like it will tie-out after things settle. Thx for explanation.

re: flight
How frustrating. At least it didn't cause an accident!

Looks like when you do arrive the temps will make up for this frigid wind...

Brazil Temps (http://www.wunderground.com/global/BZ.html)

[Bok]

It actually suits me, I get to spend another evening with my wife and kid and yes the blowout was on a tire :( The only 'chick' that came to my rescue was my wife who had to bring along the locking wheel nut which was sitting in the garage at home :blush:

Not cool having a blowout at 75mph though....I was running on the rim for a short time, luckily it's not damaged. $370 for two new tires installed.

Bok