PDA

View Full Version : Perl log analyser for pproxy stats



alpha
01-07-2008, 11:40 AM
I've written a simple perl script to analyse your local pproxy log files and give you some stats like the largest and smallest stubs ever submitted to your pproxy.

READ THIS PARAGRAPH BEFORE USAGE. All you need to know is to put the attached script in the same directory as all your pproxy log files, and run it with "perl csvparse_totals.txt", or I guess you can chmod +x it and execute it like an executable. It has the txt extension due to forum upload restrictions, so feel free to rename to pl. I developed it on FreeBSD, but it should work on practically any system with Perl.

Here are my stats:


Overall PProxy stats based on 1258 days and 57531 stubs:

Smallest: 0.04 Gnodes, submitted on 14/12/2007
Largest: 891.53 Gnodes, submitted on 03/09/2007
Average: 38.61 Gnodes
Total: 2221394.73 GnodesI'm no perl guru, so the script is probably very inefficient and ugly. But it works! If anyone has any suggestions on how to make this better, or more informative, I'm all ears. Who doesn't love stats?

Oh, and I have a slightly different script which I have running on an hourly cron job. It analyses only the log file for today's date to give you some stats. I can make that available as well if anyone is interested.

Edit: updated thread title and attachment to new version.

Darkness Productions
01-07-2008, 01:51 PM
2 questions :)

1) Why does it need 'use Socket'? I don't see it doing anything with sockets.
2) Why use Text::CSV? Since it's just comma separated, and doesn't have any other weird formatting, just my @columns = split(/,/, $_);, and if $columns != 8, then print your error...

alpha
01-07-2008, 02:14 PM
1) Why does it need 'use Socket'? I don't see it doing anything with sockets.

Hmm. :blush: I often copy and paste code from previous work as a starting point for new work. Looks like something got left behind that shouldn't have.


2) Why use Text::CSV? Since it's just comma separated, and doesn't have any other weird formatting, just my @columns = split(/,/, $_);, and if $columns != 8, then print your error...I was just looking for an easy solution that would be quickest for me to do. I had forgotten about that dependency until I started this thread then realised how inconvenient it will be for others to have to install the module first. I'll take a look and see if I work without it.

Thanks for the feedback! :thumbs:

alpha
01-08-2008, 06:32 AM
OK, I've removed the use Socket line and the dependancy on Text::CSV as per DP's suggestions. The initial post in this thread has been updated with correct new info and the updated script attached.

Also:


perl csvparse_totals.pl 1.36s user 0.14s system 98% cpu 1.517 total
perl csvparse_totals.pl.bak 61.33s user 0.16s system 98% cpu 1:02.38 total


The new version is over 40 times faster. DP, you rock! :cheers:

alpha
01-16-2008, 01:53 PM
So... can anyone beat my pproxy's stats? Without scanning the rollin' thread, I seem to remember someone with a 0.01 Gnode stub and I know BlisteringSheep posted in the Ars TBR thread about a 1200+ Gnode stub.

I know several of you run pproxys, so step up and post your stats. :Pokes: :)

Bok
01-16-2008, 02:12 PM
My personal Proxy..

Overall PProxy stats based on 15 days and 33446 stubs:

Smallest: 0.08 Gnodes, submitted on 11/01/2008
Largest: 794.15 Gnodes, submitted on 16/01/2008
Average: 41.89 Gnodes
Total: 1401027.86 Gnodes

Free-DC Proxy

Overall PProxy stats based on 16 days and 240227 stubs:

Smallest: 0.02 Gnodes, submitted on 04/01/2008
Largest: 1024.03 Gnodes, submitted on 16/01/2008
Average: 55.23 Gnodes
Total: 13268826.16 Gnodes

Darkness Productions
01-16-2008, 02:22 PM
Mine:

This might take a while... please be patient.

Overall PProxy stats based on 219 days and 64016 stubs:

Smallest: 0.03 Gnodes, submitted on 14/08/2007
Largest: 721.61 Gnodes, submitted on 16/01/2008
Average: 30.71 Gnodes
Total: 1966090.72 Gnodes
Gnodes/s: 0.10

PCZ
01-16-2008, 02:51 PM
D:\ogrproxy>csvparse.pl
This might take a while... please be patient.

Overall PProxy stats based on 15 days and 36489 stubs:

Smallest: 0.15 Gnodes, submitted on 04/01/2008
Largest: 818.40 Gnodes, submitted on 13/01/2008
Average: 41.49 Gnodes
Total: 1513977.44 Gnodes

D:\ogrproxy>

IronBits
01-21-2008, 12:40 PM
Thanks alpha! :thumbs:

Overall PProxy stats based on 50 days and 57364 stubs:

Smallest: 0.12 Gnodes, submitted on 29/11/2007
Largest: 963.53 Gnodes, submitted on 28/11/2007
Average: 71.44 Gnodes
Total: 4098220.79 Gnodes

IronBits
01-21-2008, 12:46 PM
This runs very fast to. :)
Here is my last 8 days not included in the above report.

Overall PProxy stats based on 8 days and 5490 stubs:

Smallest: 2.44 Gnodes, submitted on 21/01/2008
Largest: 1024.03 Gnodes, submitted on 16/01/2008
Average: 204.67 Gnodes
Total: 1123628.06 Gnodes

I suspected we were processing much larger Gnodes now.

alpha
01-21-2008, 01:04 PM
Interesting stats... looks like IB's huge stub is the largest one to pass through the Free-DC PProxy this year.

Hey Bok, any chance of running it for the 2007 (and/or prior) logs?

IronBits
04-26-2008, 02:01 PM
Overall PProxy stats based on 144 days and 166752 stubs:

Smallest: 0.12 Gnodes, submitted on 11/29/2007
Largest: 1024.03 Gnodes, submitted on 01/16/2008
Average: 128.15 Gnodes
Total: 21368700.51 Gnodes

alpha
06-13-2008, 03:14 PM
New largest stub for me, chewed up by one of the CPUs in a dual P3 933.

Overall PProxy stats based on 1416 days and 65623 stubs:

Smallest: 0.04 Gnodes, submitted on 14/12/2007
Largest: 907.98 Gnodes, submitted on 12/06/2008
Average: 49.34 Gnodes
Total: 3238088.03 Gnodes

alpha
07-31-2008, 09:14 AM
Working on this script again to add an exciting new feature! :) I'm adding a breakdown of how much work from each stubspace your pproxy has completed (maybe as a percentage of the size of the total stubspace). It's more complicated that you would initially think, but doable.

I was surprised to see that perl has no built-in switch statement but I think I found a workaround.

Also, I found a bug in the old script where it can sometimes include some OGR-24 stubs. The developments I mentioned above include the code to fix this though.

yoyo
08-01-2008, 05:18 PM
Working on this script again to add an exciting new feature! :) I'm adding a breakdown of how much work from each stubspace your pproxy has completed (maybe as a percentage of the size of the total stubspace). It's more complicated that you would initially think, but doable.

I was surprised to see that perl has no built-in switch statement but I think I found a workaround.

Also, I found a bug in the old script where it can sometimes include some OGR-24 stubs. The developments I mentioned above include the code to fix this though.

Hello,
where can I download the script? Would try it on my log.
yoyo

Bok
08-01-2008, 05:22 PM
It's attached to the first post in this thread... :)

yoyo
08-02-2008, 05:12 PM
This might take a while... please be patient.

Overall PProxy stats based on 63 days and 546281 stubs:

Smallest: 0.18 Gnodes, submitted on 30/06/2008
Largest: 1942.40 Gnodes, submitted on 10/07/2008
Average: 154.90 Gnodes
Total: 84618957.34 Gnodes

Bok
08-02-2008, 05:24 PM
Nice...

About time I ran it on the Free-DC proxy again and you reminded me...

This might take a while... please be patient.

Overall PProxy stats based on 215 days and 2476937 stubs:

Smallest: 0.01 Gnodes, submitted on 03/02/2008
Largest: 2821.39 Gnodes, submitted on 17/02/2008
Average: 110.42 Gnodes
Total: 273509517.37 Gnodes


Bok

alpha
08-04-2008, 08:09 AM
OK, here we go with v0.3 of the script (attached to this post). The fix for OGR-24 stubs being included is there. Also, I'm parsing out any Phase 1 OGR-25 stubs (though they were probably never included before). The stubspace breakdown is in, and here is how it looks:

This might take a while... please be patient.

Overall OGRp2-25 PProxy stats based on 1468 days and 66244 stubs:

Smallest: 0.04 Gnodes, submitted on 14/12/2007
Largest: 907.98 Gnodes, submitted on 12/06/2008
Average: 51.63 Gnodes
Total: 3419850.19 Gnodes

Stubspace 1 stubs crunched: 5580
Stubspace 2 stubs crunched: 10677
Stubspace 3 stubs crunched: 9713
Stubspace 4 stubs crunched: 21336
Stubspace 5 stubs crunched: 6710
Stubspace 6 stubs crunched: 10768
Stubspace 7 stubs crunched: 931
Stubspace 8 stubs crunched: 511
Stubspace 9 stubs crunched: 18
I decided not to include the % of total stubspace for each of those lines, because it looked very messy. If anyone can think of a better way to lay all that information out, I'm open to ideas, because the data is all there and easy to get.

BTW, nice stats yoyo and Bok, those largest stubs are HUGE! :eek:

Bok
08-04-2008, 10:47 AM
Updated run on new version..

[root@quad dnetproxy]# ./csvv3.pl
This might take a while... please be patient.

Overall OGRp2-25 PProxy stats based on 217 days and 2481342 stubs:

Smallest: 0.01 Gnodes, submitted on 03/02/2008
Largest: 2821.39 Gnodes, submitted on 17/02/2008
Average: 110.51 Gnodes
Total: 274212967.73 Gnodes

Stubspace 2 stubs crunched: 34
Stubspace 3 stubs crunched: 259
Stubspace 4 stubs crunched: 2901
Stubspace 5 stubs crunched: 31328
Stubspace 6 stubs crunched: 1824749
Stubspace 7 stubs crunched: 506066
Stubspace 8 stubs crunched: 113895
Stubspace 9 stubs crunched: 2110

yoyo
08-04-2008, 03:40 PM
Thanks for the updated script:

Overall OGRp2-25 PProxy stats based on 65 days and 568128 stubs:

Smallest: 0.09 Gnodes, submitted on 03/08/2008
Largest: 1942.40 Gnodes, submitted on 10/07/2008
Average: 154.83 Gnodes
Total: 87961299.77 Gnodes

Stubspace 6 stubs crunched: 567018
Stubspace 7 stubs crunched: 1110

alpha
08-08-2008, 05:34 AM
v0.4: Just cosmetic changes. Large numbers are now split by commas. Total stubs complete is shown in a different place and as a percentage of the entire project. Crunch rate as average Gnodes per day. Other small bits.

This might take a while... please be patient.

Overall OGRp2-25 PProxy stats based on 1,472 days:

Smallest: 0.04 Gnodes, submitted on 14/12/2007
Largest: 907.98 Gnodes, submitted on 12/06/2008
Average: 51.79 Gnodes
Total: 3,432,439.57 Gnodes
Rate: 2,331.82 Gnodes/day

Stubspace 1 stubs: 5,580
Stubspace 2 stubs: 10,677
Stubspace 3 stubs: 9,713
Stubspace 4 stubs: 21,336
Stubspace 5 stubs: 6,710
Stubspace 6 stubs: 10,805
Stubspace 7 stubs: 931
Stubspace 8 stubs: 511
Stubspace 9 stubs: 18

Total stubs crunched: 66,281 (0.01087% of project)edit: quick last minute change

Darkness Productions
08-08-2008, 01:04 PM
This might take a while... please be patient.

Overall OGRp2-25 PProxy stats based on 380 days:

Smallest: 0.03 Gnodes, submitted on 14/08/2007
Largest: 1,036.68 Gnodes, submitted on 14/06/2008
Average: 77.07 Gnodes
Total: 8,013,880.19 Gnodes
Rate: 21,089.16 Gnodes/day

Stubspace 1 stubs: 8,743
Stubspace 2 stubs: 1,302
Stubspace 3 stubs: 909
Stubspace 4 stubs: 18,182
Stubspace 5 stubs: 31,939
Stubspace 6 stubs: 39,499
Stubspace 7 stubs: 1,395
Stubspace 8 stubs: 1,951
Stubspace 9 stubs: 68

Total stubs crunched: 103,988 (0.01706% of project)

yoyo
08-08-2008, 04:21 PM
This might take a while... please be patient.

Overall OGRp2-25 PProxy stats based on 69 days:

Smallest: 0.09 Gnodes, submitted on 03/08/2008
Largest: 1,942.40 Gnodes, submitted on 10/07/2008
Average: 156.10 Gnodes
Total: 94,380,064.95 Gnodes
Rate: 1,367,827.03 Gnodes/day

Stubspace 6 stubs: 603,486
Stubspace 7 stubs: 1,110

Total stubs crunched: 604,596 (0.09916% of project)


Thanks for the update of the script. I make now daily updates here (http://www.rechenkraft.net/yoyo/download/download/stats/).

yoyo

Bok
08-13-2008, 11:29 AM
Latest run

[root@quad dnetproxy]# ./csv4.pl
This might take a while... please be patient.

Overall OGRp2-25 PProxy stats based on 226 days:

Smallest: 0.01 Gnodes, submitted on 03/02/2008
Largest: 2,821.39 Gnodes, submitted on 17/02/2008
Average: 110.50 Gnodes
Total: 283,235,423.53 Gnodes
Rate: 1,253,254.09 Gnodes/day

Stubspace 2 stubs: 34
Stubspace 3 stubs: 259
Stubspace 4 stubs: 2,901
Stubspace 5 stubs: 31,328
Stubspace 6 stubs: 1,876,495
Stubspace 7 stubs: 536,277
Stubspace 8 stubs: 113,897
Stubspace 9 stubs: 2,111

Total stubs crunched: 2,563,302 (0.42041% of project)

We need to get this run on DPC's proxy :)

[NGS]Cpt00Kirk
08-14-2008, 06:18 AM
We need to get this run on DPC's proxy

I have posted this tread in our DPC OGR forum so lets see if people will post stats!

Lets see if we can beat your scores :thumbs:

AND THE FIRST EDIT BY DPC AT THE PROG!! .... WE CHANGED THE NUMBERS BEHIND THE DOT ( see smallest ) :)

These numbers are from : x-RaY99 the one-man 'bucket'


Overall OGRp2-25 PProxy stats based on 452 days:

Smallest: 0.0032 Gnodes, submitted on 02/07/2007
Largest: 1,073.2944 Gnodes, submitted on 26/07/2007
Average: 62.11 Gnodes
Total: 155,858,692.43 Gnodes
Rate: 344,820.12 Gnodes/day

Stubspace 3 stubs: 768
Stubspace 4 stubs: 550,191
Stubspace 5 stubs: 726,531
Stubspace 6 stubs: 1,029,808
Stubspace 7 stubs: 189,447
Stubspace 8 stubs: 11,847
Stubspace 9 stubs: 951

Total stubs crunched: 2,509,543 (0.41159% of project)


These numbers are from : Reneger from Subteam Fryslân MP

Overall OGRp2-25 PProxy stats based on 494 days:

Smallest: 0.00932 Gnodes, submitted on 25/05/2007
Largest: 1,016.22 Gnodes, submitted on 15/06/2008
Average: 48.30 Gnodes
Total: 8,007,301.42 Gnodes
Rate: 16,209.11 Gnodes/day

Stubspace 2 stubs: 37
Stubspace 3 stubs: 6,015
Stubspace 4 stubs: 58,625
Stubspace 5 stubs: 68,796
Stubspace 6 stubs: 30,115
Stubspace 7 stubs: 2,175
Stubspace 8 stubs: 36

Total stubs crunched: 165,799 (0.02719% of project)

Bok
08-14-2008, 08:17 AM
Thanks.

Nice numbers :)

Keep them coming!

alpha
08-14-2008, 08:32 AM
Yeah, impressive stuff. :)

Thanks for the suggestion too, I forgot about uber-small stubs requiring more decimal places to be shown. I've made the change in my local version so if I ever release another version it will be in there.

Any more suggestions? Anything anyone else would like to see whilst the project is still going? There is so much data that practically anything is possible. For instance, play0r over at Ars modified the script to generate a HTML table with a breakdown per user (http://cybertron.backslider.net:8081/ogrp2stats/bugjuice.html) (source available).

[NGS]Cpt00Kirk
08-14-2008, 09:07 AM
And we have also a winner with the largest stub!!

These numbers are from : Subteam Division Brabant


Overall OGRp2-25 PProxy stats based on 840 days:


Smallest: 0.01 Gnodes, submitted on // Use of uninitialized value in concatenation (.) or string at csvparse_totals_v0.4.txt line 128.
Largest: 3,565.48 Gnodes, submitted on // Use of uninitialized value in concatenation (.) or string at csvparse_totals_v0.4.txt line 130.
Average: 48.96 Gnodes
Total: 40,016,271.45 Gnodes
Rate: 47,638.42 Gnodes/day

Stubspace 1 stubs: 23,557
Stubspace 2 stubs: 127,717
Stubspace 3 stubs: 149,553
Stubspace 4 stubs: 126,664
Stubspace 5 stubs: 137,139
Stubspace 6 stubs: 195,020
Stubspace 7 stubs: 54,447
Stubspace 8 stubs: 3,262
Stubspace 9 stubs: 36

Total stubs crunched: 817,395 (0.13406% of project)

don't know what the error with the date is?

Bok
08-14-2008, 09:08 AM
I think the per-user is a decent idea..

alpha
08-14-2008, 09:52 AM
Wow, that stub is giant. :)


Cpt00Kirk;125744']don't know what the error with the date is?
The dates are based on the filename of the log files. The only reason I can think for this to happen is if the logs have been renamed, or are not in the standard format of pproxyogrp2YYYYMMDD.log

The script checks for at least one valid filename, so I would say that the user has a mixture of standard and non-standard log filenames. Perhaps you could get them to investigate and let me know? Thanks.

edit: Just to clarify, the problematic logs must have passed the initial check, so they will be at least be called pproxyogrp2*.log, it is just that the script is having trouble splitting the asterisked part down into the constituent year, month and day.

[NGS]Cpt00Kirk
08-14-2008, 11:35 AM
These numbers are from : The User SandStar


Overall OGRp2-25 PProxy stats based on 380 days:

Smallest: 0.01 Gnodes, submitted on 02/07/2007
Largest: 1,177.07 Gnodes, submitted on 24/11/2007
Average: 47.19 Gnodes
Total: 26,955,069.90 Gnodes
Rate: 70,934.39 Gnodes/day

Stubspace 2 stubs: 115
Stubspace 3 stubs: 553
Stubspace 4 stubs: 188,049
Stubspace 5 stubs: 253,208
Stubspace 6 stubs: 122,979
Stubspace 7 stubs: 6,348

Total stubs crunched: 571,252 (0.09369% of project)

And the Score from the Noizy Cows ( with Axe-Action ) will be here soon. :rock:

ColdFusion
08-14-2008, 01:34 PM
From the Team ColdFusion (DPC) main proxy, since the beginning of P2 in May 2004 :)

Overall OGRp2-25 PProxy stats based on 1,542 days:

Smallest: 0.0045 Gnodes, submitted on 17/09/2007
Largest: 3,208.91 Gnodes, submitted on 29/09/2007
Average: 45.18 Gnodes
Total: 245,513,265.64 Gnodes
Rate: 159,217.42 Gnodes/day

Stubspace 1 stubs: 650,496
Stubspace 2 stubs: 813,124
Stubspace 3 stubs: 790,024
Stubspace 4 stubs: 1,195,997
Stubspace 5 stubs: 1,037,423
Stubspace 6 stubs: 859,060
Stubspace 7 stubs: 80,842
Stubspace 8 stubs: 4,824
Stubspace 9 stubs: 1,994

Total stubs crunched: 5,433,784 (0.89120% of project)

[NGS]Cpt00Kirk
08-14-2008, 05:30 PM
And the numbers from the Noizy Cows!! :rock::rock:


Overall OGRp2-25 PProxy stats based on 1,432 days:

Smallest: 0.0014 Gnodes, submitted on 01/12/2007
Largest: 1,224.1086 Gnodes, submitted on 09/01/2008
Average: 103.06 Gnodes
Total: 1,784,827,558.41 Gnodes
Rate: 1,246,387.96 Gnodes/day

Stubspace 1 stubs: 170,804
Stubspace 2 stubs: 252,982
Stubspace 3 stubs: 1,033,142
Stubspace 4 stubs: 1,295,152
Stubspace 5 stubs: 663,495
Stubspace 6 stubs: 11,117,688
Stubspace 7 stubs: 2,492,456
Stubspace 8 stubs: 291,685
Stubspace 9 stubs: 960

Total stubs crunched: 17,318,364 (2.84040% of project)

Bok
08-14-2008, 05:40 PM
That's a LOT of stubs crunched!!!

Odd that the largest isn't particularly big.

[NGS]Cpt00Kirk
08-15-2008, 03:29 AM
Okay .... lets see what we have!

the Smallest : 0.0014 Gnodes, submitted on 01/12/2007 by Noizy Cows
the Largest : 3,565.48 Gnodes, submitted on // by Division Brabant

correct me if im wrong :thumbs:

alpha
08-19-2008, 09:16 AM
Yup, that looks right Cpt00Kirk.

I've stolen Lani's idea for a "best day" stat:

This might take a while... please be patient.

Overall OGRp2-25 PProxy stats based on 1,483 days:

Smallest: 0.0416 Gnodes, submitted on 14/12/2007
Largest: 907.98 Gnodes, submitted on 12/06/2008
Average: 52.72 Gnodes
Total: 3,517,608 Gnodes
Rate: 2,372 Gnodes/day

Best day: 68,769 Gnodes, on 29/10/2007

Stubspace 1 stubs: 5,580
Stubspace 2 stubs: 10,677
Stubspace 3 stubs: 9,713
Stubspace 4 stubs: 21,336
Stubspace 5 stubs: 6,710
Stubspace 6 stubs: 11,246
Stubspace 7 stubs: 931
Stubspace 8 stubs: 511
Stubspace 9 stubs: 18

Total stubs crunched: 66,722 (0.01094% of project)

Also some other tiny changes but I'm not quite ready to release this version yet.

clzupp
09-16-2008, 05:36 AM
Cpt00Kirk;125795']Okay .... lets see what we have!

the Smallest : 0.0014 Gnodes, submitted on 01/12/2007 by Noizy Cows
the Largest : 3,565.48 Gnodes, submitted on // by Division Brabant

correct me if im wrong :thumbs:

hi,

from yoyo (http://www.rechenkraft.net/yoyo/download/download/stats/) a
BIG one...

Largest: 5,097.61 Gnodes, submitted on 02/09/2008

@alpha: will be version 0.4 of your script the last one?

bye, uwe

Bok
09-16-2008, 12:19 PM
That one is pretty big...

I don't think alpha was going to make any more changes, what did you have in mind ?

I made a few minor alterations myself as I wanted to see the average stubsize per day.

Script gives the full output but this is just showing the averages..

Sep 01 Average: 12.72 Gnodes
Sep 02 Average: 80.38 Gnodes
Sep 03 Average: 40.34 Gnodes
Sep 04 Average: 58.79 Gnodes
Sep 05 Average: 63.03 Gnodes
Sep 06 Average: 58.18 Gnodes
Sep 07 Average: 80.97 Gnodes
Sep 08 Average: 71.41 Gnodes
Sep 09 Average: 68.61 Gnodes
Sep 10 Average: 79.61 Gnodes
Sep 11 Average: 61.58 Gnodes
Sep 12 Average: 59.78 Gnodes
Sep 13 Average: 63.32 Gnodes
Sep 14 Average: 59.05 Gnodes
Sep 15 Average: 75.68 Gnodes (so far)

alpha
09-17-2008, 09:32 AM
I have got a new version but it isn't all that different. The best day stat is introduced (as previously mentioned) in two forms: greatest number of stubs and greatest number of Gnodes. A few small bits and pieces. I've attached it as v0.5 to this post, let me know if there are any problems.

This might take a while... please be patient.

Overall OGRp2-25 PProxy stats based on 1,509 days:

Smallest: 0.0416 Gnodes, submitted on 14/12/2007
Largest: 907.98 Gnodes, submitted on 12/06/2008
Average: 53.43 Gnodes
Total: 3,669,349 Gnodes
Rate: 2,432 Gnodes/day

Best days:
68,769 Gnodes, on 29/10/2007
846 stubs, on 04/05/2007

Stubspace 1 stubs: 5,580
Stubspace 2 stubs: 10,682
Stubspace 3 stubs: 9,713
Stubspace 4 stubs: 21,336
Stubspace 5 stubs: 6,711
Stubspace 6 stubs: 11,526
Stubspace 7 stubs: 2,207
Stubspace 8 stubs: 890
Stubspace 9 stubs: 30

Total stubs crunched: 68,675 (0.01126% of project)

the-mk
09-17-2008, 04:52 PM
I wish I had a personal proxy so I could use your script :D
but I think it is not worth it installing one for the last few weeks of OGR...

Bok
09-30-2008, 08:37 PM
WTF...

[root@quad dnetproxy]# ./csv5.pl 20080930
This might take a while... please be patient.

Overall OGRp2-25 PProxy stats based on 1 days:

Smallest: 0.21 Gnodes, submitted on 30/09/2008
Largest: 972.41 Gnodes, submitted on 30/09/2008
Average: 54.45 Gnodes
Total: 1,135,757.54 Gnodes
Rate: 1,135,757.54 Gnodes/day

Stubspace 1 stubs: 1
Stubspace 2 stubs: 6
Stubspace 6 stubs: 1,248
Stubspace 7 stubs: 18,171
Stubspace 8 stubs: 1,429
Stubspace 9 stubs: 2

Total stubs crunched: 20,857 (0.00342% of project)

alpha
10-01-2008, 03:02 AM
Hehe.. that's me again:

Overall OGRp2-25 PProxy stats for 30/09/2008:

Smallest: 0.94 Gnodes by 192.168.2.6
Largest: 156.68 Gnodes by 192.168.2.1
Average: 44.76 Gnodes
Total: 7117.57 Gnodes

Stubspace 1 stubs: 1
Stubspace 2 stubs: 6
Stubspace 6 stubs: 4
Stubspace 7 stubs: 148

Those are my stats for yesterday. I still don't understand why I'm getting those weird stubs all of a sudden, and it only seems to be me. As long as I keep getting credit for them I'm not going to complain though. I may post over at Ars and see if TheJet can shed any light on it.

alpha
10-26-2008, 01:46 PM
The good news is that my script will be incredibly trivial to adapt for OGR-NG. All I need to know is how many stubs there are (and if we're still only doing one level of verification) and a breakdown of stubspaces.

I'll wait for the official stats to come online and see what info they provide before trying to contact someone for the gory details.

Also, I'm tempted to adapt the script to support RC5-72 stats as well, where the user can choose which to print based on a command line option.

Lani
10-27-2008, 02:46 PM
just feel free to use the rc5-72 script. i'm currently digging in the ppstats. :smoking:

Death
11-09-2008, 05:35 PM
so what's the progress?

Data shown reflects all blocks received as of 08-Nov-2008 at 23:59 UTC. Current time is 09-Nov-2008 21:34:48.

Status Overview
Total Stubs: 9,967,533

and it looks like there will be no phase2.

alpha
11-09-2008, 05:52 PM
Yeah, no phase 2 this time. :)

The script is ready, I just don't have the details of how the stubspaces are split (either diff length, or stub-length or whatever). Neither TheJet or ertyu could help me with that, nor did anyone else have any ideas in the official IRC channel. Maybe someone else has some ideas? I don't see why it's so difficult, the constraints are obviously known by someone for this page (http://stats.distributed.net/project/ogr_status.php?project_id=26) to have been created.

If no-one cares about a stubspace breakdown I can just post the script now, but I'd actually like it myself.

The new script version is fully RC5-72 and OGR-26 compatible and it's such a step forward that I've named the new script "pppla" - Perl proxyper log analyser. It's quite a jump from the previous versions and much more polished.

alpha
11-11-2008, 04:28 PM
The new script can be found here (http://www.free-dc.org/forum/showthread.php?t=16742). Give it a try!