Perl log analyser for pproxy stats RC5-72 style

[Lani]

dear all,

i just modified alpha's ogr25 log parser for use with rc5-72 log files. It is written in perl.

READ THIS PARAGRAPH BEFORE USAGE. All you need to know is to put the attached script in the same directory as all your pproxy log files, and run it with "perl csvparse_totals_v0.21_rc572.txt"

Goal was to see how much units were processed by a certain blockprefix --> see detailed substats

Here is a basic output from the script:



Overall RC5-72 PProxy stats based on 3 days and 87032 blocks:

First block submitted on: 09/08/2008
Last block submitted on: 12/08/2008
Best day on: 09/08/2008 with 87000 blocks

Average: 29,010.67 blocks/day
Rate: 1,442,128.06 kkeys/day

Total: 0.0000079155 % Keyspace exhausted

detailed substats:

Subspace: 53 - 0.00000002 % done - Blocks : 1 finished
Subspace: AA - 0.00000002 % done - Blocks : 1 finished
Subspace: CA - 0.00162104 % done - Blocks : 69623 finished
Subspace: DA - 0.00040529 % done - Blocks : 17407 finished



Feel free to add your comments or make any suggestions for improvements. BUT My perl skill are very limited. Basicly i just started a couple of hours ago. I'm going on vacation tomorrow so this will be the last update for the next two weeks.

[alpha]

Typo "finsihed" should be "finished".

Other than that, great job! :thumbs:

edit: welcome to the forums!

[alpha]

Anyone gonna run Lani's script and post the output? I'm interested to see some numbers.

Where's IB when you need him..? :looney:

[IronBits]

What do you need me for?

perl csvparse_totals_v0.30_rc572.pl
This might take a while... please be patient.

Overall RC5-72 PProxy stats based on 201 days and 1726950 blocks:

First block submitted on: 24/11/2007
Last block submitted on: 20/06/2008
Best day on: 25/05/2008 with 34074 blocks

Average: 8,591.79 blocks/day
Rate: 427,100.25 kkeys/day

Total: 0.0001570652 % Keyspace exhausted

detailed substats:

Subspace: 53 - 0.00005460 % done - Blocks : 2345 finished
Subspace: CB - 0.04015409 % done - Blocks : 1724605 finished

[alpha]

Nice. :thumbs:

[Lani]

As the year fade away i spent some more time on improving the script :santa:

holy snow, here are the improvments

- better format of the output
- ready for the use of bigger blocksizes (CUDA sizes :D )
- detailed stats on blocksizes

Here we go ;)

*quote dislikes formating, don't be afraid it looks better if you try it :smoking:




This might take a while... please be patient.

Overall RC5-72 PProxy stats based on 8 days and 38680 blocks:

First block submitted on: 10/02/2009
Last block submitted on: 17/02/2009
Best day on: 17/02/2009 with 9105 blocks

Average: 4,835.00 blocks/day
Rate: 240,349.15 kkeys/day

Total: 0.0000035179 % Keyspace exhausted

detailed substats:

Subspace: 53 - 0.00018815 % done - Blocks : 8081 finished
Subspace: CB - 0.00071244 % done - Blocks : 30599 finished


detailed blocksize overview:

paketsize: 1 - 8091 times - 8091 blocks
paketsize: 2 - 7 times - 14 blocks
paketsize: 3 - 10 times - 30 blocks
paketsize: 4 - 9 times - 36 blocks
paketsize: 5 - 7 times - 35 blocks
paketsize: 6 - 9 times - 54 blocks
paketsize: 7 - 10 times - 70 blocks
paketsize: 8 - 14 times - 112 blocks
paketsize: 9 - 14 times - 126 blocks
paketsize: 10 - 11 times - 110 blocks
paketsize: 11 - 7 times - 77 blocks
paketsize: 12 - 12 times - 144 blocks
paketsize: 13 - 20 times - 260 blocks
paketsize: 14 - 11 times - 154 blocks
paketsize: 15 - 6 times - 90 blocks
paketsize: 16 - 1822 times - 29152 blocks
paketsize: 62 - 1 times - 62 blocks
paketsize: 63 - 1 times - 63 blocks


v0.42 fixed bugs thx Alpha

[alpha]

Change the line in question to:


$blockspace[$block_tmp] += $columns[4];

..and the warnings go away.

A couple of other things:



There are 255 "subspaces" so eventually the output of the script is going to get very long.
Your script is skipping the "00" subspace, so you need to change the starting value of $i in the for loop on line 105.


Good work! :rock:

[Lani]

looking into $args later tomorrow.

gonna make these detailed stats optional :thumbs: