pppla - your shiny new pproxy log analyser!

[alpha]

pppla - Perl proxyper log analyser

Now new and improved with OGR-26 and RC5-72 analysis.

v0.6 - too many changes to list. I had loads of help from Darkness Productions and the RC5-72 code is based on Lani's, so thanks to you guys. I still require the stub-length or diff-length (or whatever) constraints for the stubspaces if anyone can help with that. Any problems let me know.

The formatting gets a bit broken when you post output here, but this is a rough idea of the new layout:

OGR-26 output:

Overall OGR-26 PProxy stats based on 16 days:

Smallest: 3.66 Gnodes, submitted on 06/11/2008
Largest: 338.36 Gnodes, submitted on 11/11/2008
Average: 62.80 Gnodes
Total: 58,091 Gnodes
Rate: 3,631 Gnodes/day, 0.04 Gnodes/sec, 58 stubs/day

Best days:
6,612 Gnodes, on 10/11/2008
131 stubs, on 05/11/2008

Stubs done: 925 (0.00464% of project)

RC5-72 output:

Overall RC5-72 PProxy stats based on 25 days:

First block: 25/03/2007
Last block: 11/11/2008
Best day: 01/11/2008 with 864 blocks
Rate: 116 blocks/day, 5.76 Mkeys/sec

Keys done: 12,433,930,321,920
Blocks done: 2,895 (0.000000263% of project)

Give it a try and post your output. Your feedback is welcome!

[alpha]

v0.7 (http://www.free-dc.org/forum/attachment.php?attachmentid=1205&d=1228221051) - Fixed a bug with commas and made quite a lot of changes which will make adding new OGR or RC5 projects trivial. Also some other small miscellaneous changes.

[alpha]

v0.9 (http://www.free-dc.org/forum/attachment.php?attachmentid=1264&d=1253203292) - the RC5-72 stats are now more detailed and interesting. Also, the script is now aware of multi-block packets.


Overall RC5-72 PProxy stats based on 60 active days:

First block: 25/03/2007
Last block: 17/09/2009
Best day: 6,863 blocks, 341.16 Mkeys/sec, on 11/09/2009
Avg. rate: 1,200 blocks/day, 5.16 Tkeys/day, 59.67 Mkeys/sec

Keys done: 309.35 Tkeys
Blocks done: 72,025
Keyspace done: 0.000006551%"Tkeys" is trillion keys, I hope that's fairly obvious. All the stats specified in Tkeys are shown to two decimal places unless that stat exceeds one thousand trillion (one quadrillion). In which case, no decimal places will be shown.

[alpha]

v0.91 (http://www.free-dc.org/forum/attachment.php?attachmentid=1273&d=1272392923) - Quite an overhaul for the RC5-72 stats in this version.



The output has been redone to have dynamic alignment (which the OGR output already had).
"Tkeys" has been renamed to "Gkeys", because the former could be mistaken for terakeys, which is actually not the case. Now, "Gkeys" is more appropriate because it represents gigakeys, where 1 Gkeys = 1,000 Mkeys.
The totals section at the end of the output has been combined into one line, similar to the existing OGR layout.
Every time blocks is mentioned, the equivalent number of keys is now shown.
New line of output which describes the average blocksize. This is obviously only useful if you fetch blocks which are larger than 1*2^32 keys, but it won't break even if that isn't the case.


Overall RC5-72 PProxy stats based on 162 active days:

First block: 25/03/2007
Last block: 27/04/2010
Best day: 15,805 blocks (67.88 Gkeys), 785.67 Mkeys/sec, on 01/03/2010
Avg. rate: 5,859 bl/day (25.17 Gkeys), 291.27 Mkeys/sec
Avg. blocksize: 90*2^32 keys (0.387 Gkeys)

Totals: 949,228 blocks, 4,077 Gkeys (0.000086332% of keyspace)
Please post feedback and the output for your own pproxy!

[alpha]

v0.92 - I must not have had enough coffee yesterday. "Tkeys" was indeed correct because in the code I'm dividing by 10E12. That is the only change in this version except for some more cleanups (including something to prevent confusion over this issue in future).