Stats Coding

a week or so ago, I created 3 new tables

teamdata,userdata,hostdata

These are keyed by project name,date and id.

Nightly during the rollover, for each boinc project, I populate the tables.

For instance, lets take the userdata

I loop around all projects which are tagged as 'boinc'

foreach one I do

insert into userdata (select '$proj','$yesterday',id,metric1,projrank,teamrank) from $proj_user;


As you can imagine this is adding up to a lot of data...

After 10 days there is 919272 rows in teamdata, ~15M rows in userdata and ~33M rows in hostdata...