PDA

View Full Version : Dnet stats server update



Bok
03-26-2004, 02:54 PM
If I'm right on the identity of the one VERY generous donation (and I'm pretty sure I am) I'd like to thank that person. You do a tremendous service to the community both by this and other donations made in the past. :cheers:

Bok

Cut and paste from the DNET site.

---------------------Begin-----------------------------


:: 25-Mar-2004 23:06 CST (Thursday) ::

Just to answer some questions... Apologies for the acronym overload...

The old statsbox (aka "blower" or "statsbox3") was a quad xeon 450mhz
with 2GB RAM and Dell Perc RAID. It had five SCSI disks configured in a
2xRAID1 3xRAID5 configuration.

The new statsbox has been ordered (as yet unnamed). It will be:

Dual Opteron 1.8GHz
4GB RAM
8X200GB SATA (Hotswap) on 3Ware 8506 RAID Controller
3U Case
No keyboard :)

The current plan is to split the 8 drives as:
2xRAID1 + Hot Spare
4xRAID10 + Hot Spare

We'll of course be staying with PostgreSQL and FreeBSD, although bumping
to FreeBSD 5.x for amd64 support.

I expect to get an ETA for delivery tomorrow (Friday 26-March UTC-6)


:: 24-Mar-2004 20:37 CST (Wednesday) ::

Thanks in part to user donations (including one VERY generous donation)
we're close to being able to order a new stats server. After some
internal debate on the best approach, the current plan is to pick up a
dual opteron box and load it with memory and drives. Traditionally,
statsbox has been i/o bound on disk and memory but not very demanding of
CPU. An Opteron solution sounds like a good target platform for what we
need.

I spent a lot of today borrowing a surrogate opteron box from Bovine to
validate that postgresql and freebsd 5.x are a viable platform. I've also
confirmed with Doug White and Vinor Kashyap that 3Ware support
in FreeBSD 5.x is stable and reliable.

We're also eager to move to a smaller sized case -- blower was in a
gigantic Dell 6400 series case which limited our options for alternative
colos if we ever decided to move servers around. I think we can stuff
everything we need into a 3U chassis.

I've got a price quote that seems agreeable and I hope to place the order
tomorrow. It's unlikely this will get us back online before next week,
though.

I'll post more as the ordering+building+deployment progresses...

Thanks again everyone for your patience and understanding.

Darkness Productions
03-26-2004, 04:01 PM
Sweet!

edorajh
03-26-2004, 04:33 PM
Yes, sweet indeed! :)

alpha
04-07-2004, 02:54 PM
I hope they get it sorted soon. The lack of stats is driving me crazy. It would've been cool if they had a backup box for stats or something, no stats is no fun.

the-mk
04-07-2004, 03:11 PM
Originally posted by alpha
I hope they get it sorted soon. The lack of stats is driving me crazy. It would've been cool if they had a backup box for stats or something, no stats is no fun.
what you say!

edorajh
04-07-2004, 04:48 PM
Yeah, same here.

Brucifer
04-07-2004, 06:53 PM
Bok, yes he is indeed a benevolent soul, and he has done this several times before too.

edorajh
04-08-2004, 02:10 AM
Well, there is a new entry in nugget's plan. New statsbox has arrived. Seems stats will be up really soon. :)

the-mk
04-08-2004, 02:47 AM
Nice little box :D

Some pics out of http://n0cgi.distributed.net/cgi/dnet-finger.cgi?user=nugget

http://www.slacker.com/photos/computers/open_and_closed
http://www.slacker.com/photos/computers/inside

:bouncy: :bouncy: Stats are coming back! :bouncy: :bouncy:

PY 222
04-12-2004, 03:37 AM
Dude... that box is a beast!

Wow.... whoever that donated that dough to buy that box is definitely on my good book. :thumbs:

the-mk
04-12-2004, 05:17 AM
http://n0cgi.distributed.net/cgi/dnet-finger.cgi?user=nugget

:: 11-Apr-2004 14:51 CDT (Sunday) ::

The new statsbox is built out and I've got the backup of the statsdb loaded
and audited. Apache and PHP are up and running and I've got our admin
scripts loaded and going.

I've done some preliminary tuning of PostgreSQL and I'm not seeing any
disk-based sort_memory used during the normal stats processing process.

Some timing comparisons between blower and the new box:

Sample run from blower's logs (45 minutes total):
00:49 (statsbox-iii/r72) Beginning daily processing routines
01:10 (statsbox-iii/r72) Daily processing for 20040121 has completed
01:10 (statsbox-iii/ogr) Beginning daily processing routines
01:34 (statsbox-iii/ogr) Daily processing for 20040121 has completed

On the new box (9 minutes total):
19:40 (statsbox-iv/r72) Beginning daily processing routines
19:46 (statsbox-iv/r72) Daily processing for 20040205 has completed
19:46 (statsbox-iv/ogr) Beginning daily processing routines
19:49 (statsbox-iv/ogr) Daily processing for 20040205 has completed

I'm seeing raw hourly log import times in the 20-30 second range. Overall
it's taking the new box ~32 minutes to import an entire day's worth of logs
for both projects combined.

This is giving us a total daily processing time of 41 minutes with log
saturation from the keymaster. At that rate, stats should be current
before too long.

Thanks again for your patience, everyone. We're plugging away at getting
this box up and available again.

edorajh
04-12-2004, 10:37 AM
Yes!

:bouncy: :elephant: :bouncy: :elephant: