Results 1 to 4 of 4

Thread: Update on new DB server

  1. #1
    Administrator Bok's Avatar
    Join Date
    Oct 2003
    Location
    Wake Forest, North Carolina, United States
    Posts
    22,233
    Blog Entries
    13

    Update on new DB server

    I know it's been a while, so wanted to give an update on this.

    Server is up and running with Centos8 installed, latest version of mariadb and I've tweaked the DB settings as much as I can to try and keep the database in memory (without using the ENGINE=MEMORY fully - too much of a change).

    I spent about a month tweaking some of my scripts to try and streamline some operations with varying successes. I would like to do some more radical changes but I'm also cognizant about getting this online, not least the fact that it's sitting on a coffee table in my front room with a 50 ft ethernet cable attached stretching to a router!

    Now to the fails. These are the storage entries

    Click image for larger version. 

Name:	drives.jpg 
Views:	17 
Size:	140.9 KB 
ID:	1395

    I have 2 Intel SSD's as the primary O/S drives, these are pretty solid and no issues. They are enterprise grade drives I had already as backups for the current server.

    There are also 4 nvme m.2 drives in the system as the database drives.

    1xSamsung 950
    1xSamsung 960
    2xIntel P660's

    1 is using a connector on the board while the other 3 are in adaptor cards on the PCI lanes

    One of the intel's is just not stable. If I leave the stats running , then about 24hours in it crashes - always the same drive. It's under warranty as I just bought these in June/July with the recent donations, so I'll look into returning it.

    I only really need 3 minimum but I know the Samsung 960 is also potentially not quite 100% (it came from zombie67 and he had noted some issues with it). But it's been running the stats for the last 48 hours ok.

    I have ordered another Samsung 970 which will arrive tomorrow so I'll put that in.

    I may still do some more tweaks.

    Now to the good news.

    Even though the processors (cores) are a little slower in this server the stats are running about 3x faster, probably mainly due to the amount of processing in memory and the sheer speed of the hard drives.

    The longest running query has always been the computation of the combined user stats which does a sum, group by cross project id and then update, this is running in about 8mins now.

  2. #2
    Administrator Bok's Avatar
    Join Date
    Oct 2003
    Location
    Wake Forest, North Carolina, United States
    Posts
    22,233
    Blog Entries
    13
    Stats have been running well on new server for almost a week now without issue. There are a couple of places that I haven't updated yet but most of it is done. Nightly rollover is much quicker on this setup (and with a couple of coding tweaks to be fair).

    FWIW stats6 is pointing to the new database server..

  3. #3
    CO2 Emissions Algae Scientist Nflight's Avatar
    Join Date
    May 2006
    Location
    Fredericksburg, Pennsylvania, United States
    Posts
    41
    Seems Database has swallowed a Furball


  4. #4
    Administrator Bok's Avatar
    Join Date
    Oct 2003
    Location
    Wake Forest, North Carolina, United States
    Posts
    22,233
    Blog Entries
    13
    intermittent issue where it stops the downloads (correctly) while doing a daily rollover but then doesn't restart them. I haven't tracked it down yet. Obviously something in the changes I've put in. but yet to find it.

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •