Server Memory Upgrade - Page 1
Forum section: electronics / general

author: EEVblog
author_rank: Unknown
timestamp: June 04, 2013, 09:10:44 am
content: Is now complete. The server now has 8GB of RAM instead of 4GB.Will have to run the backup tests and see if the server crashes again.

author: EEVblog
author_rank: Unknown
timestamp: June 04, 2013, 09:11:20 am
content: Hmm, I just got a database connection error while posting this, have never seen that before since the old shared server days. Not a good start!

author: BravoV
author_rank: Super Contributor
timestamp: June 04, 2013, 09:13:21 am
content: And also you have this same thread posted twice in this section.

author: EEVblog
author_rank: Unknown
timestamp: June 04, 2013, 09:15:07 am
content: Quote from: BravoV on June 04, 2013, 09:13:21 amCrap.I just tried a database backup from within SMF and got a website not found error message

author: EEVblog
author_rank: Unknown
timestamp: June 04, 2013, 09:24:44 am
content: Just tried a database backup from within cpanel and it locked up the forum just like before. So much for the memory upgrade

author: Psi
author_rank: Super Contributor
timestamp: June 04, 2013, 09:31:53 am
content: If the backup is programmed to run as fast as it can then it's always going to grind things to a halt.More ram will just make it finish quicker.It needs a limit on the percentage system resources its allowed to use.

author: arekm
author_rank: Unknown
timestamp: June 04, 2013, 09:34:20 am
content: Quote from: EEVblog on June 04, 2013, 09:24:44 amWould be interesting to see "show full processlist" result from mysql console when than happens. If dump locks tables and dump takes few minutes then memory upgrade won't help.

author: EEVblog
author_rank: Unknown
timestamp: June 04, 2013, 09:47:04 am
content: Quote from: Psi on June 04, 2013, 09:31:53 amYes, was very quick, like a minute or something.gnif assures me that one he finishes penguining it will no longer lock up during backups.

author: EEVblog
author_rank: Unknown
timestamp: June 04, 2013, 09:58:14 am
content: I'm posting this during a capanel database backup!Fixed!

author: gnif
author_rank: Unknown
timestamp: June 04, 2013, 10:17:35 am
content: There is enough ram now to perform the backup in a single transaction which prevents the tables from being locked during the dump. This should be the last we see of the nasty SMF database error, and gateway timeouts.

author: BravoV
author_rank: Super Contributor
timestamp: June 04, 2013, 10:34:41 am
content: Quote from: gnif on June 04, 2013, 10:17:35 amGnif, just curious, with the new ram upgrade and equipped with the previous data/log you've collected, thru projection and estimation, also assuming everything is the same as now, no fixes/upgrades/enhances applied.How much/big the data grow in future that will make this same problem again using the current hardware configuration ?

author: gnif
author_rank: Unknown
timestamp: June 04, 2013, 10:36:11 am
content: Quote from: BravoV on June 04, 2013, 10:34:41 amWith the current configuration and performance of the server, and the headroom we now have, we should not have to worry for a very long time unless Dave somehow grows the site enormously overnight. I would wager a guess of a couple of years.

author: BravoV
author_rank: Super Contributor
timestamp: June 04, 2013, 11:24:37 am
content: Quote from: gnif on June 04, 2013, 10:36:11 amAs ballpark number, how bout 2 or 3 times membership counts and/or postings counts from the current capacity ? Still within safe headroom ?Sorry Gnif, don't mean to sound like interrogating you, and honestly I don't know jack about this server thingy, just a personal concern seeing the server problem lately.

author: gnif
author_rank: Unknown
timestamp: June 04, 2013, 11:29:02 am
content: Quote from: BravoV on June 04, 2013, 11:24:37 amThat guess took into account growth of the user base and visits to the site. The server should easily handle anything we can throw at it for quite some time.

author: EEVblog
author_rank: Unknown
timestamp: June 04, 2013, 11:50:34 am
content: FYI, "persistent connection" option in SMF is currently disabled, and the forum is still stupidly lightning quick.Huge thanks to gnif!BTW, hostgater are only charging $40/month for the extra memory, not $100 as advertised. Presumably I can upgrade the memory again if needed.

author: gnif
author_rank: Unknown
timestamp: June 04, 2013, 11:54:58 am
content: Quote from: EEVblog on June 04, 2013, 11:50:34 amYou are most welcome. I will have it generating free energy soon also

author: Chet T16
author_rank: Frequent Contributor
timestamp: June 04, 2013, 11:56:15 am
content: Just had a timeout...may well have been my end. I think it adds character

author: EEVblog
author_rank: Unknown
timestamp: June 04, 2013, 11:57:15 am
content: Quote from: gnif on June 04, 2013, 11:54:58 amCan we use the extra capacity of the dedicated server to mine bitcoins or something?

author: gnif
author_rank: Unknown
timestamp: June 04, 2013, 12:00:04 pm
content: Quote from: Chet T16 on June 04, 2013, 11:56:15 amWas this just a browser time-out or an actual 504 error?Quote from: EEVblog on June 04, 2013, 11:57:15 amI hope you are kidding...

author: rkupka
author_rank: Regular Contributor
timestamp: June 04, 2013, 12:03:49 pm
content: success.Just keep up with regular update checks for CentOS and cpanel (yea, there´s a nasty hole in it right now waiting to be fixed).

author: gnif
author_rank: Unknown
timestamp: June 04, 2013, 12:06:00 pm
content: Quote from: rkupka on June 04, 2013, 12:03:49 pmDone and done. I am monitoring this server 24x7 for many things, including system updates using Icinga (a nice nagios fork) and a set of custom scripts. I generally know when there is an issue with the server within 5 minutes. I have been eager to get this fixed simply so I stop getting woken up to load alerts at 2AM.

author: EEVblog
author_rank: Unknown
timestamp: June 04, 2013, 12:08:28 pm
content: Quote from: gnif on June 04, 2013, 12:00:04 pmWell, maybe play tetris or something...

author: rkupka
author_rank: Regular Contributor
timestamp: June 04, 2013, 12:10:22 pm
content: LOLDon't become enslaved by itI taught my 15 servers to be nice and behave. Otherwise I whip them.

author: gnif
author_rank: Unknown
timestamp: June 04, 2013, 12:12:21 pm
content: Quote from: EEVblog on June 04, 2013, 12:08:28 pmWouldbastetsuffice?

author: xrunner
author_rank: Super Contributor
timestamp: June 04, 2013, 12:41:03 pm
content: Quote from: EEVblog on June 04, 2013, 11:50:34 amGood news on the price. Now wait until it gets as busy as the Arduino forum - about 20pagesof new posts per day!

author: EEVblog
author_rank: Unknown
timestamp: June 04, 2013, 12:59:00 pm
content: Quote from: xrunner on June 04, 2013, 12:41:03 pmWe are currently at about 400-500 new posts per day, so it's getting pretty big and only growing.

author: EEVblog
author_rank: Unknown
timestamp: June 04, 2013, 12:59:51 pm
content: Quote from: xrunner on June 04, 2013, 12:41:03 pmStill a rip-off though, but thankful for small mercies

author: xrunner
author_rank: Super Contributor
timestamp: June 04, 2013, 01:08:41 pm
content: Quote from: EEVblog on June 04, 2013, 12:59:00 pmWhen I got my Arduino I joined the Arduino forum, so I could (I thought) keep up with people and their projects as they came in.Wrong.That place is so busy it's insane. When I realized there were ~20pagesof new posts per day, I gave up on that idea. I still look at it from time to time but there's just too much to keep up with. Getting too big can be a problem in it's own way. But of course they are over-boarded but's that's another story ...