UESPWiki:Upgrade History/2013

24 December 2013
:* New parser function added to MetaTemplate.php, MetaTemplate_body.php, and MetaTemplate.i18n.magic.php (this last one is not active on content1/2 yet, but I didn't want us to get confused)  &ndash;       08:29, 24 December 2013 (GMT)

10 December 2013
:* Revert changes related to files1 maintenance:
::* Restored the files/images/skins/maps.uesp.net sub-domains.
::* Pointed the PHP session path back to the shared files1 path.
::* Enabled wiki uploads on all wikis.
:: -- Daveh   01:58, 11 December 2013 (GMT)

9 December 2013
:* Changes for files1 maintenance
::* Redirected files/images/skins/maps.uesp.net to content2.
::* Resynced map tiles on content2.
::* Resynced wikiimages on content1/2/3.
::* Turned off and redirected wiki uploads on mobile.uesp.net.
::* Moved PHP sessions to NFS shared mount on content3.
::* Turned off and redirected uploads on content1/2/3.
:: -- Daveh   16:59, 9 December 2013 (GMT)

27 November 2013
:* Forwarded the old v2 maps to the new v3 maps on content1/2/3. People may still have to reload the page manually to see the update. -- Daveh   15:48, 27 November 2013 (GMT)

26 November 2013
:* Updated the maps code on content1/2/3 using the new code repository install method. -- Daveh   16:09, 26 November 2013 (GMT)
:* Upgraded PHP to v5.3 on content1/2. -- Daveh   19:04, 26 November 2013 (GMT)

21 November 2013
:* Fixed an issue with the Lucene search index update script on content2 which appears to have prevented the index from being correctly updated every hour. -- Daveh   16:39, 21 November 2013 (GMT)

20 November 2013
:* Moved all passwords and secrets from configuration files (wiki, maps, and forums) to separate included files on content1/2/3. -- Daveh   19:35, 20 November 2013 (GMT)

:* Made comparable changes to above on mobile servers.
:* Harmonized permissions, namespace aliases, content namespaces, default searched namespaces, and RC max age on mobile servers with same settings on main servers. (Note: there are a number of other settings that aren't harmonized between them which need to be looked at later. Also, memcached is enabled on mobile3, but not on the other two.)
:* Removed Icon extension on mobile servers.
:* Enabled JobQueue extension on mobile servers.  &ndash;       21:29, 20 November 2013 (GMT)

15 November 2013
:* Modified the  extension to permit viewing of edit counts of users over a specific time period (last day, week, month, etc...). -- Daveh   17:16, 15 November 2013 (GMT)

8 November 2013
:* Added the internal IPs to hosts.allow on content1/2 due to NFS permission errors. It was causing intermittent issues with logged in users (pages not loading). -- Daveh   20:58, 8 November 2013 (GMT)
:* Switched back to using files1 after maintenance:
::* Reverted DNS entries of images/maps/skins.uesp.net to files1.uesp.net.
::* Kept memcached on content1 for now.
::* Changed the /w/images symbolic link to point to the image share on files1.
::* Turned Wiki uploads back on.
::* Switched the maps to use the maps.uesp.net for image tiles.
::* PHP sessions were switched back to being stored on the files1 shared folder.
:: -- Daveh   00:35, 9 November 2013 (GMT)

7 November 2013
:* Prepared files1 for maintenance:
::* Turned off MediaWiki's memcache usage on content1/2/3. Could temporarily setup it up on content1 if needed.
::* Created a NFS share on content3 and mounted on content1/2. Copied all existing PHP sessions to it and switched Apache to use it.
::* Ensured all Wiki images are copied onto content1/2/3.
::* Turned off Wiki uploads on content1/2/3.
::* Changed the image path to the locally copied version on content1/2/3.
::* Changed the styles path to the local server on content1/2/3.
::* Changed map image path to www.uesp.net on all maps on content1/2/3.
:: -- Daveh   15:31, 7 November 2013 (GMT)
:* More changes related to files1 maintenance:
::* Setup memcached on content1 (very little memory in use on that server).
::* Switched the DNS entries for images/maps/skins.uesp.net to point to content2 with the relevant content copied and setup to serve those sub-domains.
:: -- Daveh   21:37, 7 November 2013 (GMT)

28 October 2013
:* Removed unused IP addresses from router/firewall configuration as they were interfering with the used IP addressed (limit of 10 hosts on current license). -- Daveh   04:07, 28 October 2013 (GMT)

10 October 2013
:* Tweaked a few files on content1/2/3 to reduce the number of HTML validation errors. -- Daveh   19:27, 10 October 2013 (GMT)
:::* LocalSettings.php -- Changed border of rights icon to CSS.
:::* UespCustomCode\MonoBook.php -- Various corrections/edits to fix missing and out of order tags.
:::* skins\MonoBook.php -- Various corrections/edits to fix missing and out of order tags.
:* Changed the settings of mod_evasive on content1/2/3 to be a little more permissive...the maps can generate a lot of small queries in a short time. -- Daveh   21:16, 10 October 2013 (GMT)
:* Edited the customBox() function in skins/MonoBook.php to re-enable the extra sidebar indentation. -- Daveh   00:11, 11 October 2013 (GMT)
:* Changed short_open_tag = On in php.ini on content3 (setting was changed in recent upgrade to PHP v5.3). -- Daveh   00:16, 11 October 2013 (GMT)

7 October 2013
:* Updated MetaTemplate/MetaTemplateCategoryPage.php to hopefully fix two small   bugs:
:**   now trimmed from line feed onwards (similar to sortkeyprefix in API)
:** redirects retain proper formatting  &ndash;       00:55, 7 October 2013‎ (GMT)

20 September 2013
:* Added a maximum limit of 20 connections from one IP in Squid on squid1. -- Daveh   15:26, 20 September 2013 (GMT)
:* Installed the httpd-devel package on content1/2/3. -- Daveh   17:11, 20 September 2013 (GMT)
:* Installed mod_evasive for Apache on content1/2/3. Initial settings are shown below: -- Daveh   17:11, 20 September 2013 (GMT)
        DOSHashTableSize    3145739
        DOSPageCount        3
        DOSSiteCount        20
        DOSPageInterval     5
        DOSSiteInterval     1
        DOSBlockingPeriod   10
        DOSEmailNotify       
        DOSWhiteList         
:* Enabled and configured mod_evasive for Lighttpd on files1. Current setting of evasive.max-conns-per-ip = 20. -- Daveh   18:19, 20 September 2013 (GMT)
:* Upgraded yum installed packages on content3. -- Daveh   01:11, 21 September 2013 (GMT)
:* Installed php53 and related packages on content3. -- Daveh   01:11, 21 September 2013 (GMT)
:* Fixed broken replication on content3. -- Daveh   01:22, 21 September 2013 (GMT)

19 September 2013
:* Blocked 190.39.85.29 manually on squid1 due to connection abuse. -- Daveh   21:26, 19 September 2013 (GMT)

25 August 2013
:* Ran the MySQL command "alter table abuse_filter_log modify afl_namespace INT;" on db1 to fix the issue of namespace indices exceeding the original TINYINT used there. -- Daveh   19:06, 25 August 2013 (GMT)
:* Updated all abuse_filter_log rows with namespace ID of 127 to correct namespace ID.  &ndash;       21:31, 25 August 2013 (GMT)

6 August 2013
:* Since intermittent problem (see below) does not occur on dev, re-uploading MetaTemplate and UespCustomCode changes to main Content3 server only, one file at a time, to determine what caused the issues.  &ndash;       00:44, 6 August 2013 (GMT)
:* Updated SpecialDailyEdits.php on all main servers (not present on mobile).  &ndash;       01:21, 6 August 2013 (GMT)

5 August 2013
:* Updated the following files on all servers. Unless otherwise noted, code was strictly updated based on current standards (e.g., $specialPageAliases instead of $aliases), and per r52503 since MW 1.21 removes some of this functionality altogether.  &ndash;       04:27, 5 August 2013 (GMT)
:** CheckUser/CheckUser.hooks.php (reverted to previous on regular servers, since 30 April 2013 changes were unrelated to problem; not applicable to mobile servers)
:**   (Permissions issue on all three regular servers, Dave notified; not applicable on mobile servers)
:** MetaTemplate/MetaTemplate.alias.php
:** MetaTemplate/MetaTemplate_body.php (used consistent read-only check on all servers)
:** MetaTemplate/MetaTemplate.i18n.magic.php
:** MetaTemplate/MetaTemplate.php (also removed some unused code and global declarations)
:** UespCustomCode/SiteCustomCode.alias.php
:** UespCustomCode/SiteCustomCode.i18n.magic.php
:** UespCustomCode/SiteCustomCode_body.php (correct reference/value mismatch in addCanonicalToHeader and getCachedTrail)
:** UespCustomCode/SiteCustomCode.php (also changed dir check to simpler sitename check and removed a couple of unused global declarations)
:** UespCustomCode/SiteNamespace.php
:** UespCustomCode/SiteSearchMySQL.php (updated to use MWNamespace)
:** UespCustomCode/SiteSpecialPreferences.php
:** UespCustomCode/SiteSpecialSearch.php
:** UespSiteStats/UespSiteStats.alias.php
:** UespSiteStats/UespSiteStats.php
:** UespSiteStats/UespSiteStats_body.php
:** UncategorizedUESPPages/UncategorizedUESPPages.alias.php
:** UncategorizedUESPPages/UncategorizedUESPPages.php
:** UsersEditCount/UsersEditCount.alias.php
:** UsersEditCount/UsersEditCount.php
:* MetaTemplate and UespCustomCode changes reverted for now due to intermittently unparsed magic words.  &ndash;       05:29, 5 August 2013 (GMT)

26 July 2013
:* Uncommented larger shell memory and file size settings on content3 only. Since   is the third or fourth such request, I've left the settings in place so Dreamshadow can update large thumbnails at need without hogging memory on the main servers.  &ndash;       01:33, 26 July 2013 (GMT)

18 June 2013
:* Uploaded version 1.4.3 of RegexFunctions to fix PHP injection bug.  &ndash;       18:01, 18 June 2013 (GMT)

14 June 2013
:* Created the Data Dumps page which is automatically updated with the latest XML page dump of the wiki. The page dumps are currently run from content3 and then copied, updated, and served from files1. -- Daveh  

8 June 2013
:* Implemented fix in LogFormatter.php for Patrol Log bug on all servers.  &ndash;       00:59, 8 June 2013 (GMT)

7 June 2013
:* Reverted yesterday's changes due to Watch tab breakage, per Bugzilla.  &ndash;       20:21, 7 June 2013 (GMT)

6 June 2013
:* Limited write API access to approved bots on all regular and mobile servers due to recent vandalism by unapproved bot.  &ndash;       07:44, 6 June 2013 (GMT)

23 May 2013
:* Disabled and deleted Oversight on all regular and mobile servers. (Tables not deleted, sent e-mail to Dave.)  &ndash;       13:50, 23 May 2013 (GMT)
:* Added RevisionDelete to mobile servers.  &ndash;       13:50, 23 May 2013 (GMT)
:* Disabled API-based user creation on mobile servers (pre-emptive for MW 1.20).  &ndash;       13:50, 23 May 2013 (GMT)

21 May 2013
:* Banned 74.208.16.55 on content3 due to connection abuse. -- Daveh  
:* Added a robots.txt on cs.uesp.net to prevent all bot usage. -- Daveh  

20 May 2013
:* Added a robots.txt file on monitor.uesp.net to disallow all content to hopefully prevent issues with bots overloading the server. -- Daveh  
:* Banned 65.55.52.89 on content3 due to abuse of using the CS list. -- Daveh  

15 May 2013
:* Blocked the 180.76.5.XXX and 180.76.6.XXX IPs via iptables on content3 do to abuse of the monitoring app. -- Daveh  

9 May 2013
:* Enabled AbuseFilter on mobile wiki on all servers.  &ndash;       17:46, 9 May 2013 (GMT)

5 May 2013
:* Enabled CheckUser on mobile wiki on all servers.  &ndash;       06:47, 5 May 2013 (GMT)

3 May 2013
:* Manually killed a bunch of frozen "convert" processes on content1/2. -- Daveh  

1 May 2013
:* Temporarily increased   to 204800 on content3 only. Refreshed SR-Map-Windhelm.jpg and User-Roger-Solstheim_Map_02.jpg to allow thumbnails to generate, then reverted to previous version of settings.  &ndash;       02:01, 1 May 2013 (GMT)

30 April 2013
:* Trimmed   variable in various routines in   (CheckUser.hooks.php) as a possible cause of unlogged user creations.  &ndash;       22:28, 30 April 2013 (GMT)

29 April 2013
:* Disabled account creation via API on all servers.  &ndash;       22:34, 29 April 2013 (GMT)
:* Removed Math/LaTeX-related entries from LocalSettings.php on content1/2/3—feature was removed in 1.18. No effect on wiki, just decluttering the settings file.  &ndash;       05:33, 29 April 2013 (GMT)

23 April 2013
:* Changed $wgAbuseFilterEmergencyDisableThreshold to 0.5 from its default 0.05 on content1/2/3. -- Daveh  

9 April 2013
:* Enabled RevisionDelete on content1/2/3 in the hopes that we can remove Oversight.  &ndash;       21:22, 9 April 2013 (GMT)

19 March 2013
:* Added several IP addresses to the adminengine in qwebirc and restarted it on content3. -- Daveh  

10 March 2013
:* Removed custom site Javascript from includes/OutputPage.php as it was moved to uesp.js. It was causing Google analytics to record double the site traffic. -- Daveh  

7 March 2013
:* Switched master database back to db1. Reset replication from db1 to db2/content3/backup1. -- Daveh  
:* Changed maximum length of nicknames in the qwebirc client from 15 to 20 on content3. -- Daveh  
:* Installed MobileFrontend extension on content3. -- Daveh  

5 March 2013
:* Started replication on db1 from db2 after hard drive replacement on db1. -- Daveh  
:* Opened another MySQL IP address window in the firewall for backup1 and restarted replication. -- Daveh  

4 March 2013
:* Changed $wgRCMaxAge on content1/2/3 from 1 to 3 months. -- Daveh  
:* Changed the master database from db1 to db2 in preparation for maintenance on db1. -- Daveh  
:* Changed replication on content3 to use db2 as its master. -- Daveh  

27 February 2013
:* Replaced the site logo with a re-made version on content1/2/3. -- Daveh  
:* Added the static blog and www files to the weekly backup on content1. -- Daveh  

26 February 2013
:* Updated the qwebirChat extension on content1/2. -- Daveh  
:* Added Google+ link at bottom of Wiki page for verification purposes. -- Daveh  
:* Added social media links in the sidebar. -- Daveh  

24 February 2013
:* Setup content2 to properly serve the mobile/m subdomains. -- Daveh  
:* Purged all mobile pages on squid1. -- Daveh  

23 February 2013
:* Changed firewall rules to deny access to MySQL except for a few specific known IPs. -- Daveh  
:* Installed the custom qwebirchat extension on content1/2/3. -- Daveh  

21 February 2013
:* Setup and installed QWebIRC on content3: -- Daveh  
::* EPEL repository
::* python26
::* python26-devel
::* zope.interface v4.0.4 (from source)
::* Twisted v12.3.0 (from source)
:* Opened port 9090 in firewall for QWebIRC. Changed from a global rule to a outgoing rule to fix some strange issues. -- Daveh  
:* Added the irc. and chat. subdomains which currently point to content3. -- Daveh  

20 February 2013
:* Fixed missing parameter in call to execute() in UespCustomCode/SiteSpecialPreferences.php. -- Daveh  
:* Made fix in the Gadgets extension to prevent breaking with memcached. Note the Gadgets bug appears to have been noticed by others....see the 37228 MediaWiki Bug Report although no fix is given. -- Daveh  
:* Re-enabled memcached on content1/2/3. -- Daveh  
:* Added the following files to the root web, mobile and forum directories on content1/2/3 to satisfy missing file warnings. -- Daveh  
::* apple-touch-icon.png
::* apple-touch-icon-precomposed.png
::* apple-touch-icon-144x144.png
::* apple-touch-icon-144x144-precomposed.png
::* apple-touch-icon-114x114.png
::* apple-touch-icon-114x114-precomposed.png
::* apple-touch-icon-72x72.png
::* apple-touch-icon-72x72-precomposed.png
:* Moved /maps/index.shtml to /maps/index.html in order to correctly redirect to the maps page. -- Daveh  
:* Corrected missing definition of mPosted in UespCustomCode/SiteSpecialPreferences.php on content1/2/3. -- Daveh  

19 February 2013
:* Disabled memcached on content1/2/3 to fix gadgets issue. -- Daveh  

18 February 2013
:* Added content2 back into the load balancing rotation on squid1. -- Daveh  
:* Changed permissions on the /uesp-setup/ path on all servers to uesp:uespadmin. -- Daveh  
:* Flushed and restarted the memcached service on files1. Re-enabled use of memcached on content1/2/3. So far the Gadgets extension is working. -- Daveh  
:* Restarted the Lucene search on content2. -- Daveh  
:* Killed several hung rsync sessions on content3. -- Daveh  
:* Fixed the MetaTemplate and SearchLog extensions to properly check for the read-only state of the wiki. -- Daveh  

14 February 2013
:* Created the uesp-removeip-denyhosts script for easily removing a blocked IP from the server. -- Daveh  

9 February 2013
:* Temporarily reverted changes to MetaTemplate on content1 due to variables not saving. -- Daveh  

8 February 2013
:* Made the SearchLog and MetaTemplate extensions respect the read only setting of the wiki database. -- Daveh  
:* Switched back to using db1 as the master database. -- Daveh  

5 February 2013
:* Restarted broken replication on content3 from db2. -- Daveh  
:* Started replication on db1 from db2 in preparation for restoring db1 as master. -- Daveh  

1 February 2013
:* Moved master database to db2 for all services. MySQL on db1 turned off. -- Daveh  
:* Changed replication on content3 to use db2. -- Daveh  
:* Added MySQL permissions for edgblog on db2. -- Daveh  

30 January 2013
:* Installed JobQueue on content1/2/3.  &ndash;       23:59, 30 January 2013 (GMT)

29 January 2013
:* Turned off memcached on the Wiki on content1/2 as it was causing the Gadgets to not work. -- Daveh  

25 January 2013
:* Setup automatic script on db1 to weekly clear the search log summary and delete all log entries older than 1 week. This will prevent the search log tables from becoming too large and slowing down searches. -- Daveh  
:* Created the  extension and added to content1/2/3. Graph generation is currently setup daily on content3. -- Daveh  

24 January 2013
:* Modified the UespCustomCode extension to include the uesp.js file for site specific JavaScript that needs to be loaded in the page head. -- Daveh  
:* Reverted main.css to the original 1.19.3 version (changes were merged into  ). -- Daveh  
:* Increased wgStyleVersion on content1/2/3 to 210. -- Daveh  

23 January 2013
:* Add note to the ad report form. -- Daveh   20:08, 23 January 2013 (GMT)
:* Added average search time to the SearchLog extension and other minor tweaks. -- Daveh   20:08, 23 January 2013 (GMT)
:* Moved all custom changes to skins/monobook/main.css to . -- Daveh   20:36, 23 January 2013 (GMT)
:* Increased wgStyleVersion on content1/2/3 to 209 (it was still 207 on content1). -- Daveh   20:39, 23 January 2013 (GMT)

21 January 2013
:* Moved Lucene search to content1/2. The search index is currently hosted on content2 and the index is rebuilt hourly. -- Daveh   15:37, 21 January 2013 (GMT)
:* Clear the searchlog wiki tables on db1. -- Daveh   20:19, 21 January 2013 (GMT)
:* Re-enabled the SearchLog extension on content1/2/3. -- Daveh   20:23, 21 January 2013 (GMT)
:* Updated includes/specials/SpecialSearch.php to include the search time for the search log. -- Daveh   20:36, 21 January 2013 (GMT)

19 January 2013
:* Reverted $wgJobRunRate to 0.1 on content1/2/3. Bot was inexplicably causing lag - testing to see if this was the issue.  &ndash;       00:44, 20 January 2013 (GMT)

18 January 2013
:* Skipped one replication command on content3 and restarted slave. -- Daveh   14:05, 18 January 2013 (GMT)
:* Removed the MediaWiki_Talk: and Template_Talk: namespaces from being in the default searched namespaces on content1/2/3. -- Daveh   19:13, 18 January 2013 (GMT)
:* Turned memcache settings back on for the content1/2 Wikis. -- Daveh (talk) 22:12, 18 January 2013 (GMT)

17 January 2013
:* Added a few sections to  to fix the advanced search options colors and format. -- Daveh   15:21, 17 January 2013 (GMT)

15 January 2013
:* Finished ongoing file moves and database updates to repair broken images (see 11 January 2013).  &ndash;       and        00:39, 16 January 2013 (GMT)

14 January 2013
:* Freed up space on content3
::* Removed unneeded rotation of some backup files.
::* Deleted old mysql bin-logs and setup automatic deletion of old ones.
::* Removed all dhack backups.
::* -- Daveh   15:46, 14 January 2013 (GMT)
:* Backup Review
::* Checked all existing backups. 
::* Turned on weekly backups on db1 of all dbs except the wiki (too large to full backup via mysqldump).
::* Restarted MySQL on db2 to turn log-slave-updates on.
::* Fixed backup of configuration on content3 and squid2.
::* Added weekly backups on files1. 
::* -- Daveh   16:47, 14 January 2013 (GMT)
:* Changed hostname on content3 to the FQDN. -- Daveh   16:56, 14 January 2013 (GMT)
:* Fixed missing key setup on db2 and squid2. -- Daveh   17:08, 14 January 2013 (GMT)
:* Restarted denyhosts on db1 and removed local IPs from being blocked. -- Daveh   18:06, 14 January 2013 (GMT)
:* Changed the weekly cron scripts on content3 to run on Monday instead of Sunday mornings. -- Daveh   19:49, 14 January 2013 (GMT)
:* Changed the weekly cron scripts on backup1 to run on Tuesday instead of Sunday mornings. -- Daveh   19:49, 14 January 2013 (GMT)

12 January 2013
:* Restored all CS databases from a week old content3 backup on db1. This fixes the issue since the replication restore on content3 a few days ago. -- Daveh   16:29, 12 January 2013 (GMT)
:* Fixed the database connection in cswrite_conn.inc to point to db1 instead of content3. -- -- Daveh   16:29, 12 January 2013 (GMT)
:* Added the cs.uesp.net sub-domain that points to the CSList. -- -- Daveh   16:29, 12 January 2013 (GMT)

11 January 2013
:* Moved numerous orphaned files/images to correct archive folder and updated   table where necessary. Some had no apparent link, so moved them to my personal folder just in case.  &ndash;       03:36, 11 January 2013 (GMT)
:* Deleted 0-sized orphan   and  .  &ndash;       03:36, 11 January 2013 (GMT)
:* Deleted   orphan duplicated by  .  &ndash;       03:36, 11 January 2013 (GMT)
:* Deleted   orphan duplicated by  .  &ndash;       03:36, 11 January 2013 (GMT)
:* Tweaked the ad reporting form a bit: added a simple spam captcha, tweaked formatting, made subject record date/time. -- -- Daveh   14:54, 11 January 2013 (GMT)

10 January 2013
:* Upgraded content1/2/3 Wiki to 1.19.3. -- Daveh   15:59, 10 January 2013 (GMT)
:* Added content2 back into the Squid load balancing (and turned back off shortly after). -- Daveh   16:07, 10 January 2013 (GMT)
:* Reloaded database dump and restarted replication on content3. -- Daveh   20:41, 10 January 2013 (GMT)
:* Added a proper ad reporting form when a user presses the "Report Ad" link beside any of the ads. -- Daveh   01:46, 11 January 2013 (GMT)

9 January 2013
:* Bumped $wgJobRunRate down to 0.25 due to intermittent lag experienced by multiple users.  &ndash;      
:* Increased $wgJobRunRate in LocalSettings.php on content1/2/3 from 0.1 to 0.5 to help clear job queue.  &ndash;      

7 January 2013
:* Removed IMDB interwiki link and added IMDbName, IMDbTitle, IMDbCompany, and IMDbCharacter to fix linking problem and harmonize with Wikipedia.  &ndash;      
:* Fixed descriptions for MetaTemplate and UsersEditCount in  on content 1/2/3.  &ndash;      

6 January 2013
:* Turned off all weekly backups on db1 as they were creating a very large (200GB) backup file which was filling up the server and crashing the site.

5 January 2013
:* Set the wgImageMagickTempDir parameter to /imagetmp on content1.
:* Changed the ImageMagick temp directory to /imagetmp on content2/3.
:* Enabled logging on the firewall to see if we can catch the intermittent content2 connection issue.

4 January 2013
:* Changed the ImageMagick tmp path to /imagetmp on content1 to prevent /tmp from regularily being filled up. Is cleared by a cron script once a day.

3 January 2013
:* Added the uespforum group to all content servers and backup1. -- Daveh (talk) 15:16, 3 January 2013 (GMT)
:* Added the steve user to all content servers and backup1 (login only enabled on content1 for forum admin). -- Daveh (talk) 15:16, 3 January 2013 (GMT)
:* Added avron and steve to the uespforum group. -- Daveh (talk) 15:16, 3 January 2013 (GMT)