Storage2

storage2 is a 16 GB box with a 3ware 9550SX-16ML storage controller, and 16 500 GB SATA drives.
As of March 18, 2008, it is serving our publicly available data sets as download.wikimedia.org.
As of July 24, 2009, it has had three drives replaced due to a degraded state and the filesystem had to be rebuilt.
These include
* Xml snapshots
* MediaWiki Releases
* Fundraising statistics
== Services ==
Daemons:
* HTTP server for backup
** download.wikimedia.org
* NFS server for backup
** Mounted by srv31, srv225, amane
Jobs:
* AWstats to track the downloads of our clients
** standard ubuntu install with config files in /etc/awstats/awstats.conf
** runs every 12 hours through cron
== Bonnie results ==
A single JBOD drive, JFS:
Version 1.03 ------Sequential Output------ --Sequential Input- --Random-
 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP
storage1 32072M 48674 83 52395 7 23678 3 47038 80 63308 5 182.6 0
 ------Sequential Create------ --------Random Create--------
 -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
 files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP
 16 2648 5 +++++ +++ 3107 7 1740 10 +++++ +++ 1117 4
storage1,32072M,48674,83,52395,7,23678,3,47038,80,63308,5,182.6,0,16,2648,5,+++++,+++,3107,7,1740,10,+++++,+++,1117,4
A single RAID-10 array over 16 disks on one controller, LVM, JFS:
Version 1.03 ------Sequential Output------ --Sequential Input- --Random-
 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP
storage2 32072M 56214 96 134296 20 46691 7 50508 86 265700 26 620.6 0
 ------Sequential Create------ --------Random Create--------
 -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
 files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP
 16 10795 26 +++++ +++ 11982 27 4039 26 +++++ +++ 6044 28
storage2,32072M,56214,96,134296,20,46691,7,50508,86,265700,26,620.6,0,16,10795,26,+++++,+++,11982,27,4039,26,+++++,+++,6044,28
A single RAID-10 array over 16 disks on one controller, LVM, JFS, 3ware performance profile:
Version 1.03 ------Sequential Output------ --Sequential Input- --Random-
 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP
storage2 32072M 57131 98 238231 37 51066 7 50014 86 236461 22 634.3 0
 ------Sequential Create------ --------Random Create--------
 -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
 files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP
 16 4813 11 +++++ +++ 21782 46 7894 52 +++++ +++ 5674 25
storage2,32072M,57131,98,238231,37,51066,7,50014,86,236461,22,634.3,0,16,4813,11,+++++,+++,21782,46,7894,52,+++++,+++,5674,25
A single RAID-10 array over 16 disks on one controller, LVM, JFS, 3ware performance profile, NCQ enabled:
Version 1.03 ------Sequential Output------ --Sequential Input- --Random-
 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP
storage2 32072M 57366 98 239127 35 52581 8 48502 82 262786 24 422.3 0
 ------Sequential Create------ --------Random Create--------
 -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
 files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP
 16 4597 10 +++++ +++ 22378 51 6972 51 +++++ +++ 5488 28
storage2,32072M,57366,98,239127,35,52581,8,48502,82,262786,24,422.3,0,16,4597,10,+++++,+++,22378,51,6972,51,+++++,+++,5488,28
A single RAID-10 array over 16 disks on one controller, LVM, Reiserfs, 3ware performance profile, NCQ enabled:
Version 1.03 ------Sequential Output------ --Sequential Input- --Random-
 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP
storage2 32072M 299268 93 62118 15 185330 25 580.9 1
 ------Sequential Create------ --------Random Create--------
 -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
 files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP
 16 27900 98 +++++ +++ 23333 99 26874 100 +++++ +++ 21485 99
storage2,32072M,,,299268,93,62118,15,,,185330,25,580.9,1,16,27900,98,+++++,+++,23333,99,26874,100,+++++,+++,21485,99
== External links ==
* 3ware controller command line user guide