We recently acquired a Dell MD3200 and MD1200 6Gb/sec shared SAS storage system and I have spent a couple of days setting up some tests to see how it compares to our old iSCSI EMC Clariion. Wasn't really a fair fight, given that the EMC had 500GB 7200rpm SATA disks in it, whereas the new systems had 450GB 15000rpm SAS in the MD3200 and 2TB 7200rpm nearline SAS in the MD1200.
Big caveat on the following test results ... all are the result of testing a single VM ... I do not (yet) have any results with a multipleVM shared workloads on shared LUNs, so I haven't tested the impact of contention, locking, etc.
Tests were done by running simple IOMETER jobs. Results per job were cross-checked with 'esxtop' to ensure that they roughly matched (they did). I installed a Windows Server 2008 R2 VM and created 100GB vmdk's on each storage tier. I tested with 5-disk and 6-disk RAID5 as well as a few tests with a 6-disk RAID10.
I had a guess at constructing some sample workloads to simulate SQL data (reading/writing 64KB chunks of data) as well as simulating retrieval of data for backups. My guess as to how these might work could be way off! If anyone thinks so and can suggest improvements to the IOMETER test workloads, I am happy to receive that feedback and can probably repeat the tests with different parameters.
Some of the conclusions I reached (some of which came as a surprise to me, and some which didn't!):
5-disk RAID5 is almost indistinguishable from 6-disk RAID (between 2% and 4% better performance with the 6-disk config)
edit: this is only under light workload ... see updated stats below
5-disk RAID5 out-performed a 6-disk RAID10 by a fair margin (about 20%) on the "all in one" IOMETER tests
edit: this is only under light workload ... see updated stats below
450GB 15k SAS outperformed 2TB 7.2k nearline SAS by 50%-100% in a 5-disk RAID5 configuration
its possible to pull around 700-800MB/sec of real data out of the shared SAS storage given optimal conditions, which blows away a small iSCSI config (unless you have masses of 1Gb/sec NICs teamed, or are blessed with 10Gb/sec ethernet)
Here's the some of the test results, in case they're of interest. Feedback welcomed.
IOMETER standard "all in one" workload | |||||||||
Storage | Physical | RAID | Number | TEST RESULTS | % IMPROVEMENT | ||||
Tier | Disk Type | Type | of Disks | IOPS | MB/sec | Avg Seek | IOPS | MB/sec | Avg Seek |
MD3200 | 15000rpm 450GB SAS | RAID5 | 5 | 2015 | 25.8 | 0.50 | 294% | 291% | 74% |
MD3200 | 15000rpm 450GB SAS | RAID5 | 6 | 2065 | 26.5 | 0.48 | 303% | 302% | 75% |
MD3200 | 15000rpm 450GB SAS | RAID10 | 6 | 1640 | 21.0 | 0.61 | 220% | 218% | 69% |
MD1200 | 7200rpm 2TB nearline SAS | RAID5 | 5 | 1710 | 21.9 | 0.58 | 234% | 232% | 70% |
MD1200 | 7200rpm 2TB nearline SAS | RAID5 | 6 | 1733 | 22.2 | 0.58 | 238% | 236% | 70% |
MD1200 | 7200rpm 2TB nearline SAS | RAID10 | 6 | 1175 | 15.1 | 0.85 | 129% | 129% | 56% |
iSCSI SAN | 7200rpm 500GB SATA | RAID5 | 5 | 512 | 6.6 | 1.95 |
"simulated SQL workload" workload (reading/writing 64KB blocks in 80:20 ratio, random/sequential in 90:10 ratio) | |||||||||
Storage | Physical | RAID | Number | TEST RESULTS | % IMPROVEMENT | ||||
Tier | Disk Type | Type | of Disks | IOPS | MB/sec | Avg Seek | IOPS | MB/sec | Avg Seek |
MD3200 | 15000rpm 450GB SAS | RAID5 | 5 | 240 | 14.9 | 4.18 | 229% | 224% | 69% |
MD3200 | 15000rpm 450GB SAS | RAID5 | 6 | 250 | 15.6 | 4.00 | 242% | 239% | 71% |
MD1200 | 7200rpm 2TB nearline SAS | RAID5 | 5 | 119 | 7.4 | 8.43 | 63% | 61% | 38% |
MD1200 | 7200rpm 2TB nearline SAS | RAID5 | 6 | 126 | 7.9 | 7.90 | 73% | 72% | 42% |
iSCSI SAN | 7200rpm 500GB SATA | RAID5 | 5 | 73 | 4.6 | 13.60 |
"simulated backup workload" workload (reading 64KB blocks, 100% sequential) | |||||||||
Storage | Physical | RAID | Number | TEST RESULTS | % IMPROVEMENT | ||||
Tier | Disk Type | Type | of Disks | IOPS | MB/sec | Avg Seek | IOPS | MB/sec | Avg Seek |
MD3200 | 15000rpm 450GB SAS | RAID5 | 5 | 2004 | 125.3 | 0.50 | 309% | 309% | 75% |
MD3200 | 15000rpm 450GB SAS | RAID5 | 6 | 2017 | 126.1 | 0.49 | 312% | 312% | 76% |
MD1200 | 7200rpm 2TB nearline SAS | RAID5 | 5 | 1967 | 123.0 | 0.51 | 301% | 302% | 75% |
MD1200 | 7200rpm 2TB nearline SAS | RAID5 | 6 | 2008 | 125.5 | 0.50 | 310% | 310% | 75% |
iSCSI SAN | 7200rpm 500GB SATA | RAID5 | 5 | 490 | 30.6 | 2.04 |