Test System and Methodology
We utilize a new approach to HDD and SSD storage testing here at TweakTown for our Enterprise Test Bench. Designed specifically to target the long-term performance of solid state with a high level of granularity, our new SSD testing regimen is applicable to a wide variety of flash devices. From typical form-factor SSDs to the hottest PCIe application accelerators available, we are utilizing this new test regimen to provide accurate performance measurements over a variety of parameters.
Many forms of testing involve utilizing peak and average measurements over a given time period. While these average values can give a basic understanding of the performance of the storage solution, they fall short in providing the clearest view possible of the QOS (Quality Of Service) of the I/O.
The problem with average results is that they do little to indicate the variability experienced during the actual deployment of the device. The degree of variability is especially pertinent, as many applications can hang or lag as they wait for one I/O to complete. This type of testing illustrates the performance variability expected in these types of scenarios while also including a whole host of other relevant data, including the average measurements during the measurement window.
While under load, all storage solutions deliver variable levels of performance that are subject to constant change. While this fluctuation is normal, the degree of fluctuation is what separates enterprise storage solutions from typical client-side hardware. By providing ongoing measurements from our workloads with one-second reporting intervals, we can illustrate the difference between different products in relation to the purity of the QOS while the device is under load. By utilizing scatter charts readers can get a basic understanding of the latency distribution of the I/O stream without directly observing numerous graphs.
Consistent latency is the goal of every storage solution, and measurements such as Maximum Latency only illuminate the single longest I/O received during testing. This can be misleading, as a single 'outlying I/O' can skew the view of an otherwise superb solution. Standard Deviation measurements take the average distribution of the I/O into consideration, but do not always effectively illustrate the entire I/O distribution with enough granularities to provide a clear picture of system performance.
Our testing regimen follows SNIA principles to ensure consistent, repeatable testing. Due to the very nature of NAND devices, it is important that we test under steady state conditions. We attain steady state convergence through a process that brings the device within a performance level that does not range more than 20% from the average speed measured during the measurement window.
We only test below QD32 to illustrate the scaling of the device. However, low QD testing with enterprise-class storage solutions is a frivolous activity if not presented with higher QD results as well. Administrators that have optimized their infrastructure correctly sustain high QD levels, capitalizing on the performance of the premium tier of storage that SSDs provide. With the explosion of virtualization into the datacenter, the high QD performance of the storage solution is the most important metric.
The first page of results will provide the 'key' to understanding and interpreting our new test methodology.
PRICING: You can find products similar to this one for sale below.
United States: Find other tech and computer products like this over at Amazon's website.
United Kingdom: Find other tech and computer products like this over at Amazon UK's website.
Canada: Find other tech and computer products like this over at Amazon Canada's website.
- Page 1 [Introduction]
- Page 2 [Product Positioning and Data Protection]
- Page 3 [Architecture and Management]
- Page 4 [Micron P320h]
- Page 5 [Test System and Methodology]
- Page 6 [4K Random Read/Write]
- Page 7 [8K Random Read/Write]
- Page 8 [128K Sequential Read/Write]
- Page 9 [OLTP and Webserver]
- Page 10 [Fileserver and Emailserver]
- Page 11 [Final Thoughts]
- We at TweakTown openly invite the companies who provide us with review samples / who are mentioned or discussed to express their opinion of our content. If any company representative wishes to respond, we will publish the response here.
Recommended for You
Latest News Posts
- Acer Predator gaming notebooks feature i7-6700HQ, 980M, 4K, G-SYNC
- AMD says price drop on their GPUs isn't their doing
- Multiple Instagram accounts now supported on Android
- Make us an awesome TweakTown wallpaper, win a Corsair Hydro H110i GT
- Raspberry Pi Zero sells out in a day
- Sharp GX-BT7 2.1-Channel Wireless Bluetooth Speaker Review
- D-Link DCS-2630L 1080p Ultra-Wide View IP Wi-Fi Camera Review
- ID-Cooling Frostflow 240L CPU Liquid Cooler Review
- Lexar JumpDrive M20i 32GB OTG iOS Flash Drive Review
- Gibabyte GA-Z170X- Gaming 7 Supported RAM (2 x16Gb or 4 x 8GB) ?
- Team Group Announces Neptune Gaming SO-DIMM Memory
- Cooltek Announces the Skall Series ATX Mid-tower Chassis
- Eurocom offers $500 USD off Black Friday & Cyber Monday deal for EUROCOM Sky X9 Desktop Laptop with Intel Skylake desktop class CPUs and NVIDIA GeForce GTX 980 Desktop GPU and 64 GB DDR4 memory
- MSI @ DREAMHACK WINTER 2015
- ADATA Releases the Lightning Card Reader