I posted a blog last week that illustrated how time between each benchmark test can affect performance results. To show what we wanted, we used a small portion of a new benchmark that is built into Futuremark's PCMark 8 2.0. The new Consistency and Adaptivity (yes, I know, it's not really a word) tests add additional features to an already good benchmark.
We've stated before that the key to a good benchmark isn't just the test you are running, but the preconditioning involved before the test. SSD FOB (Fresh out of Box) performance is always great and very close to the limits of SATA III, but real-world performance has days, weeks, and months of data on the drive.
In the past, we've simulated prior stress with our Data on Disk testing by adding data on the drive and running PCMark Vantage's Storage Tests. Futuremark took that test and worked up a better method to show what we consider a better representation of real-world performance.
The following was provided by Futuremark:
The PCMark 8 Consistency test measures the performance consistency and degradation tendency of a storage system.
The Storage test workloads are repeated. Between each repetition, the storage system is bombarded with a usage that causes degraded drive performance. In the first part of the test, the cycle continues until a steady degraded level of performance has been reached.
In the second part, the recovery of the system is tested by allowing the system to idle and measuring the performance with long intervals.
The test reports the performance level at the start, the degraded steady-state and the recovered state, as well as the number of iterations required to reach the degraded state and the recovered state.
The Adaptivity test measures the "learning" capabilities of the storage system.
The Storage test workloads are repeated and the results are observed. The test continues until a steady state of performance has been reached.
The benchmark reports the performance level at the start and in the steady state, as well as the number of iterations required to reach the state. Today, we're publishing a handful of products that we've run through the new Consistency test and expanding upon the information used in the blog post.