What is the VMmark Benchmark?
VMmark® is a free tool used by hardware vendors, virtualization software vendors, and others to measure the performance, scalability, and power consumption of virtualization platforms.
The VMmark benchmark:
- Allows accurate and reliable benchmarking of virtual data center performance and power consumption.
- Allows comparison of the performance and power consumption of different virtualization platforms.
- Can be used to determine the performance effects of changes in hardware, software, or configuration within the virtualization environment.
Why a Virtualization Platform Benchmark?
Server consolidation typically collects several diverse workloads onto a virtualization platform — a collection of physical servers accessing shared storage and network resources. Traditional single-workload performance and scalability benchmarks for non-virtualized environments were developed with neither virtual machines nor server consolidation in mind. Even previous single-server virtualization benchmarks have not fully captured the complexities of today's virtualized data centers.
VMmark 2.x: A True Multi-Server Virtualization Platform Benchmark
VMmark 1.x pioneered single-server virtualization benchmarking with its unique tile-based multi-application design. VMmark 2.x took the next step, filling the need for a multi-server virtualization platform benchmark by incorporating a variety of common platform-level workloads such as live migration of virtual machines, cloning and deploying of virtual machines, and automatic virtual machine load balancing across the data center.
VMmark 2.5: Server and Storage Power Measurement
In addition to the performance measurement in previous versions of VMmark, VMmark 2.5 adds the option to measure both the absolute power consumption and the power efficiency of the servers and storage used in the benchmark tests. This allows purchasing decisions to include not just absolute performance, but also performance per kilowatt, an increasingly significant factor in the total cost of ownership of computing resources.
Note: Though VMmark uses the SPEC® PTDaemon, VMmark results are not SPEC metrics and cannot in any manner be compared to SPEC metrics.
How Does VMmark Work?
The VMmark benchmark combines commonly-virtualized applications into predefined bundles called "tiles." The number of VMmark tiles a virtualization platform can run, as well as the cumulative performance of those tiles and the performance of a variety of platform level workloads, determine the VMmark 2.x score.
A Peer Reviewed Benchmark with More than 200 Published Results
Before being published, VMmark results must be submitted to a review panel composed of a variety of companies that have published VMmark benchmark results, ensuring the fairness and integrity of the benchmark.
Since its inception in 2007, more than 200 VMmark results have been published on the VMmark website and VMmark has become the standard by which the performance of virtualization platforms is evaluated.