Benckmarking a IaaS cloud computing infrastructure
At today most public cloud infrastructures are sort of black boxes. There’s not too much that cloud providers are happy to disclose about, including their architecture internals, internal and 3rd parties software layers, or security defenses.
Customers have to blindly trust the provider as there’s no way yet to plug-in monitoring agents or on-demand assessments without a major pain (assuming a provider would permit them).
So the idea of measuring the performance of these public clouds is rather interesting. CloudHarmony, a new project focused on cloud benchmarking and taxonomy of public clouds, is providing some insight and early reports that are worth a check.
Benchmarking is a challenging discipline. In this scenario seems almost impossible, as the cloud platforms are distributed across worldwide datacenters and the abstractive nature of the cloud implies that the underlying hypervisor or even the underlying physical hardware may change without notice, in any moment.
Still, CloudHarmony decided to test over 150 public clouds measuring things from raw CPU power to application workloads performance against the almost 100 benchmarks that are part of their suite.
The first published test is about the raw CPU power and includes the following clouds:
- Amazon EC2
- The RackSpace Cloud
- Storm on Demand
- GoGrid
- Voxel
- NewServers
- Linode
- SoftLayer
- Terremark vCloud Express
- OpSource Cloud
- Speedyrails
- Zerigo
- ReliaCloud
- IBM Development & Test Cloud
- BlueLock
- Cloud Central
- RimuHosting
- ElasticHosts
- Flexiscale 2.0
Their brief conclusions are interesting:
One take-away point we observed is that heterogenous hardware environments (where host hardware is configured with faster CPUs for larger sized instances) appears to be more conducive to true cloud CPU scaling. Of the 20 server clouds we benchmarked, only 4 appear to be providing such an environment: EC2, Storm on Demand, GoGrid and NewServers.
virtualization.info Newest articles
December 20th, 2011
Oracle has released version 4.1.8 of its virtualization platform VM VirtualBox. This version which can be considered a maintenance release can be installed on top of any VM VirtualBox 4.1.x…
December 20th, 2011
VKernel, recently acquired by Quest Software has released version 4.5. of its vOperations Suite (vOps). vOperations is a suite of products providing Performance Analysis, Capacity Management, Resource Optimization, Reporting and…
December 7th, 2011
Teradici is the developer of the PC-over-IP (PCoIP) remote desktop protocol, which is leveraged in software (by VMware view) and provided with Teradici hardware solutions which are OEM’ed by several…
December 7th, 2011
Citrix has released a whitepaper titled:"Windows 2008 R2 Optimization Guide For Desktop Virtualization with XenApp 6 / 6.5", the paper which contains 23 pages outlines optimization for XenApp 6 and…
December 6th, 2011
In November Microsoft released a public beta of the Microsoft Assessment and Planning Toolkit (MAP) version 6.5. Today Microsoft announced its release, which is the follow-up of version 6.0 which…
December 6th, 2011
Open source vendor Red Hat has released version 6.2 of its Linux distribution, Red Hat Enterprise Linux. This version is the follow-up of version 6.1 which was released in May…
December 6th, 2011
Microsoft has released version 3.2 of the Linux Integration Services for its hypervisor Hyper-V. This version is the follow-up of version 3.1 which was released in July this year.
The…
November 29th, 2011
Since its first official release beginning 2009, the Virtual Session Indexer(VSI) has gained popularity as an independent benchmarking tool. One of the projects using the VSI tool is Project Virtual…
November 21st, 2011
VMware has released version 4.1 of its desktop virtualization platform for Apple Mac: Fusion. This release is considered an minor upgrade for version 4.0 which was released in September this…
November 21st, 2011
In September VMware released a new major version of its virtualization platform Workstation 8.0 and in October it released Player 4.0. Now VMware released an update for its virtualization platform…
November 17th, 2011
VMware has released version 4.7 of of its application virtualization solution ThinApp. This version includes the ability to use ThinApp packages in combination with its Software as a Service (SaaS)…
November 17th, 2011
VKernel, provider of performance and capacity management products, has announced its acquisition by Quest Software. VKernel will operate as a independent subsidiary of Quest.
VKernel entered the virtualization market in…
November 16th, 2011
Lanamark has released a new version of its Capacity Planning platform Suite, this version is the follow up of version 2010 which was released in March last year.
Suite 2012…
November 15th, 2011
In November last year, started releasing Solaris 11 Express, the development version eventually leading to the release of Oracle Solaris 11 which was released last week. Solaris is one of…
Copyright © 2003-2012 virtualization.info. All rights reserved.
virtualization.info | cloudcomputing.info | virtualization.tv | Virtualization Congress