In the previous VMware Virtual SAN Performance Testing blog post we reviewed the benefits of running performance tests utilizing I/O trace files over synthetic workload tools such as IOmeter to more accurately characterize the performance of a Virtual SAN cluster. The VMware I/O Analyzer includes pre-created trace files of specific application profiles that allows you to quickly perform scale-out testing utilizing a mix of industry standard workloads But what if you want to characterize the performance of your existing vSphere virtualized environment within a new Virtual SAN configuration? This is were the use of custom I/O Trace replays can be useful. Continue reading
Category Archives: Performance
Big Data Extensions enables the deployment of Hadoop and HBase clusters in virtual machines on the VMware vSphere platform. This article gives you a brief introduction to the new features in BDE version 2.1. BDE ships as a virtual appliance (an OVA file) and it is a free download for users of vSphere Enterprise or Enterprise Plus.
BDE users are interested in using their favorite management tools from their Hadoop distro vendors, along with BDE and vCenter, to manage their newly created virtualized Hadoop clusters. The 2.1 release of BDE implements this feature in an elegant way!
Now you can use BDE and Cloudera Manager or Ambari together to install and manage your Hadoop clusters without leaving your Web Client BDE seat. You can also use the earlier styles of provisioning a Hadoop cluster as shown under the “BDE Only” and “BDE 2.0″ headings below. The first method on the left allows BDE to use a repository to install the Hadoop vendor’s software on to the virtual machines. BDE does the whole job of provisioning everything in this case – hence referred to as “BDE Only”.
Using BDE 2.0 (shown in the center column) you can create a basic cluster, i.e. one with no Hadoop software in it. Then you can use the Hadoop vendors’ installation and configuration tool to install the Hadoop software on those virtual machines. With BDE 2.1 you don’t have to go between the different tools; the full Hadoop installation can be done inside BDE’s user interface, but using the vendor’s APIs under the covers to do that. The difference between the BDE 2.0 and 2.1 methods is that in 2.1 the management tool from the Hadoop vendor is called by BDE directly.
In the first installment of the Virtual SAN Performance Testing series, we reviewed benchmarking performance using synthetic I/O generation tool Iometer, automated by the VMware I/O Analyzer appliance. Using Iometer, or other synthetic I/O generation tools is frequently the first option for benchmarking selected, as it is an operationally light weight method to benchmark storage performance. But what if you want to be able to simulate real world workloads within your Virtual SAN cluster, without the burden of building out applications. That is where I/O trace files can come into play.
As people begin to assess, design, build, and deploy VMware Virtual SAN based solutions for the first time, there is great curiosity in understanding the performance expectations to have, and results one can achieve when utilizing Virtual SAN in specific configurations. Most customers are running some type of benchmark in proof-of-concept environments in order to gauge the performance of VMware Virtual SAN in their environment. In working with customers and partners, we have seen a variety of methods used in attempting to benchmark and analyze Virtual SAN performance. In order to ease this process, we are developing guidance on how best to perform performance testing on Virtual SAN. This guidance will be presented in a four part series as follows:
- Virtual SAN Performance Testing Part I – Utilizing I/O Analyzer with Iometer
- Virtual SAN Performance Testing Part II – Utilizing I/O Analyzer with Application Trace Files
- Virtual SAN Performance Testing Part III – Utilizing Custom Application Trace files
- Virtual SAN Performance Testing Part IV – Analyzing Performance Results
Today VMware released Update 2 of its vSphere management solution, vCenter Server. In this release there are updates to the supported database versions and many resolved known issues.
- vCenter Server database support: vCenter Server now supports the following external databases:
- Oracle 12c. Important: For pre-requisite requirements, see KB 2079443.
- Microsoft SQL Server 2012 Service Pack 1
- Microsoft SQL Server 2014
- vCloud Hybrid Service: The vCloud Hybrid Service (vCHS) introduces a new container, Hybrid Cloud Service, on the vSphere Web Client home page. The Hybrid Cloud Service container contains the vCHS installer and the new vCloud Connector installer.
- Customer Experience Improvement Program: The vSphere customer experience improvement program is introduced to collect configuration data for vSphere and transmit weekly to VMware for analysis in understanding the usage and improving the product. For more details, see the vSphere Documentation Center.
Microsoft Exchange is a very common critical application managed by enterprises. Exchange 2013 has brought forth many changes to the performance and IO profile of its infrastructure.
Exchange Server 2013 is an even greater candidate for virtualization than its predecessors. Architectural changes and improvements to the core of Exchange Server, along with advancements in server hardware, make vSphere the default choice for Exchange 2013.
There are some really very interesting and useful virtualized Big Data-related talks and demos at VMworld 2014 during the week of the 24th-27th August. Among them is a customer panel at 4-5pm on Monday discussing vSphere, vCAC and Big Data Extensions for managing your virtualized Hadoop workloads as well as a talk from a VMware customer on providing Hadoop-as-a-Service (1-2pm on Monday and again at 2:30pm on Wednesday).
Here is a quick summary of the various Big Data events at the show. Come by and meet us at the various demo stations where we will show these technologies, as well as at the Hands-On Lab, HOL-SDDC-1409. Hope to see you there!
|VAPP1428 – Hadoop as a Service: Utilizing VMware vCloud Automation Center and Big Data Extensions at Adobe||Mon, Aug 25, 1-2pm (first occurrence)Wed, Aug 27, 2:30-3:30pm (second occurrence)|
|VAPP1807 – Best Practices of Virtualizing Hadoop on vSphere – Customer Panel||Mon, Aug 25, 4-5pm|
|VAPP1314 – Scaling Your Storage Architecture for Big Data – How the Isilon Server Fits Well with Virtual Hadoop Workloads||Tue, Aug 26, 4-5pm|
|VAPP1859 – Extreme Performance Series: How to Build a High Performance Platform for Big Data||Wed, Aug 27, 8:30-9:30am|
|HOL-SDDC-1409 – Big Data Extensions Hands on Lab :||All Week|
|Demonstrations on the VMware booth and at the Data Lake area of the EMC/EVP booth||All Week|
|Customer Meetings||Contact firstname.lastname@example.org|
|VMware Big Data Special Interest Group (SIG)||Contact email@example.com|
TPC-C Benchmark is an on-line transaction processing (OLTP). (TPCC Main site) TPC-C uses a mix of five concurrent transactions of different types and complexity. The database is comprised of nine types of tables with a wide range of record and population sizes. TPC-C is measured as transactions per minute (TPM).
The goal of this exercise was to see if 1 million TPM can be achieved on virtualized SQL 2014 backed by an all Flash storage array for a TPC-C like test. The TPC-C testing would be compared between two VM sizes (Within NUMA & Exceeding NUMA boundaries)
As many of you know, I work very closely with VMware Product Management and Engineering and we are always looking for data points to support concepts and aid the development of future generations with our products. We have created a 3 page survey that covers Performance and Availability within vCenter Server environments.
Help us make our products better by spending a few minutes to complete, your participation is much appreciated.
Now that I’ve scared you, lets take a look at these use cases.