It is with great pleasure and joy that I like to announce the official launch of VMware Virtual SAN 6.0, one of VMware’s most innovative software-defined storage products and the best hypervisor-converged storage platform for virtual machines. Virtual SAN 6.0 delivers a vast variety of enhancements, new features to the as well as performance and scalability improvements.
vSphere Virtual Volumes
Today VMware announced the release of vSphere 6.0 and with this announcement comes the official release of vSphere Virtual Volumes. vSphere Virtual Volumes (VVOLs) is VMware’s new management & integration framework designed to deliver a more efficient operational model for external storage.
vSphere Virtual Volumes implements the core tenants of the VMware SDS vision to enable a fundamentally more efficient operational model for external storage in virtualized environments, centering on the application instead of the physical infrastructure.
vRealize Operations Management Pack for Virtual SAN Beta – Early Sign-up
If you already heard the exciting news about VMware new offerings – vSphere 6, Virtual SAN 6 and vSphere Virtual Volumes – and thought it can’t get any better, we have a small surprise for you. Virtual SAN 6.0 includes a host of new features including high performance snapshots and clones, all flash Virtual SAN with intelligent 2-tier model, failure domains and more. One of the most requested features among Virtual SAN 5.5 customers is enabling greater visibility to what happens “under the hood”. The Virtual SAN team developed a new health dashboard that will help customers tackle underlying hardware issues as part of the v6.0 release, but in addition to that the vRealize operations team developed an advanced set of dashboards aimed at making Virtual SAN users life much easier.
The Virtual SAN team along with the vRealize Operations team are thrilled to offer you a unique opportunity to beta test the new vRealize Operations Management Pack for Storage Devices. The management pack will feature advanced insight into Virtual SAN through advanced analytics to enable rapid troubleshooting and cluster optimization.
We will share more details closer to the start of the beta program which will kick off in Q1 2015. If you would like to get more information and be on the list of people who get an invitation to participate in the beta, please sign up here – www.vmware.com/go/vrops4vsan-beta
Check out the vROps MPSD blog post for more details – http://blogs.vmware.com/management/2015/02/vsan-simplifying-sddc-storage-operations-with-vrealize-operations-management-pack-for-storage-devices.html
VMware Virtual SAN: File Services with NexentaConnect
NexentaConnect for Virtual SAN is a software-defined storage solution designed specifically to deliver file service on top of Virtual SAN. This solution complements Virtual SAN by delivering a software-based NAS capabilities that add enterprise-class Windows and UNIX-based file services without the need for any additional hardware purchase to augment the virtual machine storage provided by VMware Virtual SAN.
NexentaConnect is designed to deliver high-performance NFS and SMB file services to the full datacenter by leveraging Virtual SAN features and capabilities. The management and configuration of the solution adopts Virtual SAN simplified management approach delivering an agile and efficient operational model. The solution delivers NFSv3, NFSv4, and SMB 2.1 file shares services for hybrid networks, as well as its set of capabilities relate to performance, availability, and storage services such as:
- Localized server-side read cache
- Compression and de- duplication
NexentaConnect for Virtual SAN maintains data integrity under high workload, network/disk/host recovery and brings various recovery functions, such as snapshot and remote file replication designed specifically for this solution. All configured and managed through the vCenter console and the vSphere Web Client.
Storage and Availability at Partner Exchange 2015
VMware’s 2015 Partner Exchange is now just about one week away, and it’s shaping up to be a great one!
In storage and availability we’ll have a lot to talk about across the board: Some sessions will offer deeper examinations of our current products, others will give you a great exploration of some of the newer things VMware has to showcase.
I’ve made a list of some of the sessions put on by those of us in the storage and availability product team; it’s a good cross section from product marketing, product managers, and technical marketing people such as myself. Outside of the engineers who actually write the code, these are the people closest to the products you use, so sign up and hear something new. There are also sessions from our highly experienced field sales and technical teams — the experts at understanding how these products address customer requirements and explaining their value to our customers.
I’m personally doing a technical session with my colleague Rawlinson on Virtual SAN (STO4275) and looking forward to it quite a bit.
Lastly, don’t be shy to come say hello after the sessions. We love to hear your thoughts, if we’ve got time between activities…
Discover Software-Defined Storage & VMware Virtual SAN at PEX 2015!
Are you a VMware partner? Come learn more about VMware Virtual SAN — our software-defined storage solution designed for vSphere environments — at VMware Partner Exchange (PEX) 2015.
The sessions, like the rest of PEX 2015, will take place at the Moscone Center in San Francisco, California, February 3 – 5th. Depending on your needs, there will be several important Software-Defined Storage and VMware Virtual SAN sessions you won’t want to miss.
If your organization is concerned about enterprise-level storage and availability, add these Software-Defined Storage and VMware Virtual SAN sessions to your calendar. (Log on and register to view session abstracts, speakers, and locations.)
Tuesday 2/3
- STO4280: 12:30 PM – 1:30 PM, VMware Software-Defined Storage Overview
- STO4278: 2:00 PM – 3:00 PM, Virtual Volumes Technical Overview
- STO4273: 3:30 PM – 4:30 PM, What’s New with VMware Virtual SAN and How to be Successful Selling It
- STO4289: 5:00 PM – 6:00 PM, Conducting a Successful Proof of Concept for Virtual SAN
Wednesday 2/4
- STO4295: 11:30 AM – 12:30 PM, SRM & Business Continuity Overview
- STO4275: 12:45 PM – 1:45 PM, Virtual SAN Technical Walkthrough
- STO4290: 2:00 PM – 3:00 PM, Delivering SDS to SAN/NAS with Virtual Volumes
- STO4464: 3:15 PM – 4:15 PM, Virtual SAN Panel: View from the Sales Trenches
- STO4465: 4:30 PM – 5:30 PM, Performance and Best Practices for Business Critical Applications leveraging Virtual SAN
Thursday 2/5
- STO4293: 9:00 AM – 10:00 AM, SRM & VR6 Technical Deep Dive
- STO4276: 10:15 AM – 11:15 AM, Virtual SAN Hardware Guidance & Best Practices
- STO4279: 11:30 AM – 12:30 PM, Software-Defined Storage: the Key to Agility with Control
Be sure to follow our social channels at @vmwarevsan and Facebook.com/vmwarevsan for the latest updates.
For more information about VMware Virtual SAN, visit http://www.vmware.com/products/virtual-san.
Operationalizing VMware Virtual SAN: Automating vCenter Alarm Configuration Using PowerCLI
Welcome to the next installment in our Operationalizing VMware Virtual SAN series. In our previous article we detailed “How to configure vCenter alarms for Virtual SAN”. In today’s article we will demonstrate how to automate that configuration workflow leveraging PowerCLI.
(Many thanks to VMware genius Alan Renouf (@alanrenouf) for his contributions to this topic) [Joe Cook: @CloudAnimal]
The PowerCLI code required to automate the configuration of vCenter Alarms for Virtual SAN is considerably straightforward.
1. Connect to vCenter
Connect-VIServer -Server 192.168.100.1 -User Administrator@vsphere.local -Password vmware
2. Define the the Virtual SAN cluster where you would like the rules to be created
$Cluster = "Cluster Site A"
3. Next we create a hash table with the desired VMware ESXi Observeration IDs (VOB IDs) for Virtual SAN and include a description for each VOB ID.
If you are not used to programming, the concept of arrays and hash tables may be a bit confusing. Using variables is generally much easier to understand. One way of understanding variables is to think of them simply as a short amount of text used to represent a larger amount of text in your program or script ($x=”larger amount of text”). Instead of typing “larger amount of text” continually, you can simply type $x and the language interpreter (in our case PowerShell), will substitute the string “larger amount of text” wherever it finds $x in your script. Variables can be used to greatly reduce the amount of code you have to type, make your scripts much easier to read, and have many other uses as well.
If we think of variables as ways to store one value to reference, we can think of arrays as a way to store multiple values to reference. In our example today, we would have to create at least 32 variables to perform the same work that we can with one hash table.
A hash table is a type of array that is also known as a dictionary. It is a collection of name-value pairs (e.g. “name”=”value”) that can be used . Here we have an example of a basic hash table:
$HashTableName = @{ VOB_ID_A="VOB Description"; VOB_ID_B="VOB Description"; VOB_ID_C="VOB Description"; }
In the table below we have a breakdown of the components of the code used to create a hash table:
Syntax Component | Description |
$HashTableName = | Replace “HashTableName” with the text you wish to use to reference this list of key-values pairs. |
@{ | Indicates the start of the hash table or array |
VOB_ID_A=”VOB Description”; | Key-Value pair to store within the hash table. VOB_ID_A will be the VOB ID from the VMware ESXi Observation Log (VOBD) (e.g. “esx.audit.vsan.clustering.enabled”). “VOB Description” will be the description of the associated “VOB ID” (e.g. “Virtual SAN clustering service had been enabled”). Make sure to use quotation marks whenever spaces are used and to separate each key-value pair with a semicolon (;).Examine /var/log/vobd.log on your vSphere host to obtain possible VOB IDs. See here for a list of VMware ESXi Observation IDs for Virtual SAN. |
} | Indicates the end of the hash table or array |
Here is an example of a hash table with a single key-value pair representing a single vCenter Alarm for Virtual SAN:
$VSANAlerts = @{ "esx.audit.vsan.clustering.enabled" = "Virtual SAN clustering service had been enabled"; }
Below is the actual hash table that we will use in our example Virtual SAN Alarm Configuration script. It is fully populated with all of the recommended VOB IDs for Virtual SAN along with the description for each. We have labeled this hash table as “$VSANAlerts”. You will see $VSANAlerts referenced further along in the script as we reference the items within our hash table.
$VSANAlerts = @{ "esx.audit.vsan.clustering.enabled" = "Virtual SAN clustering service had been enabled"; "esx.clear.vob.vsan.pdl.online" = "Virtual SAN device has come online."; "esx.clear.vsan.clustering.enabled" = "Virtual SAN clustering services have now been enabled."; "esx.clear.vsan.vsan.network.available" = "Virtual SAN now has at least one active network configuration."; "esx.clear.vsan.vsan.vmknic.ready" = "A previously reported vmknic now has a valid IP."; "esx.problem.vob.vsan.lsom.componentthreshold" = "Virtual SAN Node: Near node component count limit."; "esx.problem.vob.vsan.lsom.diskerror" = "Virtual SAN device is under permanent error."; "esx.problem.vob.vsan.lsom.diskgrouplimit" = "Failed to create a new disk group."; "esx.problem.vob.vsan.lsom.disklimit" = "Failed to add disk to disk group."; "esx.problem.vob.vsan.pdl.offline" = "Virtual SAN device has gone offline."; "esx.problem.vsan.clustering.disabled" = "Virtual SAN clustering services have been disabled."; "esx.problem.vsan.lsom.congestionthreshold" = "Virtual SAN device Memory/SSD congestion has changed."; "esx.problem.vsan.net.not.ready" = "A vmknic added to Virtual SAN network config doesn't have valid IP."; "esx.problem.vsan.net.redundancy.lost" = "Virtual SAN doesn't haven any redundancy in its network configuration."; "esx.problem.vsan.net.redundancy.reduced" = "Virtual SAN is operating on reduced network redundancy."; "esx.problem.vsan.no.network.connectivity" = "Virtual SAN doesn't have any networking configuration for use." }
(For more information on working with PowerShell hash tables, see this handy Microsoft TechNet article)
4. Next we use the Get-View cmdlet to query the vCenter Alarm Manager for each VOB ID listed in step 3.
The Get-View cmdlet returns the vSphere inventory objects (VIObject) that correspond to the specified search criteria.
$alarmMgr = Get-View AlarmManager $entity = Get-Cluster $Cluster | Get-View $VSANAlerts.Keys | Foreach { $Name = $VSANAlerts.Get_Item($_) $Value = $_
5. Create the vCenter Alarm specification object
$alarm = New-Object VMware.Vim.AlarmSpec $alarm.Name = $Name $alarm.Description = $Name $alarm.Enabled = $TRUE $expression = New-Object VMware.Vim.EventAlarmExpression $expression.EventType = Vim.Event.EventEx $expression.eventTypeId = $Value $expression.objectType = "HostSystem" $expression.status = "red" $alarm.expression = New-Object VMware.Vim.OrAlarmExpression $alarm.expression.expression += $expression $alarm.setting = New-Object VMware.Vim.AlarmSetting $alarm.setting.reportingFrequency = 0 $alarm.setting.toleranceRange = 0
6. Create the vCenter Alarm in vCenter
Write-Host "Creating Alarm on $Cluster for $Name" $CreatedAlarm = $alarmMgr.CreateAlarm($entity.MoRef, $alarm) } Write-Host "All Alarms Added to $Cluster"
As you can see, the steps to create vCenter Alarms for Virtual SAN are actually pretty straightforward. If you have not yet began monitoring your Virtual SAN environment, these steps can accelerate the process quite rapidly and you really do not have to be an expert in PowerCLI to do so.
VMware Hands on Labs
Here is a great tip brought to you by our friends at the VMware Hands on Labs. If you would like an excellent shortcut to getting “hands on” creating vCenter Alarms for Virtual SAN, using PowerCLI cmdlets, try out the lab below:
We have many more articles on there way so share, re-tweet, or whatever your favorite social media method is. You will not want to miss these!
(Thanks to @millardjk for his keen eye)
Resources
- Download and Install PowerCLI 5.8 Release 1
- Download and Install PowerCLI for vCD and vCloud Air Tenants 5.8 Release 1
VMware Virtual SAN and ScaleIO : Fundamentally Two different approaches to Software-Defined Storage
There’ s a lot of buzz and excitement around Software-Defined Storage (SDS) and hyper-converged storage solutions. Particularly around VMware’s recently introduced product: VMware Virtual SAN.
VMware Virtual SAN is seeing tremendous traction in the market since its release. After only two full quarters of availability, we already have many hundreds of customers happily running a variety of applications on Virtual SAN, from VDI to test & development to production applications and databases. Virtual SAN customers love the product’s simplicity and integration with the VMware stack.
But along with increased awareness and traction, we are also seeing an increasing level of confusion in the market on the key differences between Virtual SAN and other SDS products. Particularly, we have been receiving a great deal of questions from our customers and partners about differences between Virtual SAN and EMC ScaleIO. They are asking us about where Virtual SAN should be used, where ScaleIO should be used, and whether there’s any real difference between the two.
This type of confusion is unfortunate because VMware Virtual SAN and ScaleIO follow two fundamentally different approaches to SDS.
- VMware Virtual SAN is designed specifically around tight integration with vSphere – with the objective of providing super-simple management and very high levels of performance for vSphere VMs. Virtual SAN is always deployed in a hyper-converged configuration, where storage is converged with the vSphere compute nodes. Virtual SAN is targeted at the generalist IT professional, not just storage experts.
- ScaleIO has a different design point – to provide highly scalable server-based storage for heterogeneous platforms, including multiple hypervisors and physical servers. ScaleIO has its own installation, configuration and management workflows which are typically driven by expert storage administrators.
The confusion between VMware Virtual SAN and ScaleIO is partially fueled by recent press articles, which claim full integration of ScaleIO into vSphere’s ESX kernel. This claim is not accurate. There are no plans to port the core ScaleIO product in the ESX kernel or integrate it with the rest of the vSphere stack.
More specifically, ScaleIO consist of two components: a) a block storage server that is the core of the ScaleIO product and which serves block storage to its clients through the ScaleIO protocol; b) a client which connects to the server and allows VMs and applications to access storage on ScaleIO clusters. This model is very similar to an iSCSI target server serving data to iSCSI initiators. EMC has written an ESX kernel driver that implements a ScaleIO client module. It ‘talks’ the ScaleIO protocol and accesses the ScaleIO server(s). It exposes storage to VMs running in vSphere in a way similar to iSCSI volumes. This ScaleIO driver has been written using public kernel APIs that are available to any VMware partner who develops kernel drivers in ESX. The ScaleIO server is not being ported in or integrated with vSphere and the ESX kernel. The ScaleIO server runs on Linux servers, either on bare metal or as a virtual appliance.
This architectural model allows ScaleIO to be a great SDS solution for heterogeneous platforms.
In the case of bare metal deployments VM I/O goes through the in-kernel driver and onto the external ScaleIO cluster over an IP network as it is the case with other storage arrays. In the virtual appliance case, a VM I/O operation traverses the ESX storage stack through the virtual appliance.
In contrast, VSAN and all its components are natively integrated with vSphere. The key functional components of VSAN, including its “server” functionality, run in the ESX kernel. This fundamental difference in architecture allows VSAN to be optimized for vSphere VMs in an unparalleled way. VSAN is also integrated directly with the ESX control plane, vCenter and vSphere APIs to provide a simple and effective management experience. Together, these integrations provide important benefits to vSphere customers:
- Performance and Overhead: The full kernel integration gives VMware Virtual SAN higher levels of performance and efficiency because Virtual SAN can more efficiently utilize the available memory and CPU cycles. Hence, Virtual SAN’s memory footprint and CPU cycles consumed per operation are the lowest in the market. Furthermore, compute and storage operations are executing inside the same layer of software, minimizing communication latencies. This efficiency translates to more compelling performance and total-cost-of-ownership for the end user[V3] . By contrast, no other hyper-converged solution has its “server” logic integrated in the vSphere kernel, limiting the gains and efficiencies that can be achieved by these solutions.
- Management integration: Virtual SAN is designed to be managed through vCenter, by any administrator who is familiar with vSphere. The setup, configuration and ongoing management of the product are simple and fully integrated with vSphere management workflows. As a result, there are no separate management consoles and solutions. The required storage properties of each VM and virtual disk are expressed in the form of policies. Effectively, storage becomes a quality of every VM, not a separate function.
- Programmatic APIs: The functionality of Virtual SAN’s control plane is exposed through new or extensions to existing vSphere APIs. These are stable APIs with s wide range of language bindings that VMware customers have been using for years to automate their operational processes.
- vSphere Features: In addition, since Virtual SAN is embedded within the hypervisor, all vSphere features such as DRS, vMotion, SVMotion, High Availability, vSphere Replication, and others are seamlessly supported with VSAN.
VMware Virtual SAN’s architectural model allows it to be the best storage solution for hyper-converged vSphere environments and for vSphere VMs. It does not address non-vSphere storage needs today.
So what does it mean in terms of where each solution should be used? In practice things are never black or white as we would like them to be, but at a high level there are some key aspects that we can keep in mind when comparing:
- Use VMware Virtual SAN if you value deep integration with vSphere, both on the data path and control plane. Virtual SAN is deployed in a hyper-converged model, where storage is converged with compute on the same x86 hosts and storage scales in alignment with vSphere clusters (up to 32 nodes per cluster today, soon to become 64). We believe the Virtual SAN approach delivers highly differentiated, unique advantages for customers of all sizes looking for an SDS solution for vSphere.
- Use ScaleIO when delivering highly scalable shared storage from a single storage pool to different hypervisors or across multiple vSphere clusters. The primary use case for ScaleIO is serving storage for a heterogeneous environment (i.e when storage is served to a diverse set of hypervisor clients or between virtual and physical environments) or when the storage system needs to scale beyond the size of a vSphere cluster.
The picture below should help clarify what these two products are positioned for:
Gartner Predictions: Storage Integration Leading the Way in 2015
Rowing crews move in sync to keep their craft moving at a steady pace – but that synchronous movement would not exist without an investment in the right hardware and the right training. For businesses, that means not only investing in the right rowers, but also in the right tools to enable athletes. And for a long time those tools, namely storage for midmarket organizations, have either been too expensive, too resource heavy or too complex.
It doesn’t have to be that way. Midmarket teams should be able to afford the right equipment without worry so they can focus on more important tasks. That’s why we’re thrilled to discover Gartner Research included VMware Virtual SAN in their recent report, “Predicts 2015: Midmarket CIOs Must Shed IT Debt to Invest in Strategic IT Initiatives.”
The report investigates how CIOs can best invest resources to give IT teams the simplified tools they need while staying on budget. Often, this excludes “best of breed” solutions. Gartner suggests midsize businesses seek out integrated systems that combine server, storage and network components in a package suitable for their needs instead.
For many, Virtual SAN, VMware’s policy-driven storage product design for vSphere environments, is that solution. Its ease of use, performance, scalability and low total cost of ownership helps to avoid significant upfront investments. And, with its VM-level storage policies, Virtual SAN automatically and dynamically matches requirements with underlying storage resources. Meaning less time manually managing storage tasks and more time focusing on important tasks.
According to Gartner’s predictions, roughly 40% of midsize enterprises will replace all data center services and storage with integrated systems by 2018. We certainly would like to see, and be at the forefront, of that transition.
VMware Virtual SAN stands apart from the competition not just because of its ability to deliver simple software defined shared storage, but also because of its integrated partner ecosystem. More than 40 Virtual SAN Ready Nodes can be purchased from our system vendor partners.
We’re thrilled to have been a part of software defined storage in 2014, and we can’t wait to push the envelope further in 2015.
Be sure to subscribe to the Virtual SAN blog or follow our social channels at @vmwarevsan and Facebook.com/vmwarevsan for the latest updates.
For more information about VMware Virtual SAN, visit http://www.vmware.com/products/virtual-san.
Tips for a Successful VMware Virtual SAN Evaluation
One of the biggest advantages of Virtual SAN is that it is so easy to set up and use. Out of all the evaluation options available to them, many customers have realized that trying it out in their own environment is entirely feasible.
We’ve been keeping track of the many Virtual SAN evaluations to date, and have created a quick guide that should help anyone evaluating Virtual SAN in their environment. In it, you’ll find a checklist on configurations, verifying compatibility, testing the network, expected behaviors for failure testing, and tips on testing performance. It’s an essential guide for anyone working with Virtual SAN.
We hope you find this document useful!
Download: Tips for a Successful VMware Virtual SAN Evaluation