Home > Blogs > VMware vSphere Blog > Tag Archives: storage

Tag Archives: storage

VMWorld Topic: Virtual Volumes (VVOLS) a game changer for running Tier 1 Business Critical Databases

One of the major components released with vSphere 6 this year was the support for Virtual Volumes (VVOLS). VVOLS has been gaining momentum with storage vendors, who are enabling its capabilities in their arrays.

When virtualizing business databases there are many critical concerns that need to be addressed that include:

  1. Database Performance to meet strict SLAs
  2. Daily Operations e.g. Backup & Recovery to complete in set window
  3. Cut down time to Clone / Refresh of Databases from Production
  4. Meet different IO characteristics and capabilities based on criticality
  5. Never ending debate with DBAs
  6. File Systems v/s Raw Devices (VMFS v/s RDM)

VVOLS can offer solutions to mitigate these concerns that impact the decision to virtualize business critical databases. VVOLS can help with the following:

1. Reduce backup windows for databases
2. Provide ability to have Database consistent backups
3. Reduced cloning times for multi-terabyte databases
4. Provide capabilities for Storage Policy based management

Details on the solutions available with VVOLS and its impact on “Virtualized Tier1 Business Critical Databases” will be discussed in detail at vmworld 2015 in session STO4452:

STO4452 –  STO4452 – Virtual Volumes (VVOLS) a game changer for running Tier 1 Business Critical Databases
Session Date/Time: 08/31/2015 03:30 PM – 04:30 PM

Use VSAN Assessment to validate Virtual SAN’s benefits for your organization

Are you experiencing challenges with your current vSphere storage environment (i.e., performance, capacity constraint, complexity, expensive renewals) or just not sure if VMware Virtual SAN (VSAN) would be a good fit?

Now VMware partners, SEs, or reps can help you with a free VSAN Assessment.

Continue reading

vSphere with Operations Management Product Walkthroughs

If you’ve ever tried to watch a product demo video, or tried to use it to show a product to someone else, often times you find yourself trying to pause the video at the exact right moment, and then having scrub backwards or forwards because you missed the timing.  At VMware we’ve created an alternative way ot showing demos, which we call Product Walkthroughs.  These are web-based demos that let you walk through a scenario screen-by-screen, at your own pace.  Each screen has annotations to explain what’s going on and markups that highlight important parts of the screen, both of which can be turned off if you want a clean view.

Although we have created Product Walkthroughs for numerous products and solutions, the ones I want to focus on are for vSphere 6 and vSphere with Operations Management.  Both of these provide a great way to learn about these products and their features at your own pace, as well as to show how something works to your colleagues (or bosses).  The one on vSphere 6 highlights the features in this major new release, with sections on:

and more.

The vSphere with Operations Management product walkthrough provides an in-depth look at all the features of its two major components, vSphere and vRealize Operations, including

So, check them out and let us know what you think!

What’s New with Virtual SAN 6.0?

Software-Defined Storage is making waves in the storage and virtual infrastructure fields. Data and infrastructure are intertwined, and when they’re both brought together, companies can cut down on expenses and increase productivity.

Rawlinson Rivera, Principal Architect, Storage and Availability, recently hosted a webinar, discussing how VMware is approaching Software-Defined Storage (SDS) and virtualization in recently announced VMware updates, including updates to VMware Virtual SAN 6.0.

Software-defined storage offers organizations the ability automate, distribute and control storage better than ever before. SDS can provision storage for applications on demand and without complex processes. It also allows for standardized hardware, reducing costs for businesses everywhere.

To bring the customers the best software-defined storage experience to realization, we had to update VMware® Virtual SAN™. And we did just that. With VMware Virtual SAN 6.0, we introduced several new features with SDS in mind:

  • Software-defined storage optimized for VMs
  • All Flash architecture
  • Broad hardware support
  • The ability to run on any standard x86 server
  • Enterprise-level scalability and performance
  • Per-VM storage policy management
  • And a deep integration with the VMware stack

There’s a lot more to unpack from the latest updates to our VMware solutions. For a more in-depth guide to what’s new and how it affects you, watch the webcast here!

Be sure to subscribe to the Virtual SAN blog or follow our social channels at @vmwarevsan and Facebook.com/vmwarevsan for the latest updates.

For more information about VMware Virtual SAN, visit http://www.vmware.com/products/virtual-san.

Virtual SAN Certification & VCG Update

The Virtual SAN product team is pleased to announce that last week we released new certified components (I/O controllers, SSDs and HDDs), new Ready Nodes and a new Hardware Quick Reference Guide for Virtual SAN 6.0 along with a new and improved VCG page.  Please see updated links below:

Updated Virtual SAN VCG

Updated Virtual SAN Hardware Quick Reference Guide

Updated Virtual SAN Ready Nodes

 

How many new components and Ready Nodes do we have listed for Virtual SAN 6.0?

We now have 26 I/O controllers, 170 SSDs and 125 HDDs (and counting) supported on Virtual SAN 6.0.   In addition to the Virtual SAN 5.5 Ready Nodes, we have 8 new Ready Nodes for Virtual SAN 6.0  (Cisco – 4 Hybrid, Dell – 1 Hybrid, Hitachi – 1 Hybrid, Super Micro – 1 All Flash & 1 Hybrid).

We expect this list to grow very quickly.  We have a number of components that are currently getting certified and we plan to add new certified devices and Ready Nodes to the VCG on a weekly basis.

 

How does the Virtual SAN Certification process work?

The VMware Virtual SAN team treats hardware certification very seriously.  I/O controllers play a very important part in determining the stability and performance of a Virtual SAN cluster and need to be able to withstand high I/O under stress conditions.

The I/O controllers are put through a rigorous I/O certification process while the HDD, SSD and Ready Nodes  are put through stringent paper qualifications.

We run a I/O controller card through a 3-week-long certification test plan (the certification is done by VMware or by the partner) that stress tests the card across many dimensions, particularly in high load and failure scenarios to ensure the card can withstand the level of I/O pushed down by Virtual SAN even in the most adverse situations (example: rebuilds and resyncs triggered due to host failures).

If there are issues identified, we work closely with our controller vendor/OEM partner to resolve them and re-run the entire test suite after resolution.  Sometimes an updated firmware or driver version addressing the issue is required from the vendors before we can proceed with more testing.

Only controllers that fully pass the test criteria laid out in the above process are listed on the Virtual SAN VCG.

 

Are separate I/O controller certifications required for different releases?

Yes, we require controllers to be recertified whenever any of the following change:

  • Virtual SAN Release version (eg: 5.5 to 6.0)
  • The controller driver version
  • The controller firmware version

We also certify the same controller separately for Virtual SAN All Flash vs Hybrid since the caching and I/O mechanism are different for these two configurations and we expect controllers to behave differently with varying levels of I/O.

 

What about certification of PCIe-SSD devices?

PCIe-SSDs are nothing but SSDs with an on-board I/O controller in a PCIe form factor.  Therefore, these require the same level of due diligence as required by standard I/O controllers.  As a result, we are putting these devices through the same level of rigorous certification as we do for I/O controllers.

VMware is working very closely with partners to certify the first set of PCIe-SSDs for Virtual SAN 6.0 over the coming weeks.

 

What are the new updates to the VCG page?

The Virtual SAN VCG page has been enhanced to allow users to easily build or choose their All Flash configurations in addition to Hybrid configurations.  Since All Flash Virtual SAN requires SSDs of different endurance and performance spec for caching and performance tiers (See Updated Virtual SAN Hardware Quick Reference Guide for details on specs), we have enhanced the VCG to help users easily pick SSDs for the tier they are interested in.

We have also introduced a new SSD filter called “Virtual SAN type” to help easily filter our All Flash vs Hybrid configurations.  Furthermore, we have added a filter called “Tier” to help you filter our Virtual SAN hybrid caching, Virtual SAN All Flash caching and Virtual SAN capacity caching tiers.

The endurance rating for SSDs are now displayed on the VCG in TBW (Terabytes written over 5 years) as opposed to DWPD (Drive Writes Per Day) which was used previously.

 

What are the controllers that are currently in the certification queue and when do we expect them to get certified?

Please see the attached list of controllers that are currently undergoing Virtual SAN certification

Note:  In many cases, we rely on our partners to provide driver/firmware fixes for controller issues so if there are delays in receiving these updates from partners, the certification timelines may get pushed out.

Having said that, we are making good progress on most of the controllers listed in the attached document and expect them to follow our standard certification process.

On a similar note, Ready Nodes  are primarily dependent on the controllers getting certified, so as you see new controllers on the VCG for 6.0 certified, Ready Nodes  including those controllers will follow.

Video: Virtual SAN From An Architect’s Perspective

Video: Virtual SAN From An Architect’s Perspective

Have you ever wanted a direct discussion with the people responsible for designing a product?

Recently, Stephen Foskett brought a cadre of technical bloggers to VMware as part of Storage Field Day 7 to discuss Virtual SAN in depth.  Christos Karamanolis (@XtosK), Principle Engineer and Chief Architect for our storage group went deep on VSAN: why it was created, its architectural principles, and why the design decisions were important to customers.

The result is two hours of lively technical discussion — the next best thing to being there.  What works about this session is that the attendees are not shy — they keep peppering Christos with probing questions, which he handles admirably.

The first video segment is from Alberto Farronato, explaining the broader VMware storage strategy.

The second video segment features Christos going long and deep on the thinking behind VSAN.

The third video segment is a run-over of the second.  Christos presents the filesystem implementations, and the implications for snaps and general performance.

Our big thanks to Stephen Foskett for making this event possible, and EMC for sponsoring our session.

 

VMware Virtual SAN 6.0 Now Generally Available

Virtual SAN 6 – you heard about it in February… thousands of you read about it in Rawlinson’s blog post… and today you can get your hands on it. Virtual SAN 6 is now generally available (GA) – download your evaluation version today! For those of you who missed Rawlinson’s blog post describing the details around what’s new with Virtual SAN 6 – you can read it here (below). But there’s a better way to get the information – register and attend this week’s webinar on “What’s New with Virtual SAN 6” hosted by Rawlinson Rivera – we’ll see you there!

VSAN-ALL-FLASH-LOGO

It is with great pleasure and joy that I like to announce the official launch of VMware Virtual SAN 6.0, one of VMware’s most innovative software-defined storage products and the best hypervisor-converged storage platform for virtual machines. Virtual SAN 6.0 delivers a vast variety of enhancements, new features to the as well as performance and scalability improvements.

Virtual SAN 6.0 introduces support for an all-flash architecture specially designed to provide virtualized applications high performance with predictably low latencies. Now with support for both hybrid and all-flash architectures Virtual SAN 6.0 is ready to meet the performance demands of just about any virtualized application by delivering consistent performance with sub-millisecond latencies.

Hybrid Architecture

  • In the hybrid architecture, server-attached magnetic disks are pooled to create a distributed shared datastore that persists the data. In this type of architecture, you can get up to 40K IOPS per server host.

All-Flash Architecture

In All-Flash architecture, the flash-based caching tier is intelligently used as a write-buffer only while another set of flash devices forms the persistence tier to store data. Since this architecture utilizes only flash devices, it delivers extremely high IOPs of up to 90K per host, with predictable low latencies.

VSAN-Archs

Virtual SAN 6.0 delivers true enterprise-level scale and performance by doubling the scalability of Virtual SAN 5.5 by scaling up to 64 nodes per cluster for both hybrid and all-flash configurations. In addition, Virtual SAN 6.0 improves the number of virtual machines per host up to 200 for both supported architectures.

VSAN-Scale

The performance enhancements delivered in Virtual SAN 6.0 are partially due to the new Virtual SAN on-disk Filesystem (VSAN FS). The new version delivers a new VMDK delta file (vsanSparse) takes advantage of the new on-disk format writing and extended caching capabilities to deliver efficient performance. This results in the delivery of performance-based snapshots, and clone that are comparable to SAN snapshots.

Virtual SAN 6.0 now enables intelligent placement of virtual machine objects across server racks for enhanced application availability even in case of complete rack failures. Virtual SAN Fault Domains provide the ability to group multiple hosts within a cluster to define failure domains to ensure replicas of virtual machines data is spread across the defined failure domains (racks).

VSAN-FD

Along with all the new added features a significant amount of improvements have been added to enhance the management user experience:

  • Disk/Disk Group Evacuation – Introduce ability to evacuate data from individual disk/disk groups before removing a disk/disk group from the Virtual SAN.
  • Disk Serviceability features – easily map the location of magnetic disks and flash devices. Ability light disk LED on failures, Turn disk LED on/off from the vSphere Web Client.
  • Storage Consumption Models – adds functionality to visualize Virtual SAN 6.0 datastore resource utilization when a VM Storage Policy is created or edited.
  • UI Resynchronization Dashboard – the vSphere Web Client UI displays virtual machine objects resynchronization status and remaining bytes to sync.
  • Proactive Rebalance – provides the ability to manually trigger a rebalance operation in order to utilize newly added cluster storage capacity.
  • Health Services – deliver troubleshooting and health reports to vSphere Administrators about Virtual SAN 6.0 subsystems and their dependencies such as cluster, network, data, limits, physical disk.

VSAN-health

With all the major enhancements and features of this release, Virtual SAN is now enterprise-ready, and customers can use it for a broad range of use cases, including business-critical and tier-1 production applications.  Stay tune, there is a lot more to come from the world’s greatest software-defined storage platform. For more information visit the Virtual SAN product page.

– Enjoy

For future updates on Virtual SAN (VSAN), vSphere Virtual Volumes (VVOLs) and other Software-defined Storage technologies as well as vSphere + OpenStack be sure to follow me on Twitter: @PunchingClouds

Be sure to subscribe to the Virtual SAN blog or follow our social channels at @vmwarevsan and Facebook.com/vmwarevsan for the latest updates.

For more information about VMware Virtual SAN, visit http://www.vmware.com/products/virtual-san.

 

 

 

 

Storage Blog Recap: Top Blogs from January

The third week of every month, we will be compiling a list of the top vSphere Storage posts from the previous month for you to digest.

Here are the top storage blogs from January:

VMware Virtual SAN: File Services with NexentaConnect

Rawlinson Rivera discusses NexentaConnect for Virtual SAN, a software-defined storage solution designed specifically to deliver file service on top of Virtual SAN.

SAP HANA Dynamic Tiering and the VMware Software Defined Data Center

The latest release of SAP HANA has brought the concepts of multiple-temperature data and lifecycle management to a new level. Bob Goldsand talks more about this, as well as native use cases and dynamic tiering with VMware HA and workload management.

Storage and Availability at Partner Exchange 2015

VMware Partner Exchange just wrapped up in San Francisco, California. In this post, Ken Werneburg talks about some key storage and availability sessions that were offered during the conference.

Discover Software-Defined Storage and VMware Virtual SAN at PEX 2015!

The Virtual SAN team highlights some of the can’t-miss sessions that were available to attendees of VMware Partner Exchange 2015.

Performance Unplugged: Demanding Applications

Mark Achtemichuk introduces a new series called “Performance Unplugged”, which showcases a number of talented performance gurus and also covers commonly asked questions and topics.

Be sure to subscribe to the Virtual SAN blog or follow our social channels at @vmwarevsan and Facebook.com/vmwarevsan for the latest updates.

For more information about VMware Virtual SAN, visit http://www.vmware.com/products/virtual-san.

One Cloud, Any Application – #VMW28days

Screen Shot 2015-02-09 at 4.11.51 PM

VMware Virtual SAN 6.0 – you heard all about it on February 2nd – you read all about it in our blog post on the vSphere Storage Blog.

 

Still want more?

 

Visit VMware’s One Cloud, Any Application site every day in February to learn more about our products and solutions including software-defined storage, Virtual SAN 6, and Virtual Volumes (VVOLs). With content for IT decision makers and practitioners alike, this site contains everything from technical documentation to infographics, whitepapers, and analyst insights.

 

Stop by today!

 

Also, this Thursday, February 12th, at 11am PST, we would like to invite you to join the software-defined storage CrowdChat! Here, you’ll be able to ask questions directly to VMware storage experts. RSVP today!

 

For more information about VMware Virtual SAN, follow us on Twitter at @VMwareVSAN and Facebook at facebook.com/vmwarevsan.

 

vSphere APIs for IO Filtering

I’ve been fortunate to have one of our super sharp product line managers, Alex Jauch (twitter @ajauch), spend some time explaining to me one of the new enabling technologies of vSphere 6.0: VAIO.  Let’s take a look at this really powerful capability and see what types of things it can enable and an overview of how it works.

VAIO stands for “vSphere APIs for IO Filtering”

This had for a time colloquially been known as “IO Filters”. Fundamentally, it is a means by which a VM can have its IO safely and securely filtered in accordance with a policy.

VAIO offers partners the ability to put their technology directly into the IO stream of a VM through a filter that intercepts data before it is committed to disk.

Why would I want to do that? What kinds of things can you do with an IO filter?

Well that’s up to our customers and our partners. VAIO is a filtering framework that will initially allow vendors to present capabilities for caching and replication to individual VMs. This will expand over time as partners come on board to write filters for the framework, so you can imagine where this can go for topics such as security, antivirus, encryption and other areas, as the framework matures. VAIO gives us the ability to do stuff to an IO stream in a safe and certified fashion, and manage the whole thing through profiles to ensure we get a view into the IO stream’s compliance with policy!

The VAIO program itself is for partners – the benefit is for consumers who want to do policy based management of their environment and pull in the value of our partner solutions directly into per-VM and indeed per-virtual disk storage management.

When partners create their solutions their data services are surfaced through the Storage Policy Based Management control plane, just like all the rest of our policy-driven storage offerings like Virtual SAN or Virtual Volumes.

Beyond that, because the data services operate at the VM virtual device level, they can also work with just about any type of storage device, again furthering the value of VSAN and VVOLs, and extending the use of these offerings through these additional data services.

How does it work?

The capabilities of a partner filter solution are registered with the VAIO framework, and are surfaced for user interaction in the SPBM Continue reading