Home > Blogs > VMware vSphere Blog > Tag Archives: storage

Tag Archives: storage

What’s New with Virtual SAN 6.0?

Software-Defined Storage is making waves in the storage and virtual infrastructure fields. Data and infrastructure are intertwined, and when they’re both brought together, companies can cut down on expenses and increase productivity.

Rawlinson Rivera, Principal Architect, Storage and Availability, recently hosted a webinar, discussing how VMware is approaching Software-Defined Storage (SDS) and virtualization in recently announced VMware updates, including updates to VMware Virtual SAN 6.0.

Software-defined storage offers organizations the ability automate, distribute and control storage better than ever before. SDS can provision storage for applications on demand and without complex processes. It also allows for standardized hardware, reducing costs for businesses everywhere.

To bring the customers the best software-defined storage experience to realization, we had to update VMware® Virtual SAN™. And we did just that. With VMware Virtual SAN 6.0, we introduced several new features with SDS in mind:

  • Software-defined storage optimized for VMs
  • All Flash architecture
  • Broad hardware support
  • The ability to run on any standard x86 server
  • Enterprise-level scalability and performance
  • Per-VM storage policy management
  • And a deep integration with the VMware stack

There’s a lot more to unpack from the latest updates to our VMware solutions. For a more in-depth guide to what’s new and how it affects you, watch the webcast here!

Be sure to subscribe to the Virtual SAN blog or follow our social channels at @vmwarevsan and Facebook.com/vmwarevsan for the latest updates.

For more information about VMware Virtual SAN, visit http://www.vmware.com/products/virtual-san.

Virtual SAN Certification & VCG Update

The Virtual SAN product team is pleased to announce that last week we released new certified components (I/O controllers, SSDs and HDDs), new Ready Nodes and a new Hardware Quick Reference Guide for Virtual SAN 6.0 along with a new and improved VCG page.  Please see updated links below:

Updated Virtual SAN VCG

Updated Virtual SAN Hardware Quick Reference Guide

Updated Virtual SAN Ready Nodes

 

How many new components and Ready Nodes do we have listed for Virtual SAN 6.0?

We now have 26 I/O controllers, 170 SSDs and 125 HDDs (and counting) supported on Virtual SAN 6.0.   In addition to the Virtual SAN 5.5 Ready Nodes, we have 8 new Ready Nodes for Virtual SAN 6.0  (Cisco – 4 Hybrid, Dell – 1 Hybrid, Hitachi – 1 Hybrid, Super Micro – 1 All Flash & 1 Hybrid).

We expect this list to grow very quickly.  We have a number of components that are currently getting certified and we plan to add new certified devices and Ready Nodes to the VCG on a weekly basis.

 

How does the Virtual SAN Certification process work?

The VMware Virtual SAN team treats hardware certification very seriously.  I/O controllers play a very important part in determining the stability and performance of a Virtual SAN cluster and need to be able to withstand high I/O under stress conditions.

The I/O controllers are put through a rigorous I/O certification process while the HDD, SSD and Ready Nodes  are put through stringent paper qualifications.

We run a I/O controller card through a 3-week-long certification test plan (the certification is done by VMware or by the partner) that stress tests the card across many dimensions, particularly in high load and failure scenarios to ensure the card can withstand the level of I/O pushed down by Virtual SAN even in the most adverse situations (example: rebuilds and resyncs triggered due to host failures).

If there are issues identified, we work closely with our controller vendor/OEM partner to resolve them and re-run the entire test suite after resolution.  Sometimes an updated firmware or driver version addressing the issue is required from the vendors before we can proceed with more testing.

Only controllers that fully pass the test criteria laid out in the above process are listed on the Virtual SAN VCG.

 

Are separate I/O controller certifications required for different releases?

Yes, we require controllers to be recertified whenever any of the following change:

  • Virtual SAN Release version (eg: 5.5 to 6.0)
  • The controller driver version
  • The controller firmware version

We also certify the same controller separately for Virtual SAN All Flash vs Hybrid since the caching and I/O mechanism are different for these two configurations and we expect controllers to behave differently with varying levels of I/O.

 

What about certification of PCIe-SSD devices?

PCIe-SSDs are nothing but SSDs with an on-board I/O controller in a PCIe form factor.  Therefore, these require the same level of due diligence as required by standard I/O controllers.  As a result, we are putting these devices through the same level of rigorous certification as we do for I/O controllers.

VMware is working very closely with partners to certify the first set of PCIe-SSDs for Virtual SAN 6.0 over the coming weeks.

 

What are the new updates to the VCG page?

The Virtual SAN VCG page has been enhanced to allow users to easily build or choose their All Flash configurations in addition to Hybrid configurations.  Since All Flash Virtual SAN requires SSDs of different endurance and performance spec for caching and performance tiers (See Updated Virtual SAN Hardware Quick Reference Guide for details on specs), we have enhanced the VCG to help users easily pick SSDs for the tier they are interested in.

We have also introduced a new SSD filter called “Virtual SAN type” to help easily filter our All Flash vs Hybrid configurations.  Furthermore, we have added a filter called “Tier” to help you filter our Virtual SAN hybrid caching, Virtual SAN All Flash caching and Virtual SAN capacity caching tiers.

The endurance rating for SSDs are now displayed on the VCG in TBW (Terabytes written over 5 years) as opposed to DWPD (Drive Writes Per Day) which was used previously.

 

What are the controllers that are currently in the certification queue and when do we expect them to get certified?

Please see the attached list of controllers that are currently undergoing Virtual SAN certification

Note:  In many cases, we rely on our partners to provide driver/firmware fixes for controller issues so if there are delays in receiving these updates from partners, the certification timelines may get pushed out.

Having said that, we are making good progress on most of the controllers listed in the attached document and expect them to follow our standard certification process.

On a similar note, Ready Nodes  are primarily dependent on the controllers getting certified, so as you see new controllers on the VCG for 6.0 certified, Ready Nodes  including those controllers will follow.

Video: Virtual SAN From An Architect’s Perspective

Video: Virtual SAN From An Architect’s Perspective

Have you ever wanted a direct discussion with the people responsible for designing a product?

Recently, Stephen Foskett brought a cadre of technical bloggers to VMware as part of Storage Field Day 7 to discuss Virtual SAN in depth.  Christos Karamanolis (@XtosK), Principle Engineer and Chief Architect for our storage group went deep on VSAN: why it was created, its architectural principles, and why the design decisions were important to customers.

The result is two hours of lively technical discussion — the next best thing to being there.  What works about this session is that the attendees are not shy — they keep peppering Christos with probing questions, which he handles admirably.

The first video segment is from Alberto Farronato, explaining the broader VMware storage strategy.

The second video segment features Christos going long and deep on the thinking behind VSAN.

The third video segment is a run-over of the second.  Christos presents the filesystem implementations, and the implications for snaps and general performance.

Our big thanks to Stephen Foskett for making this event possible, and EMC for sponsoring our session.

 

VMware Virtual SAN 6.0 Now Generally Available

Virtual SAN 6 – you heard about it in February… thousands of you read about it in Rawlinson’s blog post… and today you can get your hands on it. Virtual SAN 6 is now generally available (GA) – download your evaluation version today! For those of you who missed Rawlinson’s blog post describing the details around what’s new with Virtual SAN 6 – you can read it here (below). But there’s a better way to get the information – register and attend this week’s webinar on “What’s New with Virtual SAN 6” hosted by Rawlinson Rivera – we’ll see you there!

VSAN-ALL-FLASH-LOGO

It is with great pleasure and joy that I like to announce the official launch of VMware Virtual SAN 6.0, one of VMware’s most innovative software-defined storage products and the best hypervisor-converged storage platform for virtual machines. Virtual SAN 6.0 delivers a vast variety of enhancements, new features to the as well as performance and scalability improvements.

Virtual SAN 6.0 introduces support for an all-flash architecture specially designed to provide virtualized applications high performance with predictably low latencies. Now with support for both hybrid and all-flash architectures Virtual SAN 6.0 is ready to meet the performance demands of just about any virtualized application by delivering consistent performance with sub-millisecond latencies.

Hybrid Architecture

  • In the hybrid architecture, server-attached magnetic disks are pooled to create a distributed shared datastore that persists the data. In this type of architecture, you can get up to 40K IOPS per server host.

All-Flash Architecture

In All-Flash architecture, the flash-based caching tier is intelligently used as a write-buffer only while another set of flash devices forms the persistence tier to store data. Since this architecture utilizes only flash devices, it delivers extremely high IOPs of up to 90K per host, with predictable low latencies.

VSAN-Archs

Virtual SAN 6.0 delivers true enterprise-level scale and performance by doubling the scalability of Virtual SAN 5.5 by scaling up to 64 nodes per cluster for both hybrid and all-flash configurations. In addition, Virtual SAN 6.0 improves the number of virtual machines per host up to 200 for both supported architectures.

VSAN-Scale

The performance enhancements delivered in Virtual SAN 6.0 are partially due to the new Virtual SAN on-disk Filesystem (VSAN FS). The new version delivers a new VMDK delta file (vsanSparse) takes advantage of the new on-disk format writing and extended caching capabilities to deliver efficient performance. This results in the delivery of performance-based snapshots, and clone that are comparable to SAN snapshots.

Virtual SAN 6.0 now enables intelligent placement of virtual machine objects across server racks for enhanced application availability even in case of complete rack failures. Virtual SAN Fault Domains provide the ability to group multiple hosts within a cluster to define failure domains to ensure replicas of virtual machines data is spread across the defined failure domains (racks).

VSAN-FD

Along with all the new added features a significant amount of improvements have been added to enhance the management user experience:

  • Disk/Disk Group Evacuation – Introduce ability to evacuate data from individual disk/disk groups before removing a disk/disk group from the Virtual SAN.
  • Disk Serviceability features - easily map the location of magnetic disks and flash devices. Ability light disk LED on failures, Turn disk LED on/off from the vSphere Web Client.
  • Storage Consumption Models - adds functionality to visualize Virtual SAN 6.0 datastore resource utilization when a VM Storage Policy is created or edited.
  • UI Resynchronization Dashboard – the vSphere Web Client UI displays virtual machine objects resynchronization status and remaining bytes to sync.
  • Proactive Rebalance – provides the ability to manually trigger a rebalance operation in order to utilize newly added cluster storage capacity.
  • Health Services – deliver troubleshooting and health reports to vSphere Administrators about Virtual SAN 6.0 subsystems and their dependencies such as cluster, network, data, limits, physical disk.

VSAN-health

With all the major enhancements and features of this release, Virtual SAN is now enterprise-ready, and customers can use it for a broad range of use cases, including business-critical and tier-1 production applications.  Stay tune, there is a lot more to come from the world’s greatest software-defined storage platform. For more information visit the Virtual SAN product page.

- Enjoy

For future updates on Virtual SAN (VSAN), vSphere Virtual Volumes (VVOLs) and other Software-defined Storage technologies as well as vSphere + OpenStack be sure to follow me on Twitter: @PunchingClouds

Be sure to subscribe to the Virtual SAN blog or follow our social channels at @vmwarevsan and Facebook.com/vmwarevsan for the latest updates.

For more information about VMware Virtual SAN, visit http://www.vmware.com/products/virtual-san.

 

 

 

 

Storage Blog Recap: Top Blogs from January

The third week of every month, we will be compiling a list of the top vSphere Storage posts from the previous month for you to digest.

Here are the top storage blogs from January:

VMware Virtual SAN: File Services with NexentaConnect

Rawlinson Rivera discusses NexentaConnect for Virtual SAN, a software-defined storage solution designed specifically to deliver file service on top of Virtual SAN.

SAP HANA Dynamic Tiering and the VMware Software Defined Data Center

The latest release of SAP HANA has brought the concepts of multiple-temperature data and lifecycle management to a new level. Bob Goldsand talks more about this, as well as native use cases and dynamic tiering with VMware HA and workload management.

Storage and Availability at Partner Exchange 2015

VMware Partner Exchange just wrapped up in San Francisco, California. In this post, Ken Werneburg talks about some key storage and availability sessions that were offered during the conference.

Discover Software-Defined Storage and VMware Virtual SAN at PEX 2015!

The Virtual SAN team highlights some of the can’t-miss sessions that were available to attendees of VMware Partner Exchange 2015.

Performance Unplugged: Demanding Applications

Mark Achtemichuk introduces a new series called “Performance Unplugged”, which showcases a number of talented performance gurus and also covers commonly asked questions and topics.

Be sure to subscribe to the Virtual SAN blog or follow our social channels at @vmwarevsan and Facebook.com/vmwarevsan for the latest updates.

For more information about VMware Virtual SAN, visit http://www.vmware.com/products/virtual-san.

One Cloud, Any Application – #VMW28days

Screen Shot 2015-02-09 at 4.11.51 PM

VMware Virtual SAN 6.0 – you heard all about it on February 2nd – you read all about it in our blog post on the vSphere Storage Blog.

 

Still want more?

 

Visit VMware’s One Cloud, Any Application site every day in February to learn more about our products and solutions including software-defined storage, Virtual SAN 6, and Virtual Volumes (VVOLs). With content for IT decision makers and practitioners alike, this site contains everything from technical documentation to infographics, whitepapers, and analyst insights.

 

Stop by today!

 

Also, this Thursday, February 12th, at 11am PST, we would like to invite you to join the software-defined storage CrowdChat! Here, you’ll be able to ask questions directly to VMware storage experts. RSVP today!

 

For more information about VMware Virtual SAN, follow us on Twitter at @VMwareVSAN and Facebook at facebook.com/vmwarevsan.

 

vSphere APIs for IO Filtering

I’ve been fortunate to have one of our super sharp product line managers, Alex Jauch (twitter @ajauch), spend some time explaining to me one of the new enabling technologies of vSphere 6.0: VAIO.  Let’s take a look at this really powerful capability and see what types of things it can enable and an overview of how it works.

VAIO stands for “vSphere APIs for IO Filtering”

This had for a time colloquially been known as “IO Filters”. Fundamentally, it is a means by which a VM can have its IO safely and securely filtered in accordance with a policy.

VAIO offers partners the ability to put their technology directly into the IO stream of a VM through a filter that intercepts data before it is committed to disk.

Why would I want to do that? What kinds of things can you do with an IO filter?

Well that’s up to our customers and our partners. VAIO is a filtering framework that will initially allow vendors to present capabilities for caching and replication to individual VMs. This will expand over time as partners come on board to write filters for the framework, so you can imagine where this can go for topics such as security, antivirus, encryption and other areas, as the framework matures. VAIO gives us the ability to do stuff to an IO stream in a safe and certified fashion, and manage the whole thing through profiles to ensure we get a view into the IO stream’s compliance with policy!

The VAIO program itself is for partners – the benefit is for consumers who want to do policy based management of their environment and pull in the value of our partner solutions directly into per-VM and indeed per-virtual disk storage management.

When partners create their solutions their data services are surfaced through the Storage Policy Based Management control plane, just like all the rest of our policy-driven storage offerings like Virtual SAN or Virtual Volumes.

Beyond that, because the data services operate at the VM virtual device level, they can also work with just about any type of storage device, again furthering the value of VSAN and VVOLs, and extending the use of these offerings through these additional data services.

How does it work?

The capabilities of a partner filter solution are registered with the VAIO framework, and are surfaced for user interaction in the SPBM Continue reading

VMware’s 64-node All-Flash VSAN demo at PEX

Another productive VMware Partner Exchange day for our partners and we had another great turnout at the Software-Defined Storage (SDS) Pavilion, where we demoed VDI boot storm on VMware’s 64-node All-Flash VSAN and we continue to have multiple ecosystem partners showcasing their joint solutions with Virtual SAN and Virtual Volumes.

SDS Pavilion_Feb4

If you missed it, on Monday Feb 2nd VMware launched VMware Virtual SAN 6the best storage platform for virtual machines, including business critical applications. Radically simple, VMware Virtual SAN 6 introduces 2x more scalability (yes 64 nodes!) and up to 4.5x greater performance (that’s 90k IOPs per host!) while adding several new enterprise-class data services capabilities. Continue reading

The Software-Defined Storage Pavilion is open!

 

SDS Pavilion at PEX 2015

SDS Pavilion at PEX 2015

PEX 2015 is off to a great start, and in case you missed it Software-Defined Storage (SDS) is key component of what VMware wants to show the partner community this year. We announced VMware Virtual SAN 6, the next generation of the radically simple hypervisor-converged storage software, and vSphere Virtual Volumes, a new integration framework to enable VM-aware storage.

To help partners navigate everything there is to know about these technologies, we created the first ever Software-Defined Storage Pavilion. The SDS Pavilion brings together the vast ecosystem of storage technology partners that deliver certified solutions for both Virtual SAN and Virtual Volumes.

The Pavilion opens today at 11:30 and it is located on the 2nd floor of Moscone West. 10 showcase partners will be present all day: Cisco, Dell, HP, HDS, IBM, Micron & Supermicro, NetApp, Nexenta, SanDisk and Tintri. We also have a lineup of experts rotating at the Expert Bar and Demo stations.

If you are interested in hearing from Partners, at 11:30 SoftNAS will show NFS & CIFS Storage for Virtual SAN 6, at 12:30 Atlantis computing will show a Virtual Volumes demo and at 1:30 SolidFire will follow on that same topic.

And if you want to engage with VMware experts, we have Christos Karamanolis, Principal Engineer for Virtual SAN at 2:00, Jack Lo, VP for Storage & Availability at VMware at 5:00 and the entire Virtual SAN engineering team on site throughout the day.

So, stop by and learn about VMware Software-Defined Storage! Follow the conversation via #PEXsds #VMwarePEX

Announcing the VMware Software-Defined Storage Pavilion at PEX 2015

SDS Pavilion Showcase Partners for VSAN & VVOLs

VMware SDS Pavilion Showcase Partners @ PEX 2015

Following the exciting launch of VMware Virtual SAN 6 and vSphere Virtual Volumes, PEX 2015 will host the first Software-Defined Storage (SDS) Pavilion to showcase solutions by the partners in the SDS ecosystem. The SDS Pavilion is located on the 2nd floor of Moscone West. This week, Tuesday to Thursday, the SDS Pavilion will be featuring guest exec speakers, live demos, expert bar Q&A, coffee chats and more for PEX attendees.

We invite you to stop by to visit with our 10 SDS showcase partners and daily guest experts as well as follow the conversation via #PEXsds #VMwarePEX to learn more about delivery of the Software-Defined Storage vision through VMware Virtual SAN 6, VMware’s hyper-converged storage software, and vSphere Volumes which enables deeper levels of integration between vSphere and storage arrays extending SDS policy automation to VMware’s ecosystem.