Home > Blogs > VMware Tech Alliances (TAP) Blog

NSX Monthly Customer Advisory

In this communication, we detail the top trending issues with VMware NSX for vSphere and provide you with helpful information on how to address the issues while we build a permanent fix. Please review the left column of the chart below to search for issues specific to your environment, and click on the hyperlinks to access more detailed information on each.

For up-to-date Top Trending NSX issues, previous and current, please see KB Article Trending support issues in VMware NSX for vSphere 6.x (2131154).

SPOTLIGHT ISSUES

Affected version Component Issue Summary Resolution/Work-Around KB Number
1 6.3.x Guest Introspection Guest Introspection memory usage spikes to 90+% or you see the error: “Lost communication with ESX module”.

Issue 1 : On the ESXi host impacted, you see the error “Lost Communication with ESX module” reported in the “Tasks and Events” tab

Issue 2 : Memory usage on the Guest Introspection USVM spikes to nearly 100% at the same time impact to virtual machines is observed.

Intermittent network I/O disruption on virtual machines protected by the Guest Introspection (GI) agentless antivirus protection.

Both the Guest Introspection (vsepflt.sys) and the Network Introspection driver (vnetflt.sys) are installed in the affected guest virtual machines.

Guest Introspection is installed in the cluster(s) where this issue is observed.

These are known issues affecting Guest Introspection in the NSX for vSphere 6.3.x releases.

To temporarily work around these issues, do one of the following:

  • Reboot the Guest Introspection USVM on the ESXi host.
  • Place the ESXi host on maintenance mode. Once all virtual machines have been evacuated, reboot the ESXi host.

Please refer to the KB for more details.

KB: 2151235
2 6.2.x, 6.3.x EAM After upgrading NSX 6.2.x to 6.3.x, the EAM MOB shows the old 6.2.x VIBs instead of the 6.3.x VIBs.

 

To resolve this issue, ensure that the ESX Agent Manager is updated to reflect the new 6.3.x VIBs.

Please refer to the KB for more details.

KB: 2151504

 

3 6.2.x, 6.3.x Guest Introspection From vCenter, you are unable to power on vMotion VMs and you receive the following error: “All required agent virtual machines are not currently deployed on host hostname”.

 

Removing GI is not deleting the USVMs from the Hosts.

The EAM/ MOB is not accessible.

If the EAM service is in a stuck state, a cleanup of the EAM database is required.

 

Please refer to the KB for more details.

 

KB: 2151502
4 6.2.x, 6.3.x NSX Manager Backing up NSX Manager data fails in JP locale.

You see the error: “File upload action aborted due to insufficient storage or invalid file name. (550 The filename, directory name, or volume label syntax is incorrect.)”

This issue occurs because some FTP servers do not accept backup filename with specific multi bytes characters.

This is a known issue affecting VMware NSX.

Currently, there is no resolution.

To work around this issue, set the locale to en-US.

KB: 2150844
5 6.2.x DFW DFW fails to publish updated FW rules to ESXi hosts with error: “Failed to publish message with topic ‘null’ ”

During publishing process, you may notice high CPU utilization.

DFW fail to publish updated FW rules to ESXi hosts.

This is a known issue affecting NSX and is resolved in NSX for vSphere 6.2.8.

 

KB: 2151137

GA ANNOUNCEMENT

VMware vSphere 6.3.3 | Build 6276725 was released on August 10, 2017 and is now available for download. It includes many new enhancements like SDDCaaS (VMC on AWS) platform enablement, changed underlying OS for controller and Bug fixes for Critical Customer impacting defects.

In NSX 6.3.3, NSX VIB names change on ESXi 6.0 and later. VIB names on ESXi 5.5 remain the same. The esx-vxlan and esx-vsip VIBs are replaced with esx-nsxv if you have NSX 6.3.3 installed on ESXi 6.0 or later.

For more information, see the VMware NSX for vSphere 6.3.3 Release Notes and NSX Documentation page.

CRITICAL ALERT FOR ESXi USERS ON NSX

KB 2151267 – NSX 6.3.3 does not support ESXi versions earlier than 6.0 Update 2 or 5.5 GA.

The minimum supported version of ESXi running with NSX 6.3.3 is as follows:

  • NSX 6.3.3 installed in a vSphere 5.5 environment requires a minimum version of ESXi 5.5 GA.
  • NSX 6.3.3 installed in a vSphere 6.0 environment requires a minimum version of ESXi 6.0 Update 2.
  • NSX 6.3.3 installed in a vSphere 6.5 environment requires a minimum version of ESXi 6.5a (no change from earlier 6.3.x versions).
  • If NSX 6.3.3 is installed on an earlier version of 5.5/ 6.0 ESXi, the netcpa service will fail to start preventing communication between ESXi hosts and the NSX Controllers.
  • Environments that do not meet the above minimum requirement will require an ESXi upgrade prior to upgrading to NSX 6.3.3. For the most up-to-date information, see the VMware Product Interoperability Matrix for details.

DO NOT FORGET

Subscribe to my.vmware.com to get timely notifications on NSX Product Releases, Fixes and upcoming patches.

Have feedback on this NSX Customer Advisory?

We would like to hear from you. Send us your feedback by providing comments on the Feedback Box (available at the bottom of KB Article).

Thank you for helping us continually improve this communication.

Changes to TAP Program and NFR Guides

Technology Alliance Partners have recently been audited and, in an effort to ensure partners understand appropriate license use, we’ve updated the TAP Program Guide and TAP Not for Resale Software Guide. These changes clarify our policies around:

  • Wholly-Owned Subsidiaries: we’ve updated our policy so that wholly-owned subsidiaries at all partnership levels may also receive the benefits of the partner’s TAP participation. Additional details on this policy can be found in the TAP Program Guide.
  • License Audits and Acceptable License Usage: the TAP Not for Resale Software Guide includes details on partner audits and how to remain in compliance with license usage. For additional details on license management, please join us for our webinar on October 18.
  • TAP Mobile NFR Licenses: in the TAP Not for Resale Software Guide, we’ve expanded our description of licenses included in TAP Mobile membership.

Please review these documents to make sure you are aware of these changes.

If you have any questions, please contact the TAP team at tapalliance@vmware.com.

TAP Quarterly Webinar: MyVMware and License Management

Register now for the TAP quarterly webinar, which will be taking place on Wednesday, October 18, 2017 at 9:00 a.m. PDT.

This quarter, we will be discussing the MyVMware portal and best practices for license management. Technology Alliance Partners have been audited for incorrect usage of their TAP NFR licenses, and this webinar is designed to clarify our license policies and to assist partners in managing their licenses in the portal. Our agenda will include:

  • TAP NFR license keys
  • MyVMware portal overview
  • NFR license management in MyVMware
  • License key and folder management
  • How to file a support request
  • Support options available to Technology Alliance Partners

If you are unable to attend, this webinar will be recorded and posted in Partner Central at a later date. In order to take full advantage of the event, which will include a live Q&A, please attend the live session.

If you have any questions about the TAP quarterly webinars or any other TAP benefit, please reach out to the TAP team at 866-524-4966 or via email at tapalliance@vmware.com.

NSX Monthly Customer Advisory

In this communication, we detail the top trending issues with VMware NSX for vSphere and provide you with helpful information on how to address the issues while we build a permanent fix. Please review the left column of the chart below to search for issues specific to your environment, and click on the hyperlinks to access more detailed information on each.

For up-to-date Top Trending NSX issues, previous and current, please see KB Article Trending support issues in VMware NSX for vSphere 6.x (2131154).

Spotlight Issues

NSX for vSphere Version Component Issue Summary Resolution/Work-Around KB Number
1 6.2.x, 6.3.x NSXManager High disk and CPU usage in NSX Manager.

This issue occurs due to a high rate of IP address changes on virtual machines which causes frequent firewall publications and translations tasks to be triggered on the NSX Manager.

This is a known issue affecting VMware NSX for vSphere 6.2.x and 6.3.x. Currently, there is no resolution.

To work around this issue, contact VMware Support,and file a Support Request.

KB:2150429

 

2 6.3.x NSXManager NSX Manager high CPU utilization triggered by many simultaneous vMotion tasks.

This is a known issue in VMware NSX for vSphere 6.2.7 and earlier and 6.3.x.

This issue is resolved in VMware NSX for vSphere 6.2.8.

To work around this issue, if you do not want to upgrade, do not use dynamic security group based on VM name or VM guest OS.

KB:2150668
3 6.2.x, 6.3.x NSXManager / USVM Unable to power on VM’s, VM stuck at 0% or 35%.

This issue occurs in the environments installed with NSX for vSphere when NSX Manager or Guest Introspection VM’s are powered off or when NSX Guest Introspection USVM fails on a host.

To resolve the issue, ensure all the NSX management VM’s are powered on. KB:2150904
4 6.2.x, 6.3.x Controller Deploying NSX controller fails with the message “copying ovf” Operation failed on VC.Unable to resolve the hostname of the host by NSX Manager. Configure the DNS on NSX Manager to resolve the host name. KB:2150906
5 6.2.x DFW DFW Firewall User Interface (UI) constantly displays “Publishing rules”.

This issue occurs due to a stale entry in the NSX Manager firewall table for a host which does not exist.

This issue is not encountered in NSX for vSphere 6.2.5 or above version.

To resolve this issue, remove the stale entry in NSX manager database.

KB:2150907
6 6.3.x Guest Introspection Guest Introspection USVM reports disk is full.You receive an alert that the /var/log disk space is full or almost full on one or more of the Guest Introspection USVMs. To work around this issue: Delete the Guest Introspection USVM. Click on resolve to redeploy. KB:2149856

Trending KB

Issue: Guest Introspection USVM reports disk is full

Affected Version: 6.3.x

Resolution: This issue is resolved in VMware NSX for vSphere 6.3.2, available at VMware Downloads. If you choose not to upgrade, as a workaround, delete the Guest Introspection USVM. Click on resolve to redeploy. For more details, please refer to: KB: 2149856.

VMware Recommended Release

VMware recommends NSX 6.2.6 for new deployments. The minimum version a customer should be running is NSX 6.2.2 based on critical bug fixes identified as having a general impact in an NSX environment. For the most up-to-date information, see the latest version of the NSX for vSphere 6.x Release Notes.

Don’t Forget

Subscribe to my.vmware.com to get timely notifications on NSX Product Releases, Fixes and upcoming patches.

Have feedback on this NSX Customer Advisory?
We would like to hear from you. Send us your feedback by providing comments on the Feedback Box (available at the bottom of KB Article).

vSphere Deprecation Announcements

VMware recently announced plans to deprecate several of its vSphere products: vCenter Server for Windows, Flash-Based vSphere Web Client, and vmkLinux APIs. The content and links below provide an overview of the deprecation, migration plan, and helpful resources.

vCenter Server for Windows

VMware plans to deprecate vCenter Server for Windows with the next numbered release (not update release) of vSphere.  Partners who have not yet migrated to the VCSA should start planning their migrations as soon as possible as the next numbered release of vSphere will be the terminal release for vCenter Server for Windows.

For more information, please visit the vSphere blog.

Flash-Based vSphere Web Client

VMware plans to deprecate the Flash-based vSphere Web Client with the next numbered release (not update release) of VMware vSphere.  Partners should start transitioning over to the vSphere Client if they have not already done so as the vSphere Web Client will no longer be available after the next vSphere release.

For more information, please visit the vSphere blog.

vmkLinux APIs and Associated Driver Ecosystem

VMware plans to deprecate the vmkLinux APIs and associated driver ecosystem with the next numbered release (not an update release) of VMware vSphere.  The next version of vSphere will be the terminal release for which vmkLinux APIs and its associated driver ecosystem will be available.

Most partners won’t need to do anything as they adapt to the vSphere release after deprecation since most of the current and all future hardware will be compatible with the “native” vSphere driver ecosystem. For a small percentage of hardware, which are based on very old I/O technologies, it is possible that future vSphere releases may not be compatible after deprecation.

For more information, please visit the vSphere blog.

VMworld and Partner Exchange US 2017: Recap

We hope you enjoyed your time at this year’s VMworld and Partner Exchange in Las Vegas. If you weren’t able to make it or want to revisit the highlights from the event, we’ve compiled a list of the best from VMworld and Partner Exchange.

News and Announcements

We made a series of announcements unveiling offerings designed to help customers succeed in a multi-cloud era. In total we issued eight releases packed full of product releases and partnership announcements. Here are some highlights:

Watch Session Replays

Missed a session at VMworld 2017 US? Want to watch one again? We’ve got you covered.

  • General Sessions: Watch our Day 1 and Day 2 general sessions on-demand on our general sessions playback page.
  • Top Sessions: We’ll be posting video of the top sessions from each day within 24 hours of the conclusion of the day’s event.
  • All Sessions: Attendees who purchased full-conference registration passes will have access to every available on-demand session from VMworld US inside our content catalog (must be logged in to access them). NOTE: Some sessions presented may not be available on demand.

See you in Barcelona!

If you are attending VMworld Europe in Barcelona next week, be sure to plan your schedule with the Content Catalog and Schedule Builder.

Partner Exchange and VMworld US: Know Before You Go

Partner Exchange and VMworld US are only a few days away! Before you head to Las Vegas, learn about these can’t-miss events and exclusive opportunities for technology partners.

VMworld and Partner Exchange Keynotes

PEX General Session and Keynotes

The Partner General Session will be presented by Brandon Sweeney, SVP, Worldwide Sales and Operations and Ross Brown, SVP, Strategic Corporate Alliances. Get a sneak peek at VMworld updates, and hear from key executives on our vision, strategy and insight into the expanding ecosystem opportunity for partners.

New to Partner Exchange, Business Growth Keynotes will be occurring on Sunday from 1:30–5:00 P.M. These keynotes will focus on three business areas:

VMworld General Session and Keynotes

Our VMworld general sessions feature top VMware leaders discussing the company’s industry perspective on digital business, transformative technologies and innovation.

Not able to attend? The Monday and Tuesday general sessions will be live streamed from the VMworld.com home page at the following times:

  • Monday, August 28, 09:00–10:30 A.M. PDT
  • Tuesday, August 29, 09:00–10:30 A.M. PDT

Brand new to VMworld, this year’s Showcase Keynotes give conference participants the opportunity to hear from VMware experts on what the newest cloud solutions and innovations are, and where they’re going. Topics include:

Breakout Sessions for Technology Partners

VMworld and Partner Exchange offer a curriculum of more than 500 breakout sessions, plus a wide range of additional session types to help you create a tailored agenda. At Partner Exchange, be sure to check out these sessions designed exclusively for TAP:

Having trouble deciding which sessions to attend at VMworld? Recommended VMworld sessions for Technology Alliance Partners include:

Other VMworld Favorites

Had your fill of informative sessions and breakthrough keynotes? Don’t worry, there’s plenty more for you to enjoy! Some event favorites to check out include:

  • Solutions Exchange: a showcase for the latest and best in the industry, the Solutions Exchange features partner booths, lounges, and demonstrations and presentations throughout each day.

  • VMworld Welcome Reception: kick off VMworld with hors d’oeuvres, drinks and camaraderie in the Solution Exchange. Explore vendor offerings, discover the new technologies on display, and get to know each other in a relaxed and convivial atmosphere.
  • Hall Crawl: come to the Solution Exchange for the chance to get up close and personal with the VMware ecosystem, sponsors and exhibitors.
  • Hands-on-Labs: gain special access to the latest VMware technologies without being required to purchase equipment, software or licenses. Explore a wide range of today’s most exciting topics with a VMware-provided machine or your own device, all with product experts on hand to provide one-on-one guidance.

If you have any questions about VMworld and Partner Exchange, please contact the TAP team at tapalliance@vmware.com. We look forward to seeing you in Las Vegas!

Recent Updates to the VMware Operations Management Portfolio

VMware announced upcoming releases for its portfolio of operations management products – vRealize Operations 6.6, vRealize Log Insight 4.5, vRealize Business for Cloud 7.3 and vRealize Network Insight 3.4.

vRealize Operations 6.6

This release delivers several game-changing innovations, redesigned user experience, and greater/deeper integration across software-defined data center technologies and multiple public clouds. VMware vRealize Operations 6.6 delivers core capabilities around:

  • Application-aware SDDC and multi-cloud monitoring to help customers accelerate adoption of SDDC and integrate public clouds.
  • Automated and proactive performance management helps customers simplify operations, avoid disruption and free up time for more strategic tasks.
  • Cloud Planning, capacity optimization and compliance through a tight integration with vRealize Business for Cloud, which appears as “Business Management” tab within the vRealize Operations UI.

For more information on vRealize Operations 6.6, please visit the Cloud Management Blog.

vRealize Log Insight 4.5

VMware vRealize Log lnsight delivers heterogeneous and highly scalable log management with intuitive, actionable dashboards, sophisticated analytics, and broad third-party extensibility. With this new release, you’ll experience:

  • Full Integration in-context within vRealize Operations provides direct launch into Log Insight Dashboard and Log Insight Interactive Analytics mode, and object and vRealize Operations Alerts auto-initiated log management
  • New Server Capabilities including vUpdated Log Insight RESTful APIs and vComprehensive SSO support
  • Improved agent capabilities through vAgent multi-destination

Other new features and capabilities of vRealize Log Insight 4.5 can be found here.

vRealize Business for Cloud 7.3

The new release of vRealize Business for Cloud 7.3 continues to improve the ease-of-access and ease-of-use for private cloud cost management and delivers more visibility into public cloud spending. This new release allows you to:

  • Easier cost management with improvements to navigation, decision making tools, insight tools, and IT service pricing
  • More visibility to optimize cloud management with enhancements to usage and cost visibility

Details about the vRealize Business for Cloud 7.3 announcement can be found on the Cloud Management blog.

vRealize Network Insight 3.4

vRealize Network Insight 3.4 allows you to plan micro-segmentation, troubleshoot across virtual and physical infrastructure and manage and scale NSX deployments. Other capabilities of this new release include:

  • Manage public cloud security with visibility into your AWS infrastructure
  • Troubleshoot across the virtual and physical infrastructure by providing layer 2 network visibility in the VM to VM path and enhanced traffic and security analytics
  • Customize for maximum deployment flexibility by integrating with log management products

Full description of new features and capabilities of vRealize Network Insight 3.4 can be found here.

Now Available: vSphere 6.5 Update 1

VMware has announced the general availability of vSphere 6.5 Update 1, the first major update to the well-received vSphere 6.5 that was released in November of 2016. With this update release, VMware builds upon the already robust industry-leading virtualization platform and further improves the IT experience for its customers.

vSphere 6.5 focuses on 4 areas of innovation directly targeted at the challenges customers face as they digitally transform their businesses:

  • Simplified customer experience – Re-architected vCenter Server Appliance, streamlined HTML5-based GUI, and simple rest-based APIs for automation.
  • Comprehensive Built in Security – Policy-driven security at scale to secure data, infrastructure, and access.
  • Universal App Platform – A single platform to support any application, anywhere.
  • Proactive Data Center Management – Predictive analytics to address potential issues before they become serious problem.

Additional support and enhancements found in vSphere 6.5 Update 1 include:

  • vSphere Client Now Supports 90% of General Workflows
  • vCenter Server Foundation Now Support 4 Hosts
  • vSphere Support and Interoperability Across Ecosystems
  • vSphere 6.5 General Support Has Been Extended
  • Upgrade from vSphere 6.0 Update 3 Now Supported

Visit the vSphere blog to learn more about the new features included in vSphere 6.5 Update 1.

A recap of key capabilities offered in vSphere 6.5 can be found here.

Can’t Miss Opportunities at VMworld and Partner Exchange 2017

Partner Exchange and VMworld US 2017 are only a month away! At these events, you’ll learn how to better leverage new partner programs, differentiate your business, and make more money with VMware.

Meet with a TAP Program Manager

Technology Alliance Partners who are planning on attending the annual VMworld conference can now request a one-on-one meeting with a member of the TAP team. Partners can utilize this time to learn more about the program and provide valuable feedback about their partnership.

Applications will be reviewed on a first-come, first-served basis and availability is limited, so fill out the application today to apply for a meeting.

Reach a Global Audience of Thousands as an Exhibitor and Sponsor

To become a sponsor for VMworld US means being a part of the preeminent virtualization and cloud infrastructure event. You’ll reach thousands of technology experts, practitioners, hands-on users and key decision makers and influencers at the cutting edge of powerful trends such as the software-defined data center, IT-as-a-service, hybrid cloud and workforce mobility.

Key benefits of exhibiting and sponsoring VMworld include:

  • Generate qualified leads: Make valuable connections as you interact with thousands of VMware loyalists and key industry leaders.
  • Increase brand awareness: Improve your exposure and visibility as you position your organization as an essential VMware partner.
  • Establish thought leadership: Take your place among the visionaries shaping the new mobile-cloud era of IT.
  • Amplify your message: Use speaking opportunities to show your company’s industry experience and insight.

Sponsorship and exhibiting opportunities are still available for both VMworld US and VMworld Europe! For information about sponsorship and exhibitor packages, please contact:

Companies A-K: Shana McMahon 617-807-6011

Companies L-Z: Bethany Porrazzo 617-848-8765

Attend Sessions Specifically Designed for Technology Alliance Partners

VMworld and PEX offer a curriculum of more than 500 breakout sessions, plus a wide range of additional session types to help you create an agenda tailored to your goals. Unique sessions for Technology Alliance Partners include:

Technology Partner Programs and Marketplace Revolution

Join us to hear the latest Technology Partner Program updates, as well as new marketplace opportunities, including an in-product marketplace experience that will allow you to bring your solutions directly to VMware customers.

You Want to Be an NSX Technology Partner – Partner Program and Enablement for the SDDC

A new SDDC architecture to deliver on promises of better and more relevant security control is open to integration by technology partners. How will this ecosystem be enabled through VMware? What solutions and services are NSX proven? How does a VMware technology alliance partner engage with VMware to envision, build and deliver for the NSX marketplace? Global Technology Alliances and Ecosystem Services are your VMware partners for the SDDC program offerings to enable Network and Security development for NSX. We’ll introduce you to the SDK and certification materials for NSX Advanced Services Insertion for Endpoint and Network. Find out from your alliance and ecosystem team, the qualifications for program participation and the structure of this partner program and deliverables.

Acting as One: Plug in to vSphere

If you have ever wondered how to develop, deploy and update multiple solutions with the vSphere client, test custom solutions without having to set up complex infrastructure, transition from Flex to HTML plugins or run plugins without affecting vSphere client performance, you’ll want to hear from our panel of developers who are working to provide a seamless experience for solutions integrating with the new vSphere HTML client. We will also share details on the certification program introduced in vSphere 6.5 for HTML as well as Flex solutions.

Register Today

The VMworld and Partner Exchange Content Catalog and Schedule Builder are now live. Filter and search through all VMworld and Partner Exchange sessions, and pre-register and reserve seats at your top choice sessions. Register now for VMworld and PEX, as you have to be registered to access Schedule Builder and sessions fill up quickly.