Enterprises can get tremendous productivity and business transformation from AI. With VMware Private AI Foundation with NVIDIA, Broadcom and NVIDIA aim to unlock AI and unleash productivity with lower TCO. Recently with VCF 9.0, Broadcom and NVIDIA released several features in VMware Private AI Foundation with NVIDIA to further our mission of providing private and secure AI models for enterprises. Today we are happy to announce additional capabilities to help enterprises in this mission.
VMware Private AI Services Will be Included in VCF Subscription
Previously sold separately, VCF will include VCF Private AI services as part of the platform. Private AI services enable privacy and security, simplify infrastructure management and streamline model deployment. They include capabilities such as GPU Monitoring, Model Store, Model Runtime, Agent Builder, Vector Database and Data Indexing and Retrieval. By embedding all the benefits of Private AI into VMware Cloud Foundation, enterprises will get a unified platform for their AI and non-AI workloads without an additional purchase.
New Capabilities Supported now
We are releasing an exciting new capability in the platform.
NVIDIA Blackwell Architecture Support
NVIDIA Blackwell GPUs unlock the potential of generative, agentic and physical AI by delivering exceptional performance, efficiency and scale for enterprises. VCF will now support the NVIDIA Blackwell architecture, enabling enterprises to get the industry-leading AI training and inference capabilities at unprecedented scale. Let’s look at the supported GPUs.
NVIDIA RTX PRO 6000 Blackwell Server Edition
For workloads that require the compute density and scale that data centers offer, the NVIDIA RTX PRO 6000 Blackwell Server Edition GPU delivers powerful performance for next-generation AI, scientific and visual computing applications across industries such as healthcare, manufacturing, retail and media and entertainment. Designed for enterprise data center deployments, the RTX PRO 6000 Blackwell Server Edition can be configured with up to eight GPUs per server.
Future Releases
We will continue to release exciting new capabilities in the future. Let us examine a few of these.
Enable Privacy and Security
Broadcom and NVIDIA’s collaboration on this platform helps enterprises build and deploy private and secure AI models with integrated security capabilities in VCF and NVIDIA AI Enterprise. Let’s examine one of the capabilities that we will release in the future to improve privacy and security.
Multi-tenant models as a service
With VCF 9.0, we announced general availability of Model Runtime capability, enabling enterprises and cloud service providers to deploy models as a shared and scalable service for their users. With Model endpoint sharing, the Model Runtime service will be enhanced to allow the secure sharing of AI models between tenants or separate lines of business while maintaining full data privacy for each. Practically, this means enterprises and cloud service providers can host a single instance of a model and scale horizontally for their entire organization, and then each team or division can have separate private and secure namespaces for their private data. With this capability, enterprises can reduce power consumption and drive greater AI efficiencies by eliminating model redundancies while still securing how data is shared with a model by individual tenants or lines of business. This puts private AI in the enterprise on par with AI model services in the public cloud.
Simplify Infrastructure Management
VMware Private AI Foundation with NVIDIA comes with specially architected capabilities that help simplify infrastructure management of AI environments and optimize costs. Let’s review one of the capabilities that we will release to simplify infrastructure management.
DirectPath enablement for GPUs with VMware Private AI Foundation with NVIDIA
VMware Private AI Foundation with NVIDIA will support DirectPath enablement for NVIDIA accelerated computing. This capability will provide an even simpler infrastructure path for how enterprises initiate and scale their artificial intelligence (AI) projects minimizing the required licensing.
It will enable high-performance, exclusive GPU access to a single VM and the VM will be able to fully utilize GPU capabilities. With this new capability, enterprises will be able to readily experiment with AI, prototype new applications, and deploy AI projects on VMware Private AI Foundation with NVIDIA.
Intelligent Assist with VCF
Built using the capabilities of VCF Private AI services, this LLM-powered assistant will be integrated into VCF as an AI Assistant for VCF users. When issues occur, Intelligent Assist will enable users to quickly access Broadcom’s knowledge base for solutions, significantly reducing downtime, in both air-gapped and connected private cloud deployments.
Streamline Model Deployment
Broadcom and NVIDIA have also enabled software and capabilities to greatly streamline model and AI agents deployment for data scientists. Let’s examine some of the capabilities to be released in the future that fall in this category.
Model Context Protocol (MCP)
In future releases, MCP support will be added in VMware Private AI Foundation with NVIDIA. MCP will provide a standardized method to integrate AI agents with internal content repositories and external tools like Oracle, Microsoft SQL Server, ServiceNow, GitHub, Slack, and PostgreSQL, without the need for custom connectors. This will also include end-to-end authentication and RBAC, ensuring secure, scalable workflows and empowering developers to create context-aware applications and task automation using real-time, permissioned data.
High-Speed Networking with Enhanced DirectPath I/O
VCF will incorporate support for NVIDIA ConnectX-7 and NVIDIA BlueField-3 Super NICs with Enhanced DirectPath I/O. This will enable customers to leverage advanced capabilities like GPUDirect® RDMA and GPUDirect Storage for high-speed, multi-host AI model training and data transfer, crucial for demanding Generative AI workloads.
A cornerstone of this integration is the ability for customers to retain familiar VCF operational workflows and enterprise-grade virtualization features such as vMotion, High Availability (HA), Distributed Resource Scheduler (DRS), and Live Patching.
VCF Support for NVIDIA HGX Platform with Blackwell GPUs and NVSwitch
With support for NVSwitch on the HGX platform with Blackwell GPUs, enterprises will be able to do massive scale AI deployments on VMware Private AI Foundation with NVIDIA.
NVIDIA HGX platform brings together the full compute of NVIDIA accelerated computing, NVIDIA NVLink, NVSwitch, NVIDIA networking, and fully optimized AI software stacks with NVIDIA AI Enterprise to provide the highest AI application performance and drive the fastest time to insights for every data center. NVSwitches provide the ability to have 8 GPUs per node connected together with a high speed 900GB/s GPU communication network. Together with VMware Private AI Foundation with NVIDIA, this facilitates unparalleled performance for LLMs inference and training within private and secure AI deployments.
VCF Support for NVIDIA HGX B200
Coming in a future release of VCF, support for NVIDIA HGX B200 systems will meet the needs of advanced accelerated computing and generative AI workloads. As a premier accelerated scale-up x86 platform with up to 15X faster real-time inference performance with 12X lower cost and 12X less energy than the previous Hopper generation, HGX B200 is designed for the most demanding AI, data analytics, and high-performance computing (HPC) workloads.
New Partners in the VMware Private AI Ecosystem
Beyond the core capabilities, VMware Private AI Foundation with NVIDIA is expanding its ecosystem through strategic partnerships, further enriching the value proposition for enterprises. We are delighted to welcome the following partners to the VMware Private AI ecosystem
● Zenera
This partnership leverages VMware Private AI Foundation with NVIDIA to enable intelligent applications embedded with autonomy, allowing them to understand, plan, code, and complete tasks independently. Zenera’s expertise in autonomous AI solutions complements our platform, offering enterprises the ability to deploy more sophisticated and self-sufficient AI applications.
● Xtravirt
Xtravirt, a leading cloud consulting and managed services provider, and Broadcom have partnered to help enterprises realize value from VMware Private AI Foundation with NVIDIA. From designing and deploying secure, scalable infrastructure to integrating AI applications and services, Xtravirt’s deep experience will simplify complexity and accelerate long-term success for our joint customers. Their comprehensive services ensure that enterprises can navigate the intricacies of AI adoption with confidence.
● ITQ
Adopting AI while meeting sovereignty, compliance, and performance demands is a complex challenge. ITQ addresses this by combining deep Broadcom expertise, award-winning ITQ engineers, and sovereign, enterprise-ready AI infrastructure through VMware Private AI Foundation with NVIDIA. This partnership empowers enterprises to innovate faster and protect sensitive data when deploying AI, ensuring that regulatory and performance requirements are met without compromise.
Ready to get started on your AI and ML journey? Check out these helpful resources:
- Complete this form to contact us!
- Read the VMware Private AI Foundation with NVIDIA solution brief.
- Learn more about VMware Private AI Foundation with NVIDIA.
- Get started with NVIDIA Blueprints on build.nvidia.com.
- Accelerate your AI agents from development to deployment with NVIDIA AI Enterprise.
- Connect with us on Twitter at @VMwareVCF and on LinkedIn at VMware VCF.
Editorial Notes: The information in this news release is for informational purposes only and may not be incorporated into any contract. There is no commitment or obligation to deliver any items presented herein. VMware Cloud Foundation with VMware Private AI Services is purchased directly from Broadcom or authorized Broadcom Partners. NVIDIA AI Enterprise software, which is a requirement for vGPU and NVIDIA NIMs deployment, is purchased from NVIDIA directly.
Discover more from VMware Cloud Foundation (VCF) Blog
Subscribe to get the latest posts sent to your email.
