posted

At VMware, we believe that VMs and containers work best together to provide an agile, efficient infrastructure for application development and deployment. But no web-scale application runs on just a single VM, or even a small group of VMs. Application deployment and operation requires a well-managed cluster, with the ability to elastically scale to meet service demands. Just as Kit mentioned earlier at DockerCon, we are introducing a solution to better assist DevOps engineers with these challenges.

In September of last year, we introduced Big Data Extensions (BDE) for vSphere to enable enterprises with deploying, running, and managing clustered workloads like Hadoop. Because BDE was designed to help our customers easily deploy clusters, and plan and automate VM provisioning, we saw an excellent opportunity to extend vSphere BDE to provision and manage Mesos and Kubernetes clusters as well.

While we’ve previously written about our collaboration with Google’s Kubernetes project in this areas, today we are adding Mesosphere to our ecosystem using this BDE extension. The latest BDE fling enables vSphere users to stand up a Mesos or a Kubernetes cluster in minutes, via a simple GUI or a single spec file. The clusters, as one would expect, can be customized for size and topology, and to scale elastically on demand.

BDE with Mesos and Kubernetes integrations can be downloaded from our flings page, where we frequently release new technologies. We look forward to hearing about your experience in using this Mesos/Kubernetes integrated BDE package to deploy, manage, and scale your applications – come talk to us at @cloudnativeapps.

Download:

About the author(s):
Bo DongBo Dong is a Senior Product Line Manager on the vSphere team. He manages vSphere Big Data Extensions and VMware OSS Project Serengeti.

 

 

Jesse HuJesse Hu is a developer for Project Serengeti (also known as Big Data Extensions) in the VMware Beijing R&D Center. He holds an M.S. in Computer Science and is interested in Open Source, Big Data, Cloud Computing, and Linux Containers.

posted

FabioAs Kit mentioned in his earlier post, today in Amsterdam, we’re showing off drivers for VMware Fusion, vSphere and vCloud Air that’ll make it easy for our customers to deploy and manage Docker hosts in local and hybrid cloud environments. We’ve seen requests on GitHub to simplify this process, so we’ve put together a quick preview of a solution that we’re happy to talk about in more depth here.

We’ve bundled Docker Machine support for Fusion, vSphere and vCloud Air into a single package for download, though you can choose between Linux or Mac OS X installations. The only thing you’ll need is an existing installation of VMware Fusion, vSphere, or a vCloud Air subscription – one of these is sufficient. The drivers can be downloaded from GitHub, complete with all the instructions you need to get started. If you’re interested in following the drivers’ development you can watch this PR on GitHub.

If you’re already on any of the above-mentioned VMware platforms, the drivers we’re releasing today provide the fastest way to try out Docker and see whether a container-based delivery model suits your needs. You won’t need to noodle around with certificates, permissions, or a mess of settings just to test out containers. (Side Note: if you don’t have Fusion, and you happen to be at DockerCon Europe this week, come see us! We can get you set up for free.)

Since these drivers are a work in progress – they’re a preview of our projects, not a production-ready solution – we’re seeking your input on how we can make them better. Your opinions are invaluable to our growing efforts here at Cloud-Native Apps – especially in our early days – and help us better understand how we can make your lives easier as both developers and ops engineers. You can reach us anytime by commenting below, emailing us directly at microservices@vmware.com, or on Twitter at @cloudnativeapps.

Download:

About the Author:  Fabio is a seasoned IT professional with over 15 years of experience, and a background as a software developer. He currently sits on the edge between Dev and Ops, helping both reach nirvana.

posted

kitcolbertI’m at DockerCon Europe today, participating in a panel discussion on orchestration.  It’s an important subject for us, since orchestration is critical for our customers as they move from experimenting with containers to running containerized applications in production. Through our experiences with Distributed Resource Scheduling (DRS) on vSphere and vRealize Automation, we’ve grown familiar with the challenges of orchestration here at VMware. But containers present new challenges, especially around scale. To that end, several orchestration solutions have been developed by various players in the container space. We want to ensure that these new solutions are as well-integrated into VMware platforms as DRS and vRealize Automation were into our core vSphere technology.

Our goal is to simplify delivery of containerized applications to vSphere environments, so I’m excited to announce new integrations in the container orchestration space with Docker, Google, Mesosphere, and Pivotal.  Our focus is on providing a common platform for building, operating, and managing applications at scale, and these integrations help our customers do exactly that. We’ll have more posts to talk about these integrations in greater depth, but I’ll provide some background here.

Docker
Docker has captured the industry’s imagination and customer interest around Linux container technologies, and we announced a partnership with Docker at VMworld earlier this year. Thus far, Docker’s focus has largely been on single host management, but its ambitions are to enable remote management and orchestration of many Docker hosts. Given that their orchestration technology is still in the early alpha phase, we wanted to focus on their upcoming remote management capabilities, called Docker Machine. Docker Machine enables developers and operators to start Dockerized applications on remote hosts, and today we’re introducing Docker Machine integrations for VMware Fusion, VMware vSphere, and VMware vCloud Air. This simplifies the process for deploying applications in VMware environments, whether it’s on a dev box via Fusion or into staging or production via vSphere or vCloud Air.

Kubernetes
In June, Google introduced a container orchestration and scheduling system called Kubernetes, which has garnered industry and community interest. We started working with Google earlier this year, and today we’re introducing a way to quickly and easily provision a Kubernetes cluster onto vSphere infrastructure through a tool we developed called Big Data Extensions (BDE). As its name suggests, BDE was developed with a focus on big data workloads such as Hadoop. However, the types of problems we face when provisioning Hadoop frameworks are similar to what we see with container cluster schedulers like Kubernetes, so we used and extended what was already working for many customers. We encourage you to give it a try yourself!

Mesosphere 
We developed a similar integration with Mesos, the open resource management framework driven by Mesosphere. Mesos has an innovative two-level design that supports many different workload types using the same underlying infrastructure, and is already present in large production implementations, most notably at Twitter and Airbnb. Given the volume of customer interest in Mesos, we wanted to streamline the deployment of Mesos to vSphere infrastructure. As with Kubernetes, we’re leveraging BDE to simplify the provisioning process.

Pivotal
VMware actually had its own technology in the orchestration space several years ago – CloudFoundry, an open-source PaaS – which we spun out when we created Pivotal. Pivotal now has its own version of CloudFoundry, called Pivotal CF (PCF). While PCF has container orchestration capabilities, they’ve been deeply enmeshed within PCF. A new project from Pivotal called Diego will rewrite parts of Pivotal CloudFoundry in a more composable manner, allowing the Diego container orchestration layer to be separated from PCF. We’ll be working closely with Pivotal to enable the same tight integration into vSphere for PCF that we have with the other container orchestration engines listed above. In the meantime, Pivotal is joining us at DockerCon this week to demo .

All in all, we’re impressed with the rapid progress in the container space and excited about enabling our customers to more easily and seamlessly provision their container orchestration frameworks and containerized applications onto Fusion, vSphere, and vCloud Air. We’re looking forward to getting your feedback at @cloudnativeapps, and there’s more good stuff yet to come.

 Downloads

About the Author: Kit Colbert drives strategy and product development of third platform application solutions across the company. Previously, he was CTO of VMware’s End-User Computing business unit, Chief Architect and Principal Engineer for Workspace Portal, and the lead Management Architect for VMware vSphere Operations Suite. At the start of the career, he was the technical lead behind the creation, development, and delivery of the vMotion and Storage vMotion features in vSphere. Kit holds a ScB in Computer Science from Brown University and is recognized as a thought-leader on third platform, end-user computing, and cloud management trends. He speaks regularly at industry conferences, on the main stage at VMworld, and is the Cloud-Native and EUC voice for the VMware Office of the CTO Blog.

posted

kitcolbertThis September 2014 marked my 11 year anniversary at VMware.  When I look back at my time here, I’m inspired by the things we’ve done as a company. We’ve always pushed the envelope on behalf of our customers, and that continues today with my transition from the End-User Computing group at VMware to new role within the Office of the CTO, focusing on Cloud-Native Apps.

The Rise of Cloud-Native Apps 
There are tectonic shifts happening in the enterprise, particularly in how applications are developed and operated (e.g. DevOps), how they’re architected (e.g. micro-services and 12-factor apps), and how they’re deployed (e.g. Docker and containers). We call these applications “cloud-native” as they’re designed for the mobile-cloud era. Naturally, these cloud-native apps impact how IT decisions are made and which factors are considered in architecting a datacenter infrastructure. The need to build and deploy apps quickly means developers and operations engineers are working more closely than ever, and that developers are increasingly influential in designing the enterprise stack. We’ve built some great products and partnerships here at VMware to address these trends, but we also recognize the need for more comprehensive solutions that help our customers thrive in the mobile-cloud era.

My focus will be to ensure that we capitalize on our considerable experience delivering proven solutions to our more than 500,000 customers, and to provide them with solutions tailored to this new environment. VMware’s goal has long been to help businesses build, deploy, and operate their applications, even in the most stringent production environments. The rise of cloud-native applications presents an opportunity for us to further that goal by providing solutions that span from the developer desktop, through the DevOps lifecycle, and to the production stack where these apps are deployed and operated.

While this post officially kicks off our Cloud-Native blog, we’ve been thinking about and blogging on these topics for some time:

Stay Tuned for Cloud-Native Apps News, Hacks and More 
My first 11 years here were great. But in my mind, the real fun is just beginning! As always, there’s a lot happening here at VMware, and we’re excited to share this news with you. Please follow this blog for our latest announcements, updates, thoughts, and random hacks. We look forward to getting to know you better here at Cloud-Native Apps blog or on Twitter!

About the Author: Kit Colbert drives strategy and product development of third platform application solutions across the company. Previously, he was CTO of VMware’s End-User Computing business unit, Chief Architect and Principal Engineer for Workspace Portal, and the lead Management Architect for VMware vSphere Operations Suite. At the start of the career, he was the technical lead behind the creation, development, and delivery of the vMotion and Storage vMotion features in vSphere. Kit holds a ScB in Computer Science from Brown University and is recognized as a thought-leader on third platform, end-user computing, and cloud management trends. He speaks regularly at industry conferences, on the main stage at VMworld, and is the Cloud-Native and EUC voice for the VMware Office of the CTO Blog.