Posts Tagged ‘ hpc ’

Josh Simons

Research and High Performance Computing at VMworld US

August 16, 2015
By

There will be a High Performance Computing in Research and Data Analytics Roundtable session held on Monday evening in conjunction with VMworld US in San Francisco. This session is a part of the Government & Education Roundtable Series and is intended primarily for those customers. Seating is limited and registration is required. Registration is here . Here’s the description of the HPC/Research session: Join VMware experts to learn how VMware solutions can be used to increase the agility, flexibility, and effectiveness of high performance research computing and data analytics environments while still offering near-native application performance. Performance of Research/HPC workloads on vSphere 6 Use-cases and benefits of virtualization for Research/HPC Private clouds for centralization of Research...

Read more

Josh Simons

Using the Intel Xeon Phi Compute Accelerator with ESX 6.0

July 14, 2015
By
Using the Intel Xeon Phi Compute Accelerator with ESX 6.0

Compute accelerators  — whether they be GPUs, Intel Xeon Phi, or FPGAs — are increasingly common in HPC and so it is important that we assess the use of such technologies from within VMware vSphere® as part of our efforts to virtualize research computing and other HPC environments. Last year when I tested Intel Xeon Phi in passthrough mode (VM Direct Path I/O) with VMware ESX® 5.5, we found that it didn’t work due to some limitations in our passthrough implementation. However, using an engineering build of ESX, I was able to successfully configure the device in passthrough mode, run Intel’s bundled Phi performance tests, and demonstrate good performance. While this wasn’t of practical use to customers since I was not testing...

Read more

Andrew Nelson

What Impact Can Virtualization Have on the Field of Research Computing?

April 15, 2015
By

Challenges for IT supporting research computing environments What is most important to an IT department supporting university research? Based on conversations with many of our customers, we have repeatedly heard the following: Satisfying the varied and sometimes conflicting requirements of different research groups, which may include compliance issues for bioinformatics research Showing the value of centralized IT resources against buying isolated equipment or outsourcing to a public provider of infrastructure Meeting these goals while on a limited budget For many independent research teams, each desired environment typically involves its own set of simulation and analytics tools, including different operating systems and other middleware components. For example, different environments and tools are used for genomic research than for reservoir simulation. Satisfying these disparate requirements is...

Read more

Josh Simons

Running HPC Applications on vSphere using InfiniBand RDMA

December 22, 2014
By
Running HPC Applications on vSphere using InfiniBand RDMA

Looking back on 2014, this was the year in which we made significant strides in assessing and addressing High Performance Computing (HPC) performance on vSphere. We’ve shown that throughput or task-parallel applications can be run  with only small or negligible performance degradations (usually well under 5%) when virtualized — a fact that the HPC community seems to now generally accept. The big new thing this year, however, was the progress we are making with MPI applications — specifically those applications that require a high-bandwith, low-latency RDMA interconnect like InfiniBand. As I mentioned in an earlier blog post , we generated a great deal of RDMA-based performance data about HPC applications and benchmarks this past summer due to the hard work...

Read more

Josh Simons

Supercomputing ’14 Begins: Laissez les bon temps rouler!

November 17, 2014
By
Supercomputing ’14 Begins: Laissez les bon temps rouler!

  SC’14 , the big, annual High Performance Computing (HPC) conference officially kicks off in New Orleans this evening with the opening of the exhibits. Workshops and tutorials have been held over the weekend as well: I gave a keynote presentation on Sunday at the 4th International Workshop on Network-aware Data Management ( NDM’14 ), titled RDMA in the Cloud: Enabling high-bandwidth, low-latency communication in virtual environments for HPC (slides:  NDM’14 keynote ). While I’ve been attending SC since the late 1980s and have attended each year I’ve been at VMware, this year marks the first time VMware will have an official presence on the show floor. We’ve partnered with EMC’s Office of the CTO...

Read more

Josh Simons

High Performance Computing (HPC) Update

October 31, 2014
By
High Performance Computing (HPC) Update

Our HPC effort at VMware has been very active in recent months, and we have lots of information to share– including new performance results. Rather than cramming all of that content into a single mega blog entry, I’ve decided instead to give a preview here of some of the most significant developments. I will then delve into each of these areas in more detail in a series of upcoming monthly blog posts. InfiniBand Performance This spring we installed a four-node InfiniBand HPC cluster in our lab in Cambridge, MA. The system includes four HP DL380p Gen8 servers, each with 128 GB memory and two Intel 3.0GHz E5-2667 eight-core processors and Mellanox ConnectX3 cards that support both FDR (56 Gb/s) InfiniBand and 40 Gb/s RoCE....

Read more