Posts Tagged ‘ hadoop ’

joshsimons

Hadoop Performance on vSphere 5.1

April 19, 2013
By
Hadoop Performance on vSphere 5.1

We’ve just published a third Hadoop performance paper, written by VMware performance expert Jeff Buell, which looks in detail at the relative performance of a bare-metal 32-node Hadoop cluster compared to a range of virtual clusters with up to 128 VMs. The executive summary is that while we saw a 13% performance degradation in a head-to-head comparison of a 32-node physical cluster against a 32-VM virtual cluster (one VM per host) running on the same hardware and running the same tests, virtualized performance can be increased significantly — to the point where virtualized Hadoop actually runs a bit faster than physical — by increasing the number of VMs per host. We’ve seen this effect before with Hadoop...

Read more

joshsimons

HPC Performance in the Cloud: Status and Future Prospects

October 1, 2012
By
HPC Performance in the Cloud: Status and Future Prospects

I spoke last week at ISC Cloud 2012 in Mannheim, Germany about the performance of HPC applications in the cloud, citing results from several studies. I have summarized the talk below and my PDF slide deck is available here . For full details of ISC Cloud 2012, I recommend the coverage at  HPC in the Cloud . I gave my talk to share some specific data about HPC performance in virtual environments, but I first described what new capabilities can be gained by virtualizing an HPC environment. I felt this was necessary because in HPC discussions it is often the case that...

Read more

Steve Herrod

GigaOm Structure – Big Data in the Cloud

June 20, 2012
By

I attended GigaOm Structure this week in San Francisco, and it was another successful event with cloud bursting at the seams! I gave a talk about the real impact of Big Data when it meets cloud computing, which is an important topic for our customers.

Read more

Richard McDougall

Project Serengeti: There’s a Virtual Elephant in my Datacenter

June 12, 2012
By
Project Serengeti: There’s a Virtual Elephant in my Datacenter

Introduction There’s no question that the amount of value being extracted from data is increasing – almost every customer I speak with is building new technology to gain new or competitive insights from tapping large volumes or rates of data. In the last few posts, I have introduced VMware technologies and products that provide data services to new applications. We see four major axes along which data requirements are stretching the limits of traditional approaches to data analysis: Big Data – The need to store and compute against hundreds of gigabytes of unstructured or semi-structured data Fast Data – The increasing need for low latency interactions with large sets of data, often driven by today’s mobile and social apps. Flexible Data – The need...

Read more

Richard McDougall

Cetas (VMware) receives prestigious 2012 TiE50 award!

May 18, 2012
By
Cetas (VMware) receives prestigious 2012 TiE50 award!

  As a great validation of VMware’s decision to acquire Cetas , that team has been honored with the TiE50 award in the Software category. This award acknowledges their achievements and underscores the recognition we are getting in the Big Data Analytics space. We are thrilled to receive this prestigious award and it is a solid recognition of all the innovative and hard work done by the team. TiE is a leading entrepreneur-focused organization doing a tremendous job of fostering creativity and innovation amongst entrepreneurs while identifying the technologies and companies that rise to the top in their respective focus areas. More and more business users are demanding instant...

Read more

joshsimons

Video: Why Hadoop Can Run Faster on vSphere than Native

April 11, 2012
By

In this video interview, Jeff Buell, one of VMware’s senior performance engineers, shares his perspectives on the importance of Big Data for customers and for VMware. He also addresses the issue of why his Hadoop testing showed significantly better performance running Hadoop on vSphere when compared to native in some instances. The video (running time 6:20) is here .   The full white paper detailing Jeff’s Hadoop performance testing done in partnership with AMAX and Mellanox is here .

Read more