Apache Spark Archives - Virtualize Applications

How Virtualization Helps in the Data Science and Machine Learning Lab – Part 2

Justin Murray posted July 3rd, 2018

Rightsizing a Machine Learning Cluster on VMware vSphere In part 1 of this 2-part article, we saw multiple applications running on Apache Spark clusters, the TensorFlow runtime, Cloudera CDH platform and other workloads – all sharing a set of physical servers that were managed by VMware vSphere. These applications operate in collections of virtual Read more...

How Virtualization Helps in the Data Science and Machine Learning Lab – Part 1

Justin Murray posted June 29th, 2018

One of the most exciting aspects of data science and machine learning (ML) is the pace of technical innovation that is happening in these fields. New tools, platforms, models and data science workbenches are being created at a rapid pace – so rapid, in fact, that it is difficult for the practitioner to keep up Read more...

VMworld 2018 Applications Bootcamp – Running Big Data on VMware Technologies using Spark and Hadoop

Justin Murray posted June 27th, 2018

You are invited to a special new bootcamp event in the Virtualizing Applications series of bootcamps at this year’s VMworld! The half-day Big Data and machine learning bootcamp will bring you up to speed on the design of a VMware setup for hosting your big data/machine learning systems, whether you intend to do so on Read more...

New Architectures for Apache Spark™ and Big Data

Mohan Potheri posted December 20th, 2017

Key Trends in Big Data Infrastructure: Some of the key trends in big data infrastructure over the past couple of years are: • Decoupling of Compute and Storage Clusters • Separate compute virtual machines from storage VMs • Data is processed and scaled independently of compute • Dynamic Scaling of compute nodes used for analysis Read more...