Hadoop 2.0, also known as Yet Another Resource Negotiator
(YARN) is the newest generation of the Hadoop technology that is in popular use
today for highly distributed processing and management of big data. YARN is now
shipped by the Hadoop distributors as part of their Hadoop 2.x distributions. YARN
changes the architecture that was inherent in Hadoop 1.0 in order to allow the
system to scale to new levels and to assign responsibilities more clearly to
different components. Looking deeper into the functionality that YARN offers,
it is clear that there are many good reasons for virtualizing it.
We find that the YARN and vSphere technologies are complementary and that they serve mutually beneficial purposes in building your big data clusters.