online read us now
Paper details
Number 2 - June 2011
Volume 21 - 2011
Performance evaluation of MapReduce using full virtualisation on a departmental cloud
Horacio González-Vélez, Maryam Kontagora
Abstract
This work analyses the performance of Hadoop, an implementation of the MapReduce programming model for distributed parallel computing, executing on a virtualisation environment comprised of 1+16 nodes running the VMWare workstation software. A set of experiments using the standard Hadoop benchmarks has been designed in order to determine whether or not significant reductions in the execution time of computations are experienced when using Hadoop on this virtualisation platform on a departmental cloud. Our findings indicate that a significant decrease in computing times is observed under these conditions. They also highlight how overheads and virtualisation in a distributed environment hinder the possibility of achieving the maximum (peak) performance.
Keywords
MapReduce, server virtualization, cloud computing, algorithmic skeletons, structured parallelism, parallel computing