University Of Tasmania

File(s) under permanent embargo

BigDataSDNSim: A simulator for analyzing big data applications in software-defined cloud data centers

journal contribution
posted on 2023-05-21, 02:05 authored by Alwasel, K, Calheiros, RN, Saurabh GargSaurabh Garg, Buyya, R, Pathan, M, Georgakopoulos, D, Ranjan, R
The integration and crosscoordination of big data processing and software-defined networking (SDN) are vital for improving the performance of big data applications. Various approaches for combining big data and SDN have been investigated by both industry and academia. However, empirical evaluations of solutions that combine big data processing and SDN are extremely costly and complicated. To address the problem of effective evaluation of solutions that combine big data processing with SDN, we present a new, self-contained simulation tool named BigDataSDNSim that enables the modeling and simulation of the big data management system YARN, its related programming models MapReduce, and SDN-enabled networks in a cloud computing environment. BigDataSDNSim supports cost-effective and easy to conduct experimentation in a controllable, repeatable, and configurable manner. The article illustrates the simulation accuracy and correctness of BigDataSDNSim by comparing the behavior and results of a real environment that combines big data processing and SDN with an equivalent simulated environment. Finally, the article presents two uses cases of BigDataSDNSim, which exhibit its practicality and features, illustrate the impact of data replication mechanisms of MapReduce in Hadoop YARN, and show the superiority of SDN over traditional networks to improve the performance of MapReduce applications.


Publication title

Software: Practice and Experience










School of Information and Communication Technology


John Wiley & Sons Ltd

Place of publication

The Atrium, Southern Gate, Chichester, England, W Sussex, Po19 8Sq

Rights statement

© 2020 John Wiley & Sons, Ltd

Repository Status

  • Restricted

Socio-economic Objectives