144324 - A task-resource mapping algorithm for large-scale batch-mode computational marine hydrodynamics codes on containerized private cloud.pdf (1.79 MB)
A task-resource mapping algorithm for large-scale batch-mode computational marine hydrodynamics codes on containerized private cloud
journal contributionposted on 2023-05-21, 00:46 authored by Xu, Y, Liu, P, Irene PenesisIrene Penesis, He, G
CPU time has long been a remaining problem for large-scale batch mode based scientific computing applications. To address this time-consuming problem, a container-based private cloud was employed, and a novel task-resource mapping algorithm was developed. Firstly, the execution features of typical batch mode codes were extracted and then computing jobs were formulated as a coarseness acyclic DAG. Secondly, to guarantee both job makespan and resource utilization, a novel task-resource mapping algorithm, along with container pre-planning and worst-case-first task placement phases, were developed. Finally, a typical Computational Marine Hydrodynamics software, Rotorysics, with a different scale of input data matrix was used as benchmark software. To manifest the effectiveness of the proposed method, a number of numerical examples were given via CloudSim and a small-medium containerized private cloud platform was adopted with three practical study cases. The computational results show that 1) compared with the traditional HPC workstation computing solution, container-based cloud solution shows significant savings in makespan by more than 6 times. 2) the new method is scalable to address bigger size batch computing problem up to a run matrix 108,.
Publication titleIEEE Access
Department/SchoolAustralian Maritime College
PublisherInstitute of Electrical and Electronics Engineers
Place of publicationUnited States
Rights statement© 2021. The Authors. This is an open access article under the terms of the Creative Commons Attribution 4.0 International (CC BY 4.0) License, (https://creativecommons.org/licenses/by/4.0/), which permits use, distribution and reproduction in any medium, provided the original work is properly cited.