Experience of OpenStack Test Deployment and Comparison of Virtual and Real Cluster Environments

Introduction. A brief overview of the properties and architecture of one of the components of the National Cloud of Open Science prototype – the cloud platform OpenStack is given. The list of software and hardware components of the OpenStack test cloud environment and the sequence of actions require...

Descripción completa

Guardado en:

Detalles Bibliográficos
Autores principales:	Tamara Bardadym, Oleksandr Lefterov, Sergiy Osypenko
Formato:	article
Lenguaje:	EN RU UK
Publicado:	V.M. Glushkov Institute of Cybernetics 2021
Materias:	cloud technologies reproducible calculations cluster platform Cybernetics Q300-390
Acceso en línea:	https://doaj.org/article/b042eede8b544818a5b2f40abbd648de
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

id	oai:doaj.org-article:b042eede8b544818a5b2f40abbd648de
record_format	dspace
spelling	oai:doaj.org-article:b042eede8b544818a5b2f40abbd648de2021-11-08T19:44:54ZExperience of OpenStack Test Deployment and Comparison of Virtual and Real Cluster Environments2707-45012707-451X10.34229/2707-451X.21.3.7https://doaj.org/article/b042eede8b544818a5b2f40abbd648de2021-09-01T00:00:00Zhttp://cctech.org.ua/13-vertikalnoe-menyu-en/284-abstract-21-3-7-artehttps://doaj.org/toc/2707-4501https://doaj.org/toc/2707-451XIntroduction. A brief overview of the properties and architecture of one of the components of the National Cloud of Open Science prototype – the cloud platform OpenStack is given. The list of software and hardware components of the OpenStack test cloud environment and the sequence of actions required for the deployment of both OpenStack itself and the Slurm virtual cluster environment for portable, scalable, reproducible scientific biomedical computing are presented. The purpose of the paper is a description of the experience of test deployment of OpenStack to create a scalable computing environment for reproducible scientific computing using modern technological solutions, which can be applied to both cloud (OpenStack, AWS, Google) and cluster platforms (Slurm). Results. The structure of the created test containerized (using Singularity technology) biomedical application, which contains modern software and libraries and can be used in conventional and cloud virtual cluster environments is briefly described. The results of a comparative test of this application in the virtual cluster environment Slurm under the control of OpenStack and in the node of cluster SKIT-4.5 in the V.M. Glushkov Institute of Cybernetics of the NAS of Ukraine are given. Information on solving the problem of finding the optimal in terms of saving resources scaling parameters for the developed application in two comparable cluster environments is given. Some features of the use of these cluster environments are clarified, in particular, a comparison of the dependence of the application speed on the number of parallel processes for two cluster environments is presented. Empirical data are presented in graphical form, which illustrate the nature of the load on the OpenStack server and the use of RAM on the number of parallel processes. Possibilities of portability between the specified cluster environments, scaling of calculations and maintenance of reproducibility of calculations for the offered test application are demonstrated. The advantages of using OpenStack technology for scientific biomedical calculations are pointed out. Conclusions. The described example of test deployment and use of OpenStack gives an idea of the requirements for the necessary technical base to ensure the reproducibility of scientific biomedical calculations in cloud and cluster environments.Tamara BardadymOleksandr LefterovSergiy OsypenkoV.M. Glushkov Institute of Cyberneticsarticlecloud technologiesreproducible calculationscluster platformCyberneticsQ300-390ENRUUKКібернетика та комп'ютерні технології, Iss 3, Pp 74-85 (2021)
institution	DOAJ
collection	DOAJ
language	EN RU UK
topic	cloud technologies reproducible calculations cluster platform Cybernetics Q300-390
spellingShingle	cloud technologies reproducible calculations cluster platform Cybernetics Q300-390 Tamara Bardadym Oleksandr Lefterov Sergiy Osypenko Experience of OpenStack Test Deployment and Comparison of Virtual and Real Cluster Environments
description	Introduction. A brief overview of the properties and architecture of one of the components of the National Cloud of Open Science prototype – the cloud platform OpenStack is given. The list of software and hardware components of the OpenStack test cloud environment and the sequence of actions required for the deployment of both OpenStack itself and the Slurm virtual cluster environment for portable, scalable, reproducible scientific biomedical computing are presented. The purpose of the paper is a description of the experience of test deployment of OpenStack to create a scalable computing environment for reproducible scientific computing using modern technological solutions, which can be applied to both cloud (OpenStack, AWS, Google) and cluster platforms (Slurm). Results. The structure of the created test containerized (using Singularity technology) biomedical application, which contains modern software and libraries and can be used in conventional and cloud virtual cluster environments is briefly described. The results of a comparative test of this application in the virtual cluster environment Slurm under the control of OpenStack and in the node of cluster SKIT-4.5 in the V.M. Glushkov Institute of Cybernetics of the NAS of Ukraine are given. Information on solving the problem of finding the optimal in terms of saving resources scaling parameters for the developed application in two comparable cluster environments is given. Some features of the use of these cluster environments are clarified, in particular, a comparison of the dependence of the application speed on the number of parallel processes for two cluster environments is presented. Empirical data are presented in graphical form, which illustrate the nature of the load on the OpenStack server and the use of RAM on the number of parallel processes. Possibilities of portability between the specified cluster environments, scaling of calculations and maintenance of reproducibility of calculations for the offered test application are demonstrated. The advantages of using OpenStack technology for scientific biomedical calculations are pointed out. Conclusions. The described example of test deployment and use of OpenStack gives an idea of the requirements for the necessary technical base to ensure the reproducibility of scientific biomedical calculations in cloud and cluster environments.
format	article
author	Tamara Bardadym Oleksandr Lefterov Sergiy Osypenko
author_facet	Tamara Bardadym Oleksandr Lefterov Sergiy Osypenko
author_sort	Tamara Bardadym
title	Experience of OpenStack Test Deployment and Comparison of Virtual and Real Cluster Environments
title_short	Experience of OpenStack Test Deployment and Comparison of Virtual and Real Cluster Environments
title_full	Experience of OpenStack Test Deployment and Comparison of Virtual and Real Cluster Environments
title_fullStr	Experience of OpenStack Test Deployment and Comparison of Virtual and Real Cluster Environments
title_full_unstemmed	Experience of OpenStack Test Deployment and Comparison of Virtual and Real Cluster Environments
title_sort	experience of openstack test deployment and comparison of virtual and real cluster environments
publisher	V.M. Glushkov Institute of Cybernetics
publishDate	2021
url	https://doaj.org/article/b042eede8b544818a5b2f40abbd648de
work_keys_str_mv	AT tamarabardadym experienceofopenstacktestdeploymentandcomparisonofvirtualandrealclusterenvironments AT oleksandrlefterov experienceofopenstacktestdeploymentandcomparisonofvirtualandrealclusterenvironments AT sergiyosypenko experienceofopenstacktestdeploymentandcomparisonofvirtualandrealclusterenvironments
_version_	1718441504468369408

Experience of OpenStack Test Deployment and Comparison of Virtual and Real Cluster Environments

Ejemplares similares