DAPT: A package enabling distributed automated parameter testing

Modern agent-based models (ABM) and other simulation models require evaluation and testing of many different parameters. Managing that testing for large scale parameter sweeps (grid searches), as well as storing simulation data, requires multiple, potentially customizable steps that may...

Descripción completa

Guardado en:
Detalles Bibliográficos
Autores principales: Ben Duggan, John Metzcar, Paul Macklin
Formato: article
Lenguaje:EN
Publicado: GigaScience Press 2021
Materias:
Acceso en línea:https://doaj.org/article/bf5295eb4ffd4458a5b6c4549d0e0878
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
id oai:doaj.org-article:bf5295eb4ffd4458a5b6c4549d0e0878
record_format dspace
spelling oai:doaj.org-article:bf5295eb4ffd4458a5b6c4549d0e08782021-12-02T17:18:24ZDAPT: A package enabling distributed automated parameter testing10.46471/gigabyte.222709-4715https://doaj.org/article/bf5295eb4ffd4458a5b6c4549d0e08782021-06-01T00:00:00Zhttps://gigabytejournal.com/articles/22https://doaj.org/toc/2709-4715 Modern agent-based models (ABM) and other simulation models require evaluation and testing of many different parameters. Managing that testing for large scale parameter sweeps (grid searches), as well as storing simulation data, requires multiple, potentially customizable steps that may vary across simulations. Furthermore, parameter testing, processing, and analysis are slowed if simulation and processing jobs cannot be shared across teammates or computational resources. While high-performance computing (HPC) has become increasingly available, models can often be tested faster with the use of multiple computers and HPC resources. To address these issues, we created the Distributed Automated Parameter Testing (DAPT) Python package. By hosting parameters in an online (and often free) “database”, multiple individuals can run parameter sets simultaneously in a distributed fashion, enabling ad hoc crowdsourcing of computational power. Combining this with a flexible, scriptable tool set, teams can evaluate models and assess their underlying hypotheses quickly. Here, we describe DAPT and provide an example demonstrating its use. Ben DugganJohn MetzcarPaul MacklinGigaScience PressarticleElectronic computers. Computer scienceQA75.5-76.95ENGigaByte (2021)
institution DOAJ
collection DOAJ
language EN
topic Electronic computers. Computer science
QA75.5-76.95
spellingShingle Electronic computers. Computer science
QA75.5-76.95
Ben Duggan
John Metzcar
Paul Macklin
DAPT: A package enabling distributed automated parameter testing
description Modern agent-based models (ABM) and other simulation models require evaluation and testing of many different parameters. Managing that testing for large scale parameter sweeps (grid searches), as well as storing simulation data, requires multiple, potentially customizable steps that may vary across simulations. Furthermore, parameter testing, processing, and analysis are slowed if simulation and processing jobs cannot be shared across teammates or computational resources. While high-performance computing (HPC) has become increasingly available, models can often be tested faster with the use of multiple computers and HPC resources. To address these issues, we created the Distributed Automated Parameter Testing (DAPT) Python package. By hosting parameters in an online (and often free) “database”, multiple individuals can run parameter sets simultaneously in a distributed fashion, enabling ad hoc crowdsourcing of computational power. Combining this with a flexible, scriptable tool set, teams can evaluate models and assess their underlying hypotheses quickly. Here, we describe DAPT and provide an example demonstrating its use.
format article
author Ben Duggan
John Metzcar
Paul Macklin
author_facet Ben Duggan
John Metzcar
Paul Macklin
author_sort Ben Duggan
title DAPT: A package enabling distributed automated parameter testing
title_short DAPT: A package enabling distributed automated parameter testing
title_full DAPT: A package enabling distributed automated parameter testing
title_fullStr DAPT: A package enabling distributed automated parameter testing
title_full_unstemmed DAPT: A package enabling distributed automated parameter testing
title_sort dapt: a package enabling distributed automated parameter testing
publisher GigaScience Press
publishDate 2021
url https://doaj.org/article/bf5295eb4ffd4458a5b6c4549d0e0878
work_keys_str_mv AT benduggan daptapackageenablingdistributedautomatedparametertesting
AT johnmetzcar daptapackageenablingdistributedautomatedparametertesting
AT paulmacklin daptapackageenablingdistributedautomatedparametertesting
_version_ 1718381107813023744