Metraipolis › archive › dc_48677ae86c53
Validation framework for epidemiological models with application to COVID-19 models — Europe PMC PMID:36989251
- Source
- Europe PMC (en)
- Original
- https://europepmc.org/article/MED/36989251
- DOI
- 10.1371/journal.pcbi.1010968
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-08T02:29:14.294Z
- SHA-256 of the archived text
22b4c91d08a845db36532f6cfb6538b977ab4b4d63ea57b5118663ee530b93e8- Stable URL of this page
https://metraipolis.com/documento/dc_48677ae86c53
How to cite
Validation framework for epidemiological models with application to COVID-19 models — Europe PMC PMID:36989251 — Europe PMC (en), https://europepmc.org/article/MED/36989251 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_48677ae86c53 (Metraipolis archive dc_48677ae86c53, sha256 22b4c91d08a845db36532f6cfb6538b977ab4b4d63ea57b5118663ee530b93e8)
BibTeX
@misc{dc48677ae86c53,
title = {Validation framework for epidemiological models with application to COVID-19 models — Europe PMC PMID:36989251},
howpublished = {Europe PMC (en)},
url = {https://europepmc.org/article/MED/36989251},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_48677ae86c53; sha256 22b4c91d08a845db36532f6cfb6538b977ab4b4d63ea57b5118663ee530b93e8},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: Europe PMC (en), https://europepmc.org/article/MED/36989251. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Mathematical models have been an important tool during the COVID-19 pandemic, for example to predict demand of critical resources such as medical devices, personal protective equipment and diagnostic tests. Many COVID-19 models have been developed. However, there is relatively little information available regarding reliability of model predictions. Here we present a general model validation framework for epidemiological models focused around predictive capability for questions relevant to decision-making end-users. COVID-19 models are typically comprised of multiple releases, and provide predictions for multiple localities, and these characteristics are systematically accounted for in the framework, which is based around a set of validation scores or metrics that quantify model accuracy of specific quantities of interest including: date of peak, magnitude of peak, rate of recovery, and monthly cumulative counts. We applied the framework to retrospectively assess accuracy of death predictions for four COVID-19 models, and accuracy of hospitalization predictions for one COVID-19 model (models for which sufficient data was publicly available). When predicting date of peak deaths, the most accurate model had errors of approximately 15 days or less, for releases 3-6 weeks in advance of the peak. Death peak magnitude relative errors were generally in the 50% range 3-6 weeks before peak. Hospitalization predictions were less accurate than death predictions. All models were highly variable in predictive accuracy across regions. Overall, our framework provides a wealth of information on the predictive accuracy of epidemiological models and could be used in future epidemics to evaluate new models or support existing modeling methodologies, and thereby aid in informed model-based public health decision making. The code for the validation framework is available at https://doi.org/10.5281/zenodo.7102854. Tema degli esploratori: agenti e intelligenza artificiale (ricerca Europe PMC «agent-based model», solo open access). Pubblicazione: PLoS computational biology, 2023 (prima pubblicazione 2023-03-29). Identificativi: PMID 36989251 · PMCID PMC10057797 · DOI 10.1371/journal.pcbi.1010968. Descrittori MeSH principali: COVID-19. Pagina: https://europepmc.org/article/MED/36989251 — https://doi.org/10.1371/journal.pcbi.1010968. Autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza dell'articolo dichiarata da Europe PMC: CC0 (la versione è indicata dall'editore sulla pagina). Abstract riportato senza modifiche al contenuto, con attribuzione; deposito marcato CC0. Letto il 2026-10-08T01:47:39.451Z tramite l'API REST ufficiale di Europe PMC (EMBL-EBI), nel rispetto del robots.txt e del crawl-delay.