Metraipolis › archive › dc_ea4d95a32fb1
Implementation and prospective real-time evaluation of a generalized system for in-clinic deployment and validation of machine learning models in radiology — Europe PMC PMID:37603542
- Source
- Europe PMC (en)
- Original
- https://europepmc.org/article/MED/37603542
- DOI
- 10.1371/journal.pdig.0000227
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-07T12:28:58.615Z
- SHA-256 of the archived text
28f481e40a5438f4542a7786df2c557818223c3d2827269091868262fbcd976f- Stable URL of this page
https://metraipolis.com/documento/dc_ea4d95a32fb1
How to cite
Implementation and prospective real-time evaluation of a generalized system for in-clinic deployment and validation of machine learning models in radiology — Europe PMC PMID:37603542 — Europe PMC (en), https://europepmc.org/article/MED/37603542 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_ea4d95a32fb1 (Metraipolis archive dc_ea4d95a32fb1, sha256 28f481e40a5438f4542a7786df2c557818223c3d2827269091868262fbcd976f)
BibTeX
@misc{dcea4d95a32fb1,
title = {Implementation and prospective real-time evaluation of a generalized system for in-clinic deployment and validation of machine learning models in radiology — Europe PMC PMID:37603542},
howpublished = {Europe PMC (en)},
url = {https://europepmc.org/article/MED/37603542},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_ea4d95a32fb1; sha256 28f481e40a5438f4542a7786df2c557818223c3d2827269091868262fbcd976f},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: Europe PMC (en), https://europepmc.org/article/MED/37603542. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
The medical imaging community has embraced Machine Learning (ML) as evidenced by the rapid increase in the number of ML models being developed, but validating and deploying these models in the clinic remains a challenge. The engineering involved in integrating and assessing the efficacy of ML models within the clinical workflow is complex. This paper presents a general-purpose, end-to-end, clinically integrated ML model deployment and validation system implemented at UCSF. Engineering and usability challenges and results from 3 use cases are presented. A generalized validation system based on free, open-source software (OSS) was implemented, connecting clinical imaging modalities, the Picture Archiving and Communication System (PACS), and an ML inference server. ML pipelines were implemented in NVIDIA's Clara Deploy framework with results and clinician feedback stored in a customized XNAT instance, separate from the clinical record but linked from within PACS. Prospective clinical validation studies of 3 ML models were conducted, with data routed from multiple clinical imaging modalities and PACS. Completed validation studies provided expert clinical feedback on model performance and usability, plus system reliability and performance metrics. Clinical validation of ML models entails assessing model performance, impact on clinical infrastructure, robustness, and usability. Study results must be easily accessible to participating clinicians but remain outside the clinical record. Building a system that generalizes and scales across multiple ML models takes the concerted effort of software engineers, clinicians, data scientists, and system administrators, and benefits from the use of modular OSS. The present work provides a template for institutions looking to translate and clinically validate ML models in the clinic, together with required resources and expected challenges. Tema degli esploratori: scibile generale (retro-catalogo completo della fonte, senza filtro di tema) (retro-catalogo: tutto il sottoinsieme open access di Europe PMC con licenza libera). Pubblicazione: PLOS digital health, 2023 (prima pubblicazione 2023-08-21). Identificativi: PMID 37603542 · PMCID PMC10441783 · DOI 10.1371/journal.pdig.0000227. Pagina: https://europepmc.org/article/MED/37603542 — https://doi.org/10.1371/journal.pdig.0000227. Autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza dell'articolo dichiarata da Europe PMC: CC0 (la versione è indicata dall'editore sulla pagina). Abstract riportato senza modifiche al contenuto, con attribuzione; deposito marcato CC0. Letto il 2026-10-07T12:01:43.128Z tramite l'API REST ufficiale di Europe PMC (EMBL-EBI), nel rispetto del robots.txt e del crawl-delay.