Metraipolis › archive › dc_1a41cbce64dc
TrialDesignBench: Benchmarking Language Models for Phase-I Trial Design Against Clinical Knowledge — arXiv:2611.12640
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2611.12640
- License (as archived)
- CC0-1.0
- Archived
- 2026-11-10T18:41:55.237Z
- SHA-256 of the archived text
ed2e29553a6304ab506209b1fe3c523137e17d234c9d448abbb4647a648891c1- Stable URL of this page
https://metraipolis.com/documento/dc_1a41cbce64dc
How to cite
TrialDesignBench: Benchmarking Language Models for Phase-I Trial Design Against Clinical Knowledge — arXiv:2611.12640 — arXiv (en), https://arxiv.org/abs/2611.12640 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_1a41cbce64dc (Metraipolis archive dc_1a41cbce64dc, sha256 ed2e29553a6304ab506209b1fe3c523137e17d234c9d448abbb4647a648891c1)
BibTeX
@misc{dc1a41cbce64dc,
title = {TrialDesignBench: Benchmarking Language Models for Phase-I Trial Design Against Clinical Knowledge — arXiv:2611.12640},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2611.12640},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_1a41cbce64dc; sha256 ed2e29553a6304ab506209b1fe3c523137e17d234c9d448abbb4647a648891c1},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2611.12640. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
AI is used in much of the clinical trial pipeline. However, selecting the statistical design of a trial, a crucial step that determines how drug doses are tested on humans and evaluated, has seen almost no AI progress. LLMs appear to be a natural fit given their strengths in biomedical knowledge and statistical reasoning. Nevertheless, there is currently no appropriate way to evaluate such abilities because recent regulatory and methodological shifts, most notably FDA's Project Optimus, have redefined what constitutes a reasonable design and rendered many previous designs obsolete. To lay the groundwork for AI-assisted trial design, we introduce TrialDesignBench, a benchmark of 617 Phase-I/I-II oncology dose-finding trials, each paired with an expert-validated reference design that is consistent with the latest FDA regulatory initiatives. This reference standard is produced through a formalization of the expert design process. We evaluate five frontier LLMs, none of which matches the reference standard. Our ablation experiments trace this performance gap to two main causes, inference of latent, unrecorded design determinants from trial sources (supplying them raises class-wise balanced accuracy by 0.22) and structured decision-tree reasoning (+0.24). TrialDesignBench offers a reproducible, contemporary-standard objective for evaluating and enhancing AI-assisted trial design. Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.AI, nuovi lavori del giorno). Categorie arXiv: Artificial Intelligence (cs.AI) ; Computation and Language (cs.CL); Applications (stat.AP). Pagina del lavoro: https://arxiv.org/abs/2611.12640 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-11-10T18:37:37.554Z dalla pagina https://arxiv.org/list/cs.AI/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).