Metraipolis › archive › dc_422cb51ccf7f
KnowBench: Effort Reduction as a Unified, Deployment-Grounded Benchmark for Clinical AI — arXiv:2609.15794
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2609.15794
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-15T22:48:06.597Z
- SHA-256 of the archived text
d7bc790e22b4c0ca62195a0b39affc8ccc8f9dac5e6399e74e2a00bf9be8fde3- Stable URL of this page
https://metraipolis.com/documento/dc_422cb51ccf7f
How to cite
KnowBench: Effort Reduction as a Unified, Deployment-Grounded Benchmark for Clinical AI — arXiv:2609.15794 — arXiv (en), https://arxiv.org/abs/2609.15794 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_422cb51ccf7f (Metraipolis archive dc_422cb51ccf7f, sha256 d7bc790e22b4c0ca62195a0b39affc8ccc8f9dac5e6399e74e2a00bf9be8fde3)
BibTeX
@misc{dc422cb51ccf7f,
title = {KnowBench: Effort Reduction as a Unified, Deployment-Grounded Benchmark for Clinical AI — arXiv:2609.15794},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2609.15794},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_422cb51ccf7f; sha256 d7bc790e22b4c0ca62195a0b39affc8ccc8f9dac5e6399e74e2a00bf9be8fde3},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.15794. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Clinical AI systems are evaluated with instruments built for research settings (reference-based similarity metrics and expert rubric panels) that measure resemblance to an artifact rather than reduction of a burden. We introduce KnowBench, pioneered by Knowtex, whose unifying metric is Effort Reduction (ER): the proportion of system-generated clinical work product accepted by the responsible clinician under expert and safety review. ER is defined once and instantiated per task across the administrative workload clinical AI automates: visit notes, diagnosis and billing codes, orders, EHR chart summarization, patient after-visit summaries, and clinical decision support. In every instantiation the construction is identical: the clinician's review-and-attestation event is the ground truth, every accepted unit is work the system completed, and every correction is residual effort returned to the clinician. The primary contribution of this paper is the benchmark itself: the metric, its degenerate cases, and a reporting protocol under which ER claims are auditable and cross-system comparable. Alongside it we report an initial headline measurement from the documentation instantiation: over one million signed encounters across a production window exceeding six months and thirteen medical specialties, Knowtex's proprietary fine-tuned clinical foundation models operating inside a closed feedback architecture achieve an aggregate ER of 97.99%, with per-specialty aggregates spanning 96.8-98.9%. This release reports the protocol's checklist partially, and states which companion statistics are withheld; the benchmark is offered so that this figure, and every figure reported after it, can be held to the same standard. Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-15 in cs.AI). Categorie arXiv: Artificial Intelligence (cs.AI). Pagina del lavoro: https://arxiv.org/abs/2609.15794 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-15T22:29:03.360Z dalla pagina https://arxiv.org/catchup/cs.AI/2026-09-15?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).