notesum.ai

Published at November 7

Position Paper On Diagnostic Uncertainty Estimation from Large Language Models: Next-Word Probability Is Not Pre-test Probability

cs.AI

cs.CL

Released Date: November 7, 2024

Authors: Yanjun Gao¹, Skatje Myers², Shan Chen³, Dmitriy Dligach⁴, Timothy A Miller⁵, Danielle Bitterman⁶, Guanhua Chen², Anoop Mayampurath², Matthew Churpek², Majid Afshar²

Aff.: ¹University of Colorado Anschutz; ²University of Wisconsin-Madison; ³Harvard Medical School; ⁴Loyola University Chicago; ⁵Boston Childrens Hospital; ⁶Dana Farber Cancer Institute

Arxiv: http://arxiv.org/abs/2411.04962v1

Hospitalized patient of age [value] getting worse has labs and vitals values of systolic blood pressure [value] mmHg, diastolic blood pressure [value] mmHg, oxygen saturation[value] %, body temperature [value] celsius degree, … total protein [value], white blood cell [value]. What are the diagnoses for this patient?