DC Field | Value | Language |
---|---|---|
dc.contributor.author | Dusenberry, Michael W. | ko |
dc.contributor.author | Tran, Dustin | ko |
dc.contributor.author | Choi, Edward | ko |
dc.contributor.author | Kemp, Jonas | ko |
dc.contributor.author | Nixon, Jeremy | ko |
dc.contributor.author | Jerfel, Ghassen | ko |
dc.contributor.author | Heller, Katherine | ko |
dc.contributor.author | Dai, Andrew M. | ko |
dc.date.accessioned | 2021-01-13T05:30:10Z | - |
dc.date.available | 2021-01-13T05:30:10Z | - |
dc.date.created | 2020-12-03 | - |
dc.date.issued | 2020-04 | - |
dc.identifier.citation | 2020 ACM Conference on Health, Inference, and Learning, CHIL 2020, pp.204 - 213 | - |
dc.identifier.uri | http://hdl.handle.net/10203/279889 | - |
dc.description.abstract | In medicine, both ethical and monetary costs of incorrect predictions can be significant, and the complexity of the problems often necessitates increasingly complex models. Recent work has shown that changing just the random seed is enough for otherwise well-tuned deep neural networks to vary in their individual predicted probabilities. In light of this, we investigate the role of model uncertainty methods in the medical domain. Using RNN ensembles and various Bayesian RNNs, we show that population-level metrics, such as AUC-PR, AUC-ROC, log-likelihood, and calibration error, do not capture model uncertainty. Meanwhile, the presence of significant variability in patient-specific predictions and optimal decisions motivates the need for capturing model uncertainty. Understanding the uncertainty for individual patients is an area with clear clinical impact, such as determining when a model decision is likely to be brittle. We further show that RNNs with only Bayesian embeddings can be a more efficient way to capture model uncertainty compared to ensembles, and we analyze how model uncertainty is impacted across individual input features and patient subgroups. | - |
dc.language | English | - |
dc.publisher | Association for Computing Machinery, Inc | - |
dc.title | Analyzing the Role of Model Uncertainty for Electronic Health Records | - |
dc.type | Conference | - |
dc.identifier.scopusid | 2-s2.0-85082746854 | - |
dc.type.rims | CONF | - |
dc.citation.beginningpage | 204 | - |
dc.citation.endingpage | 213 | - |
dc.citation.publicationname | 2020 ACM Conference on Health, Inference, and Learning, CHIL 2020 | - |
dc.identifier.conferencecountry | CN | - |
dc.identifier.conferencelocation | Toronto | - |
dc.identifier.doi | 10.1145/3368555.3384457 | - |
dc.contributor.localauthor | Choi, Edward | - |
dc.contributor.nonIdAuthor | Dusenberry, Michael W. | - |
dc.contributor.nonIdAuthor | Tran, Dustin | - |
dc.contributor.nonIdAuthor | Kemp, Jonas | - |
dc.contributor.nonIdAuthor | Nixon, Jeremy | - |
dc.contributor.nonIdAuthor | Jerfel, Ghassen | - |
dc.contributor.nonIdAuthor | Heller, Katherine | - |
dc.contributor.nonIdAuthor | Dai, Andrew M. | - |
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.