TY - JOUR

T1 - Association is not prediction

T2 - A landscape of confused reporting in diabetes – A systematic review

AU - Varga, Tibor V.

AU - Niss, Kristoffer

AU - Estampador, Angela C.

AU - Collin, Catherine B.

AU - Moseley, Pope L.

PY - 2020

Y1 - 2020

N2 - Aims: Appropriate analysis of big data is fundamental to precision medicine. While statistical analyses often uncover numerous associations, associations themselves do not convey predictive value. Confusion between association and prediction harms clinicians, scientists, and ultimately, the patients. We analyzed published papers in the field of diabetes that refer to “prediction” in their titles. We assessed whether these articles report metrics relevant to prediction. Methods: A systematic search was undertaken using NCBI PubMed. Articles with the terms “diabetes” and “prediction” were selected. All abstracts of original research articles, within the field of diabetes epidemiology, were searched for metrics pertaining to predictive statistics. Simulated data was generated to visually convey the differences between association and prediction. Results: The search-term yielded 2,182 results. After discarding non-relevant articles, 1,910 abstracts were evaluated. Of these, 39% (n = 745) reported metrics of predictive statistics, while 61% (n = 1,165) did not. The top reported metrics of prediction were ROC AUC, sensitivity and specificity. Using the simulated data, we demonstrated that biomarkers with large effect sizes and low P values can still offer poor discriminative utility. Conclusions: We demonstrate a landscape of confused reporting within the field of diabetes epidemiology where the term “prediction” is often incorrectly used to refer to association statistics. We propose guidelines for future reporting, and two major routes forward in terms of main analytic procedures and research goals: the explanatory route, which contributes to precision medicine, and the prediction route which contributes to personalized medicine.

AB - Aims: Appropriate analysis of big data is fundamental to precision medicine. While statistical analyses often uncover numerous associations, associations themselves do not convey predictive value. Confusion between association and prediction harms clinicians, scientists, and ultimately, the patients. We analyzed published papers in the field of diabetes that refer to “prediction” in their titles. We assessed whether these articles report metrics relevant to prediction. Methods: A systematic search was undertaken using NCBI PubMed. Articles with the terms “diabetes” and “prediction” were selected. All abstracts of original research articles, within the field of diabetes epidemiology, were searched for metrics pertaining to predictive statistics. Simulated data was generated to visually convey the differences between association and prediction. Results: The search-term yielded 2,182 results. After discarding non-relevant articles, 1,910 abstracts were evaluated. Of these, 39% (n = 745) reported metrics of predictive statistics, while 61% (n = 1,165) did not. The top reported metrics of prediction were ROC AUC, sensitivity and specificity. Using the simulated data, we demonstrated that biomarkers with large effect sizes and low P values can still offer poor discriminative utility. Conclusions: We demonstrate a landscape of confused reporting within the field of diabetes epidemiology where the term “prediction” is often incorrectly used to refer to association statistics. We propose guidelines for future reporting, and two major routes forward in terms of main analytic procedures and research goals: the explanatory route, which contributes to precision medicine, and the prediction route which contributes to personalized medicine.

KW - Association

KW - Biomarkers

KW - Personalized medicine

KW - Precision medicine

KW - Prediction

KW - Translational research

U2 - 10.1016/j.diabres.2020.108497

DO - 10.1016/j.diabres.2020.108497

M3 - Review

C2 - 33068662

AN - SCOPUS:85095957975

VL - 170

JO - Diabetes Research and Clinical Practice

JF - Diabetes Research and Clinical Practice

SN - 0168-8227

M1 - 108497

ER -