TY - JOUR
T1 - Parametric assumptions equate to hidden observations
T2 - Comparing the efficiency of nonparametric and parametric models for estimating time to AIDS or death in a cohort of HIV-positive women
AU - Rudolph, Jacqueline E.
AU - Cole, Stephen R.
AU - Edwards, Jessie K.
N1 - Publisher Copyright:
© 2018 The Author(s).
PY - 2018/11/19
Y1 - 2018/11/19
N2 - Background: When conducting a survival analysis, researchers might consider two broad classes of models: nonparametric models and parametric models. While nonparametric models are more flexible because they make few assumptions regarding the shape of the data distribution, parametric models are more efficient. Here we sought to make concrete the difference in efficiency between these two model types using effective sample size. Methods: We compared cumulative risk of AIDS or death estimated using four survival models - nonparametric, generalized gamma, Weibull, and exponential - and data from 1164 HIV patients who were alive and AIDS-free in 1995. We added pseudo-observations to the sample until the spread of the 95% confidence limits for the nonparametric model became less than that for the parametric models. Results: We found the 3-parameter generalized gamma to be a good fit to the nonparametric risk curve, but the 1-parameter exponential both underestimated and overestimated the risk at different times. Using two year-risk as an example, we had to add 354, 593, and 3960 observations for the nonparametric model to be as efficient as the generalized gamma, Weibull, and exponential models, respectively. Conclusions: These added observations represent the hidden observations underlying the efficiency gained through parametric model form assumptions. If the model is correctly specified, the efficiency gain may be justified, as appeared to be the case for the generalized gamma model. Otherwise, precision will be improved, but at the cost of specification bias, as was the case for the exponential model.
AB - Background: When conducting a survival analysis, researchers might consider two broad classes of models: nonparametric models and parametric models. While nonparametric models are more flexible because they make few assumptions regarding the shape of the data distribution, parametric models are more efficient. Here we sought to make concrete the difference in efficiency between these two model types using effective sample size. Methods: We compared cumulative risk of AIDS or death estimated using four survival models - nonparametric, generalized gamma, Weibull, and exponential - and data from 1164 HIV patients who were alive and AIDS-free in 1995. We added pseudo-observations to the sample until the spread of the 95% confidence limits for the nonparametric model became less than that for the parametric models. Results: We found the 3-parameter generalized gamma to be a good fit to the nonparametric risk curve, but the 1-parameter exponential both underestimated and overestimated the risk at different times. Using two year-risk as an example, we had to add 354, 593, and 3960 observations for the nonparametric model to be as efficient as the generalized gamma, Weibull, and exponential models, respectively. Conclusions: These added observations represent the hidden observations underlying the efficiency gained through parametric model form assumptions. If the model is correctly specified, the efficiency gain may be justified, as appeared to be the case for the generalized gamma model. Otherwise, precision will be improved, but at the cost of specification bias, as was the case for the exponential model.
KW - Nonparametric model
KW - Parametric model
KW - Statistical efficiency
KW - Survival analysis
UR - http://www.scopus.com/inward/record.url?scp=85056717527&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85056717527&partnerID=8YFLogxK
U2 - 10.1186/s12874-018-0605-8
DO - 10.1186/s12874-018-0605-8
M3 - Article
C2 - 30453971
AN - SCOPUS:85056717527
SN - 1471-2288
VL - 18
JO - BMC medical research methodology
JF - BMC medical research methodology
IS - 1
M1 - 142
ER -