Diagnostic Accuracy of Technology-based Eye Care Services: The Technology-based Eye Care Services Compare Trial Part I

Purpose: Ophthalmologic telemedicine has the ability to provide eye care for patients remotely, and many countries have used screening tele-ophthalmology programs for several years. One such initiative at the Veterans Affairs (VA) Healthcare System is Technology-based Eye Care Services (TECS). The TECS services are located in primary care clinics and provide basic screening eye care, including vision, refraction, and retinal photography. Eye care providers (“readers”) review the clinical data and recommend appropriate follow-up. One of the most common referrals from TECS has been for glaucoma, and this study was powered for glaucoma/glaucoma suspect detection. The current study was undertaken to identify aspects of the protocol that could be refined to enhance accuracy. Design: Prospective comparison between the standard TECS protocol versus a face-to-face (FTF) examination on 256 patients, all of whom had no known history of significant ocular disease. Participants: Patients with no known ocular disease who were scheduled for an in-person eye appointment at the Atlanta VA. Patients underwent screening through the TECS protocol and received an FTF examination on the same day (gold standard). The TECS readers were masked to the results of the FTF examination. Main Outcome Measures: Percent agreement, kappa, sensitivity, and specificity were calculated for the TECS readers’ interpretations versus the FTF examination. Results: The TECS readers showed substantial agreement for cataract (κ ≥ 0.71) and diabetic retinopathy (κ ≥ 0.61) and moderate to substantial agreement for glaucoma/glaucoma suspect (κ ≥ 0.52) compared with an FTF examination. Age-related macular degeneration (AMD) showed moderate agreement (κ ≥ 0.34). Percent agreement with the TECS protocol was high (84.3%–98.4%) for each of the disease categories. Overall sensitivity and specificity were ≥75% and ≥55%, respectively, for any diagnosis resulting in referral. Inter-reader and intra-reader agreement was substantial for most diagnoses (κ > 0.61) with percent agreements ranging from 66% to 99%. Conclusions: Our results indicate that the standard TECS protocol is accurate when compared with an FTF examination for the detection of common eye diseases. The inclusion of additional testing such as OCT could further enhance diagnostic capability.