Investigating evaluation frameworks for electronic health record: A literature review

Abstract

BACKGROUND: There are various electronic health records (EHRs) evaluation frameworks with multiple dimensions and numerous sets of evaluation measures, while the coverage rate of evaluation measures in a common framework varies in different studies. AIM: This study provides a literature review of the current EHR evaluation frameworks and a model for measuring the coverage rate of evaluation measures in EHR frameworks. METHODS: The current study was a comprehensive literature review and a critical appraisal study. The study was conducted in three phases. In Phase 1, a literature review of EHR evaluation frameworks was conducted. In Phase 2, a three-level hierarchical structure was developed, which includes three aspects, 12 dimensions, and 110 evaluation measures. Subsequently, evaluation measures in the identified studies were categorized based on the hierarchical structure. In Phase 3, relative frequency (RF) of evaluation measures in different dimensions and aspects for each of the identified studies were determined and categorized as follows: Appropriate, moderate, and low coverage. RESULTS: Out of a total of 8276 retrieved articles, 62 studies were considered relevant. The RF range in the second and third level of the hierarchical structure was between 8.6–91.94 and 0.2–61, respectively. “Ease of use” and “system quality” were the most frequent evaluation measure and dimension. Our results indicate that identified studies cover at least one and at most nine evaluation dimensions and current evaluation frameworks focus more on the technology aspect. Almost in all identified studies, evaluation measures related to the technology aspect were covered. However, evaluation measures related to human and organization aspects were covered in 68 and 84 of the identified studies, respectively. CONCLUSION: In this study, we systematically reviewed all literature presenting any type of EHR evaluation framework and analyzed and discussed their aspects and features. We believe that the findings of this study can help researchers to review and adopt the EHR evaluation frameworks for their own particular field of usage. © 2021 Zahra Ebnehoseini, Hamed Tabesh, Majid Jangi, Kolsoum Deldar, Sayyed Mostafa Mostafavi, Mahmood Tara.