Yusof MM et al. 2008 "Investigating evaluation frameworks for health information systems."

Yusof MM, Papazafeiropoulou A, Paul RJ, et al. Investigating evaluation frameworks for health information systems. Int J Med Inf 2008;77(6):377-385.
"Background and purpose: Evaluation of health information systems (HIS) enables the assessment of the extent to which HIS are fulfilling their objectives in supporting the services of healthcare delivery. This paper presents an overview of evaluation in health informatics and information systems.
Methods: Literature review on discourses, dimensions and methods of HIS and IS evaluation. A critical appraisal of selected HIS and IS evaluation frameworks is undertaken in order to identify HIS evaluation dimensions and measures. The frameworks are compared based on their inclusion of human, organizational and technological factors.
Results: We found that an increasing number of evaluation studies deal with two distinct trends of HIS: one considers human and organizational issues and the other is concerned with the employment of a subjectivist approach. Our review indicates that current evaluation methods complement each other in that they evaluate different aspects of HIS and they can be improved upon.
Conclusions: Evaluation is complex; it is easy to measure many things but not necessarily the right ones. Nevertheless it is possible to consider an HIS evaluation framework with more comprehensive and specific measures that would incorporate technological, human, and organizational issues to facilitate HIS evaluation."
To present "an overview of evaluation in health informatics and information systems."
Type Clinic
Primary care and specialty care
not applicable
Type of Health IT
All types
Type of Health IT Functions
"[Health Information Systems included] range[d] from simple systems, such as transaction processing systems, to complex systems, such as clinical decision support systems (CDSS)."
Workflow-Related Findings
"Evaluation should address not just how well a system works, but also how well the system works with particular users in a particular setting."
"First, the usefulness of a technology seems to relate to the tasks of the user. It appears that users regard their system as tools, which aid or hinder them in performing their tasks. Users respond positively to system's features that realize task demands. Second, users seem capable of performing the evaluation of the task-technology fit of a particular technology that they have been using. [One] study also indicated that user evaluations could be beneficial to the practitioner as they provide fair, detailed diagnostics of information systems and services."
Study Design
Systematic literature review
Study Participants
The authors "searched health informatics, information systems, computer science and engineering databases including PubMed, Science Direct, Web of Knowledge, Engineering Village 2 and the ACM digital library. Other sources include textbooks, web search using Google and Yahoo search engines, and citation searching and chaining."