Digital Healthcare Research (DHR) is very excited to publish our latest year in review! We encourage you to take a look at the impact of recently completed research and the significance of emerging research, through selected research stories that capture the breadth and depth of our efforts to advance digital healthcare technologies to meet the evolving needs of patients, clinicians, and health systems. Our review would not be complete without mention of artificial intelligence (AI)—our Research Spotlight discusses how the DHR plans to bring evidence to bear on AI practice and policy.

Our program’s focus has been and continues to be on supporting important research that determines how the various components of the ever-evolving digital healthcare ecosystem can best come together to positively affect healthcare delivery and create value for patients and their families. This ecosystem includes clinical, contextual, and patient-generated health data (PGHD), as well as the tools used to manage and apply these data, such as advanced analytics like AI and data visualizations. The application of these data can result in knowledge, which can take the form of computable clinical guidelines and decision support. Various actors within this ecosystem include providers, payers, patients, developers, vendors, researchers, and many others who create and use these resources. We are interested in how these ecosystem elements and actors can best support the quality and safety of healthcare.
If you have any feedback for us about our year in review or thoughts about priority areas for our program’s research, feel free to send them to me: DigitalHealthcareResearch@ahrq.hhs.gov
August 2024
The Digital Healthcare Research Program at AHRQ provides foundational research to ensure that digital healthcare systems are designed and implemented in ways that improve quality and safety, while not resulting in excessive burden on physicians and other members of the care team. The entire portfolio of AHRQ-funded digital healthcare research is available and can be identified by technology studied, medical condition, population, status of the project, principal investigator, organization, funding mechanism, and location.
Current Priorities
Following the COVID-19 pandemic, virtual healthcare continues to be an important area of focus to widely disseminate lessons learned and best practices. For example, Dr. Bree Holtz, is bringing together a multidisciplinary group of decision leaders from health systems, physician groups, researchers, patient advocates, technology groups, insurers, and policymakers. The group will develop recommendations for priorities and policies for health systems, insurers, and policymakers, to guide evidence-based practices for providing high-quality telehealth services.
Remote patient monitoring with patient-generated health data (PGHD) is an important complement to telehealth. In addition to telehealth research, AHRQ is interested in research exploring the efficacy and safety of digital healthcare innovations that utilize virtually gathered PGHD. Today, more providers seek to incorporate these types of data, including but not limited to remote monitoring and surveillance data, and patient reported outcomes (PROs) to further inform care decisions. For example, Dr. David Odell is examining the ability to remotely collect, and review signs and symptoms of lung cancer recurrence using PROs and results of surveillance imaging, coupled with telehealth visits, to improve surveillance guidelines adherence and reduce barriers and disparities in care.
See the next section for additional information regarding AHRQ interest in PGHD.
Highlights
- Telehealth Post-Pandemic: A Roadmap for the Coming Decade Project Profile
- Development and Implementation of the REmote Telehealth User-Reported caNcer Surveillance (RETURNS) Program for Lung Cancer Project Profile
Patient-generated health data (PGHD) are “health-related data created, recorded, or gathered by or for patients (or family members or other caregivers) to help address a health concern.” PGHD such as patient-reported outcomes (PROs), health-relevant behaviors, anthropometrics, and physiological measures can be collected through a variety of tools including patient portals, mobile applications (apps), and devices.
The potential for PGHD to impact healthcare delivery is significant. Ambulatory care clinicians base their decisions on information received from the patient, traditionally from data collected in the clinical setting. PGHD offers insights into the day-to-day health of an individual, providing patients and clinicians the ability to employ better strategies to improve wellness, monitor for sickness, and prevent and manage acute and chronic conditions. In addition, clinicians and scientists can use these data to generate and apply analytical techniques to improve risk prediction and diagnoses.
AHRQ developed a PGHD guide to support ambulatory care practices in 1) identifying patient cohorts who can best benefit from PGHD capture, 2) accelerating adoption of health information technology solutions to support patient transfer of data, and 3) optimizing data review by mining large quantities of PGHD to identify patterns and red flags for clinical workflows and care planning.
Furthermore, AHRQ is interested in research that explores how to effectively capture and visualize PGHD. For example, UCSF researchers studied whether pain intensity data collected from patients after dental procedures can help dental providers track patients’ pain more effectively in real time and modify prescription use. These researchers adapted and customized the user interface of an existing mobile health platform and sent text messages to patients at pre-defined time intervals asking patients to report pain intensity and pain experience. Also, Dr. Jane Jih is developing, testing, and evaluating a mobile app that will integrate PRO data into the clinical workflow. Providers can review and reflect on the PRO data during clinic visits using a provider-facing dashboard within the EHR.
Highlights
- Integrating Patient-Generated Digital Health Data into Electronic Health Records in Ambulatory Care Settings Project Profile
- Optimizing Acute Post-Operative Dental Pain Management Using New Health Information Technology Project Profile
- Improving the Management of Multiple Chronic Conditions with mPROVE Project Profile
Clinical decision support (CDS) helps bring the latest evidence about what works in health care to clinicians, other care team members, and even patients, so they can act more readily on this information. We know that CDS, when inappropriately implemented for clinicians, can lead to alert fatigue, high override rates, and physician frustration. When effectively implemented, CDS provides the right information to the right audiences in the right ways and at the right times. AHRQ has a long history of investing in research to make CDS more effective and usable. In 2016, AHRQ embarked on an ambitious multi-component program to advance patient-centered CDS and to make CDS a more effective tool: to help advance research evidence into clinical practice and to help make the right thing to do, the easy thing to do.
CDS research funded under this program aims to investigate methods to broadly disseminate Patient-Centered Outcomes Research (PCOR) findings into practice through shareable, interoperable CDS. Research in this area is therefore focused on innovative projects that study how to best leverage reusable, interoperable CDS resources as a means of making CDS development and implementation more efficient and thereby making it easier to advance evidence into practice. For example, Dr. Patricia Dykes and her team developed a sharable, interoperable CDS tool for fall prevention to support primary care practices in both rural and urban areas. Additionally, Drs. Alex Spyropoulos and Thomas McGinn developed a CDS platform for detecting and treating venous thromboembolism that can be implemented by healthcare systems using different types of electronic health records (EHRs).
In 2021, in partnership with NORC, AHRQ launched the CDS Innovation Collaborative (CDSiC) to engage patients, clinicians, health system leaders, and many others to advance patient-centered CDS (PC CDS). The CDSiC has been busy developing measurement frameworks, prototyping dashboards, exploring trustworthiness of CDS, and conducting pilot projects through a variety of use cases and settings. By the end of September 2024, the CDSiC will have developed a collection of over 25 resources to help shape the field of PC CDS.
Highlights
- List of PCOR CDS resources and projects: https://cds.ahrq.gov/about
- Shareable, Interoperable Clinical Decision Support for Older Adults: Advancing Fall Assessment and Prevention Patient-Centered Outcomes Research Findings into Diverse Primary Care Practices (ASPIRE) Project Profile
- Implementation of a Novel Multi-Platform Evidence-Based Clinical Decision Support System Project Profile
- Patient-Centered Outcomes Research Clinical Decision Support (PCOR CDS) website
- CDS Innovation Collaborative website
Research is needed in two key areas: how digital healthcare systems can improve patient safety and how digital healthcare systems themselves can be safely used and implemented. AHRQ-funded research provides critical evidence in both areas.
For example, Dr. Jason Adelman evaluated the effectiveness of displaying patient photos in EHR systems when using computerized provider order entry systems. His research found that patient photos displayed in standard features in the EHR significantly reduced wrong-patient errors. He has also conducted research to develop and validate new medication safety measures needed for automatically identifying violations of the “Five Rights of Medication Safety”: right patient, right dose, right medication, right route, and right frequency. Each of the new measures achieved high positive predictive values and can be readily integrated into EHRs to study the epidemiology of order errors and to test the effectiveness of proposed EHR improvements on order error outcomes.
Health systems need such practical research evidence to guide policy decisions when implementing digital healthcare systems, especially when those policy decisions can impact efficiency and patient safety. The Digital Healthcare Research program maintains a special emphasis notice reaffirming the intent to support research regarding the safety of digital healthcare systems. DHR also worked with AHRQ’s patient safety team to jointly publish a notice of funding opportunity (NOFO) for examining the impact of Artificial Intelligence (AI) on Healthcare Safety.
Highlights
- Providing Evidence and Developing a Toolkit to Accelerate the Adoption of Patient Photographs in Electronic Health Records Project Profile
- Develop and Validate Health IT Safety Measures To Capture Violations of the Five Rights of Medication Safety Project Profile
- Digital Healthcare Safety Special Emphasis Notice
- AI on Healthcare Safety NOFO
The Program's Past Achievements
Since 1968, AHRQ has invested in research grants and contracts awarded to over 289 distinct institutions in 48 States, the District of Columbia and Puerto Rico, producing foundational work on many uses of IT to improve health delivery including telemedicine, health information exchange, and e-prescribing.
Select examples of some of the many contributions of AHRQ’s health IT work follow.
Telehealthcare can extend patient care by enabling clinicians to engage with patients or with other teams of clinicians remotely when they cannot meet in person. Project ECHO developed and evaluated a tele-consultation platform to provide clinical support to rural primary care physicians to help them to care for complex patients. Through Project ECHO, rural physicians were able to care for patients with Hepatitis C, achieving outcomes equal or exceeding patients cared for at an academic medical center. The model has been expanded to provide specialty consultation to primary care teams caring for people with asthma, heart failure, chronic pain, mental health conditions, and complications of pregnancy. The VA is now implementing Project ECHO across the country to improve access to quality care.
Highlights
- Project ECHO Extension for Community Healthcare Outcomes Project Profile
- Project ECHO Hepatitis C Ambulatory Care Quality Improvement in New Mexico through Health IT Project Profile
Health information exchange (HIE) allows doctors, nurses, pharmacists, other health care providers, and patients to access and share a patient’s medical information electronically across organizations and systems, for example between the emergency department and physician’s offices. This interoperable health information exchange can enable better coordination of care and increased safety. AHRQ funded the first large-scale demonstrations of HIE in the United States. The projects developed best-practices regarding all aspects of HIE including establishing health information organization, technical considerations for implementation, and demonstrating value. These projects laid the foundation for national health information exchange efforts and informed the ONC State HIE grant program. There are currently active HIEs in many states, and the success of these HIEs is due to the lessons learned from AHRQ’s investments.
Highlights
- State and Regional Demonstration (SRD) Projects Overview
- Colorado SRD Project Profile
- Delaware SRD Project Profile
- Indiana SRD Project Profile
- Rhode Island SRD Project Profile
- Tennessee SRD Project Profile
- Utah SRD Project Profile
E-prescribing allows clinicians, pharmacies, and health plans to communicate prescription information electronically, which can make coordinated care safer and more efficient. AHRQ funded the evaluation of a statewide program that implemented an e-prescribing system that indicated whether medications were covered by insurance and found it to be cost saving. Another project developed an electronic system to create and securely transmit prescriptions for controlled substances. This research was used by DHHS and the Drug Enforcement Agency (DEA) to issue national e-prescribing standards for controlled substances, resulting in over one billion electronic prescriptions in 2014 and allowing e-prescribing of controlled substances in 49 States.
Highlights
- Electronic Prescribing Using A Community Utility: The ePrescribing Gateway Project Profile
- Enabling Electronic Prescribing and Enhanced Management of Controlled Medications Project Profile
Clinical decision support (CDS) brings together patient-specific information with different treatment options in a way that allows clinicians and patients to choose the most appropriate care. AHRQ-funded demonstration projects created processes and tools for translating clinical knowledge and narrative guidelines into formats that can be used by multiple EHR systems for implementing CDS across a range of health care settings. One team implemented evidence-based guideline recommendations that address coronary artery disease, diabetes, and hypertension management; while another focused-on prevention of pediatric obesity and chronic management of asthma for children. The tools, standards, and technology created by these demonstrations are being used by ONC and have become the basis for health IT standards established by ONC to make it easier to share CDS between systems.
Highlights
- Clinical Decision Support Consortium Project Profile
- Guidelines Into Decision Support (GLIDES) Project Profile
AHRQ’s previous work in this area helped individual patients and their doctors find answers to questions by pioneering innovative ways to gather and analyze multiple sources of health care data for evidence about what works. The Inflammatory Bowel Disease Registry (ImproveCareNow), as part of the AHRQ-supported Enhanced Registries grant program, improved health outcomes in children with inflammatory bowel disease. The remission rate of children in the registry improved from 55 percent in 2007 to 79 percent in 2015, enabling thousands of children to attend school more regularly, actively engage in sports, and overall improve their health and well-being. Use of these data also enabled 49 percent of these children to sustain remission for at least 1 year and 94 percent have achieved satisfactory growth. Another example, the AHRQ-supported Surgical Care and Outcomes Assessment Program (SCOAP)/CERTAIN project produced a safety and quality checklist for the operating room, which is being implemented in all hospitals in Washington State. The sharing of surgical checklists, and clinical data about procedures and outcomes, among Washington hospitals involved in SCOAP has resulted in reduced complication rates, shorter stays, and fewer 30-day rehospitalizations.
Distributed research allows information to be shared across organizations without sharing data, which improves our understanding of barriers to care delivery and ability to test solutions that improve quality of care. AHRQ pioneered a distributed research network in primary care through the DARTNet project funded in 2006. DARTNet demonstrated the feasibility of using routine clinical data collected in EHRs in diverse primary care sites for comparative effectiveness research in diabetes and depression. Although the United States Preventive Services Task Force (USPSTF) has recommended screening for depression in primary care for many years, few practices have implemented this recommendation. DARTNet customized screening for depression to workflow of each practice site. The customization enabled a majority of DARTNet practices to continue with depression screening even after the end of AHRQ support for that project. AHRQ’s initial investment to create the DARTNet network met a critical need and led to its rapid growth independent of AHRQ. DARTNet has grown into a non-profit institute that now supports 12 research networks that offer access to approximately 12.5 million patient visits per year, five million patient lives, and five billion data points. These networks blend quality improvement, effectiveness, and translational research with a data driven-learning system. It is important to note that several networks focus on under-served patients including SAFTINet, Appalachian Research Network, and LA Net.
Highlights
- Comparative Effectiveness Study on Major Depression Overview
- DARTNet Summary Report
- Integrating Patient-Reported Outcomes and Electronic Health Record Data to Improve Clinical Decision Support for Depression Treatment Project Profile
The Electronic Data Methods (EDM) Forum supported a learning network of researchers, clinicians, informatics experts and other stakeholders. It developed open-access resources (e.g., journal, issue briefs, webinars, toolkits, websites) to share innovations and lessons learned, and to advance methods by supporting small-scale, rapid turnaround collaborative methods projects. The EDM Forum has also created several resources to improve governance of data and information for research and quality improvement, including a governance toolkit. Among the achievements: eGEMs is now in PubMed Central and has over 58,000 downloads and over 100 papers; the patient-centered portable consent project led to an e-consent module, which is present in all five applications of Apple’s ResearchKit.
Current AHRQ work builds on this extensive body of evidence to support projects that develop, evaluate, and scale digital healthcare systems interventions that facilitate practice improvement and better patient outcomes.
Highlights
- EDM Overview
- AcademyHealth EDM Forum for Comparative Effectiveness Research Project Profile
- AcademyHealth EDM Forum Second Phase Project Profile
- eGEMS website
- ResearchKit website