RECRUITING

Physician Response Evaluation With Contextual Insights vs. Standard Engines - Artificial Intelligence RAG vs LLM Clinical Decision Support

Description

Clinical decision support tools powered by artificial intelligence are being rapidly integrated into medical practice. Two leading systems currently available to clinicians are OpenEvidence, which uses retrieval-augmented generation to access medical literature, and GPT-4, a large language model. While both tools show promise, their relative effectiveness in supporting clinical decision-making has not been directly compared. This study aims to evaluate how these tools influence diagnostic reasoning and management decisions among internal medicine physicians.

Study Overview

Study Details

Study overview

Clinical decision support tools powered by artificial intelligence are being rapidly integrated into medical practice. Two leading systems currently available to clinicians are OpenEvidence, which uses retrieval-augmented generation to access medical literature, and GPT-4, a large language model. While both tools show promise, their relative effectiveness in supporting clinical decision-making has not been directly compared. This study aims to evaluate how these tools influence diagnostic reasoning and management decisions among internal medicine physicians.

Comparing Clinical Key AI and GPT-4 for Diagnostic Reasoning and Management Decisions

Physician Response Evaluation With Contextual Insights vs. Standard Engines - Artificial Intelligence RAG vs LLM Clinical Decision Support

Condition
Large Language Models
Intervention / Treatment

-

Contacts and Locations

Bronx

MontefioreMC, Bronx, New York, United States, 10467

Participation Criteria

Researchers look for people who fit a certain description, called eligibility criteria. Some examples of these criteria are a person's general health condition or prior treatments.

For general information about clinical research, read Learn About Studies.

Eligibility Criteria

  • * Internal medicine residents
  • * Internal medicine attending physicians
  • * Not meeting Inclusion Criteria

Ages Eligible for Study

25 Years to

Sexes Eligible for Study

ALL

Accepts Healthy Volunteers

Yes

Collaborators and Investigators

Montefiore Medical Center,

Shitij Arora, MD, PRINCIPAL_INVESTIGATOR, Montefiore Medical Center

Study Record Dates

2025-09