RecruitingNot ApplicableNCT07037940

Physician Response Evaluation With Contextual Insights vs. Standard Engines - Artificial Intelligence RAG vs LLM Clinical Decision Support

Comparing Clinical Key AI and GPT-4 for Diagnostic Reasoning and Management Decisions


Sponsor

Montefiore Medical Center

Enrollment

26 participants

Start Date

Jul 3, 2025

Study Type

INTERVENTIONAL

Conditions

Summary

Clinical decision support tools powered by artificial intelligence are being rapidly integrated into medical practice. Two leading systems currently available to clinicians are OpenEvidence, which uses retrieval-augmented generation to access medical literature, and GPT-4, a large language model. While both tools show promise, their relative effectiveness in supporting clinical decision-making has not been directly compared. This study aims to evaluate how these tools influence diagnostic reasoning and management decisions among internal medicine physicians.


Eligibility

Min Age: 25 Years

Inclusion Criteria2

  • Internal medicine residents
  • Internal medicine attending physicians

Interested in this trial?

Get notified about updates and connect with the research team.

Interventions

OTHEROpenEvidence

Medical information platform which uses retrieval-augmented generation to access medical literature

OTHERGPT-4

A chatbot application developed that uses GPT-4, a large language model, to engage in conversational interactions with users.


Locations(2)

Harvard Beth Israel Deaconess Medical Center

Boston, Massachusetts, United States

MontefioreMC

The Bronx, New York, United States

View Full Details on ClinicalTrials.gov

For the most up-to-date information, visit the official listing.

Visit

NCT07037940