Reasoning Enrichment With Feedback From IA in NEphrology Trial
Reasoning Enhancement With Feedback From a Generative AI in Nephrology (REFINe): A Randomized Evaluation of Generative AI Support in Nephrology Diagnosis
University Hospital, Lille
100 participants
Nov 20, 2025
INTERVENTIONAL
Conditions
Summary
The goal of this clinical trial is to learn how artificial intelligence (AI) may help doctors make diagnoses in kidney medicine. The researchers want to know whether an AI tool called a large language model (LLM) can help doctors choose the correct diagnosis more often and feel more confident in their answers. Before starting the study, the research team tested several AI models and chose one of the best performers, a GPT-5-class model set to use high reasoning effort. The main questions this study aims to answer are: 1. Do doctors make more correct diagnoses when they can see AI suggestions? 2. Does seeing AI suggestions change how confident doctors feel about their diagnosis? Researchers will compare doctors who receive AI suggestions with doctors who do not receive AI suggestions to see how the AI affects accuracy, confidence, and decision-making. Participants will complete up to 10 online clinical cases. For each case, they will: 1. Read a short medical scenario 2. Suggest up to three possible diagnoses (If in the AI group) Review the AI's suggestions and decide whether to change their answer The study will also look at how long participants take to answer each case and how the AI's performance compares to the human answers.
Eligibility
Inclusion Criteria5
- Adults aged 18 years or older.
- Able to read and answer clinical vignettes in English or French.
- Access to a computer or smartphone with an internet connection.
- Provides informed consent online.
- Participants are expected to have at least basic medical training (e.g., medical students, residents, fellows, or practicing clinicians), although no formal verification is required.
Exclusion Criteria3
- Individuals under 18 years of age.
- Inability to complete online study procedures.
- Prior involvement in the design, development, or evaluation of the AI system used in this study.
Interested in this trial?
Get notified about updates and connect with the research team.
Interventions
This intervention consists of displaying an AI-generated diagnostic suggestion during the clinical case-solving task. After reading each vignette, participants see the top diagnostic proposal produced by a large language model (GPT-5, high-reasoning configuration), selected after internal benchmarking. The AI suggestion appears once per vignette and cannot be requested again or modified. Participants may revise their diagnostic answer after viewing the suggestion, but they cannot return to the vignette later. No additional guidance, coaching, or interactive features are provided.
Locations(1)
View Full Details on ClinicalTrials.gov
For the most up-to-date information, visit the official listing.
NCT07352475