An AI Educational Agent for Medical Machine Learning Courses
Application and Effectiveness of a Large Language Model-Based Educational Agent in Medical Education: A Study on the Machine Learning and Data Mining Course
Sun Yat-sen University
56 participants
May 1, 2025
INTERVENTIONAL
Conditions
Summary
The goal of this interventional study is to evaluate the effectiveness of a Large Language Model (LLM)-based educational AI Agent in graduate students (Masters and PhD) specializing in medicine or nursing who are enrolled in the "Machine Learning and Data Mining" course. The main questions it aims to answer are: Does the use of an educational AI Agent improve students' academic performance and practical skills in machine learning compared to traditional methods? Does the AI intervention enhance students' learning confidence, satisfaction, and cognitive engagement? Researchers will compare students currently using the AI Agent (experimental group) to a historical control group (students from the previous cohort who did not use the AI tool) to see if the AI-assisted learning model leads to significantly higher learning achievements and better educational experiences. Participants will: Utilize the Teaching Agent for real-time answers to theoretical questions, personalized study planning, and knowledge reinforcement. Engage with the Research Agent to assist with literature reviews, research design optimization, and academic writing structure. Use the Practice Innovation Agent for guidance on coding, algorithm debugging, and applying machine learning models to medical data analysis projects.
Eligibility
Inclusion Criteria4
- Medical graduate students from universities in the Guangdong-Hong Kong-Macao Greater Bay Area;
- Graduate students who have taken the "Machine Learning and Data Mining" course;
- Have completed the required prerequisite courses: "Medical Statistics" and "Nursing Research";
- Capable of operating the AI Educational Agent system normally and willing to undergo relevant teaching interventions and assessments during the study period.
Exclusion Criteria3
- Unwilling to use the AI education agent system, or refusing to allow the research team to collect their relevant data;
- Students who cannot commit to the full duration of the course or have known scheduling conflicts that would prevent regular attendance;
- Students who have previously enrolled in or audited this course in prior academic years to avoid learning effect bias
Interested in this trial?
Get notified about updates and connect with the research team.
Interventions
The intervention involves a custom-developed AI educational system powered by Large Language Models (LLMs) and Knowledge Graph-based Retrieval-Augmented Generation (KGRAG) technology. The system comprises three specialized agents to support self-directed learning: 1. Teaching Agent: Provides real-time concept explanations, personalized study plans, and knowledge reinforcement based on the course curriculum. 2. Research Agent: Assists with literature review, research question refinement, and academic writing structure. 3. Practice Innovation Agent: Guides students through code generation, algorithm debugging, and data mining projects using Socratic tutoring methods to foster problem-solving skills. Participants have 24/7 access to this system throughout the semester.
Locations(1)
View Full Details on ClinicalTrials.gov
For the most up-to-date information, visit the official listing.
NCT07449182