cRCT of AI Agent in Clinital Resoning Training

Condition(s) studied

Investigational drug(s) / intervention(s)

AI agent: AI agent tasks for clinical reasoning training

Study materials: Study materials including case information, questions, and answer keys

Study summary

Traditional medical education has long emphasized one-way transmission of theoretical knowledge, which presents limitations in the systematic cultivation of clinical reasoning skills among medical students. Miller's pyramid of clinical competence emphasizes the gradual transformation from theoretical knowledge to clinical practice ability. Case-based learning (CBL), as a teaching method centered on real or simulated clinical cases, is a key strategy to address the above limitations. Artificial intelligence (AI)-assisted clinical reasoning training tools can overcome time and space constraints, and offer students repeatable, adaptive, and real-time feedback case training, thereby reinforcing the sustained role of CBL in clinical reasoning development. Currently, it still lacks high-quality evidence from randomized controlled trials on the impact of AI agents on medical students' clinical reasoning skills.

This study plans to evaluate the impact of an AI clinical reasoning training agent on students' clinical reasoning training outcomes and CBL learning experience.

Primary Objective: To evaluate the impact of the AI agent on student learning outcomes (course examination scores and clinical reasoning test scores).

Secondary Objective: To investigate students' AI acceptance (perceived usefulness, perceived ease of use, satisfaction, and intention to use).

This study adopts a two-arm parallel cluster randomized controlled trial design. The trial is designed and reported in accordance with the CONSORT statement.

The study population will recruit Class of 2021 medical students (8-year program) from Peking Union Medical College and Class of 2020 medical students (8-year program) from Tsinghua University School of Medicine. Both cohorts are officially enrolled in the "Comprehensive Clinical Course" for the 2025-2026 academic year, have consistent foundational knowledge in basic medicine and diagnostics, and are in the phase of clinical medicine theory learning, not yet having entered clinical practice.

Using PASS 2025 software, the sample size per arm for the cRCT is 39, with number of clusters per arm K=N/M =13, Considering a 10% attrition or exclusion rate, the target recruitment is 88 participants.

Considering potential heterogeneity in baseline between students from the two schools, and possible contamination due to discussions among dormitory mates during the intervention, this study will adopt stratified cluster randomization, first stratifying by school, then using dormitory as the smallest randomization unit. Dormitories will be sorted by the random number, with the first half allocated to the intervention group and the second half to the control group. Participants' group assignment will be revealed via unique student ID only after baseline data collection and informed consent are completed.

This study will select five topics from the "Comprehensive Clinical Course": "Infectious Diarrhea," "Viral Hepatitis," "Bloodstream Infection," "Infective Endocarditis," and "Central Nervous System Infection". Standardized cases will be provided by the teaching faculty, with two cases per topic, totaling 10 cases. These cases will be used to train AI agent. After class, the AI agent training tasks will be sent to the intervention group, and study materials will be distributed to the control group.

Course examination scores and clinical reasoning test scores are the primary outcomes. AI technology acceptance including perceived usefulness, perceived ease of use, satisfaction, and intention to use are the secondary outcomes.

This study has been approved by the Research Ethics Committee of Peking Union Medical College Hospital (Approval No.: I-26PJ0851).

Eligibility

Primary outcome measure(s)

• Course examination scores — One week after the course
  The examination includes 8 of A1 multiple choice questions (MCQs), 8 of case summary MCQs, 2 of A3 case-cluster MCQs, 3 A4 case-series best-answer MCQs, and 1 of case analysis questions, with a total score of 25. All test questions are provided by the teaching faculty, covering core diseases from the five topics. The questions will reviewed by the same two senior clinical faculty members to ensure appropriate case selection and difficulty.
• Clinical reasoning test score — One month after the course
  The test is designed based on a case of infective endocarditis (IE) and is supposed to be accomplished in 30 min. There are five questions in total. Information and questions will be presented step by step, with a total score of 25.

Trial sites (1)

More Peking Union Medical College Hospital trials in China

Other trials for the same condition