Generative AI Impact on Rheumatoid Arthritis Complications Diagnosis

Condition(s) studied

Investigational drug(s) / intervention(s)

Generative AI prediction report for RA complications: Generative AI based on multiple large language models (LLMs) is used to predict potential complications and co-existing diseases in patients with rheumatoid arthritis using EHR data available at admission. Physicians use these AI predictions as additional information to adjust their diagnostic plans during differential diagnosis. The impact of this intervention on the final diagnoses at discharge will be measured. Before the prospective study, the adoptability of the generative AI prediction reports will be validated using EHR records from retrospective RA patients.

Study summary

Generative AI (GenAI) based on large language models (LLMs) is expected to improve the diagnosis and treatment of autoimmune diseases. We are studying how GenAI may affect the diagnosis of various complications of rheumatoid arthritis (RA). In a retrospective study using RA patients' EHR records, we will quantify physician adoption of GenAI predictions for RA complications and co-existing diseases. In a prospective observational study, we will assess the feasibility of using GenAI predictions as additional clinical information to help physicians make more complete diagnoses of RA complications and co-existing diseases, including complex, uncommon, or rare conditions.

Eligibility

Primary outcome measure(s)

• Will physicians adopt GenAI predictions in diagnosing RA complications? — Immediately after reviewing patient AI report on the day of admission.
  In the routine care workflow, large language models (LLMs) are used to predict potential RA complications for each de-identified patient case and generate an AI report listing possible complications and co-existing diseases. Additional diagnostic tests are suggested to verify the predicted conditions. After reviewing the AI report, physicians immediately evaluate each disease prediction using a 5-point Likert scale (1 = complete disagreement; 2 = disagreement; 3 = neutral; 4 = agreement; 5 = complete agreement). The mean score is calculated as a measure of perceived prediction accuracy. Physicians also indicate whether each specific disease prediction could potentially be adopted or used to assist differential diagnosis (binary: 0 or 1). The percentage of positive adoption responses is calculated as a measure of potential adoption rate, or adoptability.

Trial sites (1)

More Guang'anmen Hospital of China Academy of Chinese Medical Sciences trials in China

Other trials for the same condition