November 18, 2026
Health news, explained with evidence
LIVE
Preventive Services Task Force Resumes Meetings Under New Leadership Blood-Based Genetic Signature May Predict CAR T-Cell Therapy Success in Lymphoma Ultraprocessed Diets May Impact Brain Reward Systems in Younger Adults Addressing Body Image and the Reality of Gluteal Anatomy Migraine and Smoking Linked to Increased Early Stroke Risk in Women CBD Oil Found Ineffective for Managing Behavioral Issues in Youths with Intellectual Disabilities Expert Advice on Hydration Gear Sparks Debate Among Recreational Runners A Structured Approach to Beginning a Strength and Cardio Routine The Role of Daily Mobility Training in Managing Sedentary Tension New Theoretical Framework Explores Memory Formation and Dementia Preventive Services Task Force Resumes Meetings Under New Leadership Blood-Based Genetic Signature May Predict CAR T-Cell Therapy Success in Lymphoma Ultraprocessed Diets May Impact Brain Reward Systems in Younger Adults Addressing Body Image and the Reality of Gluteal Anatomy Migraine and Smoking Linked to Increased Early Stroke Risk in Women CBD Oil Found Ineffective for Managing Behavioral Issues in Youths with Intellectual Disabilities Expert Advice on Hydration Gear Sparks Debate Among Recreational Runners A Structured Approach to Beginning a Strength and Cardio Routine The Role of Daily Mobility Training in Managing Sedentary Tension New Theoretical Framework Explores Memory Formation and Dementia

Study Evaluates AI Chatbots on Parkinson's Disease Levodopa Therapy

🏃 Fitness 2 min read 👁 3

A recent cross-sectional analysis assessed five major artificial intelligence chatbots on their ability to provide public patient education regarding levodopa therapy for Parkinson's disease, highlighting significant variations in accuracy, safety, and readability.

Study Evaluates AI Chatbots on Parkinson's Disease Levodopa Therapy🏃Fitness

Photo: Nature Health Sciences

Key points

  • Five major AI chatbots were evaluated on levodopa therapy education for Parkinson's disease.
  • Copilot and DeepSeek achieved the highest median accuracy scores among the tested models.
  • Safety gaps, inconsistent information quality, and challenging readability remain key limitations.

As individuals increasingly turn to artificial intelligence for medical inquiries, a new study published in Nature Health Sciences evaluated how well five prominent large language model chatbots—ChatGPT, Gemini, Copilot, DeepSeek, and Doubao—answer questions about levodopa therapy for Parkinson's disease. Five blinded raters assessed 265 responses using standardized benchmarks including DISCERN, EQIP, the JAMA criteria, and the Global Quality Score, alongside six readability indices. An additional independent trial of 265 responses tested the stability of the output over repeat generations.

The evaluation found that safe-response rates across the tested models spanned from 86.8% to 94.3%, with high stability observed in repeat-generation testing at 97.0% exact safety agreement. However, performance varied notably across other metrics. Copilot and DeepSeek demonstrated the highest median accuracy scores, while Doubao achieved the highest scores on the DISCERN and EQIP information quality assessments. Conversely, ChatGPT recorded the lowest information-quality scores, and Gemini offered the most favorable readability profile, whereas Doubao presented the poorest readability.

What to know: While current language models generally generate informative responses regarding Parkinson's disease medication, the study emphasizes that notable safety gaps, variable information quality, and poor text readability persist. Experts caution that these findings reflect expert-rated output quality rather than proven patient education effectiveness, meaning patient-centered validation is still necessary. Readers should consult a qualified healthcare professional before making any personal medical decisions regarding medication regimens.

Source Nature Health Sciences — nature.com/articles/s41598-026-74929-y ↗

Contact the newsroom

Got a tip, a proposal or a partnership question? Write to us and we will reply shortly.