November 18, 2026
Health news, explained with evidence
LIVE
Understanding and Addressing Love Handles Through Lifestyle Changes Ciele Releases New Woolmark-Certified Merino Winter Running Apparel Preventive Services Task Force Resumes Meetings Under New Leadership Blood-Based Genetic Signature May Predict CAR T-Cell Therapy Success in Lymphoma Ultraprocessed Diets May Impact Brain Reward Systems in Younger Adults Addressing Body Image and the Reality of Gluteal Anatomy Migraine and Smoking Linked to Increased Early Stroke Risk in Women CBD Oil Found Ineffective for Managing Behavioral Issues in Youths with Intellectual Disabilities Expert Advice on Hydration Gear Sparks Debate Among Recreational Runners A Structured Approach to Beginning a Strength and Cardio Routine Understanding and Addressing Love Handles Through Lifestyle Changes Ciele Releases New Woolmark-Certified Merino Winter Running Apparel Preventive Services Task Force Resumes Meetings Under New Leadership Blood-Based Genetic Signature May Predict CAR T-Cell Therapy Success in Lymphoma Ultraprocessed Diets May Impact Brain Reward Systems in Younger Adults Addressing Body Image and the Reality of Gluteal Anatomy Migraine and Smoking Linked to Increased Early Stroke Risk in Women CBD Oil Found Ineffective for Managing Behavioral Issues in Youths with Intellectual Disabilities Expert Advice on Hydration Gear Sparks Debate Among Recreational Runners A Structured Approach to Beginning a Strength and Cardio Routine

Data Leakage Inflates Accuracy in Alzheimer's MRI Deep Learning Benchmarks, Study Finds

🏥 Public Health 2 min read 👁 6

Researchers at the Karpagam Academy of Higher Education report that data leakage and image duplication in popular Alzheimer's disease MRI datasets falsely inflate deep learning diagnostic accuracy.

🏥Public Health

Key points

  • Patient-level data leakage found in 100% of test images under naive splitting for OASIS.
  • Removing data leakage caused OASIS mean test accuracy to collapse from 100.0% to about 46%.
  • Researchers released new leakage-free, patient- and duplicate-aware split manifests for both datasets.

A new analysis published in Nature Health Sciences reveals that artificial intelligence models trained on widely used Alzheimer's disease MRI datasets may rely on data memorization rather than true diagnostic capability. Researchers from the Department of Computer Science and Engineering at the Karpagam Academy of Higher Education in Coimbatore, India, evaluated two prominent Kaggle-hosted MRI collections: OASIS and the Kaggle-Augmented Alzheimer's Dataset (KAAD).

Flawed Splitting Methods Lead to Severe Overestimation

The investigation demonstrated that standard image-level random splitting fails to account for patient provenance, creating significant identity leakage between training and test sets. For the OASIS database, patient identifiers embedded in filenames showed that every single test image shared a patient with the training set across all 86,437 images. Meanwhile, exact-hash and perceptual-hash evaluations estimated that roughly one-fifth of KAAD images were near-duplicates.

When researchers removed this leakage, mean test accuracy plummeted from 100.0% down to approximately 46% for OASIS, and dropped from 68.0% down to a range of 58.9% to 62.8% for KAAD.

Furthermore, cross-dataset testing revealed that a classifier trained on OASIS performed entirely at a chance level of 25.0% when evaluated on KAAD, despite demonstrating perfect training accuracy. The authors noted that this study is a secondary, retrospective analysis of pre-existing, publicly available data and did not involve the collection of new human-subject data. What to know: while these findings suggest that much published accuracy reflects image memorization instead of a transferable diagnostic signal, readers should consult a qualified medical professional for any personal health decisions.

Source Nature Health Sciences — nature.com/articles/s41598-026-77108-1 ↗

Contact the newsroom

Got a tip, a proposal or a partnership question? Write to us and we will reply shortly.