Abstract:The automated evaluation of cognitive status using multimedia technologies offers a promising avenue for early dementia detection. However, the development of robust machine learning models for cognitive impairment detection is frequently hindered by the scarcity of large-scale, strictly synchronized, and clinically validated multimodal datasets. To bridge this critical gap, we introduce CogPic, a comprehensive Mandarin multimodal benchmark designed for fine-grained cognitive-status assessment. CogPic comprises strictly synchronized acoustic, visual, and linguistic data collected from 574 participants across three standardized picture-description tasks. To establish reliable diagnostic reference labels, expert clinical neuropsychologists conducted comprehensive evaluations and stratified participants into Healthy Control (HC), Mild Cognitive Impairment (MCI), and Alzheimer's Disease (AD) groups through clinical consensus. Extensive benchmark experiments spanning handcrafted and deep learning models in unimodal and multimodal settings yield a best trimodal Macro-F1 of 58.34\%. To our knowledge, CogPic stands as the largest, most modality-rich, and most comprehensively characterized Mandarin dataset of its kind to date. Together, CogPic and its extensive baseline evaluations establish a rigorous empirical foundation for future multimedia research toward robust and clinically generalizable automated cognitive health assessment.
From: Rui Feng [view email]
[v1]
Thu, 2 Apr 2026 05:04:31 UTC (1,497 KB)
[v2]
Fri, 21 Aug 2026 05:19:55 UTC (1,391 KB)
此内容由惯性聚合(RSS阅读器)自动聚合整理，仅供阅读参考。 原文来自 — 版权归原作者所有。