


























中医药知识体系独特且结构复杂,传统大语言模型在微调后常面临对齐性、数据质量和评估一致性不足的问题。研究首次使用组相对策略优化(GRPO)训练中医药专用大模型Ladder-base,该强化学习方法通过组内比较优化响应选择,提升模型推理与事实一致性。Ladder-base基于Qwen2.5-7B-Instruct构建,仅使用TCM-Ladder基准的文本子集,80%数据用于训练,剩余20%均分验证与测试集。
标准化评估显示,Ladder-base在多项推理指标上表现优于GPT-4、Gemini 2.5、Claude 3、Qwen3等通用大模型,以及BenTsao、HuatuoGPT2、Zhongjing等中医药专用模型。结果表明,GRPO是使大语言模型对齐传统医学领域专家推理水平的有效策略,可支撑可信且符合临床实际的中医药人工智能系统开发。
Traditional Chinese Medicine (TCM) presents a rich and structurally unique knowledge system that challenges conventional applications of large language models (LLMs). Although previous TCM-specific LLMs have shown progress through supervised fine-tuning, they often face limitations in alignment, data quality, and evaluation consistency. In this study, we introduce Ladder-base, the first TCM-focused LLM trained with Group Relative Policy Optimization (GRPO), a reinforcement learning method that improves reasoning and factual consistency by optimizing response selection based on intra-group comparisons. Ladder-base is built upon the Qwen2.5-7B-Instruct foundation model and trained exclusively on the textual subset of the TCM-Ladder benchmark, using 80 percent of the data for training and the remaining 20 percent split evenly between validation and test sets. Through standardized evaluation, Ladder-base demonstrates superior performance across multiple reasoning metrics when compared to both state-of-the-art general-purpose LLMs such as GPT-4, Gemini 2.5, Claude 3, and Qwen3 and domain-specific TCM models including BenTsao, HuatuoGPT2, and Zhongjing. These findings suggest that GRPO provides an effective and efficient strategy for aligning LLMs with expert-level reasoning in traditional medical domains and supports the development of trustworthy and clinically grounded TCM artificial intelligence systems.
此内容由惯性聚合(RSS阅读器)自动聚合整理,仅供阅读参考。 原文来自 — 版权归原作者所有。