Abstract:Improving LLM performance on downstream tasks sometimes requires leveraging auxiliary datasets during post-training. In practice, however, developers face constraints on compute, labeling, and licensing costs that preclude using all available data, necessitating principled dataset-level selection. These constraints are increasingly shaped by dataset marketplaces, where data acquisition is governed by budgets and negotiation. We study dataset valuation as a subset selection problem during LLM post-training. Our goal is to identify and weight auxiliary datasets so as to maximize target task performance given constrained budgets. We first show that commonly used gradient alignment scores provide a reasonable yet incomplete valuation signal, as they ignore redundancy among datasets. To address this, we propose a scalable convex dataset-level valuation method based on kernel mean matching (KMM) in gradient space, which jointly accounts for alignment with the target task and redundancy across auxiliary datasets. Through extensive experiments across diverse post-training settings and tasks, we show that our approach consistently outperforms existing valuation baselines, achieving stronger performance with low computational overhead. Our results position dataset valuation as a practical decision tool for post-training data selection in market-constrained large language model settings. The code is available at this https URL.
| Comments: | Published as a conference paper at ICML '26. 30 pages, 8 figures |
| Subjects: | Machine Learning (cs.LG) |
| Cite as: | arXiv:2605.16704 [cs.LG] |
| (or arXiv:2605.16704v1 [cs.LG] for this version) | |
| https://doi.org/10.48550/arXiv.2605.16704 arXiv-issued DOI via DataCite (pending registration) |
From: Siqi Zeng [view email]
[v1]
Fri, 15 May 2026 23:35:07 UTC (716 KB)
此内容由惯性聚合(RSS阅读器)自动聚合整理，仅供阅读参考。 原文来自 — 版权归原作者所有。