
























Abstract:Federated learning (FL) under data heterogeneity remains challenging: existing methods either ignore client differences (FedAvg), require costly cluster discovery (IFCA), or maintain per-client models (Ditto). All degrade when data is sparse or heterogeneity is multi-dimensional. We propose conditioning a single global model on locally-computed PCA statistics of each client's training data, requiring zero additional communication. Evaluating across 97~configurations spanning four heterogeneity types (label shift, covariate shift, concept shift, and combined heterogeneity), four datasets (MNIST, Fashion-MNIST, CIFAR-10, CIFAR-100), and seven FL baseline methods, we find that our method matches the Oracle baseline -- which knows true cluster assignments -- across all settings, surpasses it by 1--6% on combined heterogeneity where continuous statistics are richer than discrete cluster identifiers, and is uniquely sparsity-robust among all tested methods.
| Comments: | 9 pages main + 16 pages appendix, 19 figures, 22 tables. Extended version of FLICS 2026 paper, with full experimental tables and figures provided as appendices |
| Subjects: | Machine Learning (cs.LG) |
| MSC classes: | 68T05, 68W15 |
| ACM classes: | I.2.6; I.2.11 |
| Cite as: | arXiv:2603.11307 [cs.LG] |
| (or arXiv:2603.11307v2 [cs.LG] for this version) | |
| https://doi.org/10.48550/arXiv.2603.11307 arXiv-issued DOI via DataCite |
From: Rickard Brännvall [view email]
[v1]
Wed, 11 Mar 2026 21:06:12 UTC (146 KB)
[v2]
Tue, 5 May 2026 14:27:31 UTC (482 KB)
此内容由惯性聚合(RSS阅读器)自动聚合整理,仅供阅读参考。 原文来自 — 版权归原作者所有。