Abstract:Sequential recommendation adopted the Transformer almost as soon as it appeared: SASRec ported the decoder to next-item prediction in 2018, a year after Attention is All You Need, and the paradigm has borrowed from language modeling ever since. The two tasks look nearly identical, both consume integer-ID sequences with causal self-attention, yet they pursue opposite ends. A recommender works to bring more users into contact with more items, an entropy-increasing goal; a language model works to converge many phrasings of a question onto one answer, an entropy-decreasing one. We argue this difference, not engineering effort, is why recommendation has not reproduced the clean scaling that language models enjoy: behavioral data is locally regular yet globally heterogeneous, a casino, whereas language is locally diverse yet globally convergent, a library. Taking SASRec as an entry point, we revisit the self-attentive paradigm as a comparative study of the two domains and ask which of its inherited assumptions, implicit-only personalization, absolute positional semantics, leakage-prone single-step evaluation, and atomic tokenization, are incidental rather than intrinsic to recommendation. Our BlueSky claim is that, beyond borrowing from language models, the next findings will come from a careful comparison of the two domains that starts from the entropy structure of behavioral data. We propose no new model; we expose the gaps, outline the data- and systems-level agenda they imply, and argue that the comparison can ultimately help both domains.
From: Zan Huang [view email]
[v1]
Sun, 13 Apr 2025 14:30:57 UTC (17 KB)
[v2]
Tue, 15 Sep 2026 15:58:38 UTC (33 KB)
此内容由惯性聚合(RSS阅读器)自动聚合整理，仅供阅读参考。 原文来自 — 版权归原作者所有。