Abstract:Restricted Boltzmann machines (RBMs) are energy-based models originating from statistical physics, in which hidden units mediate the probability distribution of high-dimensional visible configurations. In this study, we use symbolic music as a structured non-physical dataset and investigate how musical regularities are encoded in the hidden layer of a Bernoulli-Bernoulli RBM. Musical scores by J.~S.~Bach are converted into binary piano-roll representations and used to train the model in an unsupervised manner. We then analyze the visible-layer patterns induced by individual hidden units by activating hidden units separately and computing the corresponding expected visible configurations. The trained RBM reconstructs piano-roll-like inputs and assigns lower energies to piano-roll configurations than to most non-musical binary images, indicating that the learned energy function captures statistical features of the piano-roll dataset. The hidden units mainly encode local temporal and pitch-statistical structures, such as sparse piano-roll-like textures, rather than directly separable musical concepts such as melodies, chords, or keys. We also analyze hidden-layer representations using t-SNE and find that transposed versions of the same musical pieces are not necessarily mapped to nearby regions in the hidden space. This behavior indicates that the trained RBM does not robustly capture transposition equivalence, which is naturally explained by the lack of translational invariance in standard RBM architectures. Samples from the trained RBM show local pitch organization, whereas iterative continuation reveals limited long-range coherence. These results provide a statistical-physics case study of how a simple spin model represents structured creative data and clarify both the usefulness and limitations of standard RBMs as interpretable models of musical structure.
From: Hiroshi Watanabe [view email]
[v1]
Fri, 5 Sep 2025 08:18:14 UTC (3,797 KB)
[v2]
Mon, 8 Sep 2025 07:31:38 UTC (368 KB)
[v3]
Thu, 27 Nov 2025 09:02:59 UTC (1,076 KB)
[v4]
Mon, 17 Aug 2026 08:30:25 UTC (1,226 KB)
此内容由惯性聚合(RSS阅读器)自动聚合整理，仅供阅读参考。 原文来自 — 版权归原作者所有。