Abstract:Though neural networks trained on large datasets have been successfully used to describe and predict many physical phenomena, there is a sense among scientists that, unlike traditional scientific models comprising simple mathematical expressions, their findings cannot be integrated into the body of scientific knowledge. Critics of machine learning's inability to produce human-understandable relationships have converged on the concept of "interpretability" as its point of departure from more traditional forms of science. As the growing interest in interpretability has shown, researchers in the physical sciences seek not just predictive models, but also to uncover the fundamental principles that govern a system of interest. However, clarity around a definition of interpretability and the precise role that it plays in science is lacking in the literature. In this work, we argue that researchers in equation discovery and symbolic regression tend to conflate the concept of sparsity with interpretability. We review key papers on interpretable machine learning from outside the scientific community and argue that, though the definitions and methods they propose can inform questions of interpretability for scientific machine learning (SciML), they are inadequate for this new purpose. Noting these deficiencies, we propose an operational definition of interpretability for the physical sciences. Our notion of interpretability emphasizes understanding of the mechanism over mathematical sparsity. Innocuous though it may seem, this emphasis on mechanism shows that sparsity is often unnecessary. It also questions the possibility of interpretable scientific discovery when prior knowledge is lacking. We believe a precise and philosophically informed definition of interpretability in SciML will help focus research efforts toward the most significant obstacles to realizing a data-driven scientific future.
| Subjects: | Machine Learning (cs.LG); Data Analysis, Statistics and Probability (physics.data-an); History and Philosophy of Physics (physics.hist-ph); Physics and Society (physics.soc-ph) |
| Cite as: | arXiv:2505.13510 [cs.LG] |
| (or arXiv:2505.13510v3 [cs.LG] for this version) | |
| https://doi.org/10.48550/arXiv.2505.13510 arXiv-issued DOI via DataCite |
From: Conor Rowan [view email]
[v1]
Fri, 16 May 2025 20:16:14 UTC (328 KB)
[v2]
Wed, 28 May 2025 18:55:13 UTC (324 KB)
[v3]
Wed, 22 Apr 2026 00:35:04 UTC (324 KB)
此内容由惯性聚合(RSS阅读器)自动聚合整理，仅供阅读参考。 原文来自 — 版权归原作者所有。