We consider a class of semi-linear differential Volterra equations with polynomial-type potentials that incorporates the effects of memory while being subjected to random perturbations via an additive Gaussian noise. Our main study is the long time statistics of the system in the singular regime as the memory kernel collapses to a Dirac function. Specifically, we show that provided that sufficiently many directions in the phase space are stochastically forced, there is a unique invariant probability measure to which the system converges, with respect to a suitable Wasserstein-type topology, and at an exponential rate which is independent of the decay rate of the memory kernel. We then prove the convergence of this unique statistically steady state to the unique invariant probability measure of the classical stochastic reaction-diffusion equation in the zero-memory limit. Consequently, we establish the global-in-time validity of the short memory approximation.