This paper studies high-order partial differential equations with random initial conditions that have both long-memory and cyclic behavior. The cases of random initial conditions with the spectral singularities, both at zero (representing classical long-range dependence) and at non-zero frequencies (representing cyclic long-range dependence), are investigated. Using spectral methods and scaling techniques, it is proved that, after proper rescaling and normalization, the solutions converge to Gaussian random fields. For each type of equation, spectral representations and covariance functions of limit fields are given. For odd-order equations, we apply the kernel averaging of solutions to obtain nonexplosive and nondegenerate limits. It is shown that the different limit fields are determined by the even or odd orders of the equations and by the presence or absence of a spectral singularity at zero. Several numeric examples illustrate the obtained theoretical results.