We study the occurrence of number rigidity and deletion singularity in a class of point processes that we call {\it projected perturbed lattices}. These are generalizations of processes of the form $Π=\{\|z\|^α+g_z\}_{z\in\mathbb{Z}^d}$ where $(g_z)_{z\in\mathbb{Z}^d}$ are jointly Gaussian, $α>0$, $d\in\mathbb{N}$, and $\|\cdot\|$ is a norm. We develop a new technique to prove sufficient conditions for the deletion singularity of $Π$, which improves significantly on the conditions one can obtain using the standard rigidity toolkit (e.g., the variance of linear statistics). In particular, we obtain the first lower bounds on $α$ for the deletion singularity of $Π$ that are independent of the dimension $d$ and the correlation of the $g_z$'s.