We study the property of hitting points for a class of $\mathbb{R}^d$-valued continuous Gaussian random fields on $\mathbb{R}^N$ with stationary increments, i.i.d. coordinates, and a regularly varying variance function $σ$ of index $0<H<1$. We first prove that if \[ \lim_{r\to 0^+} \frac{r^N}{σ^d\left(r\left( \log\log\frac{1}{r}\right)^{-1/N}\right)} = \infty, \] then every fixed point is polar (i.e., not hit almost surely). In general, this criterion may not be optimal in the critical dimension $d=N/H$. To aim for an optimal condition, we consider the specific case $σ(r) = r^H (\log(1/r))^γ$ and prove that, in the critical dimension $d=N/H$, points are polar if and only if $γ\le 1/d$, or equivalently in this specific case, \[ \int_{0^+} \frac{r^{N-1}}{σ^d(r)} dr = \infty. \] This integral condition is also necessary for points to be polar under general assumptions. Our main contribution lies in the proof of sufficiency of this condition in the specific case, where we extend a covering argument of Talagrand (1998) based on sojourn time estimates to obtain Hausdorff measure bounds and solve polarity of points in the critical dimension.