We calculate the $p$-Kazhdan--Lusztig polynomials for Hermitian symmetric pairs and prove that the corresponding anti-spherical Hecke categories categories are standard Koszul. We prove that the combinatorial invariance conjecture can be lifted to the level of graded Morita equivalences between subquotients of these Hecke categories.