We derive new HWI inequalities for the granular media equation, which external potential $V$ and interaction potential $W$ are only strictly convex on complementary parts of the space. Particularly, potentials are not assumed convex. After solving technicalities related to the singularity of a logarithmic $W$, we apply our result to obtain stability rates of log gases under non-strictly convex or quartic external potentials. We prove that the distribution of a log gas converges towards an equilibrium with respect to the Wasserstein distance at a square root rate. Finally, we establish exponential stability of log gases under the double-well potential $V(x) = \frac{x^4}{4} + c\frac{x^2}{2}$, $c < 0$ and the non-confining potential $V(x) = g\frac{x^4}{4} + \frac{x^2}{2}$, $g<0$ for $|c|$ and $|g|$ small enough.