In this paper, we derive exponential ergodicity in relative entropy for general kinetic SDEs under a partially dissipative condition. It covers non-equilibrium situations where the forces are not of gradient type and the invariant measure does not have an explicit density, extending previous results set in the equilibrium case. The key argument is to establish the hypercontractivity of the associated semigroup, which follows from its hyperboundedness and its $L^2$-exponential ergodicity. Moreover, we obtain exponential ergodicity in the $L^2$-Wasserstein distance by combining Talagrand's inequality with a log-Harnack inequality. These results are further extended to the McKean-Vlasov setting and to the associated mean-field interacting particle systems, with convergence rates that are uniform in the number of particles in the latter case, under small nonlinear perturbations.