We prove general upper estimates for the distance between two Borel probability measures in Wasserstein metric in terms of the Fourier transforms of the measures. We work in compact manifolds including the torus, the Euclidean unit sphere, compact Lie groups and compact homogeneous spaces, and treat the Wasserstein metric $W_p$ in the full range $1 \le p \le \infty$ for the first time. The proofs are based on a comparison between the Wasserstein metric and a dual Sobolev norm, Riesz transform estimates and Hausdorff--Young inequalities on compact manifolds. As an application, we show that spherical designs are optimally close to the uniform measure on the sphere in Wasserstein metric.