For positive integers $d$ and $p$ such that $d \ge p$, let $\mathbb{R}^{d \times p}$ denote the set of $d \times p$ real matrices, $I_p$ be the identity matrix of order $p$, and $V_{d,p} = \{x \in \mathbb{R}^{d \times p} \mid x'x = I_p\}$ be the Stiefel manifold in $\mathbb{R}^{d \times p}$. Complete asymptotic expansions as $d \to \infty$ are obtained for the normalizing constants of the matrix Bingham and matrix Langevin probability distributions on $V_{d,p}$. The accuracy of each truncated expansion is strictly increasing in $d$; also, for sufficiently large $d$, the accuracy is strictly increasing in $m$, the number of terms in the truncated expansion. Lower bounds are obtained for the truncated expansions when the matrix parameters of the matrix Bingham distribution are positive definite and when the matrix parameter of the matrix Langevin distribution is of full rank. These results are applied to obtain the rates of convergence of the asymptotic expansions as both $d \to \infty$ and $p \to \infty$. Values of $d$ and $p$ arising in numerous data sets are used to illustrate the rate of convergence of the truncated approximations as $d$ or $m$ increases. These results extend recently-obtained asymptotic expansions for the normalizing constants of the high-dimensional Bingham distributions.