In this article, we deal with stochastic horizontal lifts and anti-developments of semimartingales with jumps on complete and connected Riemannian manifolds without any assumption for their curvatures. We prove two one-to-one correspondences among some classes of discontinuous semimartingales on Riemannian manifolds, orthonormal frame bundles and Euclidean spaces by using the stochastic differential geometry with jumps introduced by Cohen (1996). Both of these two results are extension of the one shown in Pontier-Estrade (1992). The first result is the correspondence in the case where jumps of semimartingales are regarded as initial velocities of geodesics which are not necessarily minimal. In the second result, we also established the correspondence in the situation where jumps of semimartingales are given by connection rules, but we impose the condition that the jumps of semimartingales are small. The latter result enables us to construct martingales for a given connection rule with small jumps on any compact manifold from local martingales on a Euclidean space through horizontal semimartingales on orthonormal semimartingales.