In this paper, we study finite-time ruin probabilities for the compound Markov binomial risk model - a discrete-time model where claim sizes are modulated by a finite-state ergodic Markov chain. In the classic (non-modulated) case, the risk process has interchangeable increments and consequently, its finite-time ruin probability can be obtained in terms of Takács' famous Ballot Theorem results. Unfortunately, due to the dependency of our process on the state(s) of the modulating chain these do not necessarily extend to the modulated setting. We show that a general form of the Ballot Theorem remains valid under the stationary distribution of the modulating chain, yielding a Takács-type expression for the finite-time ruin probability which holds only when the initial surplus is equal to zero. For the case of arbitrary initial surplus, we develop an approach based on multivariate Lagrangian inversion, from which we derive distributional results for various hitting times of the risk process, including a Seal-type formula for the finite-time ruin probability.