We consider transfer operators for topological Markov shift (TMS) with countable states and with holes which are $2$-cylinders. As main results, if the closed system of the shift has finitely irreducible transition matrix and the potential is a weaker Lipschitz continuous and summable, then we obtain a version of Ruelle-Perron-Frobenius Theorem and quasi-compactness of the associated Ruelle transfer operator. The escape rate of the open system is also calculated. In corollary, it turns out that the Ruelle operator of summable potential on topologically transitive TMS has a spectral gap property. As other example, we apply the main results to the transfer operators associated to graph iterated function systems.