We investigate properties of $\mathbb{Z}_p$-towers of graph coverings that arise from a constant voltage assignment. We prove the existence and uniqueness (up to isomorphisms) of such towers. Furthermore, we study the Iwasawa invariants of these towers, and apply our results to towers of isogeny graphs enhanced with level structures, as well as towers arising from volcano graphs.