Let $E$ be a proper symmetric subset of $S^{d-1}$, and $C_{\mathbb{F}_q^d}(E)$ be the Cayley graph with the vertex set $\mathbb{F}_q^d$, and two vertices $x$ and $y$ are connected by an edge if $x-y\in E$. Let $k\ge 2$ be a positive integer. We show that for any $α\in (0, 1)$, there exists $q(α, k)$ large enough such that if $E\subset S^{d-1}\subset \mathbb{F}_q^d$ with $|E|\ge αq^{d-1}$ and $q\ge q(α, k)$, then for each vertex $v$, there are at least $c(α, k)q^{\frac{(2k-1)d-4k}{2}}$ cycles of length $2k$ with distinct vertices in $C_{\mathbb{F}_q^d}(E)$ containing $v$. This result is the inverse version of a recent result due to Iosevich, Jardine, and McDonald (2021).