This paper describes a general method for representing $k$-token graphs of Cayley graphs as lifts of voltage graphs. This allows us to construct line graphs of circulant graphs and Johnson graphs as lift graphs on cyclic groups. As an application of the method, we derive the spectra of the considered token graphs. This method can also be applied to dealing with other matrices, such as the Laplacian or the signless Laplacian, and to construct token digraphs of Cayley digraphs.