Gauge theories with finite gauge groups have applications to quantum simulation and quantum gravity. Recently, the exact number of gauge-invariant states was computed for pure gauge theories on arbitrary lattices. In this work, we generalize this counting to include the case of scalar and fermionic matter, as well as various kinds of boundary conditions. As a byproduct, we consider several related questions, such as the implementation of charge conjugation for a generic finite group. These results are relevant for resource estimation and also as a crosscheck when working in a gauge-invariant basis.