For plane frameworks with reflection or rotational symmetries, where the group action is not necessarily free on the vertex set, we introduce a phase-symmetric orbit rigidity matrix for each irreducible representation of the group. We then use these generalised orbit rigidity matrices to provide necessary conditions for infinitesimal rigidity for frameworks that are symmetric with a cyclic group that acts freely or non-freely on the vertices. Moreover, for the reflection, the half-turn, and the three-fold rotational group in the plane, we establish complete combinatorial characterisations of symmetry-generic infinitesimally rigid frameworks. This extends well-known characterisations for these groups to the case when the group action is not necessarily free on the vertices. The presence of vertices that are fixed by non-trivial group elements requires the introduction of generalised versions of group-labelled quotient graphs leads to more refined types of combinatorial sparsity counts for characterising symmetry-generic infinitesimal rigidity.