Recently, several works by a number of authors have provided characterizations of integral undirected Cayley graphs over generalized dihedral groups and generalized dicyclic groups. We generalize and unify these results in two different ways. Firstly, we work over arbitrary non-abelian finite groups admitting an abelian subgroup of index 2. Secondly, our main result actually characterizes integral mixed Cayley graphs over such finite groups, in the spirit of a very recent result of Kadyan--Bhattarcharjya in the abelian case.