Tan et al. conjectured that connected co-edge-regular graphs with four distinct eigenvalues and fixed smallest eigenvalue, when having sufficiently large valency, belong to two different families of graphs. In this paper we construct two new infinite families of connected co-edge-regular graphs with four distinct eigenvalues and fixed smallest eigenvalue, thereby disproving their conjecture. Moreover, one of these constructions demonstrates that clique-extensions of Latin Square graphs are not determined by their spectrum.