A recently proposed model of social interaction in voting is investigated by simplifying it down into a version that is more analytically tractable and which allows a mathematical analysis to be performed. This analysis clarifies the interplay of the different elements present in the system --- social influence, heterogeneity and noise --- and leads to a better understanding of its properties. The origin of a regime of bistability is identified. The insight gained in this way gives further intuition into the behaviour of the original model.