The notions of noise sensitivity and stability were recently extended for the voter model. In this model, the vertices of a graph have opinions that are updated by uniformly selecting edges. We further extend stability results to different classes of perturbations. We consider two different types of noise: in the first one, an exclusion process is performed on the edge selections, while in the second, independent Brownian motions are applied to such a sequence. In both cases, we prove stability of the consensus opinion provided the noise is run for a short amount of time, depending on the underlying graph structure. This is done by analyzing the expected size of the pivotal set, whose definition differs from the usual one in order to reflect the change associated with these noises.