A finite non-regular primitive permutation group $G$ is extremely primitive if a point stabiliser acts primitively on each of its nontrivial orbits. Such groups have been studied for almost a century, finding various applications. The classification of extremely primitive groups was recently completed by Burness and Lee, who relied on an earlier classification of soluble extremely primitive groups by Mann, Praeger and Seress. Unfortunately, there is an inaccuracy in the latter classification. We correct this mistake, and also investigate regular linear spaces which admit groups of automorphisms that are extremely primitive on points.