We investigate the box dimensions of compact sets in $\mathbb{R}^2$ that contain a unit distance in every direction (such sets may have zero Hausdorff dimension). Among other results, we show that the lower box dimension must be at least $\frac{4}{7}$ and can be as low as $\frac{2}{3}$. This quantifies in a certain sense how far the unit circle is from being a difference set.