For $δ>0$ sufficiently small and $A\subset \mathbb{Z}^k$ with $|A+A|\le (2^k+δ)|A|$, we show either $A$ is covered by $m_k(δ)$ parallel hyperplanes, or satisfies $|\widehat{\operatorname{co}}(A)\setminus A|\le c_kδ|A|$, where $\widehat{\operatorname{co}}(A)$ is the smallest convex progression (convex set intersected with a sublattice) containing $A$. This generalizes the Freiman-Bilu $2^k$ theorem, Freiman's $3|A|-4$ theorem, and recent sharp stability results of the present authors for sumsets in $\mathbb{R}^k$ conjectured by Figalli and Jerison.