Type A Demazure atoms are pieces of Schur functions, or sets of tableaux whose weights sum to such functions. Inspired by colored vertex models of Borodin and Wheeler, we will construct solvable lattice models whose partition functions are Demazure atoms; the proof of this makes use of a Yang-Baxter equation for a colored five-vertex model. As a biproduct, we construct Demazure atoms on Kashiwara's $\mathcal{B}_\infty$ crystal and give new algorithms for computing Lascoux-Schützenberger keys.