In this paper, we provide the notions of connection $1$-forms and curvature $2$-forms on graphs. We prove a Weitzenböck formula for connection Laplacians in this setting. We also define a discrete Yang-Mills functional and study its Euler-Lagrange equations.