We consider a family of gradient Gaussian vector fields on $\Z^d$, where the covariance operator is not translation invariant. A uniform finite range decomposition of the corresponding covariance operators is proven, i.e., the covariance operator can be written as a sum of covariance operators whose kernels are supported within cubes of increasing diameter. An optimal regularity bound for the subcovariance operators is proven. We also obtain regularity bounds as we vary the coefficients defining the gradient Gaussian measures. This extends a result of S. Adams, R. Kotecký and S. Müller \cite{1202.1158}.