We prove that every completely monotone function defined on a right-unbounded open interval admits a Newton series expansion at every point of that interval. This result can be viewed as an analog of Bernstein's little theorem for absolutely monotone functions. As an application, we use it to study principal indefinite sums, which are constructed via a broad generalization of Bohr-Mollerup's theorem.