We generalize the definition of the $cd$-index of an Eulerian poset to the class of semi-Eulerian posets. For simplicial semi-Eulerian Buchsbaum posets, we show that all coefficients of the $cd$-index are non-negative. This proves a conjecture of Novik for odd dimensional manifolds and extends it to the even dimensional case.