Motivated by the recent development of noncommutative Novikov algebras and multi-Novikov algebras from the study of regularity structures of stochastic PDEs, this paper gives a general approach to study various multi-Novikov algebras and multi-differential algebras, with close connection with Poisson algebras. The construction of S. Gelfand of Novikov algebras from differential commutative algebras is generalized to this context. Free noncommuting multi-Novikov algebras are constructed from typed decorated rooted trees and from noncommuting multi-differential polynomials with populated conditions.