Coherent configurations are a generalization of association schemes. In this paper, we introduce the concept of $Q$-polynomial coherent configurations and study the relationship among intersection numbers, Krein numbers, and eigenmatrices. The examples of $Q$-polynomial coherent configurations are provided from Delsarte designs in $Q$-polynomial schemes and spherical designs.