We consider the relationship between a matroidal analogue of the degree $a$ Cayley-Bacharach property (finite sets of points failing to impose independent conditions on degree $a$ hypersurfaces) and geometric properties of matroids. If the matroid polytopes in question are nestohedra, we show that the minimal degree matroidal Cayley-Bacharach property denoted $MCB(a)$ is determined by the structure of the building sets used to construct them. This analysis also applies for other degrees $a$. Also, it does not seem to affect the combinatorial equivalence class of the matroid polytope. However, there are close connections to minimal nontrivial degrees $a$ and the geometry of the matroids in question for paving matroids (which are conjecturally generic among matroids of a given rank) and matroids constructed out of supersolvable hyperplane arrangements. The case of paving matroids is still related to with properties of building sets since it is closely connected to (Hilbert series of) Chow rings of matroids, which are combinatorial models of the cohomology of wonderful compactifications. Finally, our analysis of supersolvable line and hyperplane arrangements give a family of matroids which are natrually related to independence conditions imposed by points one plane curves or can be analyzed recursively.