We introduce Magic Gems, a geometric representation of magic squares as three-dimensional polyhedra. By mapping an n times n magic square onto a centered coordinate grid with cell values as vertical displacements, we construct a point cloud whose convex hull defines the Magic Gem. Building on prior work connecting magic squares to physical properties such as moment of inertia, this construction reveals an explicit statistical structure: we show that magic squares have vanishing covariances between position and value. We develop a covariance energy functional (the sum of squared covariances with individual row, column, and diagonal indicator variables) and prove that for all orders of n greater than or equal to three, an arrangement is a magic square if and only if this complete energy vanishes. This characterization transforms the classical line-sum definition into a statistical orthogonality condition. We also study a simpler low-mode relaxation using only four aggregate position indicators; this coincides with the complete characterization for n equals three (verified exhaustively) but defines a strictly larger class for n greater than or equal to four (explicit counterexamples computed). Perturbation analysis demonstrates that magic squares are isolated local minima in the energy landscape. The representation is invariant under dihedral symmetry D4, yielding canonical geometric objects for equivalence classes.