The complex Ginibre ensemble is an $N\times N$ non-Hermitian random matrix over $\mathbb{C}$ with i.i.d. complex Gaussian entries normalized to have mean zero and variance $1/N$. Unlike the Gaussian unitary ensemble, for which the eigenvectors are distributed according to Haar measure on the compact group $U(N)$, independently of the eigenvalues, the geometry of the eigenbases of the Ginibre ensemble are not particularly well understood. In this paper we systematically study properties of eigenvector correlations in this matrix ensemble. In particular, we uncover an extended algebraic structure which describes their asymptotic behavior (as $N$ goes to infinity). Our work extends previous results of Chalker and Mehlig [CM98], in which the correlation for pairs of eigenvectors was computed.