We show that for low enough temperatures, but still above the AT line, the Jacobian of the TAP equations for the SK model has a macroscopic fraction of eigenvalues outside the unit interval. This provides a simple explanation for the numerical instability of the fixed points, which thus occurs already in high temperature. The insight leads to some algorithmic considerations on the low temperature regime, also briefly discussed.