The resource-theoretic approach to quantum thermodynamics typically assumes perfect knowledge of the thermal equilibrium state, an idealization incompatible with finite experimental precision. We develop a framework for equilibrium uncertainty by representing the equilibrium reference as a set of candidate states. Under a generic geometric condition, we prove a no-go theorem that sharply limits athermality ``purification'': converting an uncertain athermal state into a definite target is either trivial or impossible. We then derive exact one-shot entropic characterizations of work extraction and formation for two work-storage models, a clean battery with known equilibrium and a dirty battery with uncertain equilibrium. Both models exhibit strong asymptotic irreversibility even under arbitrarily small uncertainty. An explicit example reveals two distinct extremes: clean batteries display a bound-entanglement-like phenomenon, with positive formation cost but zero extractable work, whereas dirty batteries allow positive work extraction but require infinite formation cost. These phenomena show that equilibrium uncertainty is not a minor perturbation of the standard theory, but a structural ingredient that fundamentally reshapes the limits of quantum thermodynamics.