Quantum wireless sensing using Rydberg atomic receivers enables high-sensitivity signal acquisition direction-of-arrival (DoA) estimation. However, it suffers from a fundamental limitation, where only the magnitude of the received signal is observable. The recently proposed Quantum-MUSIC algorithm addresses this problem by recovering phase information through alternating minimization and subsequently applying the MUSIC algorithm for DoA estimation. However, the existing approach relies on an $\ell_2$-norm phase retrieval step, making it highly sensitive to outlier measurements produced by hardware faults, sensor saturation, or adversarial interference. In this letter, we propose a \emph{Robust Quantum-MUSIC} (RobQMUSIC) framework that replaces the $\ell_2$-norm with an $\ell_1$-norm formulation. The resulting weighted phase-retrieval problem is solved efficiently via an Iteratively Reweighted Least Squares (IRLS) scheme embedded within the alternating minimization loop, requiring no increase in structural complexity relative to the baseline algorithm. Simulation results demonstrate that RobQMUSIC achieves near-identical DoA estimation accuracy to Quantum-MUSIC under ideal conditions, while maintaining robust performance over a wide range of outlier contamination levels at which Quantum-MUSIC fails entirely.