Let $(\mathcal{A},\mathrm{tr})$ be a von Neumann algebra with a faithful, normal trace $\mathrm{tr}:\mathcal{A}\rightarrow\mathbb{C}.$ For each $a\in\mathcal{A},$ define \[ S(λ,\varepsilon)=\mathrm{tr}[\log((a-λ)^{\ast}(a-λ)+\varepsilon)],\quadλ\in\mathbb{C},~\varepsilon>0, \] so that the limit as $\varepsilon\rightarrow0^{+}$ of $S$ is the log potential of the Brown measure of $a.$ Suppose that for a fixed $λ\in\mathbb{C},$ the function \[ \varepsilon\mapsto\frac{\partial S}{\partial\varepsilon}(λ,\varepsilon)=\mathrm{tr}[((a-λ)^{\ast}(a-λ)+\varepsilon )^{-1}] \] admits a real analytic extension to a neighborhood of $0$ in $\mathbb{R}.$ Then we will show that $λ$ is outside the spectrum of $a.$ We will apply this result to several examples involving circular and elliptic elements, as well as free multiplicative Brownian motions. In most cases, we will show that the spectrum of the relevant element $a$ coincides with the support of its Brown measure.