The standard closed form lower bound on $σ$ for providing $(ε, δ)$-differential privacy by adding zero mean Gaussian noise with variance $σ^2$ is $σ> Δ\sqrt {2}(ε^{-1}) \sqrt {\log \left( 5/4δ^{-1} \right)}$ for $ε\in (0,1)$. We present a similar closed form bound $σ\geq Δ(ε\sqrt{2})^{-1} \left(\sqrt{az+ε} + s\sqrt{az}\right)$ for $z=-\log(4δ(1-δ))$ and $(a,s)=(1,1)$ if $δ\leq 1/2$ and $(a,s)=(π/4,-1)$ otherwise. Our bound is valid for all $ε> 0$ and is always lower (better). We also present a sufficient condition for $(ε, δ)$-differential privacy when adding noise distributed according to even and log-concave densities supported everywhere.