We consider the long-range random field Ising model in dimension $d = 1, 2$, whereas the long-range interaction is of the form $J_{xy} = |x-y|^{-α}$ with $1< α< 3/2$ for $d=1$ and with $2 < α\leq 3$ for $d = 2$. Our main results establish phase transitions in these regimes. In one dimension, we employ a Peierls argument with some novel modification, suitable for dealing with the randomness coming from the external field; in two dimensions, our proof follows that of Affonso, Bissacot, and Maia (2023) with some adaptations, but new ideas are required in the critical case of $α=3$.