We prove a conjecture by Bertoin that the multi-dimensional elephant random walk on $\mathbb{Z}^d$($d\geq 3$) is transient and the expected number of zeros is finite. We also provide some estimates on the rate of escape. In dimensions $d= 1, 2$, we prove that phase transitions between recurrence and transience occur at $p=(2d+1)/(4d)$. Let $S$ be an elephant random walk with parameter $p$. For $p \leq 3/4$, we provide a Berry-Esseen type bound for properly normalized $S_n$. For $p>3/4$, the distribution of $\lim_{n\to \infty} S_n/n^{2p-1}$ will be studied.