We present a simple model of a random walk with partial memory, which we call the \emph{random memory walk}. We introduce this model motivated by the belief that it mimics the behavior of the once-reinforced random walk in high dimensions and with small reinforcement. We establish the transience of the random memory walk in dimensions three and higher, and show that its scaling limit is a Brownian motion.