Bitcoin is considered the most valuable currency in the world. Besides being highly valuable, its value has also experienced a steep increase, from around 1 dollar in 2010 to around 18000 in 2017. Then, in recent years, it has attracted considerable attention in a diverse set of fields, including economics and computer science. The former mainly focuses on studying how it affects the market, determining reasons behinds its price fluctuations, and predicting its future prices. The latter mainly focuses on its vulnerabilities, scalability, and other techno-crypto-economic issues. Here, we aim at revealing the usefulness of traditional autoregressive integrative moving average (ARIMA) model in predicting the future value of bitcoin by analyzing the price time series in a 3-years-long time period. On the one hand, our empirical studies reveal that this simple scheme is efficient in sub-periods in which the behavior of the time-series is almost unchanged, especially when it is used for short-term prediction, e.g. 1-day. On the other hand, when we try to train the ARIMA model to a 3-years-long period, during which the bitcoin price has experienced different behaviors, or when we try to use it for a long-term prediction, we observe that it introduces large prediction errors. Especially, the ARIMA model is unable to capture the sharp fluctuations in the price, e.g. the volatility at the end of 2017. Then, it calls for more features to be extracted and used along with the price for a more accurate prediction of the price. We have further investigated the bitcoin price prediction using an ARIMA model, trained over a large dataset, and a limited test window of the bitcoin price, with length $w$, as inputs. Our study sheds lights on the interaction of the prediction accuracy, choice of ($p,q,d$), and window size $w$.