Based on the notion of paracontrolled distributions, we provide existence and uniqueness results for rough Volterra equations of convolution type with potentially singular kernels and driven by the newly introduced class of convolutional rough paths. The existence of such rough paths above a wide class of stochastic processes including the fractional Brownian motion is shown. As applications we consider various types of rough and stochastic (partial) differential equations such as rough differential equations with delay, stochastic Volterra equations driven by Gaussian processes and moving average equations driven by Lévy processes.