In this paper we present some new limit theorems for power variation of $k$th order increments of stationary increments Lévy driven moving averages. In this infill sampling setting, the asymptotic theory gives very surprising results, which (partially) have no counterpart in the theory of discrete moving averages. More specifically, we will show that the first order limit theorems and the mode of convergence strongly depend on the interplay between the given order of the increments, the considered power $p>0$, the Blumenthal-Getoor index $β\in (0,2)$ of the driving pure jump Lévy process $L$ and the behaviour of the kernel function $g$ at $0$ determined by the power $α$. First order asymptotic theory essentially comprise three cases: stable convergence towards a certain infinitely divisible distribution, an ergodic type limit theorem and convergence in probability towards an integrated random process. We also prove the second order limit theorem connected to the ergodic type result. When the driving Lévy process $L$ is a symmetric $β$-stable process we obtain two different limits: a central limit theorem and convergence in distribution towards a $(1-α)β$-stable random variable.