We present an infinite sequence of finite graphs with trivial automorphism group and non-trivial quantum automorphism group. These are the first known examples of graphs with this property. Moreover, to the best of our knowledge, these are the first examples of any asymmetric classical space that has nontrivial quantum symmetries. Our construction is based on solution groups to (binary) linear systems, as defined by Cleve, Liu and Slofstra in the context of non-local games. We first show that the dual quantum group of every solution group occurs as the quantum automorphism group of some graph, and then construct an infinite sequence of systems whose solution groups are nontrivial perfect groups. This leads to the desired sequence of graphs. In addition to our main result, we prove a number of related results that allow us to answer several open problems from the literature. We prove a weak quantum analog of Frucht's theorem, namely that every finite classical group $Γ$ occurs as the quantum automorphism group of a finite graph. Combined with our main result, this shows that, for every finite group $Γ$, there are graphs $G_1$ and $G_2$ that both have classical automorphism group isomorphic to $Γ$ but one of them has quantum symmetry and the other does not. Therefore, the quantum automorphism group of a graph is never determined by its classical automorphism group, and there do not exist any "quantum excluding groups".