A fundamental property of choice functions is stability, which, loosely speaking, prescribes that choice sets are invariant under adding and removing unchosen alternatives. We provide several structural insights that improve our understanding of stable choice functions. In particular, (i) we show that every stable choice function is generated by a unique simple choice function, which never excludes more than one alternative, (ii) we completely characterize which simple choice functions give rise to stable choice functions, and (iii) we prove a strong relationship between stability and a new property of tournament solutions called local reversal symmetry. Based on these findings, we provide the first concrete tournament---consisting of 24 alternatives---in which the tournament equilibrium set fails to be stable. Furthermore, we prove that there is no more discriminating stable tournament solution than the bipartisan set and that the bipartisan set is the unique most discriminating tournament solution which satisfies standard properties proposed in the literature.