In 1978, Robert Kibler at the National Security Agency in Fort Meade, Maryland published a description of all noncyclic difference sets with $k < 20$. Kibler's decision to stop his extensive computer search for difference sets at block size 19 was motivated partly by the difficult barrier at $k=20$, the difference sets with parameters $(96,20,4)$. In this paper, we announce the completion of the search for all $(96,20,4)$ difference sets, relying on the computer software GAP and the work of numerous authors over the last few decades. The difference sets and the symmetric designs they create are summarized and links are provided to webpages which explicitly list the difference sets. In addition, we use these $(96,20,4)$ difference sets to construct all $(96, 20, 4, 4)$ and $(96, 19, 2, 4)$ partial difference sets and briefly look at the corresponding strongly regular graphs.