Butterfly minors are a generalisation of the minor containment relation for undirected graphs to directed graphs. Many results in directed structural graph theory use this notion as a central tool next to directed treewidth, a generalisation of the width measure treewidth to directed graphs. Adler [JCTB'07] showed that the directed treewidth is not closed under taking butterfly minors. Over the years, many alternative definitions for directed treewidth appeared throughout the literature, equivalent to the original definition up to small functions. In this paper, we consider the major ones and show that not all of them share the problem identified by Adler.