Hi HN, I’m the solo developer of Putt Dojo. I've spent the last few years trying to make a real physical ball work convincingly inside mixed reality. The app now runs standalone on Quest 3/3S and tracks a real golf ball using a custom computer vision algorithm running on the headset passthrough cameras, then hands off to simulation once the ball starts moving.

The article describes the process of discovery and development of the product, and includes videos of some early exploratory prototypes, experiments, the latency correction work.

Happy to answer questions about the tracking, latency correction, passthrough camera constraints, or the techinical/design decisions that came out of trying to make this work.