Abstract:We investigate sketch-like pen input as an alternative way to support execution control in interactive debugging. In our interface, programmers draw lightweight marks to set breakpoints, use symbolic strokes to control execution, and extend strokes into spirals to repeat traversal actions. The prototype combines gesture recognition with Python execution tracing in a conventional editor interface. In a controlled study with 24 programmers, we compared the sketch interface with conventional mouse-and-keyboard input on debugging tasks that required breakpoint placement, step-wise execution, and runtime state inspection. The results show that sketch-like input can support these execution-control tasks, while also introducing challenges in precision, recognition, and gesture recall. Our findings suggest that pen input is most promising where debugger interactions benefit from spatial grounding or continuous movement, rather than as a wholesale replacement for conventional debugging controls.
| Comments: | Accepted at Graphics Interface 2026 (GI 2026). 9 pages, 7 figures |
| Subjects: | Human-Computer Interaction (cs.HC) |
| Cite as: | arXiv:2605.24228 [cs.HC] |
| (or arXiv:2605.24228v1 [cs.HC] for this version) | |
| https://doi.org/10.48550/arXiv.2605.24228 arXiv-issued DOI via DataCite (pending registration) |
From: Helen Weixu Chen [view email]
[v1]
Fri, 22 May 2026 21:17:02 UTC (805 KB)
此内容由惯性聚合(RSS阅读器)自动聚合整理，仅供阅读参考。 原文来自 — 版权归原作者所有。