Publication: DodecaPen: Accurate 6DoF Tracking of a Passive Stylus, ACM UIST 2017 *** Honorable Mention Award ***
Authors: Po-Chen Wu (National Taiwan University) Robert Wang (Oculus Research) Kenrick Kin (Oculus Research) Christopher Twigg (Oculus Research) Shangchen Han (Oculus Research) Ming-Hsuan Yang (UC Merced) Shao-Yi Chien (National Taiwan University)
Abstract: We propose a system for real-time six degrees of freedom (6DoF) tracking of a passive stylus that achieves submillimeter accuracy, which is suitable for writing or drawing in mixed reality applications. Our system is particularly easy to implement, requiring only a monocular camera, a 3D printed dodecahedron, and hand-glued binary square markers. The accuracy and performance we achieve are due to model-based tracking using a calibrated model and a combination of sparse pose estimation and dense alignment. We demonstrate the system performance in terms of speed and accuracy on a number of synthetic and real datasets, showing that it can be competitive with state-of-the-art multi-camera motion capture systems. We also demonstrate several applications of the technology ranging from 2D and 3D drawing in VR to general object manipulation and board games.