Publications

Keru Wang, Pincun Liu, Yushen Hu, Xiaoan Liu, Zhu Wang, Ken Perlin SIGGRAPH Asia 2024 XR Traditional design processes for physical prototypes can be time-consuming and costly due to iterations of prototyping, testing, and refinement. Extended Reality (XR) technology with video passthrough offers unique benefits for alleviating these issues by providing instant visual feedback. We

Yuhan Wang, Keru Wang, Zhu Wang, Ken Perlin Proceedings of the Nineteenth International Conference on Tangible, Embedded, and Embodied Interaction Shape-changing User Interfaces (SCUIs) can dynamically adjust their shape or layout in response to user interactions or environments. It is challenging to design expandable, affordable, and effective SCUIs with optimal space utilization for novel interactions.

Keru Wang, Pincun Liu, Ken Perlin Conference: I3D ’25: Companion Proceedings of the ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games Manipulating large virtual objects in extended reality (XR) environments poses challenges due to scale, occlusion, and interaction precision. This work presents a system design and a comparative study of two interfaces for large-object

Keru Wang, Yi Wu, Pincun Liu, Zhu Wang, Agnieszka Roginska, Qi Sun, Ken Perlin The 30th International Conference on Auditory Display (ICAD) Haptic feedback plays an important role in interaction, but tra- ditional haptic devices are often difficult to access due to their complexity and high cost. A cost-effective approach is to use au- ditory

Karl Toby Rosenberg, Rubaiat Habib Kazi, Li-Yi Wei, Haijun Xia, and Ken Perlin. UIST ’24: Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology ACM DL Open Access Abstract: We introduce DrawTalking, an approach to building and controlling interactive worlds by sketching and speaking while telling stories. It emphasizes user control

Yushen Hu, Keru Wang, Yuli Shao, Jan Plass, Zhu Wang, Ken Perlin. VRST ’24: Proceedings of the 30th ACM Symposium on Virtual Reality Software and Technology Terrain generation and authoring in Virtual Reality (VR) offers unique benefits, including 360-degree views, improved spatial perception, immersive and intuitive design experience and natural input modalities. Yet even in

Keru Wang, Zhu Wang, Ken Nakagaki, Ken Perlin The system enables users to intuitively control a multi-robot system to manipulate objects on tabletop surfaces through various modalities like gestures, GUI, tangible manipulation, and speech. The multi-robot system then autonomously anc collectively executes the instructions using a generalizable control algorithm. This approach emphasizes object-level interaction, allowing users

Karl Toby Rosenberg, Rubaiat Habib Kazi, Li-Yi Wei, Haijun Xia, Ken Perlin Abstract: We introduce DrawTalking, a prototype system enabling an approach that empowers users to build interactive worlds by sketching and speaking. The approach emphasizes user control and flexibility, and gives programming-like capability without requiring code. An early open-ended study shows the mechanics resonate

Zhu Wang, Liraz Arie, Anat V. Lubetzky, and Ken Perlin. 2021. VRGaitAnalytics: Visualizing Dual Task Cost for VR Gait Assessment. In Proceedings of the 27th ACM Symposium on Virtual Reality Software and Technology (VRST ’21). Association for Computing Machinery, New York, NY, USA, Article 15, 1–10. DOI:https://doi.org/10.1145/3489849.3489874 See the full publication here. Author(s): Zhu Wang, Liraz