Recent Publications

A Collaborative Multimodal XR Physical Design Environment

Keru Wang, Pincun Liu, Yushen Hu, Xiaoan Liu, Zhu Wang, Ken Perlin SIGGRAPH Asia 2024 XR Traditional design processes for physical prototypes can be time-consuming…

Robotecture: A Modular Shape-changing Interface Using Actuated Support Beams

Yuhan Wang, Keru Wang, Zhu Wang, Ken Perlin Proceedings of the Nineteenth International Conference on Tangible, Embedded, and Embodied Interaction Shape-changing User Interfaces (SCUIs) can…

Exploring Tangible and Graphical Interfaces for Large Virtual Object Manipulation

Keru Wang, Pincun Liu, Ken Perlin Conference: I3D ’25: Companion Proceedings of the ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games Manipulating large virtual…

AUDIO-INFLUENCED PSEUDO-HAPTICS: A REVIEW OF EFFECTS, APPLICATIONS, AND RESEARCH DIRECTIONS

Keru Wang, Yi Wu, Pincun Liu, Zhu Wang, Agnieszka Roginska, Qi Sun, Ken Perlin The 30th International Conference on Auditory Display (ICAD) Haptic feedback plays…

DrawTalking: Building Interactive Worlds by Sketching and Speaking

Karl Toby Rosenberg, Rubaiat Habib Kazi, Li-Yi Wei, Haijun Xia, and Ken Perlin. UIST ’24: Proceedings of the 37th Annual ACM Symposium on User Interface…

Generative Terrain Authoring with Mid-air Hand Sketching in Virtual Reality

Yushen Hu, Keru Wang, Yuli Shao, Jan Plass, Zhu Wang, Ken Perlin. VRST ’24: Proceedings of the 30th ACM Symposium on Virtual Reality Software and…

“Push-That-There”: Tabletop Multi-robot Object Manipulation via Multimodal ‘Object-level Instruction’

Keru Wang, Zhu Wang, Ken Nakagaki, Ken Perlin The system enables users to intuitively control a multi-robot system to manipulate objects on tabletop surfaces through various…

DrawTalking: Towards Building Interactive Worlds by Sketching and Speaking

Karl Toby Rosenberg, Rubaiat Habib Kazi, Li-Yi Wei, Haijun Xia, Ken Perlin Abstract: We introduce DrawTalking, a prototype system enabling an approach that empowers users…

Asymmetrical VR for Education

In collocated VR classes, instructors need to guide their students, while also remaining aware of the physical environment in order to ensure students’ safety. It…

VRGaitAnalytics: Visualizing Dual Task Cost for VR Gait Assessment

Zhu Wang, Liraz Arie, Anat V. Lubetzky, and Ken Perlin. 2021. VRGaitAnalytics: Visualizing Dual Task Cost for VR Gait Assessment. In Proceedings of the 27th…

Object Creation Based on Free Virtual Grid with ARGlass

Zhenyi He and Xubo Yang. 2014. Object creation based on free virtual grid with ARGlass. In SIGGRAPH Asia 2014 Posters (SA ’14). ACM, New York,…

PhyShare: Sharing Physical Interaction in Virtual Reality

Zhenyi He, Fengyuan Zhu, and Ken Perlin. 2017. PhyShare: Sharing Physical Interaction in Virtual Reality. In Adjunct Publication of the 30th Annual ACM Symposium on…

Exploring Configuration of Mixed Reality Spaces for Communication

Zhenyi He, Karl Toby Rosenberg, and Ken Perlin. 2019. Exploring Configuration of Mixed Reality Spaces for Communication. In Extended Abstracts of the 2019 CHI Conference…

A Virtual Obstacle Course within Diverse Sensory Environments

Zhu Wang, Anat Lubetzky, Charles Hendee, Marta Gospodarek, and Ken Perlin. 2020. A Virtual Obstacle Course within Diverse Sensory Environments. In ACM SIGGRAPH 2020 Immersive…

CollaboVR: A Reconfigurable Framework for Creative Collaboration in Virtual Reality

Zhenyi He, Rruofei Du, K Perlin – 2020 IEEE International Symposium on Mixed and Augmented Reality (ISMAR) See the full publication here. Author(s): Zhenyi He, Rruofei…

Walking Balance Assessment with Eye-tracking and Spatial Data Visualization

Zhu Wang, Anat Lubetzky, and Ken Perlin. 2021. Walking Balance Assessment with Eye-tracking and Spatial Data Visualization. In ACM SIGGRAPH 2021 Immersive Pavilion (SIGGRAPH ’21).…

GazeChat: Enhancing Virtual Conferences with Gaze-aware 3D Photos

Zhenyi He, Keru Wang, Brandon Yushan Feng, Ruofei Du, and Ken Perlin. 2021. GazeChat: Enhancing Virtual Conferences with Gaze-aware 3D Photos. The 34th Annual ACM…

Head mounted displays for capturing head kinematics in postural tasks

Anat V. Lubetzky, Zhu Wang, Tal Krasovsky, Head mounted displays for capturing head kinematics in postural tasks, Journal of Biomechanics, Volume 86, 2019, Pages 175-182,…

Head Mounted Display Application for Contextual Sensory Integration Training: Design, Implementation, Challenges and Patient Outcomes

Anat V Lubetzky, Jennifer Kelly, Zhu Wang, Makan TaghaviDilamani, Marta Gospodarek, Gene Fu, Erin Kuchlewski, Bryan Hujsak, “Head Mounted Display Application for Contextual Sensory Integration…

A Virtual Reality Four-Square Step Test for Quantifying Dynamic Balance Performance in People with Persistent Postural Perceptual Dizziness

M. M. H. Aharoni, A. V. Lubetzky, Z. Wang, M. Goldman and T. Krasovsky, “A Virtual Reality Four-Square Step Test for Quantifying Dynamic Balance Performance…

Contextual sensory integration training via head mounted display for individuals with vestibular disorders: a feasibility study

Anat V. Lubetzky, Jennifer Kelly, Zhu Wang, Marta Gospodarek, Gene Fu, John Sutera & Bryan D. Hujsak (2020) Contextual sensory integration training via head mounted…

Contact us

Do you want to discuss anything we’d like to discuss with you just click the button below to get in touch with us!