Prototyping Human Interaction

New From The Lab

At Arm’s Length


For as long as we’ve told ourselves stories, we’ve wanted to crawl inside their worlds and enter their fantastical spaces.  Our world is drab compared to theirs; our experiences in stories would be so much more exciting if we could just exist within them, even if only for a visit.  Many creative forms have been […]

Let’s Talk Optimization!


This is going to be a short post, as we’re in the thick of preparing to take CAVE to SIGGRAPH 2018 in a week. Super exciting stuff, but hasn’t left me with much time for blog post writing! We’re in the quality assurance stages of CAVE – content is pretty much finished, the last cave […]

A Pressure Sensing Trail


The Tactonic floor mat is the pressure sensing technology that I use in my arch index research. It captures real-time pressure images so that we can get foot pressure and further monitor the variances of the pressure along movements. Figure 1. One of the major models that we use in the lab Figure 2. One […]

Hand Tracking in VR


Time to share a new paper 😉 (I have to say it is quite annoying that I cannot just share what I’ve done during the interval because the idea is still ongoing.) Today I wanna talk about the idea “Online Optical Marker-based Hand Tracking with Deep Labels”, which is a hand tracking system based on […]

Origin story


We’ve been spending most of the last year creating a story that takes place about 10,000 years ago in Northern Europe. It’s a story of a young Shaman-to-be who needs to connect with the spirit world. My co-creator Kris Layng and I were drawn to this story partly because it describes a time when humans […]

Bellman’s Lullaby in CAVE


CAVE’s music is based on “Bellman’s Lullaby”  by Swedish composer and poet, Carl Michael Bellman (1740-1795). Bellman is a central figure in Scandinavian literature and music, and has been compared to Mozart and Shakespeare for his influence. I discovered the lullaby while searching for a temp track for the opening of the show, when Ayara’s […]

CAVE – The Movie


For the past few months, Dan Lazar, a cinematographer and recent grad of NYU Film School, has been working on crafting a 2D movie version of CAVE using Unity and Cinemachine. Dan uses wide shots, close ups, tracking and dolly shots, developed over 100s of years of cinemas history, to tell the story of CAVE […]

Sound Ideas


Ken keeps a digital piano at the available for anyone here to play, and since I joined the lab around a year ago I’ve used it often as  a MIDI controller for audio sequencing. I enjoy to compose original music–I go by ear and use samples and synthesizers to approximate the sounds “in my head.” […]

Back In Action


The mammoths are back in action, and so am I, seeing as I am back at FRL from my brief vacation. A lot has been going on since I came back. I have been working with some others at the lab on creating a small world superimposed in our own. This world has decidedly sprouted […]

Sharing Virtual Spaces: The Foundation


“The Holodeck is Other People” was one of the first things Ken Perlin told me when I joined this lab, well before it was the Future Reality Lab. If you’ve listened to him or read his blog, you’ve probably heard it as well. It’s a statement that has driven many of the projects at our […]