Prototyping Human Interaction

New From The Lab

Future of Collaboration


Tomorrow, there is a little presentation on the usual Friday meetings we have here in the lab, and I’d love to talk about it a bit. As can be noted by some of my previous posts, I have been working for a couple of months on iPads and multi-user AR. First, I used Google’s Cloud […]

The Death Star and the Jedi Council


Yesterday, Ken and I were discussing the goals, ideas, and philosophies that drive the lab. In that discussion, there were two ideas that kept on coming up in our conversation: The Death Star and the Jedi Council. Before you get worried (or excited), no, we are not planning to build a planetary destroyer. Nor are […]

History of VR and AR


Statistics say that by 2020 1/3 of the population will be using VR, and by 2022, 3.5 billion will be using AR. Although it seems like VR and AR were born yesterday, and it’s boomed at the speed of light, these technologies have actually been around much longer than that. Some would say as early […]

Augmented Audio


Something I’m really excited about the VR and AR mediums is the development of spatialized audio. I love sound designing, especially for animated films, because it’s about world building. In a film, it’s not the visuals that tell you what you’re supposed to feel at any moment, but the soundscape — the music, the foley […]

Museum Progress


The last 2 weeks, I’ve been working on various projects relating to SIGGRAPH 2019 and I don’t think I am able to talk about that work yet. So here is an update on my museum project which I have been slowly working on for the last few weeks.   I recently finished the blocking out […]

We Have New Equipment!


Exciting things are happening at the lab! Students are continuing to work on their projects, new member bios are being added to the website’s members page, and new equipment is arriving! During the meeting today we were discussing how we are going to be getting a new sound booth. The sound booth will go in […]

NYU Tech Summit is Coming Next Week


As many of you know, our lab has collaborations with Physical Therapy and Music Department on a few projects including the VR-based balance rehabilitation project I have been working on. Recently, our work was accepted as a presentation to the NYU Technology Summit (https://www.nyu.edu/life/information-technology/about-nyu-it/key-projects-and-initiatives/nyu-technology-summit.html). The summit aims at showcasing innovative and emerging technologies used in […]

Drawing Lines


Recently we are wrapping the ChalktalkVR code and optimizing it, to some extent. First, we got the “splitting” feature integrated into the main branch. That means no matter how many lines we have in Chalktalk, ChalktalkVR is able to render that. (If not, report to KTR.) However, we found that when the amount of the […]

When Reality Changes


When I coined the phrase “Future Reality”, I was trying to describe a very specific set of ideas. Those ideas are not specific to this moment in history — they apply to every moment in history. I’ll explain. In 1992 (just before the Web) if you had tried to describe Google or Wikipedia, most people […]

Mysterious HRTF


If you have ever heard about 3D audio, for sure you also heard the term HRTF. HRTF stands for Head Related Transfer Function – you can think of it as a fingerprint of our spatial hearing. It’s unique for everyone because each of us has a unique shape of the ears. To explain why this […]