Hey Everyone! I thought it would be good to give a quick update on things to look out for on the FRL website. Here at the FRL we have many generous sponsors that enable us to do amazing research. In order to express our gratitude to them, I’m in the process of creating a sponsors
Today’s post envisions the state of XR five years in the future, and how we might prototype advanced features like room-scale digitization with current hardware. This latest generation of HMDs (Oculus Quest, Oculus Rift S, Valve Index, etc.) has swapped out external tracking equipment in favor of HMD-mounted camera arrays. This change is more than
Stepping into worlds with a Reality Zipper Read More »
Rokoko motion capture suit is an IMU-based motion capture system with IMU sensors worn on the human body and recovers poses from measuring orientation and acceleration of each IMU sensor. The suit tracks all the major body components except fingers with 19 IMUs. Last week, Ben, Connor and I made a demo video showing how
Rokoko + Quest = Ready Player Zero? Read More »
Early this semester, we were working on volumetric capture. The project is about to pre-record human’s presentation and replay it remotely offline. The project includes: 1) Camera rig. To capture the whole body of the presenter, four walls of the cameras are the initial setup. 2) Movable frames. To support the movement of the presenter,
Volumetric Capture Literature Review Read More »
This morning I was working on an algorithm for being able to write text quickly by drawing with a VR/XR controller without needing to look at the controller. Technically this is called “eyes free” writing, because when you don’t need to look at what you are doing with the controller, your eyes are then freed
Accidental mandala Read More »
Recently, I think a lot about how to use the new technology to allow the users to immerse themselves inside the music. We are so used to listening to music in “flat” stereo that the opportunities of 6DoF tracking are very tempting to be explored in the music context. In one of my previous posts,
Most of us here are preparing a large palette of videos and experiences to present to visitors and potential partners. Within the general sphere of this activity, I am working to make Chalktalk’s multiple user support more robust, which requires a major rewrite of the core code-base. Since I’ve familiarized myself with the project fairly
Working on Multi-user Chalktalk Read More »
June 6th we took to Verizon’s Alley office to present our work for the past couple of months. A team of us at the lab have been working on a multi-user collaborative classroom. Specifically, we focused on creating a classroom lesson where students get together to build a cell from parts that are floating between
Verizon 5G EdTech Challenge Read More »
A couple of weeks ago, I wrote about a quick and easy calibration method. This calibration method allowed us to not only map a virtual space to a physical space with reasonable accuracy, but synchronize a virtual space between multiple users. However, as I used this method in practice with the new Oculus Quest, I
Calibrating the Oculus Quest Guardian Read More »
Now that we have room-scale co-located tracking with no external sensors, thanks to the Quest, and Connor DeFanti’s calibration scheme – we can begin to explore other exciting possibilities for the future. One of which is using small embedded boards, such as the Raspberry Pi, coupled with an camera – both attached to the front
Living at the Edge Read More »
