There was a previous blog I wrote about Tobii eye tracking system embedded with HTC Vive. A few friends who are interested in it asked me about my experience with the eye tracking system, so I feel it is good to talk a bit more about it in this blog. There are currently two SDKs…
Recently, I had a chance to test the new released HTC Vive Pro Eye headset. The headset is the first VR headset integrated eye tracking, and it is hard to notice the hardware for eye tracking when compared with a regular HTC Vive Pro. Vive Pro integrated the eye-tracking technology from Tobii, which is a…
I went to Siggraph 2019 a few weeks ago and had some thoughts about VR. With the release of the various commercial VR systems from the technology giants, VR is no longer a mystery these days. More and more people in all kinds of fields began to see it as a profound tool rather than…
This post is to share the solution of a problem that happened during the development with Oculus Quest. I got the solution from Connor (he was a colleague who has a lot of experience on Quest and just graduated in the summer). I have been working on a Unity project which requires to record position…
Earlier this year, our lab got a lightweight IMU-based wearable motion capture system called Notch. The system is a set of six waterproof IMU sensors designed to be mounted on the body. The motion capture system does not use external cameras like Optitrack or Vicon which uses a group of infrared cameras to triangulate the…
Rokoko motion capture suit is an IMU-based motion capture system with IMU sensors worn on the human body and recovers poses from measuring orientation and acceleration of each IMU sensor. The suit tracks all the major body components except fingers with 19 IMUs. Last week, Ben, Connor and I made a demo video showing how…
I am sure most of you have seen Ken’s Chalktalk demos. In one of his demos, he uses a green object attached to a pen as the drawing tool. It would be nice to use bare hands as the tool for interaction, so we implemented this simple hand tracking component for Chalktalk. It uses the…
After participating 2 rounds of application to the second Annual Innovators in Aging Award, our team (Zhu Wang, Marta Gospodarek and Rufei Sheng, advised by Prof. Ken Perlin and Prof. Anat Lubetzky) finally won the award. The competition, held by NYU Aging Incubator, aims to promote the study of aging and its impacts, and further…
Pressure sensing technologies have the advantage of obtaining the center of pressure. The center of pressure (COP) is defined by measuring the mean position of pressure distribution on the planar surface of the pressure mat. The COP of both feet are not going to be the same when we stand on the pressure mat and…
Balance control is a complicated process, which involves multiple systems such as the vestibular system, motor system. A lot of factors can cause imbalance but the underlying connections between the factors and imbalance are not well researched. We approach to reveal the primary factors and their connections to balance by analyzing the parameters that we…