Zhenyi He

This is the first blog posted when I officially came back to the lab! So excited that now I can talk about the detail of the ongoing project. The lab has been working on bringing Chalktalk to immersive environment for a while, and a lot of different devices has been involved in, like Vive, Oculus

Sketch based creation is always charming to me, like chalktalk, like autodraw. They are showing the potential to turn a static 2D image or just lines into a vivid volume. Once deep learning is being used universally, people have more approaches to apply the detection of 2D drawing. Weeks ago when we were in SIGGRAPH

“All of these ideas are simple, The problem is making them simple” “It’s not because I am a smart person. It’s because I have smart friends” — Ivan Edward Sutherland — Father of Computer Graphics Feel so lucky to be there, facing the legend, listening to the old story, imaging how ideas came up 50 years

Time to share a new paper 😉 (I have to say it is quite annoying that I cannot just share what I’ve done during the interval because the idea is still ongoing.) Today I wanna talk about the idea “Online Optical Marker-based Hand Tracking with Deep Labels”, which is a hand tracking system based on

Deep learning is everywhere now. Sometimes I felt if a topic does not include that term, it must be out of date (or maybe too novel to some extent ;-). That fact strongly stops me from learning it because if it is universal to the whole crowd, it is not that distinguished to me, until

Recently I got a chance to do something with a fisheye camera. Long time ago when I was trying to make some videos seen through ARGlasses, I built an AR-Rift based on the first version of Oculus Rift, following the instructions of AR-Rift online. I bet we can still find that early version of video

Today I wanna discuss a classic topic: Calibration. I was doing stereo camera calibration for making a sketchy AR Rift four years ago. I tried to calibrate the first version of Leap Motion with usb camera three years ago. I did a rough calibration between OptiTrack and HTC Vive one year ago. And I spent

As a routine, first we should comment on the previous post to make the post recursive (and then eventually overflow the stack). It is really good timing for us to work on possible realities now. I don’t have to explain what is virtual reality or augmented reality to my friends. I no longer need to