This evening the students in my graduate computer graphics class showed their final projects. It was quite unlike anything I have ever seen. The projects were group experiences, with every participant wearing an Oculus Quest VR headset. With the help of WebVR software our research team had provided, the students created shared amazing interactive shared…
One of the most frequent complaints I hear about developing for the Quest is: I have to confirm the guardian every time I put on my headset – and this can be many times during a coding session. If you’ve always wanted to disable these notifications, you’re in luck. With the latest firmware installed on…
I have been playing with Pytorch recently and found out that Pytorch is a much easier tool for me to start a machine learning project than Tensorflow. Pytorch uses a different design with Tensorflow and does not need to setup sessions or placeholders, so I feel the setup of Pytorch models is more intuitive. Pytorch’s…
Today at the start of my graduate graphics class we showed a VR metaroom demo with multiple people in the classroom wearing Quest VR headsets, holding controllers and collaborating over WebVR. We made it even more interesting by having the entire scene — the room with all of its furniture and the avatars of all…
For a project during my masters degree, we implemented the paper Learning to Generate Chairs by Dosovitskiy et. al. in PyTorch. The only implementation available was the author’s in Caffe with Lua, so we set off to create a clean open source implementation of the work. This work presents an early differentiable renderer using convolutional…
1.This week I found a paper, SDM-NET: Deep Generative Network for Structured Deformable Mesh. Their main idea is to decompose a 3D object into parts. And each part can be deformed from a homeomorphic simple object. Their network can also learn the support and symmetry information from the input. The part structures and geometries are…
This week I setup a 15-meter walkway in the lab for the obstacle experiment in walking paradigm. I chose to use Vive pro with a wireless adapter to accomplish a wireless VR experience. Compared with Oculus Quest, the wireless Vive pro is much heavier, and it is still constrained by the coverage of Lighthouses and…
I started an experiment if it’s possible to take a screenshot of a camera that takes a screenshot of what the camera is seeing which then is rendered to a photograph in virtual reality. Although I expected the performance wouldn’t be too well since it’s using the Oculus Quest, but it turned out it worked…
This last week or so I’ve been building a parallel world. I measured all of the sizes in a section of our lab — walls, floors, tables, and so forth. Then I built a computer graphic copy of that world, matching the real thing down to the centimeter. I can walk around in my parallel…
Over the years, I’ve work on a side project – a C++ OpenGL rendering engine that I use as a staging ground for experiments with procedural generation. One feature I had particularly had fun implementing, was adding heightmap rendering, with a node based graph built ontop of DearImGUI, with a mask painter alongside (the effects…