1. Research on Recording and Reproduction of Acoustic Realism (Master’s Thesis in Japanese)

This is a master’s thesis that summarizes my research on the application of spatial(3D) sound to virtual reality, which I conducted during my time in the Hirose Laboratory at the University of Tokyo.

I wrote my master’s thesis in Japanese in 1994, and I am currently working on translating it into English.

Conceptual diagram of acoustic presence recording and playback system Conceptual diagram of acoustic presence recording and playback system

2. Demonstration of ‘mocopi’ device as angular (IMU) sensor w/o Sony’s SDK.

3. Pseudo-3D display using a hemispherical display (in Japanese)

This article summarizes how to develop a pseudo-3D display Unity program using the hemispherical display type WORLDEYE from Gakken and a depth sensor (RealSense D435).

Overall configuration of the pseudo-3D display system

4. Making Oculus Go 6DoF with RealSense T265

Although RealSense products are incompatible with Android, I made a 6DoF version of Oculus Go HMD using V-SLAM device (RealSense T265) by modifying the Intel Realsense SDK.

Click here for slides in Japanese.

6DoF Oculus Go 6DoF Oculus Go

5. Classical Ray-Tracing renderer porting to C# code running on Unity Engine

I ported the ray-tracing rendering engine I developed in the 1980s to the C# language and tried to draw computer graphics on the Unity engine.

At the time, the program implemented the following cutting-edge technologies.

  • An accelerated ray tracing technique using a binary tree-based spatial decomposition method.
  • Curved Surface Modeling Technology Using Metaball Technology.
  • Development of Floating-Point Optimized Compilation Technology for Motorola 68020 MPU.

Here is the Github repository.

Example of a robot model rendered by ray tracing.
Example of a robot model rendered by ray tracing.

Example of a metaballs rendered by ray tracing.

6. Ray tracing rendering system that supports Looking Glass.

I developed a Unity program so that images drawn by the ray tracing engine ported in the fourth section can be viewed on the Looking Glass three-dimensional display.

7. Looking Glass Free Viewpoint Viewer

At AWE USA 2019, I exhibited a viewer that allows users to lift the Looking Glass to view 3D objects from any perspective.

This Viewer program displays the image drawn in real time by Unity program on Looking Glass based on the position of Looking Glass 3D display device measured by V-SLAM device (RealSense T265).