T04 TwinCam: Omnidirectional real-time stereoscopic telepresence system

Graduate School of System Design, Tokyo Metropolitan University / NTT Communication Science Laboratories / University of Electro-Communications / Toyohashi University of Technology

Technical details

　TwinCam is a telepresence system that transmits omnidirectional stereoscopic images from a distance in real time and presents them to the head mounted display (HMD) in accordance with the observer's head movement. The two omnidirectional cameras (THETA, Ricoh Co.Ltd.) were arranged at the same interval as the interpupil distance (64 mm) and rotated to the angle of the HMD while keeping the azimuth of the optical axis of the lens constant. We realized simultaneous suppression of the motion blur of the image and the apparent delay of the remote image by this unique camera design. It was effective in reducing the VR sickness during the observation of stereoscopic delayed remote image.
　This basic idea has already been applied for a patent, and also evaluated by PCT international application in items of originality, advancement, and industrial applicability showing that it is an unprecedented design.

Movies

Exhibition content

　TwinCam is a telepresence system that transmits omnidirectional stereoscopic images from a distance in real time and presents them to the head mounted display in accordance with the observer's head movement. The omnidirectional stereoscopic view with binocular disparity has not been realized practically before our design that enables suppression of motion blur and apparent delay of the remote image that are essential to reduce VR sickness. In this exhibition, we will provide a remote image experience captured by TwinCam.