Replication of On-Site Environments Using Mixed RealityVirtual Control Room for Training

As field engineers are aging, there are numerous challenges in passing on their expertise to younger workers. Especially in recent years, as the COVID-19 pandemic has made it difficult to pass on skills or expertise, let alone work on-site. Furthermore, in terms of maintenance and management, the need to physically visit sites for environmental checks consumes valuable time and impacts operational efficiency.

To address these issues, we have conducted research and developed a “Virtual Control Room for Training” that replicates conditions at distant sites. This system allows engineers to confirm the issues without having to physically visit the sites. It also makes on-site simulation and skill transfer much easier by enabling engineers to operate virtual control panels and switches through a proprietary program.

The image above represents a display seen within Microsoft’s HoloLens2 Mixed Reality Headset (HoloLens is a registered trademark of Microsoft Corp). With this headset, users can not only check the on-site situation but also interact with holographic equipment. Moreover, a dedicated proprietary program incorporated into HoloLens2 reproduces the equipment’s behavior following user operations, including the response times.

In addition to HoloLens2, we offer a wide variety of mixed reality devices suitable for the needs of individual customers.
We will also improve the performance of 3D models to make the experience more realistic.