Toyota and Microsoft are tagging!
Streamlining vehicle maintenance with AR Toyota Motor Corp. has teamed up with Microsoft to develop a system that streamlines vehicle maintenance work using augmented reality (AR)
It will be introduced on a trial basis at some dealers from October.
Using Microsoft’s MR Holorens 2, the information required for maintenance is displayed in space.
Workers can search and browse information without blocking their hands, improving work efficiency.
It will be introduced in all 60 sports car exclusive stores “GR Garage” by December.
The new system consists of a terminal and an independently developed application (application software).
The system is lent to dealers free of charge and technical verification is carried out for one year. Identify issues and points for improvement by operating in a physical store, and lead to the sophistication of the system.
An application was created based on the vehicle’s three-dimensional (3D) design data.
When the terminal is attached, vehicle information and work items are displayed in the space.
In addition to being able to perform touch operations in space, it also supports operations using eyes and voice.
Parts and internal wiring of each part that cannot be seen from the outside can be reproduced as a hologram by superimposing it on the actual vehicle.
New switch
90% reduction in man-hours by utilizing Toyota, HoloLens 2 etc.
Toyota is actively working on the utilization of Microsoft’s MR device “HoloLens 2”.
The company’s MR introduction example,
Use of HoloLens,
Utilization of game engine Unity
I will introduce it from the viewpoint.
Import CAD data
In order to work with 3D models of automobiles in virtual space, you first need to import CAD data.
Toyota uses Unity’s Pixyz for this process.
Convert to 3D graphics content
We are converting a large amount of CAD data into content suitable for real-time 3D graphics.
Improving the Design Review Process Using Fluid Analysis Fluid Analysis (CFD) was a very tedious process that was necessary for design review.
Use HoloLens 2
But with HoloLens 2, you can superimpose a flow image on top of your car in real time.
Design review
Participants can also use HoloLens 2 to share what they see with each other and collaborate on the review process.
A better understanding of how the vehicle works
After the assembly process is complete, it is difficult to explain the structure of the invisible part inside the car body, especially the mechanism when the car is moving. With MR, you can safely and easily show the inside of the driving body.
Error found by machine learning
Vehicle inspection through HoloLens 2
Detect mistakes that are often overlooked in normal vehicle inspection by looking at the vehicle through HoloLens 2. A mechanism for early detection has been created.
Machine learning is used to develop this function, but in the past it was necessary to use 20,000 photos and point to the relevant part in about 200 hours in order to learn the pattern of mistakes.
Introduced Unity Achieved tagging
Achieves automatic image shooting and necessary tagging.
Images labeled on mistakes can now be aligned in just 30 minutes.
Field service efficiency
One of the points of car maintenance is whether the wiring is done correctly.
However, it takes a lot of time and effort to correctly grasp the internal wiring structure after the car body is completed.
Toyota also visualizes this wiring structure with MR so that field service mechanics can understand the wiring system without the hassle of removing parts.
Mogura VR