Fraunhofer Representative Office Beijing
How drivers and cars understand each other

© Fraunhofer IOSB/Zensch
A vision model processes visual data on request. The researchers work on extracting relevant information from the image and provid-ing it as context to different functions of the car, such as AI-assistants and safety systems.

Optimizing communication between vehicle and driver as a function of the degree of automation is the objective of a research project conducted by Fraunhofer in collaboration with other companies. The researchers are combining sensors for monitoring the vehicle interior with language models to form what are known as vision language models. They are designed to increase the convenience and safety of cars in the future.