Recently, the importance of Driver Monitoring Systems (DMS) and Occupant Monitoring Systems (OMS) are well recognized when it comes to autonomous driving (AD) because the driver is still responsible for driving under certain conditions up to Level 3. Moreover, DMS is playing an important role for carmakers to get a 5-star safety award in Euro-NCAP written in its Roadmap 2025 and already used in its 2020 rating. The European Union is to mandate DMS for new models by 2022, and other regions are expected to follow. Similarly, mandated OMS features like child presence when leaving the car are imminent for North America and Europe (i.e., 5-star on 2022 Euro-NCAP).
One of the important market trends for DMS and OMS is the RGB-IR sensor, which consists of an RGB sensor and an IR one where color image and IR image can be outputted. IR is very important since there is less illumination inside vehicles at night. An IR image can detect the driver status under bad conditions for the RGB sensor. That’s why RGB-IR can take advantage of both RGB and IR.
In order to meet such a market trend, Renesas is committed to DMS and OMS leveraging our partners. Our R-Car series offers an innovative scalable solution for a standalone DMS and OMS or integration along other ADAS applications (front camera or surround-view system). Especially R-Car V3M and V3H include state-of-the-art computer vision and deep learning processing that can be used for face detection and identification, gesture detection, and classification enabling all DMS/OMS features, also state-of-the-art functional safety and security with efficient and low power.
From the feature point of view, R-Car V3M and V3H can support face detection and features (eyes, gaze, recognition, head 3D position), hands detection (hands position, gesture detection), status, distraction and alertness (drowsiness, emotion, phone usage, alcohol or substance influence), occupants detection (occupancy count and positions, seat belts status) and occupants classification (age, gender, child left behind).
Click here to get more information about R-Car V3M/V3H
R-Car DMS/OMS application