Mercedes In-Car Cameras: Privacy And Safety Concerns

Mercedes-Benz has various in-car camera features, including in-car traffic cameras, dashcams, and 360-degree cameras. The 2024 Mercedes E-Class, for example, has five interior cameras that improve driver safety and passenger comfort. The Mono Driver Camera, the only standard camera, is situated at the top of the instrument panel and enables the vehicle to recognize the driver. The car manufacturer also offers a traffic camera feature within their mbrace2 “Mercedes-Benz Apps” package, which provides drivers with live traffic snapshots. Additionally, certain Mercedes-Benz models are available with dashcam functionality, which can be useful in the event of a crash or for insurance purposes.

The 2024 Mercedes E-Class has five interior cameras

• Mono Driver Camera: The mono driver camera is standard on the E-Class and is located at the top of the instrument panel. It enables the vehicle to recognise and identify the driver. It also includes a safety feature that detects if the driver is not focusing on the road and dims the passenger screen to reduce distractions. This system has been tested by Mercedes, even at night, using infrared technology.
• Stereo Driver Camera: This is an upgraded version of the mono driver camera, positioned in the 3D driver display. It includes additional features such as pre-adjustment of exterior mirrors, enhanced Attention Assist, and a 3D driver display. The stereo camera monitors the driver for signs of fatigue or inattentiveness, detecting microsleep and issuing warnings. If the driver does not respond, the E-Class can initiate an emergency stop, unlock the doors, and contact emergency services.
• Infrared Gesture Cameras: Two infrared gesture cameras are located on the overhead control panel and are part of the MBUX Interior Assistant. These cameras are for the driver and front passenger, supporting the onboard gesture system. The system can interpret natural hand, head, and body movements to anticipate and respond to the occupants' needs.
• Selfie and Video Camera: This optional camera is part of the MBUX Superscreen and is located on the dashboard. It allows the driver to take photos or videos and can be used for video conferencing when the car is stationary.
• RGB Dash Camera: The RGB dash camera is located behind the rearview mirror and is used for Augmented Reality navigation. It superimposes graphics, directional assistance, and traffic information onto a live feed, making it easier for drivers to follow routes, especially at night or on unfamiliar roads.

While some of these camera features may be considered gimmicky, they showcase Mercedes' continued integration of cutting-edge technology into their vehicles, prioritising both safety and convenience.

The mono driver camera enables the vehicle to recognise the driver

The mono driver camera is situated at the top of the instrument panel and is the only camera that comes as standard in the 2024 Mercedes E-Class. This camera enables the vehicle to recognize and identify the driver. It includes a safety system that, when fitted with the optional passenger display, can sense whether the driver is not focusing and dim the passenger screen to reduce driver distraction. This means the passenger can continue streaming content without distracting the person behind the wheel.

The mono driver camera uses infrared technology, so the system works even at night. Mercedes has verified the safety system through extensive trials with test subjects. The passenger display only works when someone is seated next to the driver. When the passenger side is unoccupied, the screen displays a digital decorative panel with customizable motifs.

The mono driver camera can be upgraded to a stereo driver camera, which is positioned in the 3D driver display. This camera has the same functions as the mono driver camera but adds pre-adjustment of the exterior mirrors, enhanced Attention Assist, and the 3D driver display. The stereo camera monitors the driver for signs of fatigue or inattentiveness and can detect microsleep. If the driver is not focusing on the road ahead, the system will issue a series of acoustic and visual alerts. If the driver still does not pay attention, an uninterrupted tone will sound, and the car will prepare for an emergency stop, unlock the doors, and contact emergency services.

The stereo driver camera monitors the driver for signs of fatigue

The 2024 Mercedes E-Class comes with a standard mono driver camera, which enables the vehicle to recognize the driver and includes a safety system that can sense if the driver is not focusing on the road. This safety system can then dim the passenger screen to reduce distractions.

The mono driver camera can be upgraded to a stereo driver camera, which is positioned in the 3D driver display. This camera serves the same purpose as the mono driver camera but adds pre-adjustment of the exterior mirrors, enhanced Attention Assist, and the 3D driver display.

The stereo driver camera, in conjunction with Attention Assist, can monitor the driver for signs of fatigue or inattentiveness. The system can detect microsleep and issue a warning to the driver. If the driver's eyes are not focused on the road, a series of acoustic and visual alerts will sound. If the driver continues to be inattentive, an uninterrupted tone will sound, and the car will prepare for an emergency stop, unlock the doors, and contact emergency services.

The stereo driver camera is an important feature of the Mercedes E-Class, as it enhances driver safety by helping to prevent accidents caused by driver fatigue or inattentiveness.

The MBUX Interior Assistant can read occupant body language

The MBUX Interior Assistant is a feature of the Mercedes-Benz MBUX infotainment system that uses 3D laser cameras in the overhead control panel to detect the movements and body language of the driver and front passenger. It can interpret "natural hand, head, and body movements contextually" and respond with appropriate vehicle functions. This allows for a more seamless and intuitive interaction with the vehicle, enhancing both comfort and safety.

The MBUX Interior Assistant can recognise and respond to the natural body language of the driver and front passenger in several ways. For example, it can switch the reading light on or off when a hand is moved up and down vertically under the inside rearview mirror. It can also detect a child seat on the front passenger seat and signal on the central display if the seat belt is not buckled. In addition, if the vehicle exit warning of Blind Spot Assist is activated and a hand approaches the door handle, the system will issue a warning.

The MBUX system uses artificial intelligence to proactively display relevant functions for the user, depending on the situation and context. This "zero-layer" design eliminates the need for scrolling through submenus or giving voice commands, as key applications are always offered on the top level in the field of vision. The system constantly optimises its context-sensitive awareness based on changes in the surroundings and user behaviour.

The MBUX Interior Assistant also works in conjunction with the "Hey Mercedes" voice assistant, which has been enhanced to recognise vehicle occupants by their voices. Once the individual characteristics of a voice are learned, the system can access personal data and functions by activating a profile. This allows for a more personalised experience, with favourite radio stations, preselected settings, and other preferences available across different Mercedes-Benz vehicles with the new MBUX generation.

The 360-degree camera system helps with parking and manoeuvring

The 360-degree camera system is an emerging technology that provides drivers with a comprehensive view of their surroundings, making parking and manoeuvring safer and more convenient. This system, also known as a bird's eye view, top-down, surround, or around-view camera, combines feeds from multiple cameras positioned around the vehicle to create a holistic image displayed on the infotainment screen.

The 360-degree camera system in Mercedes-Benz vehicles offers a high-resolution, seamless view of the car's exterior. With this system, drivers can easily adjust the camera angle to check for obstacles and ensure their vehicle is parked within the guidelines. The system is designed to help prevent bumps and scrapes, saving drivers from the frustration and cost of minor accidents.

The camera setup typically includes cameras on the front and rear bumpers and under the side mirrors, with higher-end models utilising additional cameras for a more accurate perspective. The software stitches together the footage from these cameras to provide a real-time, bird's-eye view of the surrounding area.

In addition to its practical benefits, the 360-degree camera system can also be a fun feature for drivers. Some modern cars allow users to manually adjust the camera angle using the touchscreen, providing a unique perspective of their vehicle and its surroundings.

While the 360-degree camera system is a valuable tool for parking and manoeuvring, it is important to note that it is typically an optional extra on most vehicles. However, with its ability to enhance safety and provide peace of mind, it is a feature that many drivers may find appealing and worth the investment.

Frequently asked questions