Mercedes Driver Gesture Recognition (MBUX)

Mercedes-Benz User Experience or MBUX feature highlights

  • Revolutionizing the interaction between drivers and cars
  • An intelligent system for a more personalized user experience
  • next-generation infotainment systems inside the car
  • improvised auto-suggestion features and searches
  • ultimate hands-free distraction less driving experience

About Intelligent system

An intelligent learning system adapts to the requirements of users, remembering details such as the seat and steering wheel settings, lights, and other comfort features. The MBUX system’s most notable highlight is the next-gen AI infotainment system within the car. The new infotainment system aims to use AI to adapt itself to drivers and passengers — automatically suggesting your favorite music for your drive home, or offering directions to a favorite restaurant at dinner time. It’s also one that will benefit from “over-the-air” updates delivering new features and capabilities.

Fast Code’s contribution

Mercedes-Benz aims to reduce driver distractedness by making everything as hands-free as possible. Further examples of this natural style of interaction include menu control via gestures or handwriting recognition, whereby the user traces a finger over the display on the head unit. Fast Code championed gesture recognition technology which used Computer Vision to identify different types of gestures between the driver and passenger.

Futuristic perspective

The future operations will also be even more intuitive in the future, with voice control covering most functions, supported by gestures and touch. In the medium term, it will be possible to dictate text messages and e-mails or to call up messages in this way. This will involve speaking a headline or, in the case of so-called "free" voice browsing, a specific question.