I am sure that my colleague José Manuel González, responsible for the Muy Interesante Motor Blog, will reel off the new Mercedes S-Class in an exceptional way. But I am going to venture to describe some of the technological and intelligent characteristics that make this new vehicle of the Teutonic firm the most advanced and innovative of the moment, also including important novelties in its voice system developed with artificial intelligence (AI), its MBUX (Mercedes-Benz User Experience).
It has been two years since I had the opportunity to test the first MBUX intelligent system that Mercedes included in its A-Class, but now it announces it with important advances and new innovations in the newly introduced vehicle. We will have the opportunity to test it in the near future to see the advances in natural language processing, especially in Spanish, something that worked regularly a few months ago. But before that I do want to reel off some of the technical advances with AI that Mercedes has put into the new S-Class.
Second generation MBUX
We have already said that it incorporates the second generation of MBUX. The new version represents a new milestone in the development of this interface between the driver, the other occupants of the vehicle and the car. The cabin equips up to five screens, some of them with OLED technology. At the push of a button, the new 3D driver viewer makes spatial perception of the scene possible for the first time, with true depth effect based on Eye-Tracking. No less impressive is the Head-up-Display, especially wide format, with augmented reality content. For example, during guidance of the navigation system, animated turning arrows are displayed, virtually overlapping with great precision the actual view of the roadway.
The MBUX interior assistant uses cameras installed in the overhead control unit and learning algorithms to recognize many driving wishes of the driver. This assistant interprets the orientation of the occupant’s head, the movements of their hands and their body gestures, and reacts by activating the corresponding functions of the vehicle. If the driver looks back over his shoulder, the MBUX interior assistant automatically opens the sun blind on the rear window. Active ambient lighting, with about 250 LEDs in total, is integrated into the driver assistance systems and can underline your warnings with visual elements. Added to this is the visual confirmation of certain actions to control the air conditioning, or the “Hey Mercedes” voice control system.
Personalization and voice print
The latest generation of the standard equipment driving assistance package incorporates many new or improved functions. The new assistance screen in the driver’s display shows the operation of the driving assistance systems in an understandable and transparent way in full screen. In its new generation, “Hey Mercedes” is also capable of recognizing the voice of the various occupants, also known as a voice print. The system learns the individual attributes of the voice and can use them for authentication and to activate a profile. In this way it is possible to access the user’s personal data and functions. Voice recognition is carried out in real time using a special authentication procedure.
Hey Mercedes now supports 27 languages with Natural Language Understanding (NLU), and the cockpit is more digital and smarter as both the hardware and software have undergone a quantum leap. Up to five large-format displays make it easy to control vehicle and comfort functions with brilliant images. The customization possibilities and intuitive handling have been greatly increased. Not only for the rear seats, but also for the driver. At the push of a button, the new 3D driver viewer allows for the first time spatial perception of the scene, based on Eye-Tracking. The three-dimensional effect and depth of viewing are achieved without the need for special 3D glasses.
Augmented reality
As an option, two different versions of the Head-up-Display (HUD) are offered. The larger format HUD offers augmented reality (AR) content. For example, during guidance of the navigation system, animated turning arrows are displayed, virtually overlapping with great precision in view of the roadway. In connection with the assistance functions, other information is displayed, such as the data of the active distance assistant. The virtual image appears suspended in the air, at a distance of approximately 10 meters. The display surface is equivalent to that of a monitor with a 77-inch diagonal.
It is possible to extend the dialogue and learning ability of the “Hey Mercedes” voice assistant by activating the online services in the Mercedes me App. Furthermore, certain actions can now be initiated without having to speak the keywords “Hey Mercedes”. For example, answering a phone call. “Hey Mercedes” also explains the functions of the vehicle and answers general knowledge questions. In the new S-Class, the voice assistant can also be operated from the rear seats.
Algorithms with learning capacity
The MBUX interior assistant now uses cameras installed in the rooftop control unit and learning-capable algorithms to recognize many driving wishes of the driver. This assistant interprets the orientation of the occupant’s head, the movements of their hands and their body gestures, and reacts by activating the corresponding functions of the vehicle. The MBUX interior assistant not only offers more operating comfort, but also assists in the field of safety. For example, if the camera has recognized a child seat on the passenger side, the system may realize that the driver has not fastened the corresponding seat belt and reminds him of the need to do so.
With the MBUX Smart Home function, the S-Class can become the control center for your own home. Mobile intelligence allows you to enjoy very high comfort, also from a distance. Many people today implement smart technologies in their homes. Wi-Fi networks and modern sensors increase the communication capacity of the home under the generic concept “Smart Home”. It is thus possible to remotely monitor the temperature and lighting, or the position of the blinds, and connect some electrical appliances remotely. The motion detectors and contacts in the windows inform about possible visits, both wanted and unwanted.
