Then, Now and the
Future of the Car Cockpit

January 2019

1

15%

Introduction
As we enter the era of advanced driver-assisted systems (ADAS) and head toward autonomousvehicles, technology continues to transform the automobile cockpit. Vehicles today use technology
and features only science fictions writers might have dreamt up just a few years ago. And as thedigital revolution continues, Arm experts expect vehicle interiors to change more in the next ten
years than they have in the past 50 years.
For decades, Arm architecture has been a key enabler of automotive technology, with more than85 percent of infotainment systems and many under-the-hood applications powered by Arm-based
chips. To highlight how dramatically cockpit technology has changed in the past few decades, here’s
an overview of technology hotspots in cockpits of the past, present, and future.

85%

of car infotainment
systems powered
by Arm-based chips

2

The Instrument Cluster
Past

Present

FutureDigital speedometers arrived in the late 1970s as options, orHigh-end and premium vehicles often use full-color thin-film-

The number of displays in the cockpit have significantly

as standard in some luxury brands. Due to reliability and visibility

transistor (TFT) liquid crystal displays (LCD) in digital clusters

increased, and all vehicle instrument clusters are digital. Vehicle

issues, however, adoption was limited and most instrument

to provide a signature user experience. The cluster electronic

manufacturers include the instrument cluster application as partclusters remained back-lit analog gauges driven by stepper

control unit must have safety mechanisms to correctly displayof the digital cockpit domain controller alongside multiple mixed-

motors designed specifically for pointer control.

safety relevant content (tell-tales), and more safety information is

criticality workloads on the same electronic control unit.

shown to the driver through advanced driver-assistance system
In the early 1990s, the Driver Information Center (DIC) with

(ADAS) features.

an integrated LCD display became a more common feature

Increasingly, car makers are able to differentiate their brandand provide a signature user experience, while dynamicallyin the instrument cluster. The DIC communicated important

In-Vehicle Infotainment (IVI) system features, such as navigation,

information about the vehicle, but were only offered byaudio, and telephony data, are often integrated into the digitala few vehicle manufacturers.

cluster. Here, dynamically reconfigurable clusters let the driverreconfigurable clusters allow the driver to personalize the UI.

personalize the user interface (UI). Some vehicle manufacturers
integrate the instrument cluster application into a digital cockpit
domain controller alongside other workloads on a mixedcriticality platform.

Compute Requirements

Compute Requirements

Compute Requirements

A microcontroller drove the stepper motors for gauges

An application processor with an integrated 3D-graphics engine

An application processor with integrated 3D-graphics engine

and the DIC.

supports a rich 3D user experience. An instrument cluster

supports a rich 3D user-experience. An Instrument cluster ECU

electronic control unit typically has an ISO 26262 Automotive

typically has ISO 26262 Automotive Safety Integrity Level (ASIL).

Safety Integrity Level (ASIL) B requirement.

Arm Solution

Arm Solution

Not applicable.

Cortex-A, Mali GPU, Mali DPU.

Arm Solution

Cortex-A

Mali GPUMali DPU
3

Heads-Ups Display (HUD)
Past

Present

FutureAs early as 1988, some vehicle manufacturers were producing

For several years, HUDs have been common in premium vehicles,

Augmented reality HUDs (AR-HUD) are common, and vehicle

limited-capability, monochromatic HUDs to present data in aand include speedometer, tachometer, and navigation aids.

manufacturers see them as a way to help drivers build trust in

way that didn’t force the driver to look away from the usual

Some vehicle manufacturers offer integrated night vision sensor

new ADAS and automated driving features. AR-HUDs offer

viewpoint.

systems that also are displayed on the HUD.

enhanced vision systems by integrating advanced driver-assist

Offered as optional, these HUDs displayed a digital speedometer

In addition, there are many aftermarket HUD solutions available

aids and lane-keep assist alerts, in real time. These are displayedon the windshield, but were widely regarded as more of atoday. These are typically integrated into the same electronic

on a large portion of the windscreen.

novelty, and did not gain huge acceptance.

control unit as the digital instrument cluster application. Somesystems (ADAS) with autonomous features, such as navigation

vehicle manufacturers have started to integrate the HUD

Safety-relevant content is rendered in real time with low latency.

application into a digital cockpit domain controller alongside

ADAS visual alerts on larger AR-HUD displays require headother workloads on a mixed-criticality platform.

or eye tracking and image distortion correction. Holographic
projection is becoming increasingly available.

Compute Requirements

Compute Requirements

Compute Requirements

A microcontroller-based electronic control unit was used to drive

A microcontroller-based electronic control unit with graphics-

An application processor with an integrated 3D-graphics engine

the heads-up display.

generating IP drives a simple HUD display, and an application

supports a rich 3D user-experience.

processor with integrated 3D graphics engine supports a rich
3D user experience.

Arm Solution

Arm Solution

Arm Solution

Not applicable.

Cortex-A

Mali GPUMali DPU

4

Center Stack/Head Unit
Past

Present

FutureSome premium vehicle designs had console display units with

Modern mobile phone electronics with touchscreen UIs have

The cockpit now has one seamless widescreen display of multiple

small digital displays. Console display units typically provided

influenced IVI technology in many ways. Vehicle manufacturers

high-resolution screens. Safety continues to be a main focus asdual-zone automatic climate controls, but the majority of vehicles

offer the latest infotainment features in a standard center display,relevant driver Information is collected, prioritized, and instantly

used rotary dials, knobs and switches.

while some premium vehicles offer multiple displays with thepresented. ADAS features provide additional data, and sensor

latest smartphone app integration and wireless charging pads.

imagery is augmented with detected objects to aid driver vision.

Furthermore, some premium vehicles offer a center display

A configurable digital UI is integrated into the center console andwith a touchscreen interface for features such as seat position,

has touchscreen controls. Services and applications are provided

media playback, and climate controls. Premium vehicles also areusing native Android or iOS IVI systems.

designed with an integrated SIM card and offer services such as
WiFi connectivity, real-time traffic information, and intelligent

Advanced artificial intelligence (AI) models learn driver

voice assist.

preferences and can display information accordingly, as wellas adjust menu structures. Driver personalization settings with

In some vehicles, smartphone projection solutions takebiometric authentication allow the driver and passengers toadvantage of mobile phone apps to project on the center display.

transfer their customized display profiles and preferences

Drivers can customize menu preferences, seat positions, and sofrom vehicle to vehicle.

on, and save those settings to a specific user profile.

Compute Requirements

Compute Requirements

Compute Requirements

A microcontroller-based electronic control unit processed

Premium vehicles require a multi-CPU Systems-on-Chip (SoC)

Premium vehicles require a multi-CPU SoC with multiple GPUs

center stack control inputs and drive servos for climate control.

with a graphics processing unit (GPU). The platform runs anfor high-resolution center console displays. The platform runs an

RTOS or general-purpose OS (Linux and Android) and a center

RTOS or general-purpose OS (Linux and Android) to provide

display user interface.

a user interface with multiple displays.

Arm Solution

Arm Solution

Arm Solution

Cortex-M.

Cortex M, Cortex A, Arm Mali GPU, DPU, Arm CryptoCell,

Cortex M, Cortex A, Arm Mali GPU, DPU, Arm CryptoCell,

Arm TrustZone.

Arm TrustZone.

5

Sideview Mirror
Past

Present

FutureMirror positions could be adjusted with simple electrical motor

Sideview mirror positions are adjustable with motor controls,

The physical sideview mirror has completely gone, and vehicle

controls to give the driver the best possible view.

and multiple driver mirror positions can be saved as a profile on

manufacturers integrate a digital sideview mirror application into

the key fob. Some vehicles manufacturers install auto-dimminga digital cockpit domain controller. High dynamic range cameras

sideview mirrors with electrochromic technology.

around the vehicle use augmented reality (AR) overlays to alert
for detected objects and send blind-spot warnings. These blind-

Additional safety features include sideview mirrors with sensors

spot warnings alert the driver by audio, on the instrument cluster,for blind spot object detection and in-mirror alerts.

and via the HUD.

Compute Requirements

Compute Requirements

Compute Requirements

A simple microcontroller was used to control both left and right

Radar proximity sensors on each side of the vehicle provide

Radar sensors and camera video process blind-spot object

mirror positions.

data for real-time object detection, and the driver is immediately

detection, while left and right sideview video with detectedalerted to detected objects. Sideview mirrors with ADAS features

object overlays are displayed. This requires a multi-CPU

have an ISO26262 Automotive Safety Integrity Level (ASIL) B

application processor with integrated image signal processor (ISP)safety requirement.

and 3D-graphics engine with a software stack for real-time safe
application rendering and display. A sideview mirror system has
a min ISO 26262 Automotive Safety Integrity Level (ASIL)
B requirement.

Arm Solution

Arm Solution

Arm Solution

Cortex-M.

Cortex-M.

Cortex-A, Mali ISP, Mali GPU, Mali DPU.

6

Rearview Mirror
Past

Present

FutureAnti-glare rearview mirrors (sometimes referred to as day/Automatically dimming rearview mirrors detect glare and dim

Rearview mirrors have become intelligent displays for somenight mirrors) were standard equipment, designed to reducethe mirror to protect the driver’s vision. Some rearview mirrors

vehicle manufacturers, while others choose to integrate the rear-

the brightness and glare of high-beam headlights from vehicles

incorporate camera displays when the vehicle is in reverse toand sideview display on the console.

approaching from behind. These day/night rearview mirrors wereincrease driver visibility. Intelligent rearview camera displays inmanually operated by using a lever to change the mode. Aroundthe center console have started to replace or augment mirrors,

Quality 360-degree, high-dynamic range (HDR) cameras are

1990, some early automatic-dimming rearview mirrors werewith cameras mounted on the bumper to give the driver ancommonplace and combine a camera sensor with image-installed on certain vehicles.

unobstructed rearview display.

processing capabilities for picture clarity with minimal glare andlighting artifacts, even from main-beam headlights. Vehicles

The rearview mirror location also is used for microphonewith ADAS features use augmented reality (AR) overlays to alert

integration to support hands-free, voice recognition, anddrivers to detected objects.

a telematics communication unit (TCU). A TCU provides manysafety and security features supported by using GPS to pinpoint
the car’s location. These features include: emergency vehicle
response in the event of an accident, stolen-vehicle assistance,
remote door unlock, navigation assistance, and many more.
Increasingly, the area behind the rearview mirror also is used forlane departure warning systems.

Compute Requirements

Compute Requirements

Compute Requirements

An 8/16-bit MCU is used for automatic-dimming electronics.

A 16/32-bit MCU supports automatic-dimming electronics,

A 16/32-bit MCU is required to drive rear view camera intelligent

and a 16/32-bit MCU drives the rearview camera safety display

safety display with dynamic parking guidelines. This is an ISO

with dynamic parking guidelines. This is an ISO 26262 ASIL

26262 ASIL B safety requirement. The TCU requires a 32-bit

B safety requirement. The TCU uses a 32-bit MCU for mobile

MCU for mobile communication to centralized services.

communication to a centralized service.

Arm Solution

Arm Solution

Arm Solution

Cortex-M.

Cortex-M.

Cortex A, Mali ISP, Mali GPU, Mali DPU.

7

Driver/Cabin Monitoring
Past

Present

FutureCabin monitoring systems were not deployed by vehicle

Active real-time driver monitoring (DM) systems use sensors

ADAS and autonomous vehicle features will become very

manufacturers until recently. Some after-market camerain the steering wheel or an inward facing camera to track drivercommon in most vehicles. Active real-time driver monitoring

recording devices were available in the early 90s.

alertness and help ensure the driver stays engaged duringsystems continue to provide a vital safety feature for transfer

vehicle operation. This safety feature alerts the driver to signsof control to the driver as needed.

of drowsiness or distraction, and is crucial for vehicles with semiautonomous/ADAS driving features.
The DM system prompts the driver repeatedly, via visual andaudible warnings and by small auto-braking events, if it detects
signs of distractedness. The driver can then restore full controlof the vehicle and rest if needed.
As another driver assistance feature, some manufacturers
use a child/passenger monitoring system that gives front-seatpassengers and the driver a view of what’s going on in the backseats from the center display.

Other applications for DM systems include:
Driver identification and authentication
Heart rate measurement
	Head position tracking for real-time augmented reality (AR)HUD display correction
Human-machine interface control functions using the eyes
Gesture recognition
Driver impairment level detection
These technology innovations contribute to the more robust
safety solutions needed for the next generation of ADAS andautonomous driving functions.

Compute Requirements

Compute Requirements

Compute Requirements

None.

Real-time, low-latency processing is required for advanced facial

For future innovations, camera sensor input and processing

analysis algorithms and deep learning workloads that use CPU,

will be required, as well as real-time, low-latency processing for

DSP, GPU and FPGAs.

advanced facial analysis algorithms and deep learning workloads
that can take advantage of CPU, DPS, GPU and FPGAs.

Arm Solution

Arm Solution

Arm Solution

Not applicable.

Arm Cortex A, Arm Mali ISP, GPU.

Arm Cortex A, Arm Mali ISP, GPU.

8

Human Machine Interface
Past

Present

FutureCenter console features used rotary dials, knobs and switches,

Inspired by modern mobile phones, multi-touch screen input

Multi-touch screen input continues to be one of the mainwith driver input required for most functions. These manualon the center display is very common. This works well for several

forms of user input, while intelligent voice assistant technology

functions included:

types of applications, including navigation/maps. Intelligent voice

becomes increasingly sophisticated. As its popularity increases

assistants are available in premium vehicles for a more naturaland user experiences improve in the home smart-speaker market,

way of communicating with the vehicle. Users can operate theiradoption in vehicles soon follows.

External/interior Lighting
Windshield wipers
Central locking system
Climate controls
Seat adjustments
Radio reception
Tire Pressure Monitoringvehicle and access functions and information by simply speaking
to the vehicle.

Users can select the same intelligent voice assistant in their vehicle
that they have grown accustomed to at home. Other than touch

Gesture controls in premium vehicles allow drivers to navigate

input, the most common HMI with the vehicle will be natural

through menus by swiping a finger up and down, left and right.

language communication.

This can be done without having to take hands off the steering
wheel. The center stack rotary knob/controller is popular in some

Gesture-based controls may be integrated so the driver can

premium vehicles, and can be used by the driver without taking

provide gesture controls (such as swiping) to command theeyes off the road.

center display menus using fingers, while still keeping handson the steering wheel.

Some premium vehicles offer a touchpad as an alternative
user input device for center display menu navigation and also forcharacter input. However, driver input is still required for certain
functions, such as vehicle immobilizer, remote keyless entry, anda passive start/entry system.

Compute Requirements

Compute Requirements

Compute Requirements

A body control module provides the processing for many if not

A body domain controller provides the same processing functions

Body domain control processing combines with IVA machine

all of these functions.

as well as some additional I/O for control functions.

learning workload processing.

Arm Solution

Arm Solution

Arm Solution

Cortex-M.

Cortex-M, Cortex-R.

Cortex-M, Cortex-R.

9

Steering Wheel
Past

Present

FutureVehicles have used steering wheels since the 1890s with

The majority of vehicles still have a legacy steering wheel with

Some vehicle manufacturers deploy vehicles with collapsible

slight changes in styling and materials. Designs changed asa mechanical linkage between the steering wheel and the rack.

or retractable steering wheels. Steering wheels and pedals are

vehicle manufacturers began to integrate cruise control, audio

However, a small number of vehicles are designed using highconsidered optional for SAE Level 5 fully autonomous vehicles

controls, wiper controls on or around the steering wheel. Still, theavailability servo-electric power steering (EPS) which allows

and robo-taxis.

modern steering wheel performs the exact same basic function

for steer-by-wire. These systems use electronics and actuators

as the original.

on the steering column and rack. ADAS/autonomous steering

SAE Level 5 is the goal of vehicle manufacturers for self-drivingfeatures require this technology.

vehicles. A Level 5 vehicle is capable of complete hands-off,
driverless operation under all circumstances, and there are noSome vehicle manufacturers have integrated vibrating alerts andprovisions for human control.

a flashing LED bar into the steering wheel. Automated vehicle
driving features use these to communicate alerts such as lanekeep assist and driver monitoring.

Compute Requirements

Compute Requirements

Compute Requirements

The body control module provides the I/O and processing needs

Drive-by-wire capable systems have high-robustness andDrive-by-wire capable systems have high-robustness andfor control functions.

functional safety requirements. Driver alerts are driven by ADAS/

functional safety requirements. Driver alerts are driven by ADAS/

autonomous drive electronic control units.

autonomous drive electronic control units.

Arm Solution

Arm Solution

Arm Solution

Cortex-M

Cortex-M

Cortex-R

Cortex-M

Cortex-R

10

Rear Passenger Seat
Past

Present

FuturePortable VHS tape and DVD players with an integrated mini

Vehicle manufacturers offer rear-seat entertainment (RSE)The arrival of 5G connectivity, the next generation of cellularTV gained popularity for rear-seat entertainment. These weresystems with multiple separate 9” or larger color tilt-adjustableinfrastructure, allows passengers and commuters to be moreeither strapped onto the backrest of the front seat or included

screens. These systems provide passengers with remote-control

productive while in a vehicle. 5G technology not only speeds

a dropdown screen installed in the roof of the vehicle.

functions for built-in TV, radio, Blu-Ray/DVD player, navigation

up communication and reduces latency, but it also keeps devices

and internet connectivity, independent of the driver.

constantly connected. All the luxuries of an office environment,such as high-speed downloads and video conferencing, will beavailable to vehicle passengers.
Advanced passenger personalization settings with biometricauthentication allow customized profiles for each entertainment
display in the vehicle. This authentication allows user preferences
and services (e.g. streaming media account authentication) to

Compute Requirements

Compute Requirements

VHS video or DVD playback subsystem in the vehicle.

The following components are required for RSE systems:
	Blu-ray/DVD player controlled by the center display and/or
an integrated rear seat entertainment control panel

migrate from vehicle to vehicle. Native support for passenger
smartphone screen mirroring is built in to rear seat/passenger
entertainment displays and allows passengers to mirror theirmobile phone onto vehicle entertainment displays.

	Digital and I/O requirement to allow control by driverand passenger both in front seat and rear seatentertainment controls	Multi-CPU compute in the IVI platform for media playback/streaming to multiple displays in the vehicle
	Robust platform security for secure boot, secure keygen,secure key storage, DRM protection

Compute Requirements
Digital and I/O requirement allow entertainment control by thedriver and passengers from the front and rear. The IVI/
entertainment platform must provide multi-CPU compute for
UHD media playback/streaming to multiple displays in thevehicle. Robust platform security is needed for secure boot,secure keygen, secure key storage, and DRM protection.

Arm Solution

Arm Solution

Arm Solution

Not applicable.

Cortex M, Cortex A, Arm Mali GPU, DPU, Arm CryptoCell,

Cortex M, Cortex A, Arm Mali GPU, DPU, Arm CryptoCell,

Arm TrustZone.

Arm TrustZone.

11

Gearbox
Past

Present

FutureA manual transmission, also known as a manual gearbox or “stick

Manual transmissions remain popular in countries outside

Manual transmission vehicles no longer exist, as all passenger

shift,” is a type of transmission that uses a driver-operated clutch,of the U.S., Canada, and Australia., while in the U.S. about

vehicles with combustion engines are manufactured with anusually engaged and disengaged by a foot pedal (or hand lever)95 percent of all vehicles sold are automatic. Several vehicle

automatic transmission. An automatic transmission is required forfor regulating torque transfer and gear ratio from the engine to

manufacturers have migrated to electronic gear selectors using

vehicles that have ADAS/autonomous drive features and several

the transmission. Although some manual transmission steeringa dial or a row of buttons. This is required for drive-by-wirevehicle manufacturers have migrated to electronic gear selectors

column gear selectors were available, the majority were centerautomated driving functions.

using a dial or a row of buttons.

On the other hand, electric vehicles are designed with noThe majority of electric vehicles employ single speed direct drive

An automatic transmission is a type of vehicle transmission

gearbox. They have a direct connection between the electrictransmissions. Some vehicle manufacturers design multi-gearthat can automatically change gear ratios as the vehicle moves.

motor and the cardan/drive shaft.

transmissions for electric vehicles to help improve efficiency.

Compute Requirements

Compute Requirements

Compute Requirements

A body domain controller provides the compute to monitor

The transmission electronic control unit, sometimes referred

Most vehicle manufacturers have combined engine control/

gearbox health/temperature.

to as the transmission control module (TCM), senses gearprocessing and transmission control in a powertrain control

selector position, clutch position, brake position, engine

module (PCM). PCMs have high-robustness and functionalparameters and drives transmission actuator positions.

safety requirement.

console gear selectors.

Automatic transmission gear selectors started out on the steeringcolumn but eventually migrated to the center console.

Transmission electronic control units have high-robustness
and functional safety requirements.

Arm Solution

Arm Solution

Arm Solution

Cortex-M.

Cortex-M, Cortex-R.

Cortex-M, Cortex-R.

12

Cockpit Domain Controller
Past
The cockpit domain controller (CDC) didn’t exist until recently.

Present

Future

The first vehicles with a CDC were deployed in the 2019 model

A digital cockpit domain controller must support multiple mixed-

year. A single domain controller powers the digital instrument

criticality workloads on the same electronic control unit enabledcluster and infotainment display.

by hardware virtualization. Robust security features allow for

A CDC allows multiple cockpit domains (e.g., digital instrument
cluster, infotainment system, HUD) with separate electronic

maintenance and feature over-the-air updates to safety andnon-safety virtual electronic control units.

control units to be integrated into one domain controllerthat supports multiple levels of safety and criticality. This issometimes referred to as a mixed-ASIL system. Features required
to support a mixed criticality system include:
64-bit architecture
Efficient multi-core processing
Hardware accelerated virtualization
	Robust platform security for secure boot, secure keygen,secure key storage and DRM protection	Safety separation (i.e., safety certifiable hypervisor thatguarantees isolation (freedom of interference) between
multiple domains

Compute Requirements

Compute Requirements

Compute Requirements

None.

Application-class multi-CPU SoC with a graphics processing unit

A multi-CPU application processor with integrated 3D graphics(GPU) are used to drive multiple high-resolution displays. Systemengine and a software stack for real-time virtual ECUs support

safety certification requires an ISO 26262 ASIL B (min) certifiable

safe application rendering, safe display and safe video ingest.

Type-1 real-time hypervisor supporting an ASIL B (min) certifiable

The platform supports virtual ECUs certifiable up to ISO 26262

RTOS and general-purpose OS (Linux and Android) virtual machines.

Automotive Safety Integrity Level (ASIL) D.

Arm Solution

Arm Solution

Arm Solution

Not applicable.

Arm Cortex A, Arm Mali ISP, GPU, VPU, DPU.

Cortex-A, Mali GPU, Mali DPU, Mali ISP.

13

Stay up to speed on the road ahead
Without doubt, technology is helping the automotive industry deliver some of the most advanced,
comfortable, and safest vehicles on the roads today. Cars are becoming large smart devices capableof much more than simply getting us from point A to B. Innovations in automotive technology are
driving us toward smarter cities, cleaner environments, and safer streets.
To get the latest news and updates on Arm solutions and innovations for the automotive industry
visit arm.com/automotive.

14