It turns out all it takes to fool a Tesla’s camera system is a little tape.
Two security researchers managed to trick two Teslas into accelerating well past the speed limit by fooling their camera systems into misreading a speed sign. We first saw the news via MIT Technology Review.
They then drove a 2016 Tesla Model X toward the sign with cruise control enabled.
Cruise control is a feature of Tesla’s self-driving system, Autopilot, that is supposed to control the car’s speed and keep it a safe distance behind the car in front of it.
As the car approached the altered sign it misread it as 85 mph — and started to accelerate by 50 mph.
The same happened in a 2016 Model S.
McAfee disclosed the research to Tesla and MobilEye EyeQ3, the company that provides the Tesla 2016 models with their camera systems, last year. MIT Tech Review said Tesla did not respond to a request for comment on the research but did say it would not be fixing the issues uncovered by the McAfee researchers.
MobilEye EyeQ3 dismissed the research.
A representative told MIT Tech Review the modified sign could have been misread by a human and said the camera hadn’t been designed for fully autonomous driving, which the person said would use a variety of technologies including “crowdsourced mapping” to support cameras.
Tesla’s newer models use proprietary cameras, and MobilEye EyeQ3 has released newer versions of its cameras that McAfee tested and said were not fooled by the modified sign.
The McAfee researcher Povolny told MIT Tech Review that the findings were still concerning, though, as plenty of 2016 Teslas are still on the roads. “We are not trying to spread fear and say that if you drive this car, it will accelerate into through a barrier, or to sensationalize it,” he said. “The reason we are doing this research is we’re really trying to raise awareness for both consumers and vendors of the types of flaws that are possible.”
The safety of Tesla’s autopilot systems is under close scrutiny. Last year the National Highway Traffic Safety Administration launched a federal investigation into two fatal Tesla crashes in which it determined the autopilot had been on.
According to Huang’s wife, he had complained about the car’s Autopilot veering toward that same barrier multiple times before. Data released by the National Transportation Safety Board last week confirmed the claims, per Ars Technica.
Currently, Tesla emphasizes that its Autopilot tools are not meant to make the car fully autonomous and that drivers must always keep their hands on the wheel. But CEO Elon Musk insists that he intends to make Teslas fully self-driving in the near future.