Tesla's Newest Safety Feature Will Monitor Driver for Drowsiness, Even When Autopilot Is Off

October 18, 2023

By Kevin Armstrong

Tesla will now monitor drivers for drowsiness

Tesla has introduced an innovative feature called 'Driver Drowsiness Warning'. This new safety uses the vehice's internal camera to detect and warn potentially fatigued drivers.

Beyond Autopilot

Tesla's driver's monitoring systems have thus far been limited to Autopilot and FSD use, warning users to pay attention to the road while Autopiot is engaged. However, this is the first time Tesla is monitoring drivers while Autoilot is off. Driver Drowsiness Warning is expected to be Tesla's next active safety feature.

Tracking Metrics

Renowned Tesla hacker @greentheonly shed light on the forthcoming feature back in May. By decompiling Tesla's firmware, he unveiled that Tesla plans to utilize its camera-based monitoring system to gauge signs of driver fatigue. This includes tracking metrics such as the number of yawns and blinks, alongside evaluating driving patterns that are associated with drowsiness.

How Does It Work?

The Driver Drowsiness Warning system is only activated when vehicles have been driving for at least 10 minutes and the vehicle is traveling over 40 mph (65 km/h). Autopilot must also be disengaged. If the system recognizes symptoms of drowsiness, a visual alert flashes on the screen, matched by an audible warning. The notification prompts drivers to consider pulling over for a break before continuing to drive. However, Tesla will not prevent the driver from operating the vehicle.

Drawing data from the cabin camera and studying driving behaviors, Tesla's new feature employs a multifaceted methodology. It observes the driver's facial characteristics, such as yawning and blinking frequencies and driving patterns, such as lane warnings, to discern drowsiness. Once flagged, the alert remains on the screen until the driver is alert or slows down below 40 mph.

Turning Off the Warning

Tesla's new Driver Drowsiness Warning is sort of optional. Although you can disable it in the vehicle's settings by navigating to Controls > Safety > Driver Drowsiness, it is automatically re-enabled at the start of each drive.

Tesla will now monitor drivers for drowsiness

Not a Tesla App

Is this the Nag?

For anyone who has driven a Tesla with Full Self Driving enabled, you are well aware of the nag. For those who have not had the pleasure, it's a visual and audible warning to "apply slight pressure to the wheel" or to pay attention to the road. Tesla has considered removal of the nag before but quickly met resistance.

However, this kind of new nag could've played a role in preventing the crash where the FSD system warned the driver to take control 150 times over 45 minutes before the impact with emergency vehicles.

Evolving Monitoring Capabilities

Tesla's journey in driver monitoring has witnessed significant evolution. While initial systems were limited to detecting torque on the steering wheel, advancements post-2021 included the cabin-facing camera to ascertain driver attention. This shift marked Tesla's venture into comprehensive driver observation, ensuring the driver's gaze remains fixed on the road and is devoid of handheld device distractions.

Release Date

The feature's unveiling in Tesla's European owner's manual points to an imminent release. However, the feature doesn't appear to be active yet. Tesla's release notes have made no mention of this significant change so far, but it could be in an upcoming update. When the feature is released, we expect it to be available in select regions. Tesla will typically release a new feature such as this one in specific regions to gather additional data before making it available more widely.

Tesla Vehicles Spotted With LiDAR: What Do They Use It For?

July 13, 2024

By Karan Singh

Not a Tesla App

Tesla recently hit the news for purchasing approximately $2M in LiDAR sensors from Luminar, one of Tesla’s long-term suppliers. You’ve probably seen photos of Tesla’s Semi and various Tesla models, including the Model 3 and Model Y sporting LIDAR equipment on the roof. These cars drive around with manufacturer plates scanning streets and highways.

However, many people confuse Tesla’s purpose in purchasing LiDAR equipment with using it for FSD versus testing. So, let’s look at what LiDAR is, and why Tesla uses it on its Fleet Validation Vehicles.

What is LiDAR?

LiDAR stands for Light Detecting and Ranging – essentially using lasers to measure distances. A laser pulse is sent out, and the time it takes to return is measured – providing extremely accurate distance measurements.

Some companies working on self-driving vehicles, including Waymo and BYD, use LiDAR as part of their self-driving suites, but Tesla is one of the few stand-outs that does not. Even Rimac’s “Verne” Robotaxi – which uses self-driving technology from Mobileye, also uses LiDAR.

While LiDAR can produce extremely accurate and high-quality 3D environments, it comes with its downsides as well. Not only is LiDAR costly and requires large gear strapped to a vehicle, but it also can not be used in bad weather and can have interference issues if there are other strong light sources present.

Why Does Tesla Use LiDAR?

A LiDAR rig mounted on a Tesla Semi for testing FSD.

Not a Tesla App

At Autonomy Day in 2019, Elon Musk mentioned that LiDAR isn’t the solution for self-driving cars – it's just a crutch. Thus, Tesla hasn’t used LiDAR for any production self-driving software.

Instead, Tesla uses it exactly how it's described – they use it to gather ground-truth data. This data is then used to feed Tesla’s Full Self Driving system – which helps validate its vision-only system's accuracy. LiDAR provides very accurate measurements to help ensure that FSD’s perception of space is accurate – and is only used by Tesla to ensure that its AI technology which is the brains of FSD is capable of accurately interpreting depth from just visual data.

Tesla’s vision-only system has been seen to be extremely accurate, with Vision-only Autopark being able to park in even narrower and tighter spaces faster than the previous version that relied on ultrasonic sensors.

We’ll likely continue to see Tesla purchase LiDAR systems, as well as use them for validation well into the future.

Tesla's Upcoming Robotaxi Event in August Delayed, According to Bloomberg

July 12, 2024

By Karan Singh

Sugar Design

In a report from Bloomberg, it is claimed that Tesla will be delaying its much-anticipated 8/8 Robotaxi event by two months to October 2024.

While sources other than Bloomberg haven't confirmed this report, Bloomberg has a positive track record of reporting on financial decisions. We’ll be sure to update the article if there is confirmation on X from Elon Musk or another Tesla senior official.

Tesla’s stock has dropped nearly 8.5% over the day, ending back-to-back gains over the last two weeks. It closed yesterday at $ 241 after hitting a peak of $270 earlier in the day before the news broke.

Why the Delay?

The delay – of approximately two months – has been communicated internally, but not publicly announced just yet. Bloomberg goes on to mention that the design team was told to rework certain elements of the Cybercab, necessitating the delay.

If Bloomberg’s report is correct, it sounds like Tesla’s unveil event will be largely focused on showing off the vehicle, instead of demoing how it will work. Of course, it could still be both, but given past events, Tesla has always shown off the vehicle years before it hits production.

Rimac recently showed off their version of robotaxi vehicle named Verne, and surprisingly, it could almost pass for Tesla’s own robotaxi. A lot of design cues in Rimac’s version are elements we have already seen or expect to see in Tesla’s autonomous taxi.

A recent Tesla patent revealed that Tesla is incorporating a sanitation system into their robotaxi that will be responsible for analyzing and cleaning the vehicle’s interior, although the delay itself is likely tied more to a physical feature rather than software.

Another element we know almost nothing about is how Tesla plans to charge these robotic taxis. Will they rely on the existing charge port and adapt a solution like the robotic charging arm (video below) we saw almost eight years ago, or will wireless charging or a dock finally become realized?

While the delay for Tesla’s event appears to be related to the vehicle’s design itself and not further development of FSD, Tesla is wasting no time in getting FSD working for the upcoming vehicle. Model 3 vehicles have already been spotted with camera locations that resemble a robotaxi.

Is the Delay Accurate?

We expect that this delay might actually be true – Elon Musk usually takes to X within hours of such news breaking if it's false to refute it and hasn’t done so yet.

Tesla has delayed several of their events in the past, and a delay of a couple of months seems plausible. We should hear from Musk himself soon on whether this report is accurate.