Tesla to use internal microphone to detect emergency vehicles and aid in FSD

July 20, 2021

By Nuno Cristovao

As Tesla continues to inch closer to releasing Autopilot on city streets, and one day full self-driving, they need to account for more occurrences on the road. As we talked about briefly, Tesla now detects brake lights on vehicles in the latest beta and will soon also detect turn signals and even hand signals.

Elon has also said that Tesla will soon detect emergency vehicles such as ambulances, police cars and fire trucks. For Tesla to assess the situation properly they will also need to detect whether the vehicle is in an emergency situation so that it can follow proper driving procedures, such as pulling off, stopping at a green traffic light or letting the vehicle pass.

In order for Tesla to be able to do this, they will not only detect the emergency vehicles lights, but will also look for sirens.

Tesla Model 3 interior

Teslas do not currently have external microphones. The only microphones they have currently is the internal one used for voice commands and hands-free calling. Elon Musk confirmed that Tesla will start utilizing the internal microphone to help detect the presence of emergency vehicles.

Listening for sirens may only be the beginning if Tesla is successful in detecting situations using sound alone. What if they could detect other sounds that help the car further understand the environment and the current situation. Maybe listening for car honks, screeching tires or crashing sounds may be helpful. This may even be the start of Tesla adding a “Hey, Tesla”-like wake command to activate the voice-assistant like VW does in their ID vehicles. When Tesla starts to use the microphone for things beyond Bluetooth calling and voice commands, it could open up a whole new door of possibilities.

Action will follow recognition soon thereafter. Also, call will listen for sirens & alarms.
— Elon Musk (@elonmusk) July 12, 2021

It’s great to see Tesla moving forward and increasing Autopilot’s capability, but this feature comes with some possible issues. How will Tesla distinguish between real emergency vehicle sounds and sirens coming from music or a ringtone?

The short answer is they probably won’t. In fact, who hasn’t been tricked before when hearing police sirens on the radio only to look around them and realize it’s not real. Tesla appears to be building FSD features based on human abilities, such as seeing and hearing. If a human can do it based on vision and hearing, then why not a machine? Especially if that machine has 360-degrees of vision and the ability to make pinpoint calculations in a fraction of a second.

Tesla Vehicles Spotted With LiDAR: What Do They Use It For?

July 13, 2024

By Karan Singh

Not a Tesla App

Tesla recently hit the news for purchasing approximately $2M in LiDAR sensors from Luminar, one of Tesla’s long-term suppliers. You’ve probably seen photos of Tesla’s Semi and various Tesla models, including the Model 3 and Model Y sporting LIDAR equipment on the roof. These cars drive around with manufacturer plates scanning streets and highways.

However, many people confuse Tesla’s purpose in purchasing LiDAR equipment with using it for FSD versus testing. So, let’s look at what LiDAR is, and why Tesla uses it on its Fleet Validation Vehicles.

What is LiDAR?

LiDAR stands for Light Detecting and Ranging – essentially using lasers to measure distances. A laser pulse is sent out, and the time it takes to return is measured – providing extremely accurate distance measurements.

Some companies working on self-driving vehicles, including Waymo and BYD, use LiDAR as part of their self-driving suites, but Tesla is one of the few stand-outs that does not. Even Rimac’s “Verne” Robotaxi – which uses self-driving technology from Mobileye, also uses LiDAR.

While LiDAR can produce extremely accurate and high-quality 3D environments, it comes with its downsides as well. Not only is LiDAR costly and requires large gear strapped to a vehicle, but it also can not be used in bad weather and can have interference issues if there are other strong light sources present.

Why Does Tesla Use LiDAR?

A LiDAR rig mounted on a Tesla Semi for testing FSD.

Not a Tesla App

At Autonomy Day in 2019, Elon Musk mentioned that LiDAR isn’t the solution for self-driving cars – it's just a crutch. Thus, Tesla hasn’t used LiDAR for any production self-driving software.

Instead, Tesla uses it exactly how it's described – they use it to gather ground-truth data. This data is then used to feed Tesla’s Full Self Driving system – which helps validate its vision-only system's accuracy. LiDAR provides very accurate measurements to help ensure that FSD’s perception of space is accurate – and is only used by Tesla to ensure that its AI technology which is the brains of FSD is capable of accurately interpreting depth from just visual data.

Tesla’s vision-only system has been seen to be extremely accurate, with Vision-only Autopark being able to park in even narrower and tighter spaces faster than the previous version that relied on ultrasonic sensors.

We’ll likely continue to see Tesla purchase LiDAR systems, as well as use them for validation well into the future.

Tesla's Upcoming Robotaxi Event in August Delayed, According to Bloomberg

July 12, 2024

By Karan Singh

Sugar Design

In a report from Bloomberg, it is claimed that Tesla will be delaying its much-anticipated 8/8 Robotaxi event by two months to October 2024.

While sources other than Bloomberg haven't confirmed this report, Bloomberg has a positive track record of reporting on financial decisions. We’ll be sure to update the article if there is confirmation on X from Elon Musk or another Tesla senior official.

Tesla’s stock has dropped nearly 8.5% over the day, ending back-to-back gains over the last two weeks. It closed yesterday at $ 241 after hitting a peak of $270 earlier in the day before the news broke.

Why the Delay?

The delay – of approximately two months – has been communicated internally, but not publicly announced just yet. Bloomberg goes on to mention that the design team was told to rework certain elements of the Cybercab, necessitating the delay.

If Bloomberg’s report is correct, it sounds like Tesla’s unveil event will be largely focused on showing off the vehicle, instead of demoing how it will work. Of course, it could still be both, but given past events, Tesla has always shown off the vehicle years before it hits production.

Rimac recently showed off their version of robotaxi vehicle named Verne, and surprisingly, it could almost pass for Tesla’s own robotaxi. A lot of design cues in Rimac’s version are elements we have already seen or expect to see in Tesla’s autonomous taxi.

A recent Tesla patent revealed that Tesla is incorporating a sanitation system into their robotaxi that will be responsible for analyzing and cleaning the vehicle’s interior, although the delay itself is likely tied more to a physical feature rather than software.

Another element we know almost nothing about is how Tesla plans to charge these robotic taxis. Will they rely on the existing charge port and adapt a solution like the robotic charging arm (video below) we saw almost eight years ago, or will wireless charging or a dock finally become realized?

While the delay for Tesla’s event appears to be related to the vehicle’s design itself and not further development of FSD, Tesla is wasting no time in getting FSD working for the upcoming vehicle. Model 3 vehicles have already been spotted with camera locations that resemble a robotaxi.

Is the Delay Accurate?

We expect that this delay might actually be true – Elon Musk usually takes to X within hours of such news breaking if it's false to refute it and hasn’t done so yet.

Tesla has delayed several of their events in the past, and a delay of a couple of months seems plausible. We should hear from Musk himself soon on whether this report is accurate.