Tesla Autopilot Director Talks About the Future of High Fidelity Park Assist and It Coming to Vehicles With USS

December 18, 2023

By Kevin Armstrong

High Fidelity Park Assist in the Holiday Update

RossWynne / EVBaymax

Christmas came early for some Tesla owners thanks to the new High-fidelity Park Assist that was part of the Holiday Update. Ashok Elluswamy, Tesla’s Autopilot Software Director, took to X to show off Tesla’s latest technology, a complete overhaul of the parking experience, blending advanced 3D visualization with real-time environmental mapping.

High-fidelity park assist is shipping this weekend to Tesla customers without ultrasonic sensors as part of the holiday release!pic.twitter.com/MEHL6w003r
— Ashok Elluswamy (@aelluswamy) December 17, 2023

First, the bad news. The new technology is initially available only to customers with Tesla models that do not have ultrasonic sensors. Elluswamy says models with USS will get the new park assist “eventually” - insert your two-week joke here.

Future

Any time more than one sensor is used to create an output it gets more complicated because the output from each sensor won’t match exactly. Ultrasonic sensors are extremely good at what they do and produce extremely accurate output of distances where they’re aimed, but they can also miss things that are lower to the ground or higher up, things that Tesla Vision may be able to see.

It’s not clear whether Tesla will fuse the two sensor outputs into one or whether they’re planning on disabling USS completely when an improved version gets rolled out to vehicles with USS.

Requirements

The requirements for this new feature are still up in the air as well. All the vehicles that have received the new park assist have Tesla’s latest Ryzen-based infotainment CPU (MCU 3), however, we don’t know whether that will be required for these new visualizations.

Enhanced 3D Surroundings Reconstruction

Elluswamy's posts revealed that the new High-fidelity Park Assist is replacing the older 2D obstacle detection system with a sophisticated 3D reconstruction of the Tesla's surroundings. This breakthrough is an extension of Tesla's Occupancy Network, now boasting much higher resolution, thereby aiding drivers in navigating tight parking spots with unprecedented precision. The engineer posted: “In addition to obstacles, we also predict painted lines on the ground, also in 3D. Together, these help perform the full parking maneuver just by looking at this one screen.”

First Release and Upcoming Enhancements

Acknowledging that this is the initial version, Elluswamy teased future updates to the technology. These updates will likely include improved geometric consistency with the cameras and enhanced tracking of occluded obstacles. Even in its emergent stage, this technology significantly improves upon previous parking assistance systems. He stated: “This is the v1 release of this technology, and will have follow up releases that have even better geometric consistency with the cameras, better persistence of occluded obstacles, etc.”

The visualizations provided by this updated Park Assist system are impressively accurate. The 3D models, which change color based on proximity to the vehicle, offer a new level of awareness and interaction for drivers. This system, which uses vision technology to render 3D models in a way typically associated with LiDAR, is a significant step forward in Tesla's software development.

Tesla Vehicles Spotted With LiDAR: What Do They Use It For?

July 13, 2024

By Karan Singh

Not a Tesla App

Tesla recently hit the news for purchasing approximately $2M in LiDAR sensors from Luminar, one of Tesla’s long-term suppliers. You’ve probably seen photos of Tesla’s Semi and various Tesla models, including the Model 3 and Model Y sporting LIDAR equipment on the roof. These cars drive around with manufacturer plates scanning streets and highways.

However, many people confuse Tesla’s purpose in purchasing LiDAR equipment with using it for FSD versus testing. So, let’s look at what LiDAR is, and why Tesla uses it on its Fleet Validation Vehicles.

What is LiDAR?

LiDAR stands for Light Detecting and Ranging – essentially using lasers to measure distances. A laser pulse is sent out, and the time it takes to return is measured – providing extremely accurate distance measurements.

Some companies working on self-driving vehicles, including Waymo and BYD, use LiDAR as part of their self-driving suites, but Tesla is one of the few stand-outs that does not. Even Rimac’s “Verne” Robotaxi – which uses self-driving technology from Mobileye, also uses LiDAR.

While LiDAR can produce extremely accurate and high-quality 3D environments, it comes with its downsides as well. Not only is LiDAR costly and requires large gear strapped to a vehicle, but it also can not be used in bad weather and can have interference issues if there are other strong light sources present.

Why Does Tesla Use LiDAR?

A LiDAR rig mounted on a Tesla Semi for testing FSD.

Not a Tesla App

At Autonomy Day in 2019, Elon Musk mentioned that LiDAR isn’t the solution for self-driving cars – it's just a crutch. Thus, Tesla hasn’t used LiDAR for any production self-driving software.

Instead, Tesla uses it exactly how it's described – they use it to gather ground-truth data. This data is then used to feed Tesla’s Full Self Driving system – which helps validate its vision-only system's accuracy. LiDAR provides very accurate measurements to help ensure that FSD’s perception of space is accurate – and is only used by Tesla to ensure that its AI technology which is the brains of FSD is capable of accurately interpreting depth from just visual data.

Tesla’s vision-only system has been seen to be extremely accurate, with Vision-only Autopark being able to park in even narrower and tighter spaces faster than the previous version that relied on ultrasonic sensors.

We’ll likely continue to see Tesla purchase LiDAR systems, as well as use them for validation well into the future.

Tesla's Upcoming Robotaxi Event in August Delayed, According to Bloomberg

July 12, 2024

By Karan Singh

Sugar Design

In a report from Bloomberg, it is claimed that Tesla will be delaying its much-anticipated 8/8 Robotaxi event by two months to October 2024.

While sources other than Bloomberg haven't confirmed this report, Bloomberg has a positive track record of reporting on financial decisions. We’ll be sure to update the article if there is confirmation on X from Elon Musk or another Tesla senior official.

Tesla’s stock has dropped nearly 8.5% over the day, ending back-to-back gains over the last two weeks. It closed yesterday at $ 241 after hitting a peak of $270 earlier in the day before the news broke.

Why the Delay?

The delay – of approximately two months – has been communicated internally, but not publicly announced just yet. Bloomberg goes on to mention that the design team was told to rework certain elements of the Cybercab, necessitating the delay.

If Bloomberg’s report is correct, it sounds like Tesla’s unveil event will be largely focused on showing off the vehicle, instead of demoing how it will work. Of course, it could still be both, but given past events, Tesla has always shown off the vehicle years before it hits production.

Rimac recently showed off their version of robotaxi vehicle named Verne, and surprisingly, it could almost pass for Tesla’s own robotaxi. A lot of design cues in Rimac’s version are elements we have already seen or expect to see in Tesla’s autonomous taxi.

A recent Tesla patent revealed that Tesla is incorporating a sanitation system into their robotaxi that will be responsible for analyzing and cleaning the vehicle’s interior, although the delay itself is likely tied more to a physical feature rather than software.

Another element we know almost nothing about is how Tesla plans to charge these robotic taxis. Will they rely on the existing charge port and adapt a solution like the robotic charging arm (video below) we saw almost eight years ago, or will wireless charging or a dock finally become realized?

While the delay for Tesla’s event appears to be related to the vehicle’s design itself and not further development of FSD, Tesla is wasting no time in getting FSD working for the upcoming vehicle. Model 3 vehicles have already been spotted with camera locations that resemble a robotaxi.

Is the Delay Accurate?

We expect that this delay might actually be true – Elon Musk usually takes to X within hours of such news breaking if it's false to refute it and hasn’t done so yet.

Tesla has delayed several of their events in the past, and a delay of a couple of months seems plausible. We should hear from Musk himself soon on whether this report is accurate.