Tesla Adds Smart Assistant With Software Update, Replacing Voice Commands in China [Video]

January 12, 2024

By Kevin Armstrong

Tesla Adds Smart Assistant in China

Not a Tesla App

An early version of Tesla's 2023.44 update in China, has transformed its vehicles' voice command feature into a fully functional smart assistant. This assistant extends beyond vehicle control, offering features like weather updates, stock market insights, language translation, and even the recitation of Tang poetry. This development leads to speculation: is Grōk, xAI’s advanced AI model, already along for a ride or is Tesla leveraging a different service?

Grōk's Potential Role in Tesla's AI Evolution

The integration of Grōk AI into Tesla's fleet came up a few months ago when Elon Musk made a post on X that predicted that Grōk (smaller quantized) would run “native” in Tesla using local compute power. Musk then replied: Provided our vehicle AI computer is able to run the model, Tesla will probably have the most amount of true usable inference compute on Earth.

While it is not confirmed if Grōk is powering the new smart assistant in China, the possibility aligns with Tesla's trajectory towards more sophisticated AI applications in its vehicles. China also received another new feature in the update that is unavailable in other regions, a traffic light countdown.

User Impressions: A Glimpse into AI's Future in Automotive

Early feedback from Tesla users in China suggests that the new smart assistant offers a notably enhanced and intelligent experience, differentiating it from the previous basic voice command system. A Not a Tesla App reader told us that this is an authentic voice assistant. You can check the weather, stock prices, and other information.

That sounds like a young Grōk could be involved, considering its capabilities in handling complex interactions and live content processing.

Provided our vehicle AI computer is able to run the model, Tesla will probably have the most amount of true usable inference compute on Earth.

Even in a robotaxi future, the cars will only be used for ~1/3 of hours/week, leaving 2/3 for distributed inference, like SETI.
— Elon Musk (@elonmusk) November 4, 2023

Introducing this advanced assistant raises questions about Tesla's strategy in AI development. While the specifics of Tesla's partnerships in this arena remain unclear, the company's track record suggests a strong preference for in-house development, or at least leveraging products from Musk’s sister companies. The involvement of Grōk, a product of Musk's xAI, further points to Tesla's independent approach to using its AI capabilities.

The Scope of Grōk in Enhancing Tesla's AI Features

If Grōk is part of Tesla's new smart assistant, vehicle-user interaction could significantly leap. Grōk's advanced processing capabilities could enhance various aspects of the driving experience, from improved voice recognition to more intuitive responses, though its exact role in the current update remains speculative.

Musk's recent ventures into AI with xAI and Grōk have been closely watched, with many anticipating how these technologies would integrate into Tesla's product line. Musk's vision of incorporating AI like Grōk into Tesla's vehicles could greatly improve how we interact with the car. However, this integration's exact nature and timeline are still subjects of speculation.

While it's not confirmed if Grōk is powering this feature, the speculation aligns with Tesla's known ambitions in AI. Tesla's introduction of a new smart assistant in China is the latest advancement as Tesla tries to keep up with other vehicles that have already incorporated their own AI assistants like NIO or have leveraged existing services like Google Assistant in vehicles like Polestar.

Tesla’s holiday update, which includes the smart assistant in China started rolling out today. We’ll have to wait and see how well this feature works as it rolls out to more users. It’ll hopefully become available in additional languages and countries in the coming months.

Tesla Vehicles Spotted With LiDAR: What Do They Use It For?

July 13, 2024

By Karan Singh

Not a Tesla App

Tesla recently hit the news for purchasing approximately $2M in LiDAR sensors from Luminar, one of Tesla’s long-term suppliers. You’ve probably seen photos of Tesla’s Semi and various Tesla models, including the Model 3 and Model Y sporting LIDAR equipment on the roof. These cars drive around with manufacturer plates scanning streets and highways.

However, many people confuse Tesla’s purpose in purchasing LiDAR equipment with using it for FSD versus testing. So, let’s look at what LiDAR is, and why Tesla uses it on its Fleet Validation Vehicles.

What is LiDAR?

LiDAR stands for Light Detecting and Ranging – essentially using lasers to measure distances. A laser pulse is sent out, and the time it takes to return is measured – providing extremely accurate distance measurements.

Some companies working on self-driving vehicles, including Waymo and BYD, use LiDAR as part of their self-driving suites, but Tesla is one of the few stand-outs that does not. Even Rimac’s “Verne” Robotaxi – which uses self-driving technology from Mobileye, also uses LiDAR.

While LiDAR can produce extremely accurate and high-quality 3D environments, it comes with its downsides as well. Not only is LiDAR costly and requires large gear strapped to a vehicle, but it also can not be used in bad weather and can have interference issues if there are other strong light sources present.

Why Does Tesla Use LiDAR?

A LiDAR rig mounted on a Tesla Semi for testing FSD.

Not a Tesla App

At Autonomy Day in 2019, Elon Musk mentioned that LiDAR isn’t the solution for self-driving cars – it's just a crutch. Thus, Tesla hasn’t used LiDAR for any production self-driving software.

Instead, Tesla uses it exactly how it's described – they use it to gather ground-truth data. This data is then used to feed Tesla’s Full Self Driving system – which helps validate its vision-only system's accuracy. LiDAR provides very accurate measurements to help ensure that FSD’s perception of space is accurate – and is only used by Tesla to ensure that its AI technology which is the brains of FSD is capable of accurately interpreting depth from just visual data.

Tesla’s vision-only system has been seen to be extremely accurate, with Vision-only Autopark being able to park in even narrower and tighter spaces faster than the previous version that relied on ultrasonic sensors.

We’ll likely continue to see Tesla purchase LiDAR systems, as well as use them for validation well into the future.

Tesla's Upcoming Robotaxi Event in August Delayed, According to Bloomberg

July 12, 2024

By Karan Singh

Sugar Design

In a report from Bloomberg, it is claimed that Tesla will be delaying its much-anticipated 8/8 Robotaxi event by two months to October 2024.

While sources other than Bloomberg haven't confirmed this report, Bloomberg has a positive track record of reporting on financial decisions. We’ll be sure to update the article if there is confirmation on X from Elon Musk or another Tesla senior official.

Tesla’s stock has dropped nearly 8.5% over the day, ending back-to-back gains over the last two weeks. It closed yesterday at $ 241 after hitting a peak of $270 earlier in the day before the news broke.

Why the Delay?

The delay – of approximately two months – has been communicated internally, but not publicly announced just yet. Bloomberg goes on to mention that the design team was told to rework certain elements of the Cybercab, necessitating the delay.

If Bloomberg’s report is correct, it sounds like Tesla’s unveil event will be largely focused on showing off the vehicle, instead of demoing how it will work. Of course, it could still be both, but given past events, Tesla has always shown off the vehicle years before it hits production.

Rimac recently showed off their version of robotaxi vehicle named Verne, and surprisingly, it could almost pass for Tesla’s own robotaxi. A lot of design cues in Rimac’s version are elements we have already seen or expect to see in Tesla’s autonomous taxi.

A recent Tesla patent revealed that Tesla is incorporating a sanitation system into their robotaxi that will be responsible for analyzing and cleaning the vehicle’s interior, although the delay itself is likely tied more to a physical feature rather than software.

Another element we know almost nothing about is how Tesla plans to charge these robotic taxis. Will they rely on the existing charge port and adapt a solution like the robotic charging arm (video below) we saw almost eight years ago, or will wireless charging or a dock finally become realized?

While the delay for Tesla’s event appears to be related to the vehicle’s design itself and not further development of FSD, Tesla is wasting no time in getting FSD working for the upcoming vehicle. Model 3 vehicles have already been spotted with camera locations that resemble a robotaxi.

Is the Delay Accurate?

We expect that this delay might actually be true – Elon Musk usually takes to X within hours of such news breaking if it's false to refute it and hasn’t done so yet.

Tesla has delayed several of their events in the past, and a delay of a couple of months seems plausible. We should hear from Musk himself soon on whether this report is accurate.