Tesla is developing a voice assistant to replace voice commands [Example of Voice]

It looks like Tesla will soon replace its archaic voice commands with something much more useful: a voice assistant.

Groentheonlywho often delves deep into the Tesla software by decompiling the firmware and looking for changes, has now found the early integration of a voice assistant.

Voice assistant already available in China

Tesla has already replaced its voice commands in China with a voice assistant that can not only control certain aspects of the vehicle using more natural language, but can also answer general knowledge questions such as current weather, stock prices and more (video below).

Tesla creates its own assistant

According to Green’s findings, it appears that Tesla will develop its own solution instead of integrating something like Amazon Alexa, as Rivian has done. Tesla created its own solution in China using some of its own technology and several existing software solutions. However, some of these are only available in China, so they don’t scale to support additional regions.

Grōk

The first thought that comes to mind is that Tesla is leaning on the AI ​​efforts of Grōk and xAI, which could help support general knowledge questions and search the internet for answers. However, that only gets Tesla part way there, as Alexa and Google Assistant already support a large ecosystem, one that may not be available if Tesla creates their own voice assistant. With Tesla’s solution, a driver may, at least initially, be limited to the devices they can control through the voice assistant. Either way, a more natural way to activate certain vehicle solutions will be an improvement over what is available today. The ability to ask the assistant frequently asked questions will be the icing on the cake.

Waking

According to Green, the source code hinted at the voice assistant using a wake word, which would eliminate the need to press the scroll wheel on the steering wheel. Tesla has recently started using the left scroll wheel button for additional things like windshield wiper controls and a multi-function mode, so this may fit into their plan.

It’s fun to speculate what the wake word would be and if Tesla would add the ability to create your own word. It could be something as simple as “Hey, Tesla,” “Grok,” or something more humorous that Tesla has a knack for. Unfortunately, there were no hints as to what the actual wake word would be, but being able to set a destination, play a specific song, or ask the assistant about the weather will be a much-needed improvement.

Supported models

It’s not clear which models Tesla would support a voice assistant, but with the release of software v12 with update 2024.14.3, Tesla is starting to leave more features out of older Intel-based vehicles. While a voice assistant isn’t necessarily computationally demanding, this may depend on Tesla’s implementation and whether voice commands are transcribed on the device or transferred over the internet for transcription.

Voice model

In the software there are references to Microsoft’s text-to-speech technology and specifically to a voice called ‘Jenny Neutral’.

The voice of “Jenny Neutral” seems like an acceptable voice, bringing a natural-sounding voice to Tesla’s voice assistant, although it’s not much different from what you’ll find on other assistants. You can preview Microsoft’s “Jenny Neutral” voice in the video below.

Tesla has been more intentional about adding information about unreleased features to its software lately to help prevent leaks, so by the time Green finds something like this it usually doesn’t take long for it to become available, although this also leads to can lead to problems. an exciting Christmas gift.

Thanks to Tesla hacker Groentheonlyit looks like Tesla will soon offer a native experience for Amazon Music in their cars.

Green decompiled Tesla’s latest update, version 2024.14.3, and found references to Amazon’s music service, Amazon Music.

In the same update, Tesla added Audible playback, the audiobook service that Amazon bought in 2008.

If Tesla wants to add support for these music services, they will need to access APIs provided by the music provider. Like everything else, a deal has likely been struck between Tesla and Amazon, not just for Audible, which was released in this update, but also for Amazon’s other services. Considering there are already references to Amazon Music in 2024.14.3, it may not be long before we see the service appear in an upcoming update.

Prime Video

While Green doesn’t mention any specific references to Amazon Prime Video, it’s possible we’ll see that service added as well. Tesla’s Theater “apps” are essentially links to a browser without the user interface, so detecting references for Amazon Prime Video would be harder to spot in Tesla’s source code. Since Tesla has already implemented Audible and there are now hints of Amazon Music, it looks like we might see support for Amazon Prime Video as well.

It is not the first time that Tesla has hinted at Amazon Music

In 2020, we saw Tesla add hints to support Amazon Music, although the code was dropped in a later revision. The same source code in 2020 contained references to Pandora, Audible and Apple Music. Since then, we’ve seen Tesla add support for two of these services, with Pandora being the only one left out.

Top music services in the world

According to Exploding Topics, as of February 2024, Amazon Music is the fourth most popular music service in the world with a 13.3% market share. Number one is unsurprisingly Spotify, with Apple Music and Tencent (Chinese music service) taking second and third places respectively.

Who gets access

Amazon Music will actually be a nice addition, especially if you do not pay for a separate music service such as Spotify or Apple Music, but have Amazon Prime.

In the US, LiveOne, formerly known as Slacker, is the standard music service that comes free with Tesla, although Premium Connectivity is still required to listen while driving. Tesla simply calls it “Streaming” in the vehicle, as this was called before Tesla had support for multiple music services. Tesla currently supports LiveOne, Spotify, Apple Music, TIDAL, TuneIn and SiriusXM on Model S and Model X.

Although LiveOne is free, it has several limitations in terms of audio quality, music management, and song selection. You also can’t jump to certain parts of a song.

Amazon Music offers a much more robust solution, so it’s expected to be a nice upgrade for owners who already have access to the music service.

If you subscribe to Amazon Prime and get the free version of Amazon Music, it’s expected that you’ll be able to access it in your car at no additional cost, just like on your phone and other devices.

Amazon also offers a premium subscription for $10 per month, which includes higher quality audio and access to a larger music library. However, we do not believe the premium plan will be required to use the service in the vehicle.

Tesla update 2024.14.3 is currently rolling out to customers worldwide, although it may take several weeks before most customers have access.

Tesla has released a major software update for the Cybertruck with version 2024.14.3 that introduces nine exclusive features including limited slip differentials, Trail Assist, Off-Road Mode and many others that add completely new capabilities to the Cybertruck. Telsa has also released a guide focused on the Cybertruck’s new off-road capabilities and how to use each driving mode.

In the same update, the Cybertruck also received additional features previously available on other vehicles, such as the Colorizer function, Front Passenger Air Vent and Zoom.

In a video titled “Can the Tesla Cybertruck Really Go Off-Road?” (video below), the BBC publication Top Gear tested Tesla’s latest off-road software in a Californian desert using a Rivian R1T as a benchmark.

New accessories

Top Gear also had access to new prototype Cybertruck accessories, including a Cybercooler and a CyberInflator that allows you to adjust tire pressure. Tesla is also planning the launch of Cyberboxes that fit under the CyberTent trunk and slide securely into bed rails, as seen in the video.

Cybertruck update

Cybertruck’s Off-Road mode improves its performance on challenging terrains such as gravel, deep snow, rocks and sand. The “All Purpose” mode automatically adjusts tire slip based on the amount of traction available.

The new CyberTent mode Using the air suspension, you level the vehicle so that you get a perfectly flat sleeping surface. This also allows you to control functions such as lighting, air conditioning and activated sockets – if necessary.

The Trail assistance helps maintain a set cruising speed so drivers can concentrate on steering. The feature works as a control for both climbing a hill and descending it, preventing the wheels from slipping, Tesla explains.

Wade mode, which was previously available, will allow drivers to enter and drive through “shallow bodies of water, such as defined intersections of rivers or creeks,” while the new “Baja Mode” will improve the vehicle’s balance. The vehicle will also move more freely when Stability Assist is set to Minimum.

The new update also increases the sensitivity of the Cybertruck’s frunk, so that it stops sooner if resistance arises. The model also saw his turning circle improved 1.6 feet, making parking and low-speed maneuvers easier.

The Cybertruck’s adaptive suspension has also been upgraded with more accurate payload estimates and automatically adjusted damping for a more comfortable ride and handling.

Offroad guide

The Off-Road Guide provides a comprehensive overview of Cybertruck features, detailing the various new driving modes and controls, including instructions for using Overland and Baja modes, adjusting ride height, and managing vehicle settings for different areas.

Additionally, the guide offers best practices for off-roading, with tips for navigating different surfaces, such as sand, mud and rocks.

Tesla started delivering Cybertrucks in November last year. Despite some setbacks, Tesla continues to scale up production of the Cybertruck at its Gigafactory in Austin, Texas.