FSD Beta v11.x

The next big milestone for FSD is 11. It is a significant upgrade and fundamental changes to several parts of the FSD stack including totally new way to train the perception NN.

From AI day and Lex Fridman interview we have a good sense of what might be included.

- Object permanence both temporal and spatial
- Moving from “bag of points” to objects in NN
- Creating a 3D vector representation of the environment all in NN
- Planner optimization using NN / Monte Carlo Tree Search (MCTS)
- Change from processed images to “photon count” / raw image
- Change from single image perception to surround video
- Merging of city, highway and parking lot stacks a.k.a. Single Stack

Lex Fridman Interview of Elon. Starting with FSD related topics.

Here is a detailed explanation of Beta 11 in "layman's language" by James Douma, interview done after Lex Podcast.

Here is the AI Day explanation by in 4 parts.

Deep Understanding Tesla FSD Part 1: HydraNet

From Theory to Reality, Analyze the Evolution of Tesla Full Self-Driving

saneryee-studio.medium.com

Here is a useful blog post asking a few questions to Tesla about AI day. The useful part comes in comparison of Tesla's methods with Waymo and others (detailed papers linked).

Twelve Questions about Tesla Autopilot Technologies Exposed at 2021 AI Day

On Aug. 19 2021, Telsa held an AI day , exposing more technologies about Autopilot , from perception, planning, data labeling, simulation…

yuhuang-63908.medium.com

 

[uscbucsfan]

In case you missed Elon's last tweet on the subject, work on v11 continues. Previously unknown v11.4.7 due next week, evidently.

https://twitter.com/x/status/1689948253532659712

Anyone want to take bets if it's based on 2023.7.X?

I bet it is.

 

[lascavarian]

“Mind blowing”

Love seeing that “imo” at the end. Good etiquette imo.

 

[jebinc]

Anyone want to take bets if it's based on 2023.7.X?

I bet it is.

Of course it will be; junk.

 

[aronth5]

I really do wonder what is going on with FSDb releases at this point. Maybe it is just a nexus between having a ton more data to use for training and ramping up new training hardware?

More teaser information. I just hope new cars with HW4 get FSD fairly soon.

https://twitter.com/x/status/1689815771017531392

 

[JulienW]

Anyone want to take bets if it's based on 2023.7.X?

I bet it is.

Unless Tesla can find a way to go backwards.

PLEASE let it be stable and within a month starting to be released on all new software.

Of course we still have to contend with Elon's "wide release within a week" guesstaminet.

 

[rlsd]

It don't care how long it takes to release as long as it will blow my mind instead of blowing my hairs.

A scared man Stock Vector Image & Art - Alamy

Download this stock vector: A scared man - EF92JJ from Alamy's library of millions of high resolution stock photos, illustrations and vectors.

www.alamy.com

 

[FSDtester#1]

Of course it will be; junk.

No, your "junk" will have a mind blowing experience

 

[sleepydoc]

In case you missed Elon's last tweet on the subject, work on v11 continues. Previously unknown v11.4.7 due next week, evidently.

https://twitter.com/x/status/1689948253532659712

Unfortunately all I can take from that tweet is they are working on 11.4.7 and v12. Any time references in Elon’s tweets are meaningless.

 

[AlanSubie4Life]

Anyone want to take bets if it's based on 2023.7.X?

I bet it is.

Since 11.4.4 was based on 2023.7.x, I guess probably you are right about 11.4.7, but I will go ahead and bet the other side. Would seem pretty weird at this point to not to bring people somewhat more up to date, and merge back into the latest software path.

 

[sleepydoc]

Since 11.4.4 was based on 2023.7.x, I guess probably you are right about 11.4.7, but I will go ahead and bet the other side. Would seem pretty weird at this point to not to bring people somewhat more up to date, and merge back into the latest software path.

Except it’s just a point release. Actually a point point release. Changing the underlying version would require a significant rewrite which wouldn’t normally happen between 11.4.6 as of 11.4.7

 

[AlanSubie4Life]

Except it’s just a point release. Actually a point point release. Changing the underlying version would require a significant rewrite which wouldn’t normally happen between 11.4.6 as of 11.4.7

Yep! As I said…

 

[n.one.one]

TeslaFi just reported this:
"A new software version has been detected on TeslaFi.com - Software version 2023.18.0 was just detected as on a 2022 Tesla Model R1T Quad".
Nothing about FSD beta but that is a Rivian model not a Tesla. Could this be testing for FSD licensing? It just makes you go HHHmmmmm......
Of course it could just be a mistaken report.

Edit: See @MP3Mike post below regarding ElectraFi.

 

[MP3Mike]

TeslaFi just reported this:
"A new software version has been detected on TeslaFi.com - Software version 2023.18.0 was just detected as on a 2022 Tesla Model R1T Quad".
Nothing about FSD beta but that is a Rivian model not a Tesla. Could this be testing for FSD licensing? It just makes you go HHHmmmmm......
Of course it could just be a mistaken report.

Probably just a cross from their new product ElectraFi which provides the same service as TeslaFi but to Rivians...

 

[n.one.one]

Probably just a cross from their new product ElectraFi which provides the same service as TeslaFi but to Rivians...

Excellent info, I wasn't aware of ElectraFi.

 

[dflowerz]

Finally tried 11.4.6. It did pretty good on the highway and getting off to go to my house. It still has the same problems at the 4 way stop to turn in to my neighborhood. It stops then creeps forward for way too long (for no reason) then decides to turn left but mid turn gets confused and starts to go more straight toward the curb then stops and creeps slowly left again. The behavior improved with one of the 11.3 builds but has reverted to terrible since then.

 

[zoomer0056]

The behavior improved

From reading these posts it seems the car acts like a virgin in an area it hasn't been before. But with repeated practice it gets real good.

 

[Twiglett]

Except it’s just a point release. Actually a point point release. Changing the underlying version would require a significant rewrite which wouldn’t normally happen between 11.4.6 as of 11.4.7

You just used the word “normally“ in the context of Tesla and FSD rollout

 

[kabin]

Finally tried 11.4.6. It did pretty good on the highway and getting off to go to my house. It still has the same problems at the 4 way stop to turn in to my neighborhood. It stops then creeps forward for way too long (for no reason) then decides to turn left but mid turn gets confused and starts to go more straight toward the curb then stops and creeps slowly left again. The behavior improved with one of the 11.3 builds but has reverted to terrible since then.

Yep, that seems to be the 11.4.x consensus. No joy especially in traffic.

 

[jebinc]

And the shills are already hard at work….

 

[Twiglett]

And the shills are already hard at work….

View attachment 964299

Isn’t this “almost complete rewrite” number four or is it five? I lose track of how many times they’ve realized the path they’re on won’t get them to real FSD.