FSD Beta v11.x

The next big milestone for FSD is 11. It is a significant upgrade and fundamental changes to several parts of the FSD stack including totally new way to train the perception NN.

From AI day and Lex Fridman interview we have a good sense of what might be included.

- Object permanence both temporal and spatial
- Moving from “bag of points” to objects in NN
- Creating a 3D vector representation of the environment all in NN
- Planner optimization using NN / Monte Carlo Tree Search (MCTS)
- Change from processed images to “photon count” / raw image
- Change from single image perception to surround video
- Merging of city, highway and parking lot stacks a.k.a. Single Stack

Lex Fridman Interview of Elon. Starting with FSD related topics.

Here is a detailed explanation of Beta 11 in "layman's language" by James Douma, interview done after Lex Podcast.

Here is the AI Day explanation by in 4 parts.

Deep Understanding Tesla FSD Part 1: HydraNet

From Theory to Reality, Analyze the Evolution of Tesla Full Self-Driving

saneryee-studio.medium.com

Here is a useful blog post asking a few questions to Tesla about AI day. The useful part comes in comparison of Tesla's methods with Waymo and others (detailed papers linked).

Twelve Questions about Tesla Autopilot Technologies Exposed at 2021 AI Day

On Aug. 19 2021, Telsa held an AI day , exposing more technologies about Autopilot , from perception, planning, data labeling, simulation…

yuhuang-63908.medium.com

 

[sleepydoc]

I thought at the time that they had supplier issues and decided that the trouble wasn't worth it. Otherwise USS is a cheap convenience feature even just for parking.

yes, they had supplier issues and used that as an excuse to pull the USS rather than pursue other solutions.

The problem is, removing USS eliminated other features and as we all know, 'Tesla Vision' still can't see worth crap.

 

[enemji]

Humans drive by vision BUT THEY park close by using USS.

This tells me that you have never given your car to a valet driver

 

[JulienW]

This tells me that you have never given your car to a valet driver

That is correct. Also only one person has every washed it or almost all my cars I have owned (excluding work or 2ed vehicles).

As a 24+ miles a week runner I enjoy walking and prefer to park farther away and walk.

 

[enemji]

That is correct. Also only one person has every washed it or almost all my cars I have owned (excluding work or 2ed vehicles).

As a 24+ miles a week runner I enjoy walking and prefer to park farther away and walk.

Glad to hear you are a runner. Love it.

That said, valet drivers have forever been parking cars with an inch to spare between cars. They don't need USS.

 

[cbdream99]

Glad to hear you are a runner. Love it.

That said, valet drivers have forever been parking cars with an inch to spare between cars. They don't need USS.

LOL, when I was a little kid, I used to fascinated by my neighbor who drove dump truck for living but when he switched to his own car, he manipulated like a toy, most will take many turns to get in, he finished fast the first time, USS has not been invented yet. Now if you google "tight parking without parking sensor" .. The AI bot suggest to use a dil?o ....

 

[cyborgLIS]

Is it typical for the FSDb visualization to incorrectly position traffic cones and garbage bins that are on the opposite side of the road? I'm now noticing them appear in the road instead of on the curb as they are in reality. Sometimes they render in the middle of the road and you will see other cars drive through them. Same-side cones and bins render in the correct positions. Other opposite-side objects (cars) also render in the correct positions. I've only had FSDb for a couple of months, but I don't remember seeing this error until recently.

 

[JulienW]

Is it typical for the FSDb visualization to incorrectly position traffic cones and garbage bins that are on the opposite side of the road? I'm now noticing them appear in the road instead of on the curb as they are in reality. Sometimes they render in the middle of the road and you will see other cars drive through them. Same-side cones and bins render in the correct positions. Other opposite-side objects (cars) also render in the correct positions. I've only had FSDb for a couple of months, but I don't remember seeing this error until recently.

Yes, the visualizations are post FSD computer and are just human information/eye candy.

 

[cyborgLIS]

Yes, the visualizations are post FSD computer and are just human information/eye candy.

Meaning the visualizations render after FSDb has computed? So the visualizations operate independently from the self driving software?

 

[JulienW]

Meaning the visualizations render after FSDb has computed? So the visualizations operate independently from the self driving software?

Yes, the visualizations are rendered in the MCU.

 

[TK211X]

Someone got it during their trip to Canada.

 

[TK211X]

I just noticed I posted in the wrong thread. How to delete?

 

[Tronguy]

I just noticed I posted in the wrong thread. How to delete?

Generally, send a message to the moderator for the forum in question, tell them why, and then lay yourself at their mercy. If they're feeling nice, they'll do it.

 

[sleepydoc]

I just noticed I posted in the wrong thread. How to delete?

there should be delete and edit buttons at the bottom of your post for the first hour or two. after that you have to ask a mod

 

[j0shm1lls]

11.4.9 is great guys... amirite? I don't even want 12.3.... Pfft.


*cries inside*

 

[enemji]

Yes, the visualizations are post FSD computer and are just human information/eye candy.

Correct. They are asynchronous. They may even be delayed.

 

[enemji]

11.4.9 is great guys... amirite? I don't even want 12.3.... Pfft.


*cries inside*

Downloading v12.3 now

 

[j0shm1lls]

Downloading v12.3 now

I'm still not.

 

[Supcom]

Dear V11,

We've had a lot of good miles, but, I've met another. It's not you. It's me. You were my first, and only, single-stack and I hope we can still be friends.

 

[mgs333]

I wonder when we will unsticky this thread? I suppose when v12 catches up with the main 2024 branch?

 

[sleepydoc]

Downloading v12.3 now

Copycat!
Stick with 11.4.9 - that’s where all the cool people are!