FSD Beta v11.x

The next big milestone for FSD is 11. It is a significant upgrade and fundamental changes to several parts of the FSD stack including totally new way to train the perception NN.

From AI day and Lex Fridman interview we have a good sense of what might be included.

- Object permanence both temporal and spatial
- Moving from “bag of points” to objects in NN
- Creating a 3D vector representation of the environment all in NN
- Planner optimization using NN / Monte Carlo Tree Search (MCTS)
- Change from processed images to “photon count” / raw image
- Change from single image perception to surround video
- Merging of city, highway and parking lot stacks a.k.a. Single Stack

Lex Fridman Interview of Elon. Starting with FSD related topics.

Here is a detailed explanation of Beta 11 in "layman's language" by James Douma, interview done after Lex Podcast.

Here is the AI Day explanation by in 4 parts.

Deep Understanding Tesla FSD Part 1: HydraNet

From Theory to Reality, Analyze the Evolution of Tesla Full Self-Driving

saneryee-studio.medium.com

Here is a useful blog post asking a few questions to Tesla about AI day. The useful part comes in comparison of Tesla's methods with Waymo and others (detailed papers linked).

Twelve Questions about Tesla Autopilot Technologies Exposed at 2021 AI Day

On Aug. 19 2021, Telsa held an AI day , exposing more technologies about Autopilot , from perception, planning, data labeling, simulation…

yuhuang-63908.medium.com

 

[sleepydoc]

Note to @sleepydoc @PACEMD and other medical pros here:

Inspired by Ford, I have filed my patent application for the coin-operated pacemaker.

(Focuses the mind on spending priorities, and any patient who won't pay up will be appropriately recorded as a Deadbeat on the final certificate...)

Too late - inspired by BMW's move to make CarPlay, the heated steering wheel and seats and other features subscription items I filed a patent last year to make pacemakers subscription devices. After receiving your payment we will send a code to the device allowing another month of operation. If you have issues, please call our help desk during business hours.

 

[FSDtester#1]

Drove through Connecticut late last year on a non 11.4.9 release through a degraded hurricane and reported same here. Minor drizzle/rain: Nada, normal. Heavier rain: That message, and one is limited to 5 mph over the limit. More rain, and it drops to the speed limit. Even more rain, and it's 5 mph below the speed limit. Even more rain/mist kicked up by trucks, then one gets a message that, more or less, says, "I give up. YOU drive.". And that includes lanekeeping.

As the precipitation lightens up, the process runs in reverse.

It'll be interesting when the first snow storm passes through here.

Turn wipers to position 1 or 2, car won't make fsd slow down.
Auto wipers is the culprit.
I have RainX and can turn them off completely. Fsd will continue at max speed.

 

[Dennisis]

Hmmmmm…. I wonder if a coin operated LAD flow restrictor wouldn’t be better. Implant the coin slot in their back, and then when somoene does an “Idiocracy” worthy action, you could just slip in a quarter while they are not looking.

“Hey… did you just put a quarter in my coin-operated LAD flow restrictor?”
“Me? No way I would “ever” do that!
“What was that sound…. I …heard… aCk “.

Oh my… I think you are on to something that might lead Americans to treat each other with more respect!

LOL.

Joe

(starting to stockpile quarters in anticipation......)

 

[Dennisis]

Too late - inspired by BMW's move to make CarPlay, the heated steering wheel and seats and other features subscription items I filed a patent last year to make pacemakers subscription devices. After receiving your payment we will send a code to the device allowing another month of operation. If you have issues, please call our help desk during business hours.

I still think the the Professor's "idiocy" model would be more lucrative and better for society... (now how to get by security...........)

 

[rlsd]

Warning: 2023.44.30.9 is officially coming. Run if you are scared.

TeslaFi.com Firmware Tracker

 

[JulienW]

Warning: 2023.44.30.9 is officially coming. Run if you are scared.

The holiday update that keeps on giving.

 

[Supcom]

Warning: 2023.44.30.9 is officially coming. Run if you are scared.

TeslaFi.com Firmware Tracker

Looks to be going to just our European friends at this time.

 

[LSDTester#1]

Here is the WJS Link for Musk’s drug use:

Elon Musk Has Used Illegal Drugs, Worrying Leaders at Tesla and SpaceX

Elon Musk Has Used Illegal Drugs, Worrying Leaders at Tesla and SpaceX

Some executives and board members fear the billionaire’s use of drugs—including LSD, cocaine, ecstasy, mushrooms and ketamine—could harm his companies.

www.wsj.com

I would be worried if he didn't use illegal drugs. What is illegal anyway

 

[LSDTester#1]

Here is Musk responding to the WSJ article about his drug use. Here, he indicates “I have never tested positive for drugs”. What he doesn’t say is that the reason he has not tested positive is because he has not tested. Ugh.

Elon Musk Criticizes WSJ Reporting on His Use of Illegal Drugs
Elon Musk Criticizes WSJ Reporting on His Use of Illegal Drugs

Do we have a problem here?

 

[PACEMD]

I would be worried if he didn't use illegal drugs. What is illegal anyway

Yeah, and Musk is way too young to have been out there doing LSD with Steve Jobs. Or that crazy party animal Bill Gates........high on life that one.........

 

[JulienW]

Just for shi$s and giggles I going to discuss a NEW topic: V11

Assuming 23.44.30.9 is the final version of the holiday update (a FULL 10 releases, this must be a record) when will we see 11.4.x? Also since we are all on the same software we Early Accesses users should see it in a 2024.x software too (cool). [speculation]Did Tesla "erase" the Early Access users and won't use this again (or start all over with a new qualifier Safety Score?)

I think we will see internal 11.4 testing in a week or so and a release (11.4.2) starting the 2ed week in February and in 24.2.x.x software. Happy days thinking about getting new year software before May.

 

[PR0FESSOR]

Yes. Now, back to our regularly scheduled berating of FSD.

Do we have a problem here?

 

[sleepydoc]

Too late - inspired by BMW's move to make CarPlay, the heated steering wheel and seats and other features subscription items I filed a patent last year to make pacemakers subscription devices. After receiving your payment we will send a code to the device allowing another month of operation. If you have issues, please call our help desk during business hours.

Ok, now thanks to some judge issuing a court ‘order’ the whole thing’s on hold. Apparently some guy paid the bill for the pacemaker but didn’t pay the extra defibrillator fee. Now his family’s blaming ME for his cardiac arrest! How is this MY fault???

 

[rlsd]

My conpiracy theory at work: Elon keeps updating software every other week to make the media getting tired with the news "Tesla recalls millions of cars".

 

[Supcom]

Just for shi$s and giggles I going to discuss a NEW topic: V11

Assuming 23.44.30.9 is the final version of the holiday update (a FULL 10 releases, this must be a record) when will we see 11.4.x? Also since we are all on the same software we Early Accesses users should see it in a 2024.x software too (cool). [speculation]Did Tesla "erase" the Early Access users and won't use this again (or start all over with a new qualifier Safety Score?)

I think we will see internal 11.4 testing in a week or so and a release (11.4.2) starting the 2ed week in February and in 24.2.x.x software. Happy days thinking about getting new year software before May.

11.4.2?? I think the continual version numbering must have you confused. However, with 12.x (supposedly) close to beginning rollout, I doubt that Tesla is working on any significant changes to 11.x. Not that there have been any significant changes to 11.x in many months.

Whether 12.x actually rolls out soon is immaterial. If Tesla is planning on it, then they are likely no longer dedicating any resources to 11.x. That may change if Tesla encounters a big roadblock, like 12.1.1 unable to handle actual roadblocks.

 

[LSDTester#1]

11.4.2?? I think the continual version numbering must have you confused. However, with 12.x (supposedly) close to beginning rollout, I doubt that Tesla is working on any significant changes to 11.x. Not that there have been any significant changes to 11.x in many months.

Whether 12.x actually rolls out soon is immaterial. If Tesla is planning on it, then they are likely no longer dedicating any resources to 11.x. That may change if Tesla encounters a big roadblock, like 12.1.1 unable to handle actual roadblocks.

I'm not a software engineer and the only thing that bothers me is insufficient applause, but I'm reading you like you think 11 and 12 are two completely different beasts? I'm not on that tack. 12 eliminated 300k lines of code they say, not a complete rewrite. Why wouldn't they continue working on 11?

 

[JulienW]

11.4.2?? I think the continual version numbering must have you confused. However, with 12.x (supposedly) close to beginning rollout, I doubt that Tesla is working on any significant changes to 11.x. Not that there have been any significant changes to 11.x in many months.....

You even give a valid reason for it. I didn't say there were "significant changes" but Tesla has to at least "appear" to be making improvements on the FSD software they deliver. So we will all but certainly get a 11.5.x (typo but still on 11.x) and it will have fancy and important sounding (but minor) word salad improvements like:

Reduced runtime of candidate trajectory generation and improved smoothness by distilling an expansive trajectory optimization produced into a lightweight planner neural network.

In fact we may get at least a 11.6.x since in all likelihood V12 is still some time away (REMBER: V11 was an imminent release for 15 f'n MONTHS). This thread is proof that the next version (V10 to V11) usually takes longer than most expect.

 

[sleepydoc]

Perhaps I am misremembering, but I think disengaging with the stalk usually prompts for a voice report too. Sometimes there is location dependence though. I think it still counts as a disengagement in most cases.

I also typically voice report all the time (as I said, I was not doing so, so that I could enjoy viral YouTube glory with my riveting FSD video). About once every 2-3 miles, though in light traffic conditions it might be less.


Agreed. It is possible to be much smoother and faster.

It is also not great at going, to be honest. Sometimes it is reluctant to get up to speed. I am not sure why. It drives like a typical Tesla driver, it seems.

Also, at turns, PICK A LANE, ANY LANE. At certain turns I nearly always disengage to avoid infuriating drivers behind (something not all FSD drivers do apparently - unfortunately, because the disengagements would be good info!).

I think there may be more than one issue at play. THe last few versions of FSD seem to have trouble estimating distances causing it to make corrections while it’s slowing down. If you can’t estimate where to stop it’s hard to do it well.

The other issue is how soon to start slowing down - earlier versions of FSD tended to brake quite late, requiring a hard deceleration. It was very consistent so I don’t think it was an issue estimating distance, I think they just had it programmed to brake late. That got better for a bit but it also seems to be worse recently.

Combine those with your…shall we say.. penchant for a smooth braking profile and it’s a setup to set you off!

You’re absolutely right that acceleration/deceleration profiles should be relatively easy for them to get down. I suspect they’re just not a priority for them, at least right now.

 

[sleepydoc]

My conpiracy theory at work: Elon keeps updating software every other week to make the media getting tired with the news "Tesla recalls millions of cars".

Well, if the Media won’t actually print an accurate headline like “Tesla forced to update software to account for user stupidity” then it might as well inundate them!

 

[rlsd]

Looks to be going to just our European friends at this time.

It does include US cars.