...I should have been clearer--yes,..
It should also be clear that your software is beta which means sometimes it works fine and other times it might not even in a very same situation.
That's why sometimes it got into an accident and sometimes it magically avoids accidents.
For example, a Tesla employee was fired after showing
Tesla FSD beta collided with a green bollard. Why would he show that? He could have ONLY shown other scenes that it NEVER hit a green bollard before!
So the randomness of never hitting the green bollard before could give a false sense that the car has learned so well between updates.
Thus, you might want to look for some consistency: Like it would always reliably
blow through a particular stop sign at a specific location. Just repeat the scene over and over again and see how well it would learn between updates.
In my experience since I first got Autopilot in 2017 and now the FSD beta, the improvement in between updates is random that the car could have done either way.
With my first experience of FSD beta, it could randomly turn in the wrong direction of a one-way street or the correct way. I could have said that it "learned" between updates so that's why it's choosing the correct direction for the one-way street. But that randomness of going the wrong way disappeared with the next update.
The competency to deal with a particular curve of death never happened in between updates. Those curves of deaths are dealt with in new updates.
The other one that it has never learned and never randomly done right is a particular intersection that it is supposed to drive straight according to the navigation and the FSD beta path shown on the instrument cluster, but the system consistently moves to the right-turn-only-lane before reaching the intersection (then it illegally corrects itself by not turning right and moves straight while positioned itself in right turn lane only). No matter how many updates so far, it does the same. As in the past with curves of deaths, I believe this particular intersection will be categorized and fixed in subsequent updates but I would not hold my breath for a quick timeline.
Thus, it is important to differentiate randomness vs learning. If I was losing 20 times straight with a slot machine in a casino, then I won the 21st, 22nd, and 23rd time, is that machine learning or randomness?