How do you know what it does and does not recognize in shadow mode? Green has shown that it does see traffic lights today. So before we get to use the features, it runs in shadow mode. Also there are mounts of examples where the car would have done something differently then the human, this creates examples for training. I think your not understanding what I am saying. AP is always engaged even if you are not using it. When you turn the wheel to avoid something that AP would have proceeded to go through, that creates a delta. if the Delta is large enough, say the car moved x feet off the path the car would have taken, then its flagged for someone potentially to look at. Now they cannot look at everyone, but as they work through the process they will have less and less to even consider.
Elon mentioned and they showed a picture of a new system they are building. I believe its based on the returned DrivePX computers that they will get out of the cars as they upgrade them. They are going to rack them and use them for training. Imagine 100k AP2.0/2.5 computers in a rack that are crunching corner cases. Overtime those would be replaced with FSD1 and FSD2 computers once the costs come down and maybe a die shrink so that the costs of run the damn thing will save enough to pay for them.
wow I am not sure where I have been living and missed that video from Green, thank you for telling that it is there.
https://www.youtube.com/watch?v=umzFDfJvhLQ