I'm very familiar with the user interface problems associated with autopilot. I've been a pilot, and flight instructor, and check airman, off and on for the last 30 years. This user interface model has been used in aircraft since the 1930s.
You hear occasionally that autopilot use, or GPS, or (probably VOR) made us worse pilots than in the "old days." That might well be true, but they have also resulted in continuous improvement of the aviation safety record, while operating in an increasingly congested and regulated environment.
Any pilot with even a low level of experience has had the autopilot disengage just when the workload was high, or head off in a direction that they didn't intend, forcing a disconnect. A few, very few, accidents have been attributed to this, but it's quite rare.
Now, you'll probably tell me that this isn't a good analogy, because a car can require immediate attention, while an airplane is unlikely to hit anything in the next few seconds. First of all, that's not entirely true. Second, even when it is true, an aircraft requires more skill to operate, particularly in instrument conditions, than a car does, and can quickly get out of control. And, in the case of the car, if you take your hands off the wheel for 1-5-10 seconds, do you crash? Not typically.