This article sheds light on snother issue - the sensors and other systems that feed data to an AI don’t even work all that well:
I have a Ford Escape with most of the modern driving aids. I turn them all off. The false positives drive me nuts, constantly muting my podcast or music to beep at me for no reason.
But worse are the false negatives. I once was going to lane change, and the blind spot warning system said it was clear. Since I have a habit of shoulder checking, I did so and there was a car in the next lane half a car length behind. I guess if I had auto lane change I would either have hit him or forced him to brake or swerve.
Another time I was going to back up. Normally, if there is an obstacle or any cross traffic, the system will bleat at you as soon as you select reverse. But this time it was silent. I still had the habit of turning around in my seat and looking while backing up - and there was a delivery person standing behind the vehicle.
In aviation you learn to cover any inoperative guages so you don’t rely on them. So I turn all that stuff off. Safety systems that give occasional false negatives are worse than useless.