Much more succinct than how I put it, thank you.
And to add to md2000’s bit about how selective pressure gets weaker on rare recessive genes, it should also be noted that once the bad gene gets rare, it might disappear anyway, just by random chance. Or, of course, it might make a comeback, if a few particularly successful individuals happen to have one copy of it.
The existence of such rare recessive defects is also, incidentally, the reason why inbreeding is a bad idea. Everyone has a handful of these rare recessive defect genes, but they’re almost never relevant, since the chance of mating with someone else who happens to share one of those same defective genes is so low. But siblings or other close relatives have a pretty good chance of sharing at least a couple of them, in which case their offspring would be likely to express them.