Maybe a better way to get at the question of the OP is this:
YOU have a handicap placard that you rightfully qualified for but are improved enough that you can now walk well without fatigue. Would you pass on the convenience of a handicapped spot given an alternative of walking several blocks? Which you could handle if you had to.
This isn’t asking about passing judgement on others that you don’t really know the circumstances of.
Would the number of open handicapped spots influence your choice?