No, we don’t all think this and you ought to get a more accurate idea of what we typically do think, before making these blanket generalizations.
I think there’s something missed in translation here; when an American cop directs traffic–and I don’t even know how common that is anymore–the “hand signals” are really more like hand-and-arm signals. Usually white gloves are worn making the officer’s hands more prominent.