That fits with what I’ve always thought, though I’ve never looked it up. It’s the sound people would make when they wanted to tell you to shush, or be quiet, and don’t tell. They’d close their lips and put a finger over them in the “shhh” mode and say “mmm”.
Haven’t seen that for a while, though.