dirty in the sense that it is enough to turn your soles grey, ymmv. the feel of walking around with grey soles and cleans soles is different.
i don’t wear slippers nor socks, and i skip wearing shoes whenever possible.
knowing what i know now, i, for one, will welcome you (shoes and all) with open arms. any guests that has a problem with that when the host do not shall be whacked upside the head with a slipper.