I have been started by an opossum, and it didn’t do anything but stand there. I physically jumped into the air and screamed.
Deer are much bigger, and they can make a loud snort when started.
You can definitely be startled by a deer, though unless the deer is cornered it’s probably going to run away faster than you are. If the deer is cornered, it can definitely hurt you if it feels that is necessary.