To a first approximation, it’s going to come down to the amount of energy transmitted to you. If it’s a small amount, there’s basically no way it can cause damage–depending on the characteristics, maybe it vaporizes your top level of skin cells, or maybe it penetrates more and heats your skin by some amount, but if the duration is short enough it shouldn’t matter what the temperature is.
That said, an object at a million degrees is radiating energy at an immense rate (proportional to temperature to the fourth power). Depending on the size of the object and how close it is, a millionth of a second might not be short enough.
Lasers can be designed with very short duration pulses, but very high peak power. Take a peek at the table on page 41 here. One of their lasers has a peak power of 16.5 gigawatts. If that were continuous, it would vaporize a person instantly. But the pulse time is under a picosecond and the energy per pulse is just 15 millijoules. You can’t do significant damage with that little energy.