Why didn't contact with the Norse devastate native populations like the Spanish?

Previous recent threadthat touched on this. My answer to the OP’s question from there:

Tell that to the Britons…