Considering that there is a degree of racism within black or Hispanic populations, I think the whole question of “worse” or “better” is moot.
Remember that it was African-Americans who instituted the paper-bag test against their own community, not whites (although it was in response to a majority white society that made paler skin “more attractive”). See colorism.