Edward was not removed for being pro-Hitler. Many, many high-level officials and politicians in Britain at the time were as much, if not more so, pro-Hitler. What’s more, known opposers of the Nazis, such as Churchill, steadfastly supported Edward’s right to remain King.
Nevertheless he refused to accept the advice of his Ministers, the government of the day - they rightly viewed his proposed marriage to a twice-divorced American of questionable decorum as damaging to the monarchy and the state.
Thing is though, it’s possible he could have remained King and married his future wife if he’d gone about the situation better and more maturely. He presented it to the nation as ‘I’m going to marry this woman with or without your blessing, my subjects, and if I can’t have her then you can’t have me!’.
What he could, and should, have done is thus: "I love this woman but I know I am your King. I do not feel I am capable of living up to the standards you set for me without this woman by my side. If you wish me to abdicate for the good of the country, I shall do so, but it will not be without deep regret for the duty I would be declining.’
Like many pre-war, he admired the Nazis but not necessarily because they were Nazi, but because, like many, he felt extremely guilty for the way the defeated Germans had been treated by the Allies after WW1, and felt that the Nazis were an inevitable consequence of the Allies’ stupidity. At least now, unsavoury as they are, Germany is being respected again, and hey, that stuff they say about the Jews, no smoke without fire, eh?
There were tons of Britishers who thought like this before the war but became the staunchest of patriots when the war broke out. I can’t say for certain that Edward VIII would have been one of them, but I don’t think it’s beyond the realms of possibility.