My small input. I have spent a lot of time abroad, and I seem to have the same attitude too. I try to adapt to the local customs as much as possible and when I meet a group of American tourists I usually try to not speak English. If you are an American abroad and you speak English in front of other tourists then you immediately get hit up for a conversation. Not fun. I can understand your problem. Your peeps. Just because they are Korean doesn’t mean you have any kind of reason to hang with them. You seem to be American by cultural standards, so why pretend otherwise.
Put it this way. At least you don’t live in Korea. I know several Asians who are Amercian culturally but have gone to asia and they had a hard time. In China at least they didn’t understand how they didnt’ speak Chinese.
So I guess my point is to hang out with those you feel a connection with