You are overlooking people of your own race.
Pakistanis and Indians are racially different. It’s like Ugryurs and Han Chinese, North Africans and Blacks, or Turks and Europeans.
Anyway, the term “muslim” is slang/colloquium for Pakistanis in the UK, and Africans in mainland Europe.