Meh, it’s not your fault. Bluetooth just sucks! (link to another thread where I whine about this)
If you go all-Apple, their Bluetooth stuff works a LOT better – because Apple added custom chips to all their Bluetooth stuff that helps them pair & connect to each other better. Those chips have their own wireless communications (on top of Bluetooth) that can send signals to other nearby devices to help them locate and identify each other, which is traditionally a major part of the Bluetooth pain. There are some newer Bluetooth improvements (various “easy pair” modes) that are supposed to help with this eventually, but they’re still pretty fringe, and very few real-world devices have them, and very few computers support them.
If you’re stuck in the PC and/or Android worlds, Bluetooth is the worst wireless protocol we have. The non-Bluetooth options (in mice, headsets, remote controls, etc.) all work a LOT better than their BT equivalents.
In this case the OP has no realistic other option, but generally speaking, avoiding Bluetooth as much as possible will make life much easier and peripherals work a lot better.