In the end your money gets spread about so much in the economy the idea that you don’t want your dollars to go to causes you don’t support is ridiculous. Depending on where you live and how much you make a good chunk of your money is going to be spent by the government, who, depending on which political party is in power is almost certainly going to be spending it for causes you don’t support.
The only type of “withholding” that I think makes sense would be to attempt to effect some sort of change directly with the business in question. For example, refusing to give money to a business that has been accused of discriminating against employees based on race.
But to oppose a business just because of how they spend their (because it isn’t really your money anymore anyways) money? That’s ludicrous. For every business you frequent where you actually know what the money gets spent on I can all but guarantee there are dozens that you will never have any idea what the money gets spent on, and some of it will certainly be spent on things you don’t like.
Also, just because you can do something doesn’t make it right. I could decide to walk two extra blocks to a different grocery store because I don’t want to go to the one that is frequented by lots of blacks, or that has a black owner. That is my right, but that doesn’t change the fact it is a reprehensible stance, whether or not anyone else has to find my reasons sufficiently compelling.