Only if usage allows it. I’m trying to influence usage so it doesn’t. It’s a completely unnecessary and anti-informative slurring of meaning that ought to be fought. Ought to be fought, I say!
I’d suggest you take your complaint to zoologists first. Then, once the scientific community has stopped referring to non-mammalian products as milk, we can talk about soy and rice based products.
(Consumption of other animal’s milk is weird. Consumption of any animal’s milk past an age when consumption of solid food is possible is really pretty gross.)