I imagine most vegans can consume semen, if it didn’t require that the donater of said semen was not suffering (stop giggling). The whole point behind most people’s vegetarian beliefs is to decrease the suffering of animal-kind, though some may do it for health or religious beliefs.
Vegans and vegetarians can breast-feed their babies, pick their noses and do anything they want, just as long as they aren’t propogating suffering.