TL;DR version: I grew up with both, and I like both, like to have both.
I am neither-- which is to say, I love them both. I even feel a need for both. If I don’t have one or the other, I feel like something is missing in my life.
I was even a borderline hoarder for a while when I owned my house, but it happened because I lived in a rural area just outside a college town, where students often dumped pets when they moved, which they did frequently. Animals showed up in droves at the end of May.
At one point we had 7 cats and 4 dogs. I don’t think we were genuine hoarders, though, because the house was clean, and the animals were well-cared for, got regular vet care, the dogs got frequent walks, etc.
We also knew that was our limit, and had a moratorium on getting more at that point.
Right now, I have one of each, and with my work schedule, that is my limit. It is also the limit my landlord decree, unless a third would be some kind of service animal. Two is still my limit, service animal or no.
I grew up with both.
My parents had none when I was born, but when I was about 16 months, agreed to care for the Dachshund and Siamese of friends going out of the country for something like 8 months, specifically to see how I did with animals. Apparently I loved them.
When I was 3, the world’s sweetest Basset Hound was rehomed to us, and 3 years later, a beautiful blue point Siamese. In another year, we took in a stray B&W kitten, about 4 months old. So that is what I grew up with.
I also had a goldfish growing up. I won it at the state fair, and somehow a fantail had gotten in   with the feeder fish they usually give as prizes-- the kind that live a few weeks. My 50-cent, prize fish lived for six years, and his fantail grew to about 4 inches.
Now I have a 42 gallon tank of tropical fish-- :Panda corys, Rummynose tetras, guppies, and a loach. They swim at different levels in th tank-- corys and the loach stay on the bottom, tetras like the middle, and guppies swim around the top. So it’s a nice mix. It’s a few more fish than should be in that tank, but it has live plants, and I do frequent small changes, plus a 50% change once a month. Have lost only 2 fish in the last year, and they were guppies, none of them have become aggressive, and both the pandas and guppies breed.
Guppies breeding is nothing special, but corys rarely breed in home tanks. I take excess fry to the fish store, and exchange for food or the chemicals I need for the water.
I think you are right that you want the pets you grew up with. I have a friend who is blind (actually, Deaf-blind, FWIW), and she says she rarely meets someone who uses a service dog who did not grow up with a dog in the family.