Hey, if I was coming over and there was the promise of homemade ice cream, but the main meal was (kosher) meat, you’d have trouble getting rid of me, as I waited out my 3 hours in your house. I miss my ice cream maker. (It’s in storage until we move to a bigger place.)
But dairy (or kosher fish) would be a good idea. (Note that unlike mammals or poultry, fish doesn’t have to be killed in any particular way, so you don’t have to go out of your way to get special kosher fish, other than picking the right species.)
But just to cover all the bases 100%, I wasn’t kidding when I mentioned non-kosher cheese before. Some cheeses are made with rennet, which (sometimes) comes from cow stomachs, and therefore are unkosher to the very observant. If your dairy meal includes cheese, it still might pay to check with your guests if they care. (I don’t, some do.)