Freshly born(less than 10 minutes) are certainly not cute. They look like a soggy, poorly-filled sausage.
I actually think new kittens aren’t that cute in their first couple of weeks or so, when they look like normal kittens but they have those weird oversized pupils. Once the pupils narrow a month in is when they get “cute” for me.