Do fireplaces really make the house colder?

For Deeg.

Well, on mine I need to flip down the bottom grill, and then there’s this little trap door on the right hand side that opens up. A door with a spring latch covering a 4" diameter flexible duct that leads to the outer wall. The outer wall has a vent cover and screen on it.