A fireplace can indeed make the house colder. This happens when the fireplace isn't in use since cold air gets in through the chimney while hot air escapes. Even when the fireplace is in use, the chimney tends to suck out some warm air, and the house will be relatively colder.