It is normal for a furnace to make a humming noise when it starts up. This can be caused by the motor or fan in the furnace. However, if the humming noise continues or becomes louder, it could indicate a problem with the furnace and it may be worth getting it checked by a professional. In general, it’s always better to err on the side of caution and have any unusual noises checked out.