If you are removing a large section of brick to fit bi-fold doors, you could lose more heat as windows will usually let more heat escape than brick walls.