When you put something in the way of the escaping exhaust--like a muffler or catalytic converter--some of the engine's power must be used to push the exhaust through those devices. So if you remove them, more of the power can be used to make the car go. That means faster acceleration, and more miles per gallon.