No, not always. In some circumstances, the electric switch will actually increase emissions.
This occurs if you try replacing a small, efficient petrol car with a large electric car that has a big battery, and then only use it once a week.