Yes, heating in car uses fuel. The engine has to work harder to generate heat, which means it uses more fuel.