Only set kart gravity when the material sets gravity.