Released the floating IP if finished