Handle removing/erasing non-existent points/lines