Fix something that the coverity fixes broke.

I got too aggressive freeing points in 8ae0caad681fa27da7d258e1effac2dd80239e6b in #1777 as first evidenced by the crash reported in #1653. This fixes that.