Changed the collider removal method... it probably slowed things down a bit but at least it works now...?